US20150257682A1 - Method and system for delivering biomechanical feedback to human and object motion - Google Patents

Method and system for delivering biomechanical feedback to human and object motion Download PDF

Info

Publication number
US20150257682A1
US20150257682A1 US14/660,338 US201514660338A US2015257682A1 US 20150257682 A1 US20150257682 A1 US 20150257682A1 US 201514660338 A US201514660338 A US 201514660338A US 2015257682 A1 US2015257682 A1 US 2015257682A1
Authority
US
United States
Prior art keywords
motion
data
subject
gathering
engine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/660,338
Other languages
English (en)
Inventor
Ben Hansen
Joe Nolan
Keith Robinson
Dave Fortenbaugh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CORE SPORTS TECHNOLOGY GROUP
Original Assignee
CORE SPORTS TECHNOLOGY GROUP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CORE SPORTS TECHNOLOGY GROUP filed Critical CORE SPORTS TECHNOLOGY GROUP
Priority to US14/660,338 priority Critical patent/US20150257682A1/en
Assigned to CORE SPORTS TECHNOLOGY GROUP reassignment CORE SPORTS TECHNOLOGY GROUP ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HANSEN, BEN, NOLAN, JOE, ROBINSON, KEITH, FORTENBAUGH, DAVE
Publication of US20150257682A1 publication Critical patent/US20150257682A1/en
Priority to US15/794,579 priority patent/US10314536B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
    • A—HUMAN NECESSITIES
    • A41—WEARING APPAREL
    • A41D—OUTERWEAR; PROTECTIVE GARMENTS; ACCESSORIES
    • A41D1/00—Garments
    • A41D1/002—Garments adapted to accommodate electronic equipment
    • A—HUMAN NECESSITIES
    • A41—WEARING APPAREL
    • A41D—OUTERWEAR; PROTECTIVE GARMENTS; ACCESSORIES
    • A41D19/00—Gloves
    • A41D19/0024—Gloves with accessories
    • A41D19/0027—Measuring instruments, e.g. watch, thermometer
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1121—Determining geometric values, e.g. centre of rotation or angular range of movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
    • A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using image analysis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/486—Bio-feedback
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/7475—User input or interface means, e.g. keyboard, pointing device, joystick
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0003—Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0021—Tracking a path or terminating locations
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B60/00—Details or accessories of golf clubs, bats, rackets or the like
    • A63B60/46—Measurement devices associated with golf clubs, bats, rackets or the like for measuring physical parameters relating to sporting activity, e.g. baseball bats with impact indicators or bracelets for measuring the golf swing
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • G06K9/00348—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G06V40/25—Recognition of walking or running movements, e.g. gait recognition
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/003—Repetitive work cycles; Sequence of movements
    • G09B19/0038—Sports
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • A—HUMAN NECESSITIES
    • A41—WEARING APPAREL
    • A41D—OUTERWEAR; PROTECTIVE GARMENTS; ACCESSORIES
    • A41D2600/00—Uses of garments specially adapted for specific purposes
    • A41D2600/10—Uses of garments specially adapted for specific purposes for sport activities
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2576/00—Medical imaging apparatus involving image processing or analysis
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/10—Positions
    • A63B2220/12—Absolute positions, e.g. by using GPS
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/80—Special sensors, transducers or devices therefor
    • A63B2220/803—Motion sensors
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/80—Special sensors, transducers or devices therefor
    • A63B2220/806—Video cameras
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/80—Special sensors, transducers or devices therefor
    • A63B2220/807—Photo cameras
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/80—Special sensors, transducers or devices therefor
    • A63B2220/83—Special sensors, transducers or devices therefor characterised by the position of the sensor
    • A63B2220/833—Sensors arranged on the exercise apparatus or sports implement
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/80—Special sensors, transducers or devices therefor
    • A63B2220/83—Special sensors, transducers or devices therefor characterised by the position of the sensor
    • A63B2220/836—Sensors arranged on the body of the user
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2225/00—Miscellaneous features of sport apparatus, devices or equipment
    • A63B2225/50—Wireless data transmission, e.g. by radio transmitters or telemetry
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00—Measuring physiological parameters of the user
    • A63B2230/04—Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00—Measuring physiological parameters of the user
    • A63B2230/40—Measuring physiological parameters of the user respiratory characteristics
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00—Measuring physiological parameters of the user
    • A63B2230/60—Measuring physiological parameters of the user muscle strain, i.e. measured on the user
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00—Measuring physiological parameters of the user
    • A63B2230/65—Measuring physiological parameters of the user skin conductivity
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B49/00—Stringed rackets, e.g. for tennis
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B59/00—Bats, rackets, or the like, not covered by groups A63B49/00 - A63B57/00
    • A63B59/50—Substantially rod-shaped bats for hitting a ball in the air, e.g. for baseball

Definitions

  • This disclosure relates to a method and system for delivering biomechanical feedback to human and object motions.
  • Wearable technology is becoming a primary means of assessing human and object motion. This technology is based upon embedding sensor technology in wearable garments. An example of such use is the ability to extract data from one or more on miniaturized accelerometers and gyroscopes for the purpose of reconstructing three-dimensional motion, however, there are limitations to the precision and accuracy of wearable technology that often misleads users with information that is not supported by statistical models. Wearable technology also does not provide comprehensive motion detection of all body and object segments, and, thus, does not allow for extensive prescriptive feedback to improve performance and recovery, and, thereby, reduce the risk of injury. Wearable technology is often wirelessly interfaced with mobile devices to compute kinematics and kinetics, and to display biomechanical feedback in single sessions. That said, there is no cross-platform continuity to keep users engaged, and few methods to monitor compliance and deliver significant feedback.
  • the system utilizes three major elements: (1) multiple hardware data capture devices, including optical motion capture, inertial measurement units, infrared scanning devices, and two-dimensional RGB consecutive image capture devices, (2) a cross-platform compatible physics engine compatible with optical motion capture, inertial measurement units, infrared scanning devices, and two-dimensional RGB consecutive image capture devices, and (3) interactive platforms and user-interfaces to deliver real-time feedback to motions of humans and any objects in their possession and proximity.
  • multiple hardware data capture devices including optical motion capture, inertial measurement units, infrared scanning devices, and two-dimensional RGB consecutive image capture devices
  • a cross-platform compatible physics engine compatible with optical motion capture, inertial measurement units, infrared scanning devices, and two-dimensional RGB consecutive image capture devices
  • interactive platforms and user-interfaces to deliver real-time feedback to motions of humans and any objects in their possession and proximity.
  • the first element imports data captured from a variety of hardware devices. Data imported from the hardware devices are then fed through kinematics and kinetics algorithms to extract desired biomechanical data. Data is then compiled by the physics engine across multiple subjects and across multiple sessions of a single subject.
  • the physics engine also computes mechanical equivalencies to allow compatibility across hardware platforms. Mechanical equivalencies include correlating database data to injury and performance statistics, correlating discrete kinematics and kinetics of a body to discrete kinematics and kinetics of objects, principal component analysis to correlate time-series data of the body to objects, comparison of subject and object data to compiled databases, and extraction of prescriptive feedback based on all mechanical equivalencies
  • the second element, the hardware data capture devices may comprise a variety of peripheral devices that collect two-dimensional or three-dimensional motion data of subject or object.
  • peripheral devices may comprise (1) optical motion capture devices to collect three-dimensional positional data on reflective markers placed on the body and/or an object, (2) inertial measurement units with gyroscopes and accelerometers placed on the body, on an object, or in garments, to collect three-dimensional translation and rotation motion data of object(s) or segment(s) of the subjects body, (3) infrared scanning devices, such as the Microsoft Kinect or Google Tango, to capture three-dimensional point clouds of movement data and incorporate skeletal and object tracking algorithms to extract three-dimensional joint and object positions, and (4) Red Green Blue (RGB) two-dimensional consecutive image capture devices to collect movement images and to incorporate skeletal and object tracking algorithms to extract three-dimensional joint and object positions and kinematics.
  • RGB Red Green Blue
  • the hardware data capture devices of the second element may further comprise wearable sensor technology which utilizes motion sensing hardware embedded in wearable garments to compute human and object motion.
  • the wearable technology may be coupled the physics engine and interactive interface to offer prescriptive feedback to flaws identified in the subject's and object's motion. Such feedback may be based on an exhaustive body of object motion correlations made during biomechanical research, and be provided to the user via the interactive interface.
  • the third element utilizes information generated by the physics engine to create a user-interface that displays data to the user.
  • This interactive interface may be implemented in variety of forms such as mobile device screens (iOS/Android), Web-Based interfaces (HTML), Heads-Up-Displays (VR/AR Headsets), and Windows/OSX static formats (spreadsheets, PDF's, etc.).
  • the interactive interface has the capability of feeding information to the user, as well as the ability to collect information from the user for the purpose of monitoring compliance and monitoring usability of the interface.
  • the interactive platform may be utilized to provide to the user insight gathered from biomechanical research and marker-based motion capture methods.
  • Such interactive platforms will be able to offer prescriptive feedback based on motion data gathered from either the wearable technology, or the motion sensing mechanism built into the interactive platform and enable compliance monitoring and continuous engagement across a suite of wearable technology methods.
  • Information may be stored on a back-end storage server and also exported to the physic engine and to one or more of the hardware devices.
  • system for providing prescriptive feedback based on motion of a human subject or object comprises: A) a hardware engine for gathering data about the motion of a subject or object, B) a physics engine operatively coupled to the hardware engine and configured for processing the gathered motion data and correlating the processed motion data with previously stored biomechanical data representing idealized motion models, and C) an interactive interface operatively coupled to the data gathering devices and the physics engine and configured for providing prescriptive feedback on flaws identified in the subject's or object's motion.
  • a method for providing prescriptive feedback based on motion of a human subject or object comprises: A) gathering data about the motion of a subject or object, B) processing the gathered motion data and correlating the processed motion data with previously stored biomechanical data representing idealized motion models, and C) providing prescriptive feedback on flaws identified in the subject's or object's motion.
  • method further comprises D) enabling compliance monitoring of the motion of the subject and/or object.
  • a method for offering prescriptive feedback based on motion of a human subject and/or objects comprises: A) gathering motion data from either a wearable garment or device having motion sensing hardware embedded therein or from a motion sensing mechanism built into the interactive platform, B) processing motion data, C) correlating the process motion data with previously stored biomechanical data representing idealized motion models, and D) providing prescriptive feedback on flaws identified in the subject's and object's motion based on the motion data gathered from either the wearable technology or interactive platform.
  • FIG. 1 illustrates conceptually a system for delivering biomechanical feedback to human and object motion
  • FIG. 2 illustrates conceptually a method of the system for delivering biomechanical feedback to human and object motion and the interaction of the physics engine
  • FIG. 3 illustrates conceptually a method of the system for delivering biomechanical feedback to human and object motion by use of an interactive engine
  • FIGS. 4A-B illustrate conceptually a method of the system for delivering biomechanical feedback to human and object motion by use of hardware engines
  • FIGS. 5A-D illustrate conceptually specific marker sets used in the method of biomechanical research and its relation to optical motion capture
  • FIGS. 6A-H illustrate conceptually embodiments of wearable technology in accordance with the disclosure
  • FIG. 7 illustrates conceptually a diagram of an exemplary computer architecture in accordance with the present disclosure.
  • FIG. 8 illustrates conceptually a diagram of an exemplary network topology in which the system may be implemented in accordance with the present disclosure.
  • engine means one or more elements, whether implemented in hardware, software, firmware, or any combination thereof, capable of performing any function described herein, including a collection of such elements which collaboratively perform functions wholly or partially, serially or in parallel, synchronously or asynchronously, remotely or locally, regardless of data formats or protocols.
  • a system for providing biomechanical feedback comprises a physics engine 100 , a hardware engine 102 , and an interactive engine 101 to deliver biomechanical feedback on human or object motion.
  • hardware engine 102 may comprise one or a plurality of hardware/software devices which function collectively or individually to achieve the described functionality.
  • interactive engine 101 may comprise one or a plurality of hardware/software devices which function collectively or individually to achieve the described functionality, typically receiving data from or providing data to a subject.
  • Physics engine 100 functions as a cross-platform compatible method to transform raw three-dimensional data captured from various hardware data collection devices into usable biomechanical feedback.
  • FIG. 2 illustrates conceptually an exemplary process flow of the physics engine 100 .
  • the physics engine 100 is initialized, typically to a startup state with default parameters, as illustrated by process block 200 .
  • the physics engine 100 imports, either in a push or a pull manner over any network infrastructure, wireless or otherwise, either two-dimensional or three-dimensional datasets from the hardware engine 102 , as illustrated by process block 201 .
  • hardware engine 102 may comprise individually or collectively any of optical motion capture device 212 , inertial measurement units 213 , infrared from point scanning devices 214 , and image capture devices 215 . Data imported from these devices is provided to physics engine 100 which performs one or more algorithmic processes to compute kinematics and kinetics of the human body and objects, as illustrated by process block 202 .
  • process block 203 The above identified process for the computation of kinematics and kinetics data are repeated for multiple trials of a subject's or object's motion and compiled in a memory or database, as illustrated by process block 203 .
  • similar computed kinematics and kinetics data are compiled across multiple subjects and stored for further analysis, as also illustrated by process block 203 .
  • Physics engine 100 then provides relevant portions of the compiled kinematics and kinetics data to mechanical equivalency models, as illustrated by process block 204 .
  • physics engine 100 correlates the compiled data to performance and injury data, as illustrated by process block 300 .
  • Discrete data are correlated to performance and injury data by way of person correlations and Bayesian mixed regression to eliminate non-contributing factors.
  • Physics engine 100 further correlates discrete kinematics and kinetics data of the body to discrete kinematics and kinetics of the object or other body segments, as illustrated by process block 302 .
  • Discrete body data are correlated other discrete body and object data 302 in a similar method to 300 by way of person correlations and Bayesian mixed regression.
  • physics engine 100 correlates time-series data of the body to time-series data of other body parts or objects using principal component analysis, as illustrated by process block 303 . Time-series segment data are reduced to multiple, e.g. over 80, principal components.
  • the reduced components are then correlated to principal components of other body or object segments and are used to extract additional motion given raw data from one or more body segments.
  • Discrete and time-series data are compared to a database of motion, as illustrated by process block 305 , by use of averages and standard deviations of data across multiple subjects.
  • physics engine 100 Based upon relationships established during process blocks 300 , 302 , 303 , 305 , physics engine 100 further extracts prescriptive feedback using correlation models and the subject's/object's motion, as illustrated by process block 304 .
  • the prescriptive feedback is exported to interactive engine 101 , as illustrated by process block 205 , and presented to the subject/object in a matter that facilitates altering the mechanics in a way that leads to increased performance or reduced risk of injury.
  • FIG. 3 illustrates the process flow performed by the interactive engine 101 .
  • information is acquired from the physics engine 100 , as illustrated by process block 206 , either manually, or with automated API's in either a push or pull protocol. Such information is then stored on back end servers and databases, as illustrated by process block 207 , in a logical manner for reference.
  • the information acquired from physics engine 100 is displayed through user interfaces, as illustrated by process block 208 .
  • Interactive engine 101 may display the information acquired from physics engine 100 through any of mobile devices (iOS/Android) 306 , spreadsheets 307 , web-based interfaces (HTML) 308 , and virtual and/or augmented reality heads-up displays 309 , as illustrated by process block 208 .
  • the interactive engine 101 has the further capability to monitor compliance and usability information through the various interface components of interactive engine 101 , as illustrated by process block 209 , by storing compliance information entered by a user or collected by one of the data collection devices comprising hardware engine 102 .
  • Any acquired compliance information may be exported to either the hardware engine 102 and/or physics engine 100 , as applicable, to form a continuous feedback loop, as illustrated by process block 210 , and as illustrated in FIG. 1 .
  • FIGS. 4A-B illustrate the process flow performed by the hardware engine 102 .
  • third party software is utilized to calibrate multiple, e.g. up to 16, near infrared cameras around a centralized volume space, as illustrated by process block 310 .
  • Retro-reflective markers are then placed on the subject and/or object as seen in FIGS. 5A-D .
  • Data are recorded with devices 212 and transmitted using an Ethernet bus connected to a computer.
  • the calibrated XYZ positions of each marker in the capture volume are recorded into a binary encoded file, as illustrated by process block 312 .
  • the acquired data are exported to the physics engine 102 , for example using Windows/OSX devices, for processing, as illustrated by process block 313 .
  • accelerometers and gyroscopes are calibrated and interfaced with a microcontroller capable of interfacing with any of memory, e.g. RAM or FLASH, and Bluetooth chipsets by internal firmware operations that control the hardware, as illustrated by process block 314 .
  • Inertial measurement units are placed on points of interest, such as body segments or objects, as illustrated by process block 315 .
  • Six axes of data, in addition to time samples, may be recorded continuously.
  • a customized event as illustrated by process block 316
  • data are stored in RAM and/or FLASH memory for later analysis, as illustrated by process block 317 .
  • Data are simultaneously compressed using principal component analysis, similar as previously described with reference to process block 303 , as illustrated by process block 318 .
  • Data are then exported to a physics engine 100 , with, for example, Bluetooth low energy SDK processes on mobile devices (iOS/Android), as illustrated by process block 319 .
  • a scanning laser is calibrated alongside on-board inertial measurement units that may include accelerometers and gyroscopes, or other positional measurement units, such as Red Green Blue (RGB) video or known environmental conditions, as illustrated by process block 320 .
  • RGB Red Green Blue
  • a local skeletal and object tracking algorithm is implemented to track three-dimensional joint and object positions, as illustrated by process block 322 .
  • the local skeletal and object tracking algorithm may be implemented using known anthropometrics of the human, or known information from the object, alongside edge filtering techniques to identify points of interest on a human or object.
  • Skeletal and object data are then also stored in memory, as illustrated by process block 323 , and are exported to a physics engine 100 by, for example, Android/iOS devices.
  • a physics engine 100 by, for example, Android/iOS devices.
  • For the image and video capture devices 215 consecutive two-dimensional RGB images and videos of human object motion are captured, as illustrated by process block 325 .
  • a local skeleton and object tracking algorithm is then used to extract joint and object positions similar as previously described with reference to process block to 322 , as illustrated by process block 326 .
  • Skeletal and object positional data are then stored to memory, as illustrated by process block 327 , and are exported to physics engine 100 , by for example, mobile devices (IDS/Android), as illustrated by process block 328 .
  • IDS/Android mobile devices
  • markerset 300 comprise a full body markerset 400 and various object markersets, including baseball/softball bat markerset 401 , golf clubs markerset 402 , tennis racket markerset 403 , and other objects that interact with a human body.
  • object markersets including baseball/softball bat markerset 401 , golf clubs markerset 402 , tennis racket markerset 403 , and other objects that interact with a human body.
  • markerset 400 comprises markers attached to bony anatomical landmarks, including, but not limited to: front of the head, back of the head, right side of the head, left side of the head, the T2 vertebrate, the T8 vertebrate, the Xiphoid process of the sternum, the left and right sternoclavicular joints, the Acromioclavicular joint of both shoulders, the middle of the bicep of the upper arms, the lateral and medial epicondyle of both humeruses, middle of the forearms, the medial and lateral styloid processes of both wrists, the tip of the third metacarpal in both hands, the right and left posterior superior iliac spines, the right and left anterior superior iliac spines, the right and left greater trochanters, the middle of both thighs, the medial and lateral epicondyles of the femurs, the right calf, the medial and lateral malleouleses of the ankle
  • FIG. 5B illustrates conceptually a markerset 401 with five markers attached to a hypothetical baseball bat in the following locations: knob of bat, above the handle of the bat, at the center of mass of the bat, at the tip of the bat forming a line between the knob and center of mass, and on the posterior side of the bat at the tip.
  • FIG. 5C illustrates conceptually a markerset 402 with five markers attached to a hypothetical golf club at the following locations: at the base of the handle, above the handle, at the center of mass, at the base of the club, and at the tip of the clubface to form a direct line of the clubface angle.
  • FIG. 5D illustrates conceptually a markerset 403 with five markers are placed on a hypothetical tennis racket at the following locations: at the base of the handle, at the intersection of the handle and the racket head, on the left and right sides of the racket head, and at the tip of the racket head.
  • wearable technology 102 they comprise in embodiments any of a plurality of garments 800 , which may be made of any material including spandex, Lycra, polyester, in combination with cotton, silk or any other wearable material, to assist with the acquisition of motion data from human subjects and/or accompanying objects.
  • garments 800 may be made of any material including spandex, Lycra, polyester, in combination with cotton, silk or any other wearable material, to assist with the acquisition of motion data from human subjects and/or accompanying objects.
  • Each garment 800 comprises multiple data-gathering mechanisms 801 , such as MEMS/IMU hardware, which can which can record and transmit motion data wirelessly to an iOS/Android phone or other network enabled device 802 .
  • Software applications such as those available from Diamond Kinetics, Pittsburgh, Pa. may be utilized to compute kinematics from MEMS/IMU hardware.
  • the mThrow sleeve garment 803 is coupled with motion sensors 801 to monitor workload and performance.
  • the mThrow sleeve garment 803 is worn on the throwing arm during practices, games, or rehab sessions. Data may be collected throughout workouts and is transmitted wirelessly to an iOS/Android phone or other network enabled device.
  • garment 803 may comprise 801 a six axis accelerometer/gyroscope IMU that interfaces wirelessly via Bluetooth or other protocol with a mobile device 802 , such as an iOS/Android smartphone.
  • Software applications either executing on the network enabled device or remotely accessible via a network, perform the functions to interact with the physics engine 100 and interactive engine 101 .
  • Such existing functions include computation of throwing forearm motion, kinetic solutions of elbow reaction forces and torques, algorithmic calculation of throwing workload during game/practice/season/career, pitch and throw counting functions, computation of arm and ball speed, and trends for the use of performance and injury forecasting.
  • Principal component analysis of sensor data will also allow for mechanical equivalence models to be created that extract additional segment data that is not directly measured by the sensors.
  • the mThrow Pro garment 804 is a comprehensive throwing analysis platform designed to allow athletes of all ages and skill level to receive a full-body biomechanical analysis of their throwing mechanics. Data is gathered with four motion sensors. mThrow Pro garment 804 can be worn during games or practices, and is coupled with interactive applications to provide useful feedback. In such embodiment, garment 804 may comprise 801 multiple six axis accelerometer/gyroscope IMU's that interfaces wirelessly via Bluetooth or other protocol with a mobile device 802 , such as an iOS/Android smartphone. Software applications, either executing on the network enabled device or remotely accessible via a network, perform the functions to interact with the physics engine 100 and interactive engine 101 .
  • Such existing functions include computation of throwing forearm, upper arm, pelvis, and upper trunk biomechanical motion, kinetic solution of elbow and shoulder reaction forces and torques, algorithmic calculation of throwing workload during game/practice/season/career, pitch and throw counting functions, computation of ball and arm speed, computation of kinetic chain velocities and accelerations of the pelvis, upper trunk, upper arm, and forearm and their associated temporal reference, and trends for the use of performance and injury forecasting.
  • Principal component analysis of sensor data will also allow for mechanical equivalence models to be created that extract additional segment data that is not directly measured by the sensors.
  • the mRun ACL Sleeve garment 806 is coupled with motion sensors 801 and EMG muscle activity sensors 805 to detect injury risk factors and workload in athletic movements such as running, sprinting, cutting, and jumping.
  • the mRun ACL Sleeve garment 806 can be used on the field of play during games, practice, or training.
  • the mRun ACL Sleeve garment 806 may comprise 801 a six axis accelerometer/gyroscope IMU and 805 two EMG sensors on the quadriceps and hamstrings that interfaces wirelessly via Bluetooth or other protocol with a mobile device 802 , such as an iOS/Android smartphone.
  • Software applications either executing on the network enabled device or remotely accessible via a network, perform the functions to interact with the physics engine 100 and interactive engine 101 .
  • Such existing functions include computation of lower extremity kinematics, muscle firing activity, and algorithmic computation of movement workload during game/practice/season/career, and trends for the use of performance and injury forecasting.
  • Principal component analysis of sensor data will also allow for mechanical equivalence models to be created that extract additional segment data that is not directly measured by the sensors.
  • the mRun ACL Leggings Pro garment 807 as illustrated in FIG. 6D , give athletes in any sport the ability to reduce their risk of injury and enhance performance.
  • Garment 807 is a comprehensive movement analysis platform that captures ACL injury risk.
  • the mRun ACL Leggings Pro garment 807 uses motion sensors 801 and muscle activity sensors 805 to monitor the entire lower body during any movement.
  • mRun ACL Leggings Pro garment 808 may be used during any training platform to allow athletes to undergo an ACL risk screening.
  • garment 808 may comprise 801 two six axis accelerometer/gyroscope IMU's and 805 six EMG sensors on the quadriceps, hamstrings, and gluteus maxims that interfaces wirelessly via Bluetooth or other protocol with a mobile device 802 , such as an iOS/Android smartphone.
  • Software applications either executing on the network enabled device or remotely accessible via a network, perform the functions to interact with the physics engine 100 and interactive engine 101 .
  • Such existing functions include computation of full lower extremity kinematics and kinetics, computation of full lower extremity muscle firing activity, algorithmic computation of movement workload during game/practice/season/career, and the use of performance and injury forecasting.
  • Principal component analysis of sensor data will also allow for mechanical equivalence models to be created that extract additional segment data that is not directly measured by the sensors.
  • the SmartSocks garment 809 can be used in any sport to monitor feet movement, running patterns, and weight distribution. Coupled with force sensor arrays and motion sensors, the SmartSocks garment 810 can interface with any of the garments disclosed herein to provide a more comprehensive experience.
  • garment 810 may comprise 801 a six axis accelerometer/gyroscope IMU that interfaces wirelessly via Bluetooth or other protocol with a mobile device 802 , such as an iOS/Android smartphone.
  • Software applications either executing on the network enabled device or remotely accessible via a network, perform the functions to interact with the physics engine 100 and interactive engine 101 .
  • Additional sensor technology is to include 810 cardiac sensor for heart rate and respiration rate measurement, 811 blood oxygenation sensor, 812 sweat and hydration sensors, 813 global positioning system sensors for on field movement monitoring, and 814 force sensor arrays for weight distribution and lower extremity kinetic computations. Together, these elements will allow for in depth analysis of player workload during practice and games, while offering performance alerts in the form of dashboards for forecasting performance and injury.
  • the embodiment 809 will also have the capability to pair sensor data with 800 804 806 807 .
  • the mSense device 801 comprises 801 motion sensors, 810 cardiac heart and breathing monitors, 811 oxygen sensors, 812 sweat and hydration sensors, and 813 GPS to monitor team members during gameplay, practice, and training sessions.
  • the mSense device 801 is designed for the competitive individual as well as for coaches to monitor their entire team and embeds in on to any garment and interfaces wirelessly with your phone 802 with a user interface in the form of dashboards to monitor player workload.
  • device 801 may comprise of a six axis accelerometer/gyroscope IMU that interfaces wirelessly via Bluetooth or other protocol with 802 a mobile device, such as an iOS/Android smartphone.
  • Software applications either executing on the network enabled device or remotely accessible via a network, perform the functions to interact with the physics engine 100 and interactive engine 101 .
  • the mSwing glove garment 816 is coupled with motion sensors 801 to monitor workload and performance of swinging motions such as but not limited to golf swings, baseball batting swings, softball batting swings, tennis swings, and lacrosse swings.
  • the mSwing glove garment 816 is worn on the dominant and/or non-dominant arm during practices, games, or rehab sessions. Data may be collected throughout workouts and is transmitted wirelessly to an iOS/Android phone or other network enabled device.
  • garment 816 may comprise 801 a six axis accelerometer/gyroscope IMU that interfaces wirelessly via Bluetooth or other protocol with a mobile device 802 , such as an iOS/Android smartphone.
  • Software applications either executing on the network enabled device or remotely accessible via a network, perform the functions to interact with the physics engine 100 and interactive engine 101 .
  • Such existing functions include computation of held object motion, kinetic solutions of wrist reaction forces and torques, algorithmic calculation of swinging workload during game/practice/season/career, swing counting functions, computation of held object speed, kinematics and temporal measures, and trends for the use of performance and injury forecasting.
  • Principal component analysis of sensor data will also allow for mechanical equivalence models to be created that extract additional segment data that is not directly measured by the sensors.
  • the mBand wristband garment 817 is coupled with motion sensors 801 to monitor workload and performance of swinging motions such as but not limited to golf swings, baseball batting swings, softball batting swings, tennis swings, and lacrosse swings.
  • the mBand wristband garment 817 is worn on the dominant and/or non-dominant arm during practices, games, or rehab sessions. Data may be collected throughout workouts and is transmitted wirelessly to an iOS/Android phone or other network enabled device.
  • garment 817 may comprise 801 a six axis accelerometer/gyroscope IMU that interfaces wirelessly via Bluetooth or other protocol with a mobile device 802 , such as an iOS/Android smartphone.
  • Software applications either executing on the network enabled device or remotely accessible via a network, perform the functions to interact with the physics engine 100 and interactive engine 101 .
  • Such existing functions include computation of held object motion, kinetic solutions of wrist reaction forces and torques, algorithmic calculation of swinging workload during game/practice/season/career, swing counting functions, computation of held object speed, kinematics and temporal measures, and trends for the use of performance and injury forecasting.
  • Principal component analysis of sensor data will also allow for mechanical equivalence models to be created that extract additional segment data that is not directly measured by the sensors.
  • a computer system 500 comprises a central processing unit 502 (CPU), a system memory 530 , including one or both of a random access memory 532 (RAM) and a read-only memory 534 (ROM), and a system bus 510 that couples the system memory 530 to the CPU 502 .
  • An input/output system containing the basic routines that help to transfer information between elements within the computer architecture 500 , such as during startup, can be stored in the ROM 534 .
  • the computer architecture 500 may further include a mass storage device 520 for storing an operating system 522 , software, data, and various program modules 600 , associated with an application 580 which may include functionality described herein with reference to any of physics engine 100 , hardware engine 102 or interactive engine 100 , one or any combination thereof which are executable by a special-purpose application, such as analytics engine 524 .
  • a mass storage device 520 for storing an operating system 522 , software, data, and various program modules 600 , associated with an application 580 which may include functionality described herein with reference to any of physics engine 100 , hardware engine 102 or interactive engine 100 , one or any combination thereof which are executable by a special-purpose application, such as analytics engine 524 .
  • the mass storage device 520 may be connected to the CPU 502 through a mass storage controller (not illustrated) connected to the bus 510 .
  • the mass storage device 520 and its associated computer-readable media can provide non-volatile storage for the computer architecture 500 .
  • computer-readable media can be any available computer storage media that can be accessed by the computer architecture 500 .
  • computer-readable media may include volatile and non-volatile, removable and non-removable media implemented in any method or technology for the non-transitory storage of information such as computer-readable instructions, data structures, program modules or other data.
  • computer-readable media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, digital versatile disks (DVD), HD-DVD, BLU-RAY, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computer architecture 500 .
  • the computer architecture 500 may operate in a networked environment using logical connections to remote physical or virtual entities through a network such as the network 599 .
  • the computer architecture 500 may connect to the network 599 through a network interface unit 504 connected to the bus 510 .
  • the network interface unit 504 may also be utilized to connect to other types of networks and remote computer systems.
  • the computer architecture 500 may also include an input/output controller for receiving and processing input from a number of other devices, including a keyboard, mouse, or electronic stylus (not illustrated). Similarly, an input/output controller may provide output to a video display 506 , a printer, or other type of output device.
  • a graphics processor unit 525 may also be connected to the bus 510 .
  • a number of program modules and data files may be stored in the mass storage device 520 and RAM 532 of the computer architecture 500 , including an operating system 522 suitable for controlling the operation of a networked desktop, laptop, server computer, or other computing environment.
  • the mass storage device 520 , ROM 534 , and RAM 532 may also store one or more program modules.
  • the mass storage device 520 , the ROM 534 , and the RAM 532 may store the engine 524 for execution by the CPU 502 .
  • the engine 524 can include software components for implementing portions of the processes described herein.
  • the mass storage device 520 , the ROM 534 , and the RAM 532 may also store other types of program modules.
  • Software modules such as the various modules within the engine 524 may be associated with the system memory 530 , the mass storage device 520 , or otherwise.
  • the analytics engine 524 may be stored on the network 599 and executed by any computer within the network 599 .
  • Databases 572 and 575 which may be used to store any of the acquired or processed data or idealized models, and/or kinematics and kinetic data described herein, such databases being coupled remotely to network 599 and network interface 504 .
  • the software modules may include software instructions that, when loaded into the CPU 502 and executed, transform a general-purpose computing system into a special-purpose computing system customized to facilitate all, or part of, the techniques disclosed herein.
  • the program modules may provide various tools or techniques by which the computer architecture 500 may participate within the overall systems or operating environments using the components, logic flows, and/or data structures discussed herein.
  • the CPU 502 may be constructed from any number of transistors or other circuit elements, which may individually or collectively assume any number of states. More specifically, the CPU 502 may operate as a state machine or finite-state machine. Such a machine may be transformed to a second machine, or specific machine by loading executable instructions contained within the program modules. These computer-executable instructions may transform the CPU 502 by specifying how the CPU 502 transitions between states, thereby transforming the transistors or other circuit elements constituting the CPU 502 from a first machine to a second machine, wherein the second machine may be specifically configured to manage the generation of indices.
  • the states of either machine may also be transformed by receiving input from one or more user input devices associated with the input/output controller, the network interface unit 504 , other peripherals, other interfaces, or one or more users or other actors.
  • Either machine may also transform states, or various physical characteristics of various output devices such as printers, speakers, video displays, or otherwise.
  • Encoding of executable computer program code modules may also transform the physical structure of the storage media.
  • the specific transformation of physical structure may depend on various factors, in different implementations of this description. Examples of such factors may include, but are not limited to: the technology used to implement the storage media, whether the storage media are characterized as primary or secondary storage, and the like.
  • the program modules may transform the physical state of the system memory 530 when the software is encoded therein.
  • the software may transform the state of transistors, capacitors, or other discrete circuit elements constituting the system memory 530 .
  • the storage media may be implemented using magnetic or optical technology.
  • the program modules may transform the physical state of magnetic or optical media, when the software is encoded therein. These transformations may include altering the magnetic characteristics of particular locations within given magnetic media. These transformations may also include altering the physical features or characteristics of particular locations within given optical media, to change the optical characteristics of those locations. It should be appreciated that various other transformations of physical media are possible without departing from the scope of and spirit of the present description.
  • FIG. 8 illustrates conceptually a network topology in which the components of the disclosed system may be implemented.
  • Any of the engines 100 , 102 or 103 and the data processing systems 110 , 113 A-C, 112 - 118 , illustrated in the network topology of FIG. 8 may be implemented with a processing architecture similar to that illustrated in FIG. 7 , including any of a desktop computer, laptop computer, tablet computer or smart phone/personal digital assistant device such as an iPhone or android operating system based device.
  • any of the systems illustrated in FIG. 8 may be interoperably connected either through a wide area network (WAN) 125 or local area network (LAN) 115 or both, or any hybrid combination thereof using known network infrastructure and components, protocols, and/or topologies.
  • WAN wide area network
  • LAN local area network
  • any of devices 212 - 215 may be connected to hardware engine 102 either through a physical network physically or wirelessly, or any combination thereof.
  • any of devices 306 - 309 may be coupled to interface engine 103 either through a physical network or wirelessly, or any combination thereof.
  • any of engines 100 , 102 , 103 may be connected either via WAN 125 or LAN 115 , any portion of which may be wireless connection between respective network nodes, the entirety of the system being indicated as system 110 .
  • Systems 112 - 118 may comprise additional databases more users capable of interacting remotely with system 110 .

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Business, Economics & Management (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Physiology (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Textile Engineering (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Business, Economics & Management (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Geometry (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
US14/660,338 2014-03-17 2015-03-17 Method and system for delivering biomechanical feedback to human and object motion Abandoned US20150257682A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/660,338 US20150257682A1 (en) 2014-03-17 2015-03-17 Method and system for delivering biomechanical feedback to human and object motion
US15/794,579 US10314536B2 (en) 2014-03-17 2017-10-26 Method and system for delivering biomechanical feedback to human and object motion

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201461954375P 2014-03-17 2014-03-17
US14/660,338 US20150257682A1 (en) 2014-03-17 2015-03-17 Method and system for delivering biomechanical feedback to human and object motion

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/794,579 Continuation US10314536B2 (en) 2014-03-17 2017-10-26 Method and system for delivering biomechanical feedback to human and object motion

Publications (1)

Publication Number Publication Date
US20150257682A1 true US20150257682A1 (en) 2015-09-17

Family

ID=54067612

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/660,338 Abandoned US20150257682A1 (en) 2014-03-17 2015-03-17 Method and system for delivering biomechanical feedback to human and object motion
US15/794,579 Active US10314536B2 (en) 2014-03-17 2017-10-26 Method and system for delivering biomechanical feedback to human and object motion

Family Applications After (1)

Application Number Title Priority Date Filing Date
US15/794,579 Active US10314536B2 (en) 2014-03-17 2017-10-26 Method and system for delivering biomechanical feedback to human and object motion

Country Status (5)

Country Link
US (2) US20150257682A1 (de)
EP (1) EP3120256B1 (de)
JP (1) JP2017520336A (de)
CA (1) CA2943113C (de)
WO (1) WO2015142877A1 (de)

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170027501A1 (en) * 2014-04-03 2017-02-02 Universiti Brunei Darussalam Realtime biofeedback mechanism and data presentation for knee injury rehabilitation monitoring and a soft real time intelligent system thereof
US20170061818A1 (en) * 2015-08-25 2017-03-02 Renesas Electronics Corporation Skill teaching verification system and skill teaching verification program
WO2017055792A1 (en) * 2015-10-02 2017-04-06 Mas Innovation (Pvt) Limited System and method for monitoring the running technique of a user
US20170278304A1 (en) * 2016-03-24 2017-09-28 Qualcomm Incorporated Spatial relationships for integration of visual images of physical environment into virtual reality
US20180154215A1 (en) * 2016-12-02 2018-06-07 Electronics And Telecommunications Research Institute User customized training system and method of providing training set thereof
US20180204379A1 (en) * 2015-07-15 2018-07-19 Massachusetts Institute Of Technology System and Method for Providing Reconstruction of Human Surfaces from Orientation Data
US20180279919A1 (en) * 2015-10-06 2018-10-04 University Of Pittsburgh - Of The Commonwealth System Of Higher Education Method, Device and System for Sensing Neuromuscular, Physiological, Biomechanical, and Musculoskeletal Activity
US20190015046A1 (en) * 2016-01-05 2019-01-17 Wearable Experiments Inc. Systems and methods for smart athletic wear
US10249090B2 (en) 2016-06-09 2019-04-02 Microsoft Technology Licensing, Llc Robust optical disambiguation and tracking of two or more hand-held controllers with passive optical and inertial tracking
US10278002B2 (en) * 2017-03-20 2019-04-30 Microsoft Technology Licensing, Llc Systems and methods for non-parametric processing of head geometry for HRTF personalization
US10284992B2 (en) 2014-04-29 2019-05-07 Microsoft Technology Licensing, Llc HRTF personalization based on anthropometric features
US10315085B2 (en) * 2017-04-27 2019-06-11 TrinityVR, Inc. Baseball pitch simulation and swing analysis system
CN110176162A (zh) * 2019-06-25 2019-08-27 范平 一种可穿戴系统及应用于可穿戴系统的教学方法
US20190266407A1 (en) * 2018-02-26 2019-08-29 Canon Kabushiki Kaisha Classify actions in video segments using play state information
CN110264798A (zh) * 2019-06-25 2019-09-20 范平 一种可穿戴系统及应用于可穿戴系统的教学方法
CN110300542A (zh) * 2016-07-25 2019-10-01 开创拉布斯公司 使用可穿戴的自动传感器预测肌肉骨骼位置信息的方法和装置
US20200129811A1 (en) * 2017-03-29 2020-04-30 Benjamin Douglas Kruger Method of Coaching an Athlete Using Wearable Body Monitors
US20200145797A1 (en) * 2018-11-07 2020-05-07 Kyle Craig Wearable Device for Measuring Body Kinetics
US20200188732A1 (en) * 2017-03-29 2020-06-18 Benjamin Douglas Kruger Wearable Body Monitors and System for Analyzing Data and Predicting the Trajectory of an Object
US20200306610A1 (en) * 2019-03-27 2020-10-01 Seiko Epson Corporation Swing analysis method and swing analysis device
US11122994B2 (en) * 2017-06-16 2021-09-21 Medstar Health Systems and methods for injury prevention and rehabilitation
US20210331036A1 (en) * 2018-05-29 2021-10-28 Boe Technology Group Co., Ltd. Fitness mat
US11205443B2 (en) 2018-07-27 2021-12-21 Microsoft Technology Licensing, Llc Systems, methods, and computer-readable media for improved audio feature discovery using a neural network
US11253748B2 (en) * 2018-02-12 2022-02-22 Lung-Fei Chuang Scoring method, exercise system, and non-transitory computer readable storage medium
CN114469078A (zh) * 2022-01-28 2022-05-13 北京航空航天大学 一种基于光惯融合的人体运动检测方法
US20220187598A1 (en) * 2020-12-11 2022-06-16 Samsung Electronics Co., Ltd. Method and apparatus for estimating position of image display device

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9858388B1 (en) 2016-09-26 2018-01-02 International Business Machines Corporation Health monitoring using parallel cognitive processing
EP3680895B1 (de) 2018-01-23 2021-08-11 Google LLC Selektive anpassung und nutzung der rauschunterdrückungstechnik bei der detektion eines aufrufausdrucks
WO2019167214A1 (ja) 2018-03-01 2019-09-06 株式会社ソニー・インタラクティブエンタテインメント 推定装置、推定方法及びプログラム
US11645873B1 (en) 2020-03-20 2023-05-09 18Birdies Llc Systems, media, and methods providing a golf swing coach
WO2022144929A1 (en) * 2021-01-03 2022-07-07 Tweek Labs Private Limited Modular body-motion analysis system, device and method thereof
TWI797048B (zh) * 2022-09-01 2023-03-21 洞見資訊股份有限公司 骨骼矯正設備設計系統及其骨骼矯正設備

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020177770A1 (en) * 1998-09-14 2002-11-28 Philipp Lang Assessing the condition of a joint and assessing cartilage loss
US20050105772A1 (en) * 1998-08-10 2005-05-19 Nestor Voronka Optical body tracker
US20130038745A1 (en) * 2011-08-12 2013-02-14 Yoshihiro MYOKAN Image processing device, image processing method, and image processing program

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07313648A (ja) * 1990-12-25 1995-12-05 Kongouzen Souhonzan Shiyourinji 運動動作開発方法
JP2926040B2 (ja) * 1997-05-09 1999-07-28 ダイセル化学工業株式会社 エアバッグ用ガス発生器及びエアバッグ装置
US7684896B2 (en) * 2001-06-29 2010-03-23 Honda Motor Co., Ltd. System and method of estimating joint loads using an approach of closed form dynamics
US20050010577A1 (en) * 2003-07-11 2005-01-13 Microsoft Corporation Method and apparatus for generating Web content
JP4291093B2 (ja) * 2003-09-11 2009-07-08 本田技研工業株式会社 ２足歩行移動体の関節モーメント推定方法
JP4742278B2 (ja) * 2005-02-28 2011-08-10 国立大学法人 奈良先端科学技術大学院大学 駆動力算出装置、駆動力算出方法、筋力補助装置、プログラム、及びコンピュータ読み取り可能な記録媒体
JP2007121217A (ja) * 2005-10-31 2007-05-17 Advanced Telecommunication Research Institute International 身体動作解析装置
US7978081B2 (en) * 2006-01-09 2011-07-12 Applied Technology Holdings, Inc. Apparatus, systems, and methods for communicating biometric and biomechanical information
EP1970005B1 (de) * 2007-03-15 2012-10-03 Xsens Holding B.V. System und Verfahren zur Bewegungsnachverfolgung über eine Kalibriereinheit
JP5641222B2 (ja) * 2010-12-06 2014-12-17 セイコーエプソン株式会社 演算処理装置、運動解析装置、表示方法及びプログラム
US20120259650A1 (en) * 2011-04-07 2012-10-11 Full Recovery, Inc. Systems and methods for remote monitoring, management and optimization of physical therapy treatment
US8576929B2 (en) * 2011-06-30 2013-11-05 Broadcom Corporation Powerline communication device
US8944940B2 (en) * 2011-08-29 2015-02-03 Icuemotion, Llc Racket sport inertial sensor motion tracking analysis
US20130244211A1 (en) * 2012-03-15 2013-09-19 The Board Of Trustees Of The Leland Stanford Junior University Systems and methods for measuring, analyzing, and providing feedback for movement in multidimensional space
US20140002266A1 (en) * 2012-07-02 2014-01-02 David Hayner Methods and Apparatus for Muscle Memory Training

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050105772A1 (en) * 1998-08-10 2005-05-19 Nestor Voronka Optical body tracker
US20020177770A1 (en) * 1998-09-14 2002-11-28 Philipp Lang Assessing the condition of a joint and assessing cartilage loss
US20130038745A1 (en) * 2011-08-12 2013-02-14 Yoshihiro MYOKAN Image processing device, image processing method, and image processing program

Cited By (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170027501A1 (en) * 2014-04-03 2017-02-02 Universiti Brunei Darussalam Realtime biofeedback mechanism and data presentation for knee injury rehabilitation monitoring and a soft real time intelligent system thereof
US10004455B2 (en) * 2014-04-03 2018-06-26 Universiti Brunei Darussalam Realtime biofeedback mechanism and data presentation for knee injury rehabilitation monitoring and a soft real time intelligent system thereof
US10313818B2 (en) 2014-04-29 2019-06-04 Microsoft Technology Licensing, Llc HRTF personalization based on anthropometric features
US10284992B2 (en) 2014-04-29 2019-05-07 Microsoft Technology Licensing, Llc HRTF personalization based on anthropometric features
US10699480B2 (en) * 2015-07-15 2020-06-30 Massachusetts Institute Of Technology System and method for providing reconstruction of human surfaces from orientation data
US20180204379A1 (en) * 2015-07-15 2018-07-19 Massachusetts Institute Of Technology System and Method for Providing Reconstruction of Human Surfaces from Orientation Data
US20170061818A1 (en) * 2015-08-25 2017-03-02 Renesas Electronics Corporation Skill teaching verification system and skill teaching verification program
WO2017055792A1 (en) * 2015-10-02 2017-04-06 Mas Innovation (Pvt) Limited System and method for monitoring the running technique of a user
US20180279916A1 (en) * 2015-10-02 2018-10-04 Mas Innovation (Pvt) Limited System and Method for Monitoring the Running Technique of a User
US20180279919A1 (en) * 2015-10-06 2018-10-04 University Of Pittsburgh - Of The Commonwealth System Of Higher Education Method, Device and System for Sensing Neuromuscular, Physiological, Biomechanical, and Musculoskeletal Activity
US11389083B2 (en) * 2015-10-06 2022-07-19 University of Pittsburgh—of the Commonwealth System of Higher Education Method, device and system for sensing neuromuscular, physiological, biomechanical, and musculoskeletal activity
US20190015046A1 (en) * 2016-01-05 2019-01-17 Wearable Experiments Inc. Systems and methods for smart athletic wear
US10665019B2 (en) * 2016-03-24 2020-05-26 Qualcomm Incorporated Spatial relationships for integration of visual images of physical environment into virtual reality
US20170278304A1 (en) * 2016-03-24 2017-09-28 Qualcomm Incorporated Spatial relationships for integration of visual images of physical environment into virtual reality
US10249090B2 (en) 2016-06-09 2019-04-02 Microsoft Technology Licensing, Llc Robust optical disambiguation and tracking of two or more hand-held controllers with passive optical and inertial tracking
CN110300542A (zh) * 2016-07-25 2019-10-01 开创拉布斯公司 使用可穿戴的自动传感器预测肌肉骨骼位置信息的方法和装置
US20180154215A1 (en) * 2016-12-02 2018-06-07 Electronics And Telecommunications Research Institute User customized training system and method of providing training set thereof
US10278002B2 (en) * 2017-03-20 2019-04-30 Microsoft Technology Licensing, Llc Systems and methods for non-parametric processing of head geometry for HRTF personalization
US20200129811A1 (en) * 2017-03-29 2020-04-30 Benjamin Douglas Kruger Method of Coaching an Athlete Using Wearable Body Monitors
US20200188732A1 (en) * 2017-03-29 2020-06-18 Benjamin Douglas Kruger Wearable Body Monitors and System for Analyzing Data and Predicting the Trajectory of an Object
US10369446B2 (en) 2017-04-27 2019-08-06 TrinityVR, Inc. Baseball pitch simulation and swing analysis using virtual reality device and system
US10315085B2 (en) * 2017-04-27 2019-06-11 TrinityVR, Inc. Baseball pitch simulation and swing analysis system
US11122994B2 (en) * 2017-06-16 2021-09-21 Medstar Health Systems and methods for injury prevention and rehabilitation
US11253748B2 (en) * 2018-02-12 2022-02-22 Lung-Fei Chuang Scoring method, exercise system, and non-transitory computer readable storage medium
US10719712B2 (en) * 2018-02-26 2020-07-21 Canon Kabushiki Kaisha Classify actions in video segments using play state information
US20190266407A1 (en) * 2018-02-26 2019-08-29 Canon Kabushiki Kaisha Classify actions in video segments using play state information
US20210331036A1 (en) * 2018-05-29 2021-10-28 Boe Technology Group Co., Ltd. Fitness mat
US11205443B2 (en) 2018-07-27 2021-12-21 Microsoft Technology Licensing, Llc Systems, methods, and computer-readable media for improved audio feature discovery using a neural network
US11510035B2 (en) * 2018-11-07 2022-11-22 Kyle Craig Wearable device for measuring body kinetics
US20200145797A1 (en) * 2018-11-07 2020-05-07 Kyle Craig Wearable Device for Measuring Body Kinetics
US20200306610A1 (en) * 2019-03-27 2020-10-01 Seiko Epson Corporation Swing analysis method and swing analysis device
US11590398B2 (en) * 2019-03-27 2023-02-28 Seiko Epson Corporation Swing analysis method and swing analysis device
CN110176162A (zh) * 2019-06-25 2019-08-27 范平 一种可穿戴系统及应用于可穿戴系统的教学方法
CN110264798A (zh) * 2019-06-25 2019-09-20 范平 一种可穿戴系统及应用于可穿戴系统的教学方法
US20220187598A1 (en) * 2020-12-11 2022-06-16 Samsung Electronics Co., Ltd. Method and apparatus for estimating position of image display device
US11556004B2 (en) * 2020-12-11 2023-01-17 Samsung Electronics Co., Ltd. Method and apparatus for estimating position of image display device
CN114469078A (zh) * 2022-01-28 2022-05-13 北京航空航天大学 一种基于光惯融合的人体运动检测方法

Also Published As

Publication number Publication date
US10314536B2 (en) 2019-06-11
JP2017520336A (ja) 2017-07-27
CA2943113A1 (en) 2015-09-24
CA2943113C (en) 2022-10-25
EP3120256A4 (de) 2018-01-03
WO2015142877A1 (en) 2015-09-24
US20180177450A1 (en) 2018-06-28
EP3120256A1 (de) 2017-01-25
EP3120256B1 (de) 2020-02-12

Similar Documents

Publication Publication Date Title
US10314536B2 (en) Method and system for delivering biomechanical feedback to human and object motion
US20210272376A1 (en) Virtual or augmented reality rehabilitation
JP6938542B2 (ja) 組込みセンサと外界センサとを組み合わせる多関節トラッキングのための方法およびプログラム製品
US11238636B2 (en) Method and apparatus for sport-specific training with captured body motions
US11455909B2 (en) Identification and analysis of movement using sensor devices
US11321894B2 (en) Motion control via an article of clothing
US11210834B1 (en) Article of clothing facilitating capture of motions
US11775050B2 (en) Motion pattern recognition using wearable motion sensors
TW200844870A (en) Tracking a range of body movement based on 3D captured image streams of a user
US11551396B2 (en) Techniques for establishing biomechanical model through motion capture
Wei et al. Real-time 3D arm motion tracking using the 6-axis IMU sensor of a smartwatch
Ruffaldi et al. Sensor fusion for complex articulated body tracking applied in rowing
Rahman et al. Modeling therapy rehabilitation sessions using non-invasive serious games
Nie et al. The construction of basketball training system based on motion capture technology
Šeketa et al. Real-time evaluation of repetitive physical exercise using orientation estimation from inertial and magnetic sensors
Rahman Web-based multimedia hand-therapy framework for measuring forward and inverse kinematic data
Gharasuie et al. Performance monitoring for exercise movements using mobile cameras
Ciliberto et al. Complex human gestures encoding from wearable inertial sensors for activity recognition.
Bucciero et al. A biomechanical analysis system of posture
Viola et al. Self Representation and Interaction in Immersive Virtual Reality.
Guimaraes et al. 3D Interactive Environment Applied to Fencing Training.
Felix Dynamic Analysis of Swimmers During Training

Legal Events

Date Code Title Description
AS Assignment

Owner name: CORE SPORTS TECHNOLOGY GROUP, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HANSEN, BEN;NOLAN, JOE;ROBINSON, KEITH;AND OTHERS;SIGNING DATES FROM 20150422 TO 20150428;REEL/FRAME:035525/0207

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION