WO2001029799A2 - Systeme d'education sollicitant les systemes physiologiques et kinesthesique d'un sujet afin d'ameliorer la fonction cognitive de façon synergique - Google Patents

Systeme d'education sollicitant les systemes physiologiques et kinesthesique d'un sujet afin d'ameliorer la fonction cognitive de façon synergique Download PDF

Info

Publication number
WO2001029799A2
WO2001029799A2 PCT/US2000/041390 US0041390W WO0129799A2 WO 2001029799 A2 WO2001029799 A2 WO 2001029799A2 US 0041390 W US0041390 W US 0041390W WO 0129799 A2 WO0129799 A2 WO 0129799A2
Authority
WO
WIPO (PCT)
Prior art keywords
player
movement
person
virtual
training
Prior art date
Application number
PCT/US2000/041390
Other languages
English (en)
Other versions
WO2001029799A3 (fr
Inventor
Barry J. French
Kevin R. Ferguson
Donald Gronochan
Original Assignee
Impulse Technology Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Impulse Technology Ltd. filed Critical Impulse Technology Ltd.
Publication of WO2001029799A2 publication Critical patent/WO2001029799A2/fr
Publication of WO2001029799A3 publication Critical patent/WO2001029799A3/fr
Priority to US10/128,394 priority Critical patent/US6749432B2/en

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B69/00—Training appliances or apparatus for special sports
    • A63B69/0053—Apparatus generating random stimulus signals for reaction-time training involving a substantial physical effort
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1113—Local tracking of patients, e.g. in a hospital or private home
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/744—Displaying an avatar, e.g. an animated cartoon character
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0021—Tracking a path or terminating locations
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/003—Repetitive work cycles; Sequence of movements
    • G09B19/0038—Sports
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00—Evaluating a particular growth phase or type of persons or animals
    • A61B2503/10—Athletes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02438—Detecting, measuring or recording pulse rate or heart rate with portable devices, e.g. worn by the patient
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1116—Determining posture transitions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1118—Determining activity level
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1124—Determining motor skills
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
    • A61B5/1127—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using markers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/22—Ergometry; Measuring muscular strength or the force of a muscular blow
    • A61B5/221—Ergometry, e.g. by using bicycle type apparatus
    • A61B5/222—Ergometry, e.g. by using bicycle type apparatus combined with detection or measurement of physiological parameters, e.g. heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6813—Specially adapted to be attached to a specific body part
    • A61B5/6823—Trunk, e.g., chest, back, abdomen, hip
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0021—Tracking a path or terminating locations
    • A63B2024/0025—Tracking the path or location of one or more users, e.g. players of a game
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2208/00—Characteristics or parameters related to the user or player
    • A63B2208/12—Characteristics or parameters related to the user or player specially adapted for children
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/80—Special sensors, transducers or devices therefor
    • A63B2220/83—Special sensors, transducers or devices therefor characterised by the position of the sensor
    • A63B2220/836—Sensors arranged on the body of the user
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2225/00—Miscellaneous features of sport apparatus, devices or equipment
    • A63B2225/50—Wireless data transmission, e.g. by radio transmitters or telemetry
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B69/00—Training appliances or apparatus for special sports
    • A63B69/0024—Training appliances or apparatus for special sports for hockey

Definitions

  • the present invention relates to an education system for engaging a student in a kinesthetic learning process Specifically, the invention relates to an education system utilizing a wireless position tracker for continuously tracking and determining a student's position during movement in a defined physical space BACKGROUND OF THE INVENTION
  • Some learners benefit from education utilizing kinesthetic processes in that they learn better when the learning task involves movement that enables manipulation of objects
  • Such kinesthetic learners preferentially involve their whole bodies in their activities
  • the educational experience is enhanced by use of educational activities that involve physical movement, such as whole-body movement
  • learning is often enhanced through multisensory experiences that combine body motion with traditional visual and auditory methods of delivering information
  • Cognitive research reiterates the significant value of children's play to their cognitive and motor development In such play children in essence learn effectively through observation and direct manipulation of their environments It is expected that brain development is enhanced by simultaneously engaging different cognitive functions simultaneously Such simultaneous engagement of different cognitive functions is particularly useful for learning and retaining educational material For instance a student that reads material aloud engages both auditory and visual cognitive functions, and may be expected to retain the material better than if exposed to it only visually (through reading silently), or audito ⁇ ally (through having the material read to him or her)
  • An interactive educational system includes a tracking system for determining changes in an overall physical location of a student, and a display for displaying cues for the student to engage in full-body motion and to engage in an interactive cognitive learning task.
  • An educational method includes prompting a student to engage in an interactive cognitive learning task which involves full body motion, thereby enabling the student to reach the enhanced learning state which results from elevated metabolic rate, and synergistically engaging the student's kinesthetic learning facilities.
  • an educational method includes engaging a student in cognitive learning tasks while the student's metabolic rate is elevated
  • an educational method includes monitoring a measure of the student's metabolic rate while the student engages in cognitive learning tasks, and adjusting the learning tasks based on the metabolic rate
  • an educational system includes a tracking system for tracking movements of a student engaged in a cognitive learning task which involves full body motion.
  • an interactive educational system includes a display of a view of a virtual world which includes cognitive learning elements, and a tracking system for tracking movements of a student engaged in a cognitive learning task, movements of the student in a physical world causing manipulation of cognitive learning elements in the virtual world.
  • a method of educating includes prompting a person to engage in body core movement which elevates the person's metabolic rate; and prompting the person to engage in a cognitive learning task while the person's metabolic rate is elevated, wherein the prompting engage in a cognitive learning task includes displaying a view of a virtual space.
  • an interactive education system includes a continuous tracking system for determining changes in an overall physical location of a person, in a defined physical space; and a computer operatively coupled to the tracking system for updating in real time a player virtual location in a virtual space corresponding to the physical location of the player in the physical space, and for updating a view of the virtual space, wherein the view includes cognitive learning material.
  • an interactive education system includes means for elevating a person's metabolic rate by prompting body core movement of the person; and means for engaging the person in a cognitive learning task while the person's metabolic rate is elevated.
  • FIG. 1 is a perspective view of a testing and training system in accordance with the invention
  • Fig. 2 is a perspective view showing a representative monitor display
  • Fig. 3 is a perspective view of simulated movement skills protocol for the system of Fig. 1 ;
  • Fig. 4 is a perspective view of a simulated agility skills protocol for the system of Fig. 1 ;
  • Fig. 5 is a perspective view of a simulated task for the system;
  • Fig. 12 is a schematic representation of a simulated task that the system executes to determine Dynamic Reaction Time
  • Fig. 13 is a schematic representation of a simulated task that the system executes to determine Dynamic Phase Lag
  • Fig. 14 is a schematic representation of a simulated task that the system executes to determine First Step Quickness
  • Fig. 15 is a schematic representation of a simulated task that the system executes to determine Dynamic Reactive Bounding
  • Fig 16 is a schematic representation of a simulated task that the system executes to determine Dynamic Sports Posture
  • Fig 17 is a schematic representation of a simulated task that the system executes to determine Dynamic Reactive Cutting
  • Fig 18 is a perspective view of an alternate embodiment of the invention which uses a first person perspective view
  • Fig 19 is a perspective view of the invention being used for multiplayer play
  • Fig 20 is a perspective view of an alternate embodiment of the invention that uses multiple physical spaces and displays
  • Fig 21 is a perspective view of an alternate embodiment of the present invention which uses scaling factors
  • Fig 22 is a perspective view of an alternate embodiment of the present invention which can record movement protocols
  • Fig. 23 is a perspective view of an alternate embodiment of the present invention which tracks the position of a player's upper extremities
  • Fig. 24 is a perspective view of an alternate embodiment of the present invention which includes resistance devices that oppose player motion
  • Fig. 25 is a perspective view of a prior art slide board
  • Fig. 26 is a perspective view of a prior art ski simulation device
  • Fig 27 is a perspective view of an alternate embodiment of the present invention which includes an exercise device used by the player;
  • Fig. 28 is a plan view of a reactive power training system of the present invention.
  • Fig. 29 is a schematic view of the network connections of the system of Fig. 28, Fig. 30 is a representation of a screen display of a testing and training system of the present invention.
  • Fig. 31 is a representation of an interactive education system in accordance with the present invention.
  • tracking system for tracking movement of a person in a defined physical space.
  • Many applications of the tracking system to sports- related activities are described, followed by a description of the application of the tracking system as part of an educational system and method. It will be appreciated that many of the aspects described with respect to sports-related activities may also be utilized with the educational system.
  • Fig. 1 shows an interactive, virtual reality testing and training system 10 for assessing movement and agility skills without a confining field.
  • the system 10 comprises a three dimensionally defined physical space 12 in which the player moves, and a wireless position tracking system 13 which includes a pair of laterally spaced wireless optical sensors 14, 16 coupled to a processor 18.
  • the processor 18 provides a data signal along a line 20 via a serial port to a personal computer 22.
  • the computer 22 under control of associated software, processes the data signal and provides a video signal to a large screen video monitor or video display 28.
  • the computer 22 is operatively connected to a printer 29, such as a Hewlett Packard Desk Jet 540 or other such suitable printer, for printing output data related to testing and training sessions.
  • the computer 22 may be coupled to a data inputting device 24.
  • a data inputting device 24 Such a device may be a mouse, trackpad, keyboard, joystick, track ball, touch-sensitive video screen, or the like.
  • the computer 22 may be coupled to the data inputting device 24 by a wired or wireless connection.
  • the monitor 28 displays a computer generated, defined virtual space 30 which is a scaled translation of the defined physical space 12.
  • the overall position of the player in the physical space 12 is represented and correctly referenced in the virtual space 30 by a player icon 32.
  • the overall position of the player will be understood as the position of the player's body as a whole, which may be the position of the player's center of mass, or may be the position of some part of the player's body.
  • the player icon 32 may represent a person or a portion thereof. Alternatively it may represent an animal or some other real or imaginary creature or object.
  • the player icon 32 may interact with a protagonist icon 34 representing a protagonist (also referred to as an avatar or virtual opponent) in the performance of varying tasks or games to be described below.
  • the protagonist icon may be a representation of a person.
  • the protagonist icon may be a representation of another object or may be an abstract object such as a shape.
  • the system 10 assesses and quantifies agility and movement skills by continuously tracking the player in the defined physical space 12 through continuous measurement of Cartesian coordinate positions.
  • the player icon 32 is represented in a spatially correct position and can interact with the protagonist icon 34 such that movement related to actual distance and time required by a player 36 (also known as an athlete or a subject) to travel in the physical space 12 can be quantified.
  • the player icon 32 is at a player virtual location in virtual space
  • the protagonist icon 34 is at a protagonist virtual location in virtual space.
  • the defined physical space 12 may be any available area, indoors or outdoors of sufficient size to allow the player to undertake the movements for assessing and quantifying distance and time measurements relevant to the player's conditioning, sport and ability.
  • a typical physical space 12 may be an indoor facility such as a basketball or handball court where about a 20 foot by 20 foot area with about a 10 foot ceiling clearance can be dedicated for the training and testing. It will be appreciated that the system 10 may be adaptable to physical spaces of various sizes.
  • the system may be transported to multiple sites for specific purposes.
  • the system may be transported to the actual playing field for use.
  • the optical sensors 14, 16 and processor 18 may take the form of commercially available tracking systems.
  • the system 10 uses an optical sensing system available as a modification of the DynaSight system from Origin Instruments of Grand Prairie Texas.
  • Such a system uses a pair of optical sensors, i.e., trackers, mounted about 30 inches apart on a support mast centered laterally with respect to the defined physical space 12 at a distance sufficiently outside the front boundary 40 to allow the sensors 14, 16 to track movement in the desired physical space.
  • the processor 18 communicates position information to an application program in a host computer through a serial port.
  • the host computer is provided with a driver program available from Origin which interfaces the DynaSight system with the application program.
  • the reflector or beacon 38 (collectively herein referred to as a marker) is preferably located at or near the center of mass of the player 36, although it may be located elsewhere relative to the player.
  • the reflector or beacon may be attached to a belt which is worn about the waist of the player.
  • the sensors report positions of the reflector or beacon 38 in three dimensions relative to a fiducial mark midway between the sensors.
  • the fiducial mark is the origin of the default coordinate system.
  • Another suitable tracking system is the MacReflex Motion Measurement System from Qualisys.
  • a skilled person will recognize that many other suitable tracking systems may be substituted for or used in addition to the optical tracking systems described above.
  • known electromagnetic, acoustic and video/optical technologies may be employed. Sound waves such as ultrasonic waves, or light waves in the visible or infrared spectra, may be propagated through the air between the player and the sensor(s) and utilized to track the player. Such waves may be transmitted by an external source and reflected off of a passive reflector worn by the player. It will be understood that such waves may reflect off of the player or his or her clothing, dispensing with the need for the player to wear a passive sensor.
  • the player may wear an active emitter which emits sound or light waves.
  • an emitter may be battery operated, and may continuously emit sound or light waves when turned on.
  • the emitter may emit waves only in response to an external signal or stimulus.
  • Multiple reflecting or emitting elements may be incorporated in a single reflector or emitter. Such multiple elements may be used to aid in tracking the location of the player.
  • three spaced-apart infrared emitting elements are incorporated in an emitter worn around the player's waist. The emitting elements are activated intermittently on a rotating basis at a known frequency. Information on the relative timing of the signals received from the various emitting elements allows the player to be tracked.
  • multiple elements may be used to track the orientation of the player's body as well as his or her position. For example, twisting of the player's body may be detected independent of the movement of the player by relative motion of the elements.
  • one or more cameras or other image capturing devices may be used to continuously view the physical space.
  • Image analysis techniques may be used to determine the position of the player from these images.
  • Such image analysis techniques may for example include edge tracking techniques for detecting the location of the player relative to the background, and tracking of an item worn by the player, such a distinctively colored badge. Any of the above such systems should provide an accurate determination of the players location in at least two coordinates and preferably three.
  • tracking means used in the invention include all such tracking systems described above which are suitable for use in the invention.
  • the position-sensing hardware tracks the player 36 in the defined physical space 12 at a sample rate of 500 Hz, with an absolute position accuracy of one inch or better in all dimensions over a tracking volume of approximately 432 cubic feet (9 ft. W x 8 ft D x 6 ft. H).
  • the player icon 32 is displayed on the monitor 28 in the corresponding width, lateral x axis, height, y axis and depth, or fore-aft z axis and over time t, to create a four dimensional space-time virtual world.
  • tracking height, y axis is required.
  • the system 10 determines the coordinates of the player 36 in the defined physical space 12 in essentially real time and updates current position without any perceived lag between actual change and displayed change in location in the virtual space 30, preferably at an update rate in excess of about 20 Hz.
  • a video update rate approximately 30 Hz, with measurement latency less than 30 milliseconds, has been found to serve as an acceptable, real-time, feedback tool for human movement.
  • the monitor 28 should be sufficiently large to enable the player to view clearly the virtual space 30.
  • the virtual space 30 is a spatially correct representation of the physical space as generated by the computer 22. For a 20 foot by 20 foot working field, a 27-inch diagonal screen or larger allows the player to perceptively relate to the correlation between the physical and virtual spaces.
  • An acceptable monitor is a Mitsubishi 27" Multiscan Monitor. It will be appreciated that other display devices, such as projection displays, liquid crystal displays, or virtual reality goggles or headsets, may also be employed to display a view of the virtual reality space.
  • the computer 22 receives the signal for coordinates of the player's location in the physical space 12 from the processor 18 and transmits a signal to the monitor 28 for displaying the player icon in scaled relationship in the virtual space 30.
  • An acceptable computer is a Compaq Pentium PC.
  • Other computers using a Pentium processor, a Pentium II processor, or other suitable processors would also be acceptable.
  • the player icon 32 typically will be positioned in the computer-generated virtual space 30 at the x, y, z coordinates corresponding to the player's actual location in the physical space 12. However, it will be appreciated that the player icon may be placed in the virtual space at location(s) other than those corresponding to the player's location in physical space.
  • the player icon 32 is repositioned accordingly in the virtual space 30.
  • the repositioning is taken into account in an updated view fed to the display 28.
  • past positions of the player icon 32 may be represented in the display. For example, "ghosts", reduced brightness images of the player icon, may be displayed at locations where the player has recently been. This gives an indication of the recent path of motion of the player. Alternatively, the recent motion of the player may be indicated by a line trace which fades in intensity over time. Such indications may be used only for certain parts of a player's motion — for example only for jumps or leaps.
  • the computer 22 may retain a record of some or all of the data regarding the player's position on a data storage device such as hard disk or a writeable optical disk.
  • This retained data may be in raw form, with the record containing the actual positions of the player at given times.
  • the data may be processed before being recorded, for example with the accelerations of the player at various times being recorded.
  • a protagonist icon 34 is displayed in the computer-generated virtual space 30 by the computer software.
  • the protagonist icon 34 serves to induce, prompt and lead the player 36 through various tasks, such as testing and training protocols in an interactive game-like format that allows the assessment and quantification of movement and agility skills related to actual distance traveled and elapsed time in the physical space 12 to provide physics-based vector and scalar information.
  • the protagonist icon 34 may be interactive with the player 36.
  • an interception task allows the player icon 32 and the protagonist icon 34 to interact until the two icons occupy the same or a similar location, whence the task ends.
  • An evasion task involves interaction of the player icon 32 and the protagonist icon 34 until the two icons have attained a predetermined separation.
  • the protagonist icon is the graphic representation with which the player interacts, and defines the objective of the task.
  • Other collision-based icons, such as obstacles, barriers, walls and the like may embellish the task, but are generally secondary to the objective being defined by the protagonist.
  • the protagonist icon 34 may have varying attributes.
  • the protagonist icon may be dynamic, rather than stationary, in that its location changes with time under the control of the software thereby requiring the player to determine an ever changing interception or evasion path to complete the task.
  • the protagonist icon can be intelligent, programmed to be aware of the player's position in the computer-generated virtual space 30 and to intercept or evade according to the objectives of the task.
  • Such intelligent protagonist icons are capable of making course correction changes in response to changes in the position of the player icon 32 in much the same manner as conventional video games wherein the targets are responsive to the icon under the player's control, the difference being that the player's icon does correspond to the player's actual position in a defined physical space.
  • Movement skills are generally characterized in terms of the shortest time to achieve the distance objective. They can be further characterized by direction of movement with feedback, quantification and assessment being provided in absolute units, i.e., distance/time unit, or as a game score indicative of the player's movement capabilities related to physics-based information including speed, velocity, acceleration, deceleration and displacement.
  • Agility is generally characterized as the ability to quickly and efficiently change body position and direction while undertaking specific movement patterns. The results also are reported in absolute units, with success determined by the elapsed time to complete the task.
  • Protagonist(s) 82 The player may select the intelligence level, number, speed and size of the protagonists to reside in the selected routine. Thereafter the player is prompted to Define Obstacle(s) 84, i.e., static vs. dynamic, number, speed, size and shape. The player is then prompted to Define Objective(s) 86, i.e., avoidance or interception, scoring parameters, and goals, to complete the setup routine.
  • the player is prompted to a starting position for the task and upon reaching this position, the protagonist(s) and the obstacle(s) for the task are generated on the display.
  • the protagonist moves on the display in step 90, in a trajectory dependent on the setup definition.
  • the player moves in a path which the player determines will result in the earliest interception point with the protagonist in accordance with the player's ability.
  • the player icon is generated and continually updated, in scaled translation in the virtual space to the player's instantaneous position in the defined physical space.
  • Movement continues until player contact with the protagonist icon in step 92, resulting in interception in step 94, or until the protagonist contacts a boundary of the virtual space corresponding to the boundary of the defined physical space, 96.
  • interception if interception has occurred, a new protagonist appears on a new trajectory, 97.
  • the player icon's position is recorded, 98, the velocity vectors calculated and recorded, and a score or assessment noted on the display.
  • the system determines if the task objectives have been met, 100, and for a single task, the final score is computed and displayed, 102, as well as information related to time and distance traveled in completing the task, and the session ends, 104.
  • the direction of the protagonist is changed dependent on the setup definition, and the pursuit of the protagonist by the player continues as set forth above.
  • the player pursuit in the event that obstacles have been selected in the setup definition, the same are displayed, 110, and the player must undertake a movement path to avoid these obstacles.
  • the obstacle is highlighted, 114, and the routine is completed and scored as described above.
  • the obstacle's direction is changed, 118, and the task continues.
  • the obstacle For a multiple segment task, if the obstacle is contacted, the protagonist's direction changes and the movements continue. Similarly, upon interception for a multiple segment task, a new protagonist trajectory is initiated and the obstacles also may be reoriented. The routine then continues until the objectives of the task have been met and the session completed.
  • the tasks are structured to require the player to move forward, backward, left and right, and optionally vertically.
  • the player's movement is quantified as to distance and direction dependent on the sampling rate and the update rate of the system. For each sampling period, the change in position is calculated. At the end of the session, these samples are totaled and displayed for the various movement vectors.
  • the objective of the session is to avoid a protagonist seeking to intercept the player
  • the aforementioned is appropriately altered.
  • the session ends for a single segment task and the time and distance related information is calculated and displayed.
  • the protagonist trajectory has a new origin and the session continues for the defined task until completed or terminated.
  • FIG. 3 An example of a functional movement skills test is illustrated in Fig. 3 by reference to a standard three hop test.
  • the player 36 or patient stands on one leg and performs three consecutive hops as far as possible and lands on the same foot.
  • the player icon 32 is displayed at the center of the rear portion of the computer-generated virtual space 30, a position in scaled translation to the position of o the player 36 in the defined physical space 12.
  • Three hoops 50, protagonist icons, appear on the display indicating the sequence of hops the player should execute.
  • the space of the hoops may be arbitrarily spaced, or may be intelligent, based on standard percentile data for such tests, or on the best or average past performances of the player. s
  • the player 36 is prompted to the starting position 52.
  • the three hoops 50 appear representing the 50th percentile hop distances for the player's classification, and after a slight delay the first hoop is highlighted indicating the start of the test.
  • the player then executes the first hop with the player's movement toward the first hoop being depicted in essentially o real-time on the display.
  • this position is noted and stored on the display until completion of the test and the second hoop and third hoop are sequentially highlighted as set forth above.
  • the player's distances will be displayed with reference to normative data.
  • a test for agility assessment is illustrated in Fig.
  • cones 60, 62, 64, 66 are the protagonist icons.
  • the player 36 is prompted to a starting position 68 at the lower right corner.
  • the left lower cone 62 is highlighted and the player side steps leftward 0 thereto while facing the display.
  • the fourth cone 66 diagonally across at the front of the virtual space 30 is highlighted and the player moves toward and circles around cone 66. Thereafter the player moves toward the starting cone 60 and circles the same and then moves to a highlighted third virtual cone 64.
  • each leg of the test can be individually reported, as well as forward, backward and side to side movement capabilities.
  • the system provides a unique measurement of the player's visual observation and assesses skills in a sport simulation wherein the player is required to intercept or avoid the protagonist based on visual observation of the constantly changing spatial relationship with the protagonist. Additionally, excursions in the Y-plane can be quantified during movement as a measure of an optimal stance of the player.
  • the task is to intercept targets 70, 71 emanating from a source 72 and traveling in straight line trajectories T1 , T2.
  • the generated virtual space 30 displays a plurality of obstacles 74 which the player must avoid in establishing an interception path with the target 70.
  • the player assumes in the defined physical space a position which is represented on the generated virtual space as position P (X1 , Y1 , Z1 ) in accurately scaled translation therewith.
  • the player moves along a personally determined path in the physical space which is indicated by the dashed lines in the virtual space to achieve an interception site coincident with the instantaneous coordinates of the target 70, signaling a successful completion of the first task.
  • This achievement prompts the second target 71 to emanate from the source along trajectory T2.
  • the player is required to select a movement path which will avoid contact or collision with virtual obstacle 74.
  • a path shown by the dashed lines is executed in the defined physical space and continually updated and displayed in the virtual space as the player intercepts the protagonist target at position P(X3, Y3, Z3) signaling completion of the second task.
  • the assessment continues in accordance with the parameters selected for the session, at the end of which the player receives feedback indicative of success, i.e., scores or critical assessment based on the distance, elapsed time for various vectors of movement.
  • Another protocol is a back and forth hop test.
  • the task is to hop back and forth on one leg over a virtual barrier displayed in the computer-generated virtual space.
  • the relevant information upon completion of the session would be the amplitude measured on each hop which indicates obtaining a height sufficient to clear the virtual barrier. Additionally, the magnitude of limb oscillations experienced upon landing could be assessed.
  • the protocol may only measure the vertical distance achieved in a single or multiple vertical jump.
  • the aforementioned system accurately, and in essentially real time, measures the absolute three dimensional displacements over time of the body's center of gravity when the sensor marker is appropriately located on the player's mass center. Measuring absolute displacements in the vertical plane as well as the horizontal plane enables assessment of both movement skills and movement efficiency.
  • the protagonist icon functions as an aerobics instructor directing the player through a series of aerobic routines.
  • the system can also serve as an objective physiological indicator of physical activity or work rate during free body movement in essentially real time.
  • Such information provides three benefits: (1 ) enables interactive, computer modulation of the workout session by providing custom movement cues in response to the player's current level of physical activity; (2) represents a valid and unique criteria to progress the player in his training program; and (3) provides immediate, objective feedback during training for motivation, safety and optimized training.
  • Such immediate, objective feedback of physical activity is generally missing in current aerobics programs, particularly in unsupervised home programs. Quantification of Performance-Related Parameters
  • performance-related physical activity parameters related to movement are monitored and quantified.
  • the repetitive drudgery of conventional stationary exercise equipment that currently measures calories, heart rate, etc. is replaced by the excitement of three-dimensional movement in interactive response to virtual reality challenges presented on the monitor of the inventive system.
  • Excitement is achieved in part by the scaling transformation achieved by the present invention, through which positional changes by the user moving in real space are represented in scaled relationship in the virtual world presented on the monitor.
  • Performance-related parameters measured and/or quantified by various embodiments of the present invention include those related to (a) determining and training a user's optimal dynamic posture; (b) the relationship between heart rate and physical activity; (c) quantifying quickness, i.e., acceleration and deceleration; and (d) and quantifying energy expenditure during free ranging activities.
  • One advantage of the present system is that a variety of environments in the virtual world displayed on the monitor can prompt any desired type and intensity of physical activity, achieving activity and energy expenditure goals in an ever-changing and challenging environment, so that the user looks forward to, rather than dreads, exercise, testing, or therapy sessions.
  • Measurement of motion is used to quantify work and energy expenditure.
  • Movement-related quantities such as force, acceleration, work and power, defined below, are dependent on the rate of change of more elementary quantities such as body position and velocity (the latter of which is also a movement parameter).
  • the energy expenditure of an individual is related to the movement of the individual while performing the invention protocols.
  • the concept that a complex motion can be considered as a combination of simple bilateral movements in any of three directions is convenient since this approach allows focus on elementary movements with subsequent adding of the effects of these simple components. Such concept relates to the ability to monitor continuously the movement of the individual to measure the resultant energy expenditure.
  • this embodiment to accurately measure a subject's movement rests on being able to determine his or her position and velocity at arbitrary points of time. For a given point in time, a position is measured directly. The sampling rate of the position of the individual or player 36 is sufficiently fast to allow accurate measurements to be made at very closely spaced intervals of time. By knowing an individual's position at arbitrary points along its path the velocity can be calculated.
  • positions can be used to determine velocity along a movement path: given the position of the individual at various instances of time, the embodiment can obtain the velocity in several ways.
  • One method is to choose a point and calculate its velocity as being the result of dividing the distance between it and the next point by the time difference associated with those points. This is known as a finite difference approximation to the true velocity. For small spacing between points, it is highly accurate.
  • V D/T, where V has the units of meters per second, m/s.
  • the velocity can be labeled positive for one direction along a path and negative for the opposite direction. This is, of course, true for each of the bilateral directions separately.
  • the positional data could be fitted by spline curves and treated as continuous curves.
  • the velocity at any point would be related to the tangent to the individual's path using derivative procedures of standard calculus. This would give a continuous curve for the velocity from which a corresponding curve could be obtained for the acceleration of the individual.
  • the determination of the individual's acceleration provides a knowledge of the force F it experiences.
  • the force is related to the mass M of the individual, given in kilograms, and acceleration, by the formula
  • Energy and work may be measured in the present invention.
  • the energy expended by an individual in the inventive system can be derived from work.
  • the mechanical work is calculated by multiplying the force acting on an individual by the distances that the individual moves while under the action of force.
  • the unit of work is a joule, which is equivalent to a newton-meter.
  • the standard unit for power is the watt and it represents one joule of work produced per second.
  • a protocol called “Dynamic Posture” represents the athletic stance maintained during sport specific activity that maximizes a player's readiness for a specific task. 5 Examples are the slight crouches or "ready" position of a soccer goalie or a football linebacker.
  • Y plane displacements 0 accurately reflect vertical fluctuations of that point on the body on which the reflective marker is placed, for example, the hipline, which is often referred to as the Center of Gravity (CG) point.
  • CG Center of Gravity
  • the optimal dynamic posture during sport-specific s activities is determined as follows: a) A retro-reflective marker is mounted at the athlete's CG point. b) The invention's computer 22 measures in real-time vertical displacements of the athlete's CG (Y -plane excursions) as he responds to interactive, sport-specific protocols. o c) The invention's computer 22 calculates in essentially real-time the athlete's movement velocities and/or accelerations during performance of sport-specific protocols. d) The invention calculates the athlete's most efficient dynamic posture defined as that CG elevation that produces maximum velocities and/or 5 accelerations/decelerations for the athlete in the sports-specific protocols.
  • the invention provides numerical and graphical feedback of results. Once the optimal dynamic posture is determined, training optimal dynamic posture is achieved by the following steps: o a) A retro-reflective marker is mounted at the athlete's CG point. b) The athlete 36 assumes the dynamic posture that he or she wishes to train. c) The invention is initialized for this CG position. d) The invention provides varying interactive movement challenges over sport-specific distances and directions, including unplanned movements, e) Y-plane excursions from the optimal dynamic posture that exceed the pre-set threshold or window will generate real-time feedback of such violations for the user. f) The invention provides real-time feedback of compliance with the desired dynamic posture during performance of the protocols.
  • the invention uses unplanned, interactive game-like movement challenges requiring sport-specific responses.
  • the participant will move most effectively during stopping, starting and cutting activities if he assumes and maintains his optimum Center of Gravity (CG) elevation. Additional movement efficiencies are achieved by the player by minimizing CG elevation excursions.
  • the invention is capable of tracking in essentially real-time, the participant's CG elevation by monitoring Y plane displacements. During the training phase, the participant will be provided with real-time feedback of any Y plane excursions exceeding targeted ranges.
  • the relationship between heart rate and physical activity of the subject during performance of the protocols is also quantified by the present invention. Heart rate is measured by a commercially available wireless (telemetry) device 36A (Fig. 2) in essentially real-time.
  • simultaneous assessment and modulation of physical activity and heart rate is achieved as follows: a) The subject 36 places a retro-reflective marker at his CG point. b) A wireless heart-rate monitor 36A (Fig. 2) is worn on the subject 36, the monitor 36A in communication in real-time with the computer 22. c) Subject 36 enters desired target heart-rate range. (This step is optional.) d) The invention provides interactive, functional planned and unplanned movement challenges (protocols) over varying distances and directions. e) The invention provides real-time feedback of compliance with selected heart-rate zone during performance of these protocols. f) The invention provides a graphical summary of the relationship or correlation between heart-rate at each moment of time and free-body physical activity.
  • the present invention includes assessment and quantification of movement skills such as accelerations and decelerations during unplanned movement protocols over sport-specific distances. Quantification of bi-lateral vector accelerations and decelerations (how well a subject 36 moves left and right) are achieved as follows: a) A retro-reflective marker is mounted at the athlete's CG point, b) The invention tracks at sufficient sampling rate the athlete's movement in three degrees of freedom during his performance of sport-specific protocols, including unplanned movements over various vector distances, c) The invention calculates in essentially real-time the athlete's movement accelerations and decelerations, d) The invention categorizes each movement leg to a particular vector, e) The invention provides numerical and graphical feedback of bi-lateral performance.
  • Quantification of the intensity of free-ranging physical activity as expressed in kilocalories per minute, and the total energy expended, is derived from movement data collected as the subject moves in response to prompts from the monitor, personal data such as weight inputted by the subject, and conventional conversion formulae.
  • the inventive system can measure the intensity, i.e., strenuousness or energy cost of physical activity during free ranging (functional) activities, expressed in calories per minute, distance traveled per unit of time.
  • Energy expenditure can be derived from the subject's movement data during performance of free-ranging activities.
  • Well known laboratory instrumentation can be employed to ascertain the coefficient or conversion factor needed to convert work or power or distance derived from the movement data to calories expended.
  • Oxygen uptake expressed in milliliters per kilogram per minute can determine the caloric expenditure of physical activity and is considered the "gold standard" or reference when evaluating alternative measures of physical activity.
  • the most precise laboratory means to determine oxygen uptake is through direct gas analysis, which would be performed on representative subject populations during their execution of the invention's protocols with a metabolic cart, which directly measures the amount of oxygen consumed. Such populations would be categorized based on age, gender and weight.
  • the software flow chart for the tasks of an illustrative embodiment is shown in Figs. 8 and 9.
  • DEFINE PLAYER ICON 81
  • the player is prompted to Define Protagonists 82.
  • the player may select the intelligence level, number, speed and size of the protagonists to reside in the selected routine.
  • Obstacles 84 i.e., static vs. dynamic, number, speed, size and shape.
  • Objectives 86 i.e., avoidance or interception, scoring parameters, and goals, to complete the setup routine.
  • Objectives 86 i.e., avoidance or interception, scoring parameters, and goals.
  • the players 3-D path boundaries should be programmed, the reference frame of play, i.e., 1st person, 3rd person.
  • PATH VIOLATION 86A
  • the OBJECTIVES MET decision block should point here if NO.
  • the player is prompted to a starting position for the task and upon reaching this position, the protagonist(s) and the obstacle(s) for the task are generated on the display.
  • the protagonist moves on the display, 90, in a trajectory dependent on the setup definition.
  • the player moves in a path which the player determines will result in the earliest interception point with the protagonist in accordance with the player's ability.
  • the player icon is generated, and continually updated, in scaled translation in the virtual space to the player's instantaneous position in the defined physical space. Movement continues until player contact, 92, and interception, 94, or until the protagonist contacts a boundary of the virtual space corresponding to the boundary of the defined physical space, 96.
  • the direction of the protagonist is changed dependent on the setup definition, and the pursuit of the protagonist by the player continues as set forth above.
  • the player pursuit in the event that obstacles have been selected in the setup definition, the same are displayed, 110, and the player must undertake a movement path to avoid these obstacles.
  • the routine is completed and scored as described above.
  • a moving obstacle was selected in the setup definition, if the obstacle strikes a boundary, 116, the obstacle's direction is changed, 118, and the task continues.
  • a multiple segment task For a multiple segment task, if the obstacle is contacted, the protagonist's direction changes and the movements continue. Similarly, upon interception for a multiple segment task, a new protagonist trajectory is initiated and the obstacles also may be reoriented. The routine then continues until the objectives of the task have been met, and the session completed.
  • the tasks are structured to require the player to move forward, backward, left and right, and optionally vertically.
  • the player's movement is quantified as to distance and direction dependent on the sampling rate and the update rate of the system. For each sampling period, the change in position is calculated. At the end of the session, these samples are totaled and displayed for the various movement vectors.
  • the objective of the session is to avoid a protagonist seeking to intercept the player
  • the aforementioned is appropriately altered.
  • the session ends for a single segment task and the time and distance related information is calculated and displayed.
  • the protagonist trajectory has a new origin and the session continues for the defined task until completed or terminated.
  • the present invention provides a unique and sophisticated computer sports simulator faithfully replicating the ever-changing interaction between offensive and defensive opponents. This fidelity with actual competition enables a global and valid assessment of an offensive or defensive player's functional, sport-specific performance capabilities.
  • Such assessment may include use of indicia that are or are derived from movement parameter(s).
  • indicia derived from movement parameter(s) are several novel and interrelated measurement constructs which have been derived and rendered operable by specialized position-sensing hardware and interactive software protocols.
  • Feedback may be provided to the player regarding the measurement constructs. This feedback may take many forms. The feedback may be provided during the interactive session, with there being some effect in the virtual space (and the view) that is a function of one or more of the constructs, for example. Alternatively or in addition, feedback may be provided after the end of one or more interactive sessions.
  • Compliance a global measure of the player's core defensive skills is the ability of the player to maintain a synchronous relationship with the dynamic cues that are often expressed as an offensive virtual opponent.
  • the ability to faithfully maintain a synchronous relationship with the virtual opponent is expressed either as compliance (variance or deviation from a perfect synchronous relationship with the virtual opponent) and/or as absolute performance measures of the player's velocity, acceleration and power.
  • An integral component of such a synchronous relationship is the player's ability to effectively change position, i.e., to cut, etc. as discussed below.
  • Compliance may be determined as follows: a) A beacon, a component of the tracking system, is worn at the Player's waist.
  • Position A software scaling parameters make the virtual opponent 210, coordinates in the virtual environment equivalent to the player's 212 coordinates in the physical environment.
  • the system's video displays the virtual opponent's movement along Pathl (x,y,z,t) 214 as a function of dimensions X, Y and Z, and time
  • Opportunity a quantification of the player's ability to create an asynchronous movement event when in an offensive role.
  • the player's ability to execute abrupt changes (to cut) in his or her movement vector direction, expressed in the aforementioned absolute measures of s performance, is one of the parameters indicative of the player's ability to create this asynchronous movement event.
  • Opportunity may be determined as follows: a) A beacon, a component of the optical tracking system, is worn at the Player's waist. 0 b) At Position A, software scaling parameters make the virtual opponent
  • the system calculates at each sampling interval the Player's new position velocity, acceleration, and power, and determines the moment the Player has created sufficient opportunity to abruptly redirect his/her movement along Path3(x,y,z,t) 234 to intersect the virtual opponent's x-y plane to elude and avoid collision with the virtual opponent, f)
  • the system provides real time numerical and graphical feedback of the calculations of part e.
  • a number of performance components are essential to successfully executing the two aforementioned global roles. Accordingly the system assesses the following performance constructs or components: Dynamic Reaction Time, Dynamic Phase Lag, First Step Quickness, and Dynamic Reactive Bounding, Dynamic Sports Posture, Functional Cardio-respiratory Status, Dynamic Reactive Cutting. These constructs are explained in detail below.
  • Dynamic Reaction Time is a novel measure of the player's ability to react correctly and quickly in response to cuing that prompts a sport specific response from the player. It is the elapsed time from the moment the virtual opponent attempts to improve its position (from the presentation of the first indicating stimuli) to the player's initial correct movement to restore a synchronous relationship (player's initial movement along the correct vector path).
  • Dynamic Reaction Time is a measurement of ability to respond to continually changing, unpredictable stimuli, i.e., the constant faking, staccato movements and strategizing that characterizes game play.
  • the present invention uniquely measures this capability in contrast to systems providing only static cues which do not provide for continual movement tracking.
  • Dynamic Reaction Time is comprised of four distinct phases: the perception of a visual and/or audio cue, the interpretation of the visual and/or audio cue, appropriate neuromuscular activation, and musculoskeletal force production resulting in physical movement. It is important to note that Dynamic Reaction Time, which is specifically measured in this protocol, is a separate and distinct factor from rate and efficiency of actual movement which are dependent on muscular power, joint integrity, movement strategy and agility factors. Function related to these physiological components is tested in other protocols including Phase Lag and First Step Quickness.
  • the defensive player must typically respond within fractions of a second to relevant dynamic cues if the defensive player is to establish or maintain the desired synchronous relationship. With such minimum response time, and low tolerance for error, the defensive player's initial response must typically be the correct one. The player must continually react to and repeatedly alter direction and/or velocity during a period of continuous movement. Any significant response lag or variance in relative velocity and/or movement direction between the player and virtual opponent places the player irrecoverably out of position.
  • Dynamic Reaction Time may be determined as follows: a) A beacon, a component of the optical tracking system, is worn at the Player's waist. b) At Position A, software scaling parameters make the virtual opponent 236, coordinates in the virtual environment equivalent to the player's 238 coordinates in the physical environment.
  • the system's video displays the virtual opponent's movement along Path1(x,y,z,t) 240 to a virtual Position B 242.
  • the Player moves along Path2(x,y,z,t) 244 to a near equivalent physical Position C 246.
  • the Player's objective is to move efficiently along the same path in the physical environment from start to finish as does the virtual opponent in the virtual environment. However, since the virtual opponent typically moves along random paths and the Player is generally not as mobile as the virtual opponent, the player's movement path usually has some position error measured at every sample interval.
  • e) Once the virtual opponent reaches Position B 242, it immediately changes direction and follows Path3(x,y,z,t) 248 to a virtual Position D 250.
  • the Dynamic Reaction Timer is started after the virtual opponent's x, y, or z velocity component of movement reaches zero at Position B 242 and its movement along Path3(x,y,z,t) 248 is initiated.
  • the Player perceives and responds to the virtual opponent's new movement path by moving along Path4(x,y,z,t) 252 with intentions to comply to virtual opponent's new movement path.
  • the Dynamic Reaction Timer is stopped at the instant the Player's x, y, or z velocity component of movement reaches zero at Position C 246 and his/her movement is redirected along the correct Path4(x,y,z,t) 252.
  • the system calculates at each sampling interval the Player's new position velocity, acceleration, and power.
  • Dynamic Phase Lag is defined as the elapsed time that the player is "out of phase” with the cuing that evokes a sport specific response from the player. It is the elapsed time from the end of Dynamic Reaction Time to actual restoration of a synchronous relationship by the player with the virtual opponent. In sports vernacular, it is the time required by the player to "recover" after being "out-of-position” while attempting to guard his opponent.
  • Dynamic Phase Lag may be determined as follows: a) A beacon, a component of the optical tracking system, is worn at the Player's waist. b) At Position A, software scaling parameters make the virtual opponent 254, coordinates in the virtual environment equivalent to the player's 256 coordinates in the physical environment. c) The system's video displays the virtual opponent's movement along Pathl (x,y,z,t) 258 to a virtual Position B 260. d) In response, the Player moves along Path2(x,y,z,t) 262 to a near equivalent physical Position C 264. The Player's objective is to move efficiently along the same path in the physical environment from start to finish as does the Avatar in the virtual environment.
  • First Step Quickness may be measured as the player attempts to establish or restore a synchronous relationship with the offensive virtual opponent. First step quickness is equally important for creating an asynchronous movement event for an offensive player.
  • Acceleration is defined as the rate of increase of velocity over time and is a vector quantity
  • an athlete with first step quickness has the ability to accelerate rapidly from rest, an athlete with speed has the ability to reach a high velocity over longer distances.
  • One of the most valued attributes of a successful athlete in most sports is first step quickness.
  • acceleration is a more sensitive measure of "quickness" over short, sport-specific movement distances than is average velocity or speed. This is especially true since a realistic simulation of sports challenges, which are highly variable in distance, would not be dependent upon fixed start and end positions.
  • a second reason that the measurement of acceleration over sport-specific distances appears to be a more sensitive and reliable measure is that peak accelerations are reached over shorter distances, as little as one or two steps.
  • First step quickness can be applied to both static and dynamic situations.
  • Static applications include quickness related to base stealing.
  • Truly sports relevant quickness means that the athlete is able to rapidly change his movement pattern and accelerate in a new direction towards his goal. This type of quickness is embodied by Michael Jordan's skill in driving to the basket. After making a series of misleading movement cues, Jordan is able to make a rapid, powerful drive to the basket. The success of this drive lies in his first step quickness.
  • Valid measures of this sports skill must incorporate the detection and quantifying of changes in movement based upon preceding movement. Because the vector distances are so abbreviated and the player is typically already under movement prior to "exploding", acceleration, power and/or peak velocity are assumed to be the most valid measures of such performance.
  • Measures of speed or velocity over such distances may not be reliable, and at best, are far less sensitive indicators.
  • Numerous tools are available to measure the athlete's average velocity between two points, the most commonly employed tool being a stopwatch. By knowing the time required to travel the distance between a fixed start and end position, i.e., a known distance and direction, the athlete's average velocity can be accurately calculated. But just as an automobile's zero to sixty-mph time, a measure of acceleration, is more meaningful to many car aficionados than its top speed, an average velocity measure does not satisfy interest in quantifying the athlete's first step quickness. Any sport valid test of 1 st step quickness must replicate the challenges the athlete will actually face in competition.
  • First Step Quickness may be determined as follows. Referring to Fig. 14, a) A beacon, a component of the optical tracking system, is worn at the Player's waist. b) At Position A, software scaling parameters make the virtual opponent 274 coordinates in the virtual environment equivalent to the player's 276 coordinates in the physical environment.
  • the system's video displays the virtual opponent's movement along Pathl (x.y.z.t) 278 to a virtual Position B 280.
  • the Player moves along Path2(x,y,z,t) 282 to a near equivalent physical Position C 284.
  • the Player's objective is to move efficiently along the same path in the physical environment from start to finish as does the virtual opponent in the virtual environment. However, since the virtual opponent typically moves along random paths and the Player is generally not as mobile as the virtual opponent, the player's movement path usually has some position error measured at every sample interval.
  • the virtual opponent reaches Position B 280, it immediately changes direction and follows Path3(x,y,z,t) 286 to a virtual Position D 288.
  • the Player perceives and responds to the virtual opponent's new movement path by moving along Path4(x,y,z,t) 290 with intentions to comply to virtual opponent's new movement path.
  • the system calculates at each sampling interval the Player's new position, velocity, acceleration, and power. Within a volume 292 having radius R, either the measurement of peak acceleration or the measurement of peak power, proportional to the product of peak velocity and acceleration, characterizes First Step Quickness.
  • the system provides real time numerical and graphical feedback of the calculations of part g. Dynamic Reactive Bounding is the player's ability to jump or bound in response to cuing that evokes a sport specific response in the player.
  • measured constructs include the player's dynamic reaction time in response to the virtual opponent's jumps as well as the player's actual jump height and/or bound distance and trajectory.
  • Static measures of jumping maximal vertical jump
  • Dynamic measurements made within the present invention's simulation provide sports relevant information by incorporating the variable of time with respect to the jump or bound.
  • a jump is a vertical elevation of the body's center of gravity, specifically a displacement of the CM (Center of Mass) in the Y plane.
  • a jump involves little, if any, horizontal displacement.
  • a bound is an elevation of the body's center of gravity having both horizontal and vertical components. The resulting vector will produce horizontal displacements in some vector direction.
  • jumping and bounding ability is essential to success in many sports, and that it is also a valid indicator of overall body power.
  • Most sports training programs attempt to quantify jumping skills to both appraise and enhance athletic skills.
  • a number of commercially available devices are capable of measuring an athlete's peak jump height. The distance achieved by a bound can be determined if the start and end points are known. But no device purports to measure or capture the peak height (amplitude) of a bounding exercise performed in sport relevant simulation. The peak amplitude can be a sensitive and valuable measure of bounding performance. As is the case with a football punt, where the height of the ball, i.e., the time in the air, is at least as important as the distance, the height of the bound is often as important as the distance.
  • the timing of a jump or bound is as critical to a successful spike in volleyball or rebound in basketball as its height.
  • the jump or bound should be made and measured in response to an unpredictable dynamic cue to accurately simulate competitive play.
  • the required movement vector may be known (volleyball spike) or unknown (soccer goalie, basketball rebound).
  • This novel measurement construct tracks in real time the actual trajectory of a jump or bound performed during simulations of offensive and defensive play.
  • To measure the critical components of a jump or bound requires continuous sampling at high rates to track the athlete's movement for the purpose of detecting the peak amplitude as well as the distance achieved during a jumping or bounding event.
  • Real time measurements of jumping skills include jump height, defined as the absolute vertical displacement of CM during execution of a vertical jump, and for a bound, the peak amplitude, distance and direction.
  • Dynamic Reactive Bounding may be determined as follows. a) A beacon, a component of the optical tracking system, is worn at the Player's waist. b) At Position A, software scaling parameters make the virtual opponent 294, or virtual opponent's coordinates in the virtual environment equivalent to the player's 296 coordinates in the physical environment. c) The system's video displays the virtual opponent's movement along Path 1 (x,y,z,t) 298 to a virtual Position B 300. The virtual opponent's resultant vector path or bound is emphasized to elicit a similar move from the Player 296. d) In response, the Player 296 moves along Path2(x,y,z,t) 302 to a near equivalent physical Position C 304.
  • the Player's objective is to move efficiently along the same path in the physical environment from start to finish as does the virtual opponent in the virtual environment. However, since the virtual opponent typically moves along random paths and the Player is generally not as mobile as the virtual opponent, the player's movement path usually has some position error measured at every sample interval.
  • the system calculates at each sampling interval the Player's new position, velocity, acceleration, and power. In addition, components of the Player's bounding trajectory, i.e., such as air time, maximum y- displacement, are also calculated.
  • the system provides real time numerical and graphical feedback of the calculations of part e. The Player's bounding trajectory is highlighted and persists until the next bound is initiated.
  • Dynamic Sports Posture is a measure of the player's sports posture during performance of sport specific activities. Coaches, players, and trainers universally acknowledge the criticality of a player's body posture during sports activities. Whether in a defensive or offensive role, the player's body posture during sports specific movement directly impacts sport specific performance.
  • An effective body posture optimizes such performance capabilities as agility, stability and balance, as well as minimizes energy expenditure.
  • An optimum posture during movement enhances control of the body center of gravity during periods of maximal acceleration, deceleration and directional changes. For example, a body posture during movement in which the center of gravity is "too high” may reduce stability as well as dampen explosive movements; conversely, a body posture during movement that is "too low” may reduce mobility. Without means of quantifying the effectiveness of a body posture on performance related parameters, discovering the optimum stance or body posture is a "hit or miss" process without objective, real time feedback.
  • Optimal posture during movement can be determined by continuous, high speed tracking of the player's CM in relationship to the ground during execution of representative sport-specific activities. For each player, at some vertical (Y plane) CM position, functional performance capabilities will be optimized. To determine that vertical CM position that generates the greatest sport-specific performance for each player requires means for continual tracking of small positional changes in the player's CM at high enough sampling rates to capture relevant CM displacements. It also requires a sports simulation that prompts the player to move as she or he would in actual competition, with abrupt changes of direction and maximal accelerations and decelerations over varying distance and directions.
  • Training optimum posture during movement requires that the player strive to maintain their CM within a prescribed range during execution of movements identical to those experienced in actual game play. During such training, the player is provided with immediate, objective feedback based on compliance with the targeted vertical CM. Recommended ranges for each player can be based either on previously established normative data, or could be determined by actual testing to determine that CM position producing the higher performance values.
  • Dynamic Sports Posture during sport-specific activities may be determined as follows: a) A beacon, a component of the optical tracking system, is worn at the Player's waist. b) At Position A, software scaling parameters make the virtual opponent
  • the system's video displays the virtual opponent's movement along Pathl (x,y,z,t) 310 to a virtual Position B 312.
  • the Player moves along Path2(x,y,z,t) 314 to a near equivalent physical Position C 316.
  • the Player's objective is to move efficiently and in synchronicity city to the virtual opponent's movement along the same path in the physical environment from start to finish as does the virtual opponent in the virtual environment.
  • the virtual opponent 306 typically moves along random paths and the Player 308 is generally not as mobile as the virtual opponent, the player's movement path usually has some position error measured at every sample interval.
  • Posture may be achieved by the following steps: a) A beacon, a component of the optical tracking system, is worn at the Player's waist. b) The Player 308 assumes the dynamic posture that he/she wishes to train. c) The system provides varying interactive movement challenges over sport specific distances and directions, including unplanned movements. d) Y-plane positions, velocity, accelerations and power measurements that are greater or less than or equal to the pre-set threshold or window will generate real-time feedback of such violations for the Player 308. e) The system provides real-time feedback of compliance with the desired dynamic posture during performance of the protocols.
  • Functional Cardio-respiratory Status is the player's cardio-respiratory status during the aforementioned sports specific activities. In most sports competitions, there are cycles of high physiologic demand, alternating with periods of lesser demand. Cardiac demand is also impacted upon by situational performance stress and attention demands. Performance of the cardiorespiratory system under sports relevant conditions is important to efficient movement.
  • feedback regarding heart rate may be provided independent of feedback regarding sports-specific performance.
  • Functional Cardio-respiratory Fitness is a novel measurement construct capable of quantifying any net changes in sport-specific performance relative to the function of the cardio-respiratory system.
  • Functional Cardio-respiratory Status may be determined as follows: a) A beacon, a component of the optical tracking system, is worn at the Player's waist. b) A wireless heart rate monitor 36A (Fig. 2) is worn by the Player. The monitor communicates in real-time with the system. c) The system provides sport-specific exercise challenges to cycle the Player's heart rate to replicate levels observed in actual sport competition. d) The system provides interactive, functional planned and unplanned movement challenges over varying distances and directions. e) The system provides real-time feedback of compliance with a selected heart-rate zone during performance of defined protocols.
  • Dynamic Reactive Cutting is a measure of the player's ability to execute an abrupt change in position, i.e., a "cut" can be a directional change of a few degrees to greater than 90 degrees.
  • Vector changes can entail complete reversals of direction, similar to the abrupt forward and backward movement transitions that may occur in soccer, hockey, basketball, and football.
  • the athlete running at maximum velocity must reduce her or his momentum before attempting an aggressive directional change, this preparatory deceleration often occurs over several gait cycles. Once the directional change is accomplished, the athlete will maximally accelerate along his or her new vector direction.
  • Accurate measurement of cutting requires continuous tracking of position changes in three planes of movement; ascertaining the angle scribed by the cutting action; and measuring both the deceleration during braking prior to direction change and the acceleration after completing the directional change.
  • the cues (stimuli) prompting the cutting action must be unpredictable and interactive so that the cut can not be pre-planned by the athlete, except under specific training conditions, i.e., practicing pass routes in football. It must be sport specific, replicating the types of stimuli the athlete will actually experience in competition.
  • the validity of agility tests employing ground positioned cones and a stopwatch, absent sport-relevant cuing, is suspect. With knowledge of acceleration and the player's body weight, the power produced by the player during directional changes can also be quantified.
  • Vector Changes and Dynamic Reactive Cutting may be determined as follows: a) A beacon, a component of the optical tracking system, is worn at the
  • the system's video displays the virtual opponent's movement along Pathl (x,y,z,t) 322 to a virtual Position B 324.
  • the Player 320 moves along Path2(x,y,z,t) 326 to a near equivalent physical Position C 328.
  • the Player's objective is to move efficiently along the same path in the physical environment from start to finish as does the virtual opponent 318 in the virtual environment.
  • the virtual opponent typically moves along random paths and the Player is generally not as mobile as the virtual opponent, the player's movement path usually has some position error measured at every sample interval.
  • the performance-related components are often characterized as either the sport-specific, functional, skill or motor-related components of physical fitness. These performance-related components are obviously important for safety and success in both competitive athletics and vigorous leisure sports activities. It should be equally obvious that they are also essential for safety and productive efficiency in demanding physical work activities and unavoidably hazardous work environments such as police, fire and military — as well as for maintaining independence for an aging population through enhanced mobility and movement skills.
  • FIG. 1 Another embodiment of the invention involves a personal perspective, also known as a first person perspective
  • This perspective is a view on the display of the virtual space from the perspective of the player. It is in contrast to the type of information shown on the display 28 in Figs. 2-4, which is generally termed a third person perspective.
  • a third person perspective the view of the virtual space is from some viewpoint outside of the playing field, akin to the view a spectator would have.
  • the viewpoint is generally fixed, although the viewpoint may move as action in the virtual space shifts to different parts of the virtual space.
  • the third person perspective in a basketball simulation may shift between two half-court views, depending on where the ball and the players are in virtual space.
  • a first person view is a view from a perspective within the simulation.
  • a system 360 including first person viewing is shown in Fig. 18.
  • Such a perspective is generally that of a participant in the simulation, such as a player 362.
  • the player 362 moves within a physical space 366, such movement being detected by a tracking system as described above.
  • the view on a display 370 is altered to show virtual space from the viewpoint in virtual space corresponding to the new location 368.
  • the viewpoint will correspond to that of a virtual being (corresponding to the player) at a location in virtual space corresponding to the player's location in physical space.
  • a stationary object 372 in the virtual space will change its position on the display to reflect its position relative to the new viewpoint.
  • a movable object in virtual space such as a protagonist 376 also changes its position on the display 370 in response to a shift in viewpoint caused by movement of the player 362.
  • the protagonist 376 also is able to change its position within the virtual space. A change in position by the protagonist will also result in a change of its position on the display 370.
  • the system 360 may also display a representation indicating part of the virtual being corresponding to the player 362, for example the hands 378 shown on the display 370 in Fig. 18.
  • Such display elements may be used, for example, to indicate items held by the virtual being in the virtual space, to indicate position of part of the player's body (e.g., whether the hands are raised), or to indicate orientation of the player.
  • the representation may resemble part of a human body, e.g., hands, feet, etc. Alternatively the representation may be of other objects, e.g., wings, abstract shapes, etc.
  • the representation may or may not be always in the displayed view.
  • the display of a first person perspective increases the fidelity of the simulation, by making the view on the display closer to that which would be perceived by the player in a real life activity. Multiple Player Encounters
  • a system 380 has multiple players 382 and 384 which participate using the same physical space 386 and display 388.
  • Displayed player icons 390 and 392 correspond to the positions of the players 382 and 384. It will be appreciated that it is desirable for the tracking system associated with the system 380 to be able to differentiate between the players 382 and 384.
  • FIG. 20 shows an alternate embodiment, a system 400 in which multiple players 402 and 404 participate simultaneously in separate respective physical spaces 406 and 408.
  • the physical spaces 406 and 408 may be located in the same room, in which case it may be possible to have one tracking system track the position of both of the players. However, it may be more effective to have separate tracking systems for each of the physical spaces. This is shown in the illustrated embodiment, with tracking systems 410 and 412 corresponding to respective physical spaces 406 and 408.
  • the tracking systems 410 and 412 are operatively coupled to a computer 416 (which consist of two separate computer units in communication with one another and/or with a central computer unit).
  • the computer 416 in turn is operatively coupled to displays 418 and 420 which correspond to the physical spaces 406 and 408, respectively.
  • the operative coupling between the computer 416, and the tracking systems 410 and 412 and the displays 418 and 420 may be accomplished by means of hard-wired cables between these components.
  • the operative coupling may employ other means such as modems and telephone lines, radio or infrared light signals, or connections to computer networks such as the World Wide Web.
  • the displays 418 and 420 may show the same view of virtual space, such as a the same third person perspective. Alternatively and preferably, the displays 418 and 420 may show different views of the virtual space. For example, for a simulated tennis match each of the displays may show a third person perspective view from the end of the court corresponding to the respective physical spaces. Alternatively, different first person perspective views of the physical space may be shown on each of the displays. Thus each display may have a viewpoint in virtual space corresponding to the location of the player viewing that display.
  • each player may have an individual game unit (a display, tracking system, and physical space), while all the players share a computer or computers. It will be appreciated that even when more than one physical space is used, more than one player may occupy each physical space. For example, a simulated tennis doubles match may involve two physical spaces, with two players occupying each physical space.
  • the multiplayer simulation disclosed above allows the performance of more than one person to be evaluated simultaneously.
  • the use of a live player as a virtual opponent results in a more realistic sports simulation.
  • computers are unable to capture the nuances of human thinking and behavior in general, and sports strategy in particular.
  • Much of sports performance is governed by compressed time frames - mere milliseconds - within which offensive and defensive opponents are capable of a wide variety of movements associated with six degrees of freedom.
  • Computers are as of yet unable to fully simulate this behavior. Performance Scaling
  • Fig. 21 illustrates an alternate embodiment of the invention which includes performance scaling, also known as handicapping.
  • performance scaling also known as handicapping.
  • a testing and training system 440 with performance scaling.
  • One or more scaling factors define the relationship between movements of a player 442 in a physical space 444 and changes in the virtual space position corresponding to the player 442 (represented in Fig. 21 as the position of player icon 446 in a representation of virtual space 450 shown on a display 452).
  • a scale factor could be used to control the relationship between the actual jump height and the apparent jump height in virtual space. Such scaling may be linear or nonlinear.
  • movement by the player 442 along a path 456 may be displayed through use of a scale factor as movement of a greater or lesser distance, such as movement along a virtual path 458.
  • the scale factors may be different for movement in different directions.
  • the scale factors may be adjusted to take into account differences in skill levels and training levels of different players and different avatars or protagonists.
  • a child may be enabled to compete evenly in a virtual basketball game against a protagonist having the ability of Michael Jordan, for example.
  • Scaling may also be used to provide positive feedback which encourages further efforts. For example, a person undergoing rehabilitation after an injury is likely to react positively to a large apparent result in virtual space to a physical effort that produces only a small movement. Such a person may thereby be encouraged to continue exercising and improving skills when he or she might otherwise become discouraged.
  • Scaling may be adjusted during an individual protocol, or during a series of protocols making up a training session. Such adjustments may be made in response to increased performance, for example due to acquisition of new skills, or decreased performance, for example due to fatigue or injury.
  • scaling may be integrated with the multiplayer systems described above so as to handicap one of the opponents relative to the other. This handicapping may be used to make competitive an encounter between two opponents of unequal skill, such as a parent and a child, or a fan and a trained athlete. Through scaling a wily, though physically less proficient, person, such as a coach, may more directly interact for teaching purposes with a more physically able student.
  • a multiplayer tennis match may be handicapped by providing one of the players with a higher net (which would be perceived only in that player's display).
  • a scaled lag may be added to slow down the apparent quickness of one of the players.
  • One player may have a maximum top speed for changes of position in the virtual space.
  • protocols may be created that are designed to lead a player or subject through a series of motions.
  • a protocol may be used to drill a subject on a skill, such as lateral motion or timed leaping ability.
  • Groups of protocols may be created that involve skills specific to a certain sport, the groups being selectable for playback as such by a user. For example, drills involving basketball skills or drills involving baseball skills may be grouped, allowing an athlete with a particular interest or in training for a specific sport to easily locate and playback drills for developing appropriate skills.
  • the invention allows modulation, over a continual range, of playback of stored protocols.
  • This modulation may be accomplished by the speed, amplitude, and/or direction of motion by an avatar or protagonist during playback of a protocol.
  • Such modulation may be used to tailor an exercise program to the abilities of an individual user. For example, a rehabilitating geriatric may be sufficiently challenged by playback of a given protocol at 20% of the speed it was recorded at. However, an elite healthy athlete may require playback of the same protocol at 140% of the speed it was recorded at.
  • User-specific modulation levels may be recorded for analysis of results and for recall for future training sessions of that user. As a user progresses the modulation of protocols may be changed to continue to provide the user with new challenges.
  • Playback of protocols may also be modulated during an individual protocol or series of protocols in response to user performance. For example, comparison of current performance to past performance may indicate that the user is ready to begin training at a new, higher level of performance - modulation of playback of protocols may be revised accordingly to provide a new challenge within that training session. Alternatively, modulation may be revised in response to decreased performance, for example due to fatigue or injury.
  • Modulation of the playback of stored protocols allows a single protocol to be used by subjects having different skill levels. Thus results for various training sessions of one user, and the results of various users of different skill levels, may readily be compared. Recordation of Protocols
  • a system 460 which is able to record protocols for later playback, is shown in Fig. 22.
  • a trainer or protocol creator 462 wearing a beacon or reflector 463 moves within a physical space 464, thereby creating a three dimensional contour pattern.
  • the motion of the trainer 462 is tracked by a tracking system 466 as described above.
  • the positional data output from the tacking system 466 is sent to a computer 470.
  • the computer 470 includes a storage device such as a floppy disk drive, a hard disk drive, a writeable optical drive, a tape drive, or the like. Alternatively, the storage device may be separate from the computer.
  • the storage device records the movement contours of the trainer 462 for later playback.
  • the position of the trainer 462 may also be represented on a display 472 by the location of an icon in a virtual space, thus providing feedback to the trainer regarding his or her movements.
  • Such recordation is preferably at a rate of at least 20 Hz, is more preferably at a rate of at least 50 Hz, and is even more preferably at a rate of 70 Hz.
  • the protocol so recorded by the system 460 may be played back, with the motion of an avatar following the recorded motion contour of the trainer 462.
  • the avatar following this recorded motion contour may be interacted with by a player or subject.
  • the player may be trained to emulate the trainer's movements by attempting to maintain synchronicity with the avatar's movements.
  • a measure of compliance may be made between the player's motions and the prerecorded motions of the trainer.
  • the system 480 may be used as follows: a) The protocol creator 462 dons the beacon 463 and "choreographs" a desired movement pattern while his or her positional changes over time are recorded. This recording represents the creator's movement contour pattern. b) A user attempts to follow (the synchronicity measurement construct), or somehow interacts with, the pre-recorded movement contour pattern at a selected playback rate. c) The user is provided with real time feedback as to his or her compliance. It will be appreciated that the recording feature of the system 480 may be used to record motions of a subject for later playback, for review and/or evaluation by the subject or by others.
  • beacons may be used to measure orientation of body of the player or subject. Measurement of orientation is useful in situations where an appropriate response to a stimulus may simply involve a twist or torque of the player's body. The ability to measure orientation is valuable in a number of respects.
  • Orientation may be used to increase fidelity of simulation. Display of an icon representing the player or subject may be altered depending upon the orientation of the player. In multiplayer simulations, representation of orientation imparts useful information to an opponent, since many maneuvers such as fakes and feints often mostly or totally involve changes in orientation as opposed to changes in position.
  • orientation is a part of posture
  • measurement and display of orientation is useful in training correct sports posture. Taking orientation into account in the display would provide better feedback to the player regarding his or her orientation.
  • Measurement of player orientation may be used in determining certain measurement parameters, such as reaction time and first step quickness.
  • Measurement of orientation allows for calculation of rotational accelerations. Rapid, properly timed accelerations of the body center (the hips) are essential in many sports for speed and power development. As is known from the martial arts, rapid twisting of the hips is essential for both effective movement and power generation. First step quickness may be redefined as an acceleration of the player's hips (translational or rotational) in the correct direction. Measurement of Upper Extremity Movements
  • a training system 480 that tracks movement of upper extremities (arms) of a player 482.
  • the player 482 wears a beacon or reflector 484 for tracking whole body motion, as is described for many of the embodiments above. Additionally, the player has an upper beacon or reflector 488 on each of his or her upper extremities 490.
  • the upper beacons 488 may be placed on the upper or lower arms, on the wrists, or on the hands, as desired.
  • a tracking and display system similar to those described above is used to track and display motion of the upper extremities and of the whole body.
  • Tracking of movement of upper extremities provides enhanced simulation in activities where movement of the upper extremities is important, such as boxing, tennis, handball, and activities that involve catching or using the hands to move an object.
  • measurements may be extracted related to the player's ability to react, initiate and coordinate his or her upper extremities.
  • the ability to quantify such performance is valuable for sports enhancement (football lineman, boxers, handball players, etc.) and physical medicine (rehabilitation of shoulder and elbow injuries, etc.).
  • Dynamic Reaction Time how quickly the hands respond to cues
  • Vector Acceleration magnitude of the acceleration of the hands/arms
  • Synchronicity ability of hands to follow interactive cues
  • Cardio- Vectors heart rate relationship to work performed by the hands.
  • the training system 480 may be modified to additionally or alternatively track the lower body extremities, as by use of lower beacons on the legs, feet, hips, etc. Movement Resistance It is desirable to provide tactile and force feedback provide for enhancement of a virtual reality experience, allowing a subject or player to experience forces simulating those of the activities simulated in virtual reality. For example, if a weight is lifted in the physical world, the subject feels a resistance to the movement (due to its weight).
  • a training system 500 is shown that includes means to provide physical resistance to movements of a player or subject 502.
  • the tracking and display components of the training system 500 are similar to those described further with respect other embodiments, and such description is not repeated for this embodiment.
  • the player 502 wears a belt 504 around his or her waist.
  • One end of each of one or more resistance devices 506 are attached to the belt.
  • the resistance devices 506 provide a force against which the player 502 must pull in order to move.
  • the resistance devices 506 are elastomeric or elastic bands which provide an opposing force as they are stretched.
  • the other end of the resistance devices 506 are attached to posts or stakes 510, which are preferably outside of the physical space 512 on a floor (as shown), or on a wall or ceiling. As shown in Fig. 23, the posts or stakes 510 may slide freely in slots 516 outside of the physical space 512.
  • the resistance devices 506 thus provide resistance to movement of the player 502. As the player moves within the physical space 512, one or more of the resistance devices 506 is stretched. This stretching produces a force on the player 502 opposing his or her motion. This opposing resistance acts to progressively overload the subject or player in each movement plane, thereby accelerating progress due to well-known principles of athletic training.
  • Suitable resistance devices include springs and gas-filled cylinders, as well as cords sold under the trademark SPORT CORDS.
  • resistance devices would be provided for all three planes of movement (X, Y, Z).
  • Resistance devices for providing resistance in the Y-direction may be anchored to the floor in the vicinity of the player. Anchors for the resistance devices may be recessed in the floor. It will be appreciated that resistance devices may be attached to the player at places other than the waist. For example, the resistance devices may be attached to lower and/or upper extremities to provide resistance to movement of specific parts of the body.
  • resistance devices with both ends attached to different parts of the body may be used.
  • Such a device may be attached, for example, from arm to leg, from upper arm to lower arm, from upper leg to lower leg, from head to arm, from arm to waist, or from arm to other arm.
  • the system 500 also allows quantification of the effects of added resistance both in real time and progressively over time.
  • the resistance devices may also be used to enhance the simulation by simulating the apparent conditions encountered by the virtual counterpart that the subject controls.
  • the resistance provided by the resistance devices may simulate the resistance the subject's counterpart experiences while treading through mud, snow, or waist deep water. With appropriate force feedback, the subject not only sees the forces acting on his or her counterpart, but actually "experiences" these forces in the physical world.
  • Such resistance may be provided by one or more actuators such as piston-cylinder assemblies, motors, etc., connected to the player, the force exerted by the actuator(s) being controlled by the system to provide for a force feedback to the player or a force consistent with the virtual reality in which the player exists.
  • the resistance devices may also be used to provide handicapping in multiplayer games, with levels of resistance chosen to compensate for differences in skill between the players.
  • the slide board is a widely used exercise apparatus which is used for conditioning and rehabilitation to help improve lateral movement, power, proprioception and endurance.
  • a typical slide board 520 has a flat, slippery sliding surface 524 with stops boards 528 and 530 on either end.
  • a user uses a foot to push off the stop board 528, for example, glides or slides across the sliding surface 524, and then changes direction by pushing off the stop board 530 with the other foot.
  • Slide boards are often used to simulate the physical demands of ice skating.
  • the ski simulation device 540 shown in Fig. 26.
  • the device 540 has a tension-loaded skate 542 that glides laterally across an arc-shaped platform 546.
  • the skate 542 has foot pads 550 thereupon for a user stand on.
  • the skate 542 moves from side to side and the device 540 rocks back and forth on a curved or arcuate surface 552 of the platform 546.
  • Such devices are used for improving balance, motor skills, endurance, and muscle tone for the lower body.
  • An example of such a device is one sold under the trademark PRO-FITTER.
  • the devices shown in Figs. 25 and 26 may be used in conjunction with the tracking and display systems described earlier.
  • a training and simulation system 560 is shown.
  • the system 560 has tracking and display components similar to those described earlier with regard to other embodiments.
  • a subject 562 interacts with an exercise device 564 which is within in a physical space 568.
  • the subject's movement is tracked and displayed.
  • the devices shown in Figs. 25 and 26 and described above are exemplary exercise devices. Such displaying may involve either first person or third person perspectives, both described above.
  • Measurement constructs such as the Dynamic Sports Posture construct described above may be used to analyze the movements of the subject 562.
  • a system such as the system 560 may be used to enhance the simulation of a sports experience by displaying appropriate surroundings while using the exercise device 564. For example moguls, tree branches, other skiers, etc. may be displayed during a skiing simulation. The speed of apparent movement in the displayed virtual space may be tied to the speed of movement of the subject. Reactive Power Training
  • Typical exercise programs incorporate two primary components — isolated limb/joint resistive training (strength training) and aerobic cardiovascular (CV) training. Though generally popular, such programs are considered inferior for those seeking improved functional or sport specific performance accompanied by substantial increases in lean body mass (more muscle).
  • the traditional strength training component of isolated joint/limb training component is designed to increase the amount of load that can be lifted, not to appreciably enhance the individual's ability to efficiently and, where required, explosively negotiate his or her environment. Strength training does not train the nervous system to efficiently work in conjunction with the muscle fibers to produce optimum functional performance.
  • Power training simply stated, is comprised of multiple, relatively brief bouts (periods)of high intensity exercise. For example, sprinters run at the fastest possible pace for a brief period of time — the result is significant muscle hypertrophy. By contrast, distance runners work at a sustainable pace, doing a nominal amount of work per unit of time. It is this specificity of training that produces the contrasting long, thin thigh muscles of the marathon runner and the highly defined, large muscles of the sprinter.
  • the training system 600 includes both reactive training devices 602 and strength training devices 604.
  • the reactive training devices 602 provide cues to a subject (also referred to as a user or player) to perform movements in response.
  • the reactive training devices may involve the subject attempting to mimic the movements of an avatar on a display screen.
  • the cues are provided for numerous movements over a short period of time.
  • the cues include prompts for numerous both planned and unplanned movement challenges.
  • cues will be to elicit movements that elevate the subject's heart rate to a desired target zone.
  • the cues may include auditory and/or visual cues.
  • the cues will preferably elicit movements in at least two dimensions. Examples of such two-dimensional movements include movement within a rectangular floor area, movement along a line combined with jumping, and movement along a line (such as by sliding) while maintaining a desired posture. It will be appreciated that there are many such other movements in at least two dimensions which may be cued by the reactive training device.
  • the reactive movements prompted by the reactive training devices may include training scenarios designed to enhance sports specific skills.
  • soccer skills may be enhance by engaging the user in a simulated soccer game.
  • the reactive training devices 602 each include a physical space 610 and a tracking and display system 612.
  • the tracking and display system 612 continually tracks the position of the subject during training.
  • the subject may wear a marker, such as a reflector, emitter, or beacon, the location of which is tracked by the reactive power device.
  • the marker may emit or transmit a signal which enables the reactive training system to identify a particular subject.
  • the marker may emit sound waves (either sonic or ultrasonic) or light waves (either visible or non-visible) that the reactive training system is able to associate with the particular subject.
  • sound waves either sonic or ultrasonic
  • light waves either visible or non-visible
  • a user may be able to interrupt a particular reactive training scenario after a bout of reactive training, with the reactive training device able to later "recognize" the user and continue the scenario from the point of interruption.
  • the recognition of a particular user may be used to call forth a reactive training scenario or sequence particular to that user.
  • the marker may emit or transmit other information, such as the heart rate of the wearer.
  • a heart monitor worn by the subject may have a separate telemetry system.
  • a user may be identified to a reactive training device by other means, such as by entry of identification number on a keypad or touch screen, or by insertion into the device of an object bearing indicia, such as a bar code or a magnetic medium, which identifies the user.
  • testing and training system embodiments described above are suitable for use as reactive training devices. Many of the features of the testing and training systems, such as providing real-time feedback to the subject or user, are desirable as well in the reactive training device.
  • the reactive training devices may provide real-time feedback to the subject during use of the reactive power training device.
  • the feedback may related to one or more of the constructs described above.
  • the feedback may be indicative of the subject's reactive power, with the feedback possibly including an indication of the subject's acceleration, velocity, or power.
  • suitable strength training devices include the Total Gym, Cybex or LifeFitness selectorized strength machines, BowFlex, free weight bars and dumbbells, pulleys, elastomeric cables, chin bars and the like.
  • the strength training devices are capable of training various of the user's muscles. For example, some of the strength training devices may be directed to working the upper body muscles, while others may be directed to working the lower body muscles.
  • the reactive power training system 600 includes a network administration computer 620 which is coupled to the reactive training devices 602 to form a network 622.
  • the network allows information received at the reactive training devices (such as identification information or performance information) to be stored in a storage device 624 that is part of the network administration computer 620.
  • This stored information may be accessed by any of the reactive training devices 602 in order to provide the user with cues appropriate for the user's desired exercises.
  • the stored information may be used to modulate the cues based on the user's progress within a training session and between sessions.
  • the network administration computer 620 includes a data entry device 626 for entering and/or updating information in the storage device 624.
  • Suitable data entry devices include keyboards, mice, touch screens, disk drives, and CD-ROM drives.
  • the strength training devices 604 may also be coupled to the network 622. Information about the strength training exercises performed (such as the number of repetitions, the weight, the distance traveled, and/or the setting of the machine) may thereby be transmitted to the storage device 624.
  • Information may also be sent along the network 622 to a suitable display included as part of each of the strength training devices 604.
  • a suitable display may be integrally incorporated with the rest of the strength training device.
  • the display may be in the vicinity of the strength training device, alongside the strength training device, for example.
  • the information sent may include the information regarding the exercises to be performed, and/or may include other information.
  • reactive power training system is preferably networked as described above, it will be appreciated that reactive power training system may in whole or in part non-networked. For example, information regarding the exercises performed on the strength training devices may be recorded manually, with the information later entered into the networked storage device.
  • a subject follows a training sequence which preferably alternates between 30 to 120 second bouts (periods) of exercise on reactive training devices 602, and resistive strength enhancing activities on the strength training devices 604. These highly stimulating, engaging training sessions can be completed in approximately 35 to 50 minutes. It is believed that resistive strength training prepares (fires up) the muscle fibers prior to reactive training to create a state where the neuromuscular system is most receptive to growth.
  • training system 600 transforms the strength and power developed through isolated joint/limb training into truly functional reactive power. It develops the type of CV fitness that leads to enhanced sports performance for sports demanding repetitive explosive movement. Further, it provides a time efficient, entertaining means of creating a well-defined, powerful physique.
  • the reactive training devices 602 direct the flow of tasks over each training session, and over a series of the user's training sessions. For example, after a suitably- timed bout of exercise on the reactive training device the user may be prompted to proceed to a specific strength training device. Such a prompt may be coupled with other information, for example information regarding the performance of the just- completed bout of exercise.
  • the network administration computer 620 may be programmed to direct users so that the strength training devices 604 are used efficiently.
  • the network administration computer may be programmed to send a user to a strength training machine which is currently unused, if the unused machine is part of that user's training sequence and has not yet been used by that user in the present training session.
  • a subject's overall performance fitness must be characterized by a number of performance variables. These variables may include measures of lower and/or upper body strength, aerobic or anaerobic endurance, speed or the like. Few of these measures share a common denominator that would allow comparison between all training components.
  • Reactive Power Training there is one variable that is descriptive of the exercise components that comprise the program.
  • This single variable, power is the common denominator that enable accurate assessment of the benefits a subject derives from both isolated limb strength training, as well as the benefits derived from sport specific movement training.
  • the present invention can quantify isolated limb power, which contributes to the ability to move with skill and power, as well as reactive power, which is the ability to actually move with skill and power.
  • the above-described reactive power training system is uniquely capable of measuring reactive power.
  • dynamic (reactive) power can be quantified.
  • this entails sport specific tasks, with the measurement location being the kinematic description of movements of the pelvis during execution within a computer simulation. Consequently, both isolated limb strength and power are quantified, as well as dynamic power.
  • Movement challenges created for the player by movement of the virtual; opponent or avatar may include many relatively short, discrete movement segments or legs. These segments may prompt movement amounting to only a few inches of movement of the player's center of mass. These segments may be without fixed start or end positions. However, start or end positions may be approximated, for example, by positions where the player changes direction, or by movement of the player a given distance away from a position where he or she was at rest.
  • the present invention includes calculation of performance values (based for example on the parameters described above) by continuously sampling positional changes in at least two planes of movement, and preferably in three planes of movement.
  • Fig. 30 shows a monitor or display 660 which provides feedback to a player (or user or subject) using a testing and training system such as those described above.
  • the monitor 660 may be similar to the monitor 28 described above.
  • the monitor 660 In addition to a view 662 of virtual space, the monitor 660 also displays parameter indications 664 of one or more parameters.
  • the parameter indications 664 display information related to performance parameters such as those described above.
  • the parameter indications may be useful in providing the above-described real time segmented feedback.
  • the relation to measured performance parameters may be direct, for example displaying an indication of the player's elevation.
  • the relationship between performance parameters and the displayed information may be more attenuated.
  • the displayed information may be of a derived or calculated parameter such as power. It may alternatively be of some "game score" which is an indication of one or more aspects of the player's performance.
  • the display of information in the parameter indications 664 is preferably graphical, although the information may additionally or alternatively be displayed in other ways, such as numerically. As shown, the information in each of the parameter indications 664 is represented graphically by changing the color of part of a displayed inverted triangle 670.
  • the scaling of the parameter indications 664 may be changeable, accommodating for example the differences expected in performance of different players, and the different movements expected in different types of testing and training scenarios.
  • the parameter indications 664 each include a flag 672 which provides an indication of the maximum value of the displayed parameter.
  • the flag for an indication of player elevation may display the maximum elevation of the player thus far.
  • This elevation information is an important parameter for posture training, training a player to maintained a crouched position, for example.
  • the elevation information is also useful, for example, for informing the player of his or her highest jump.
  • parameter indications need not include flags, and may include additional flags. It will be further be appreciated that the flags may be used for a wide variety of other purposes, for example showing minimum parameter values.
  • the parameter indications 664 are preferably updated in real time, in order to provide the player with timely feedback on performance.
  • the monitor 660 also displays a heart indication 678 which indicates the heart rate of the player.
  • the heart indication may be graphical or numerical, and may include an auditory signal, such as the simulated sound of a beating heart.
  • the heart rate of the player may be measured and transmitted for display using a heart monitor such as that described above.
  • Learning Task Implementation Tracking and display systems such as those described above may be employed for use in kinesthetic educational learning tasks. As mentioned earlier, some learners benefit from education utilizing kinesthetic processes, and it is expected that brain development is enhanced by simultaneously engaging different cognitive functions simultaneously. In addition, it is expected that learning may be enhanced by increases in the student's metabolic rate, such as increases in metabolic rate that result from the student's execution of learning task(s).
  • Such increased metabolic rate may be due to an increase in the body's need, and subsequent delivery of, oxygen to support the production of energy in the body. It will be appreciated that increased metabolic rate due to increased activity can result in increased alertness. Thus increasing metabolic rate in a student can enhance a learning activity. However, numerous other factors — some as yet unidentified — for the observed enhanced learning state may be contributing.
  • the education system 700 includes a tracking system 702 for tracking a student 704 (also referred to herein as a "subject” or "person”) as he or she moves in a defined physical space 708.
  • the tracking system 702 is operatively coupled to a display 710 which displays information that prompts the subject 704 to engage in a cognitive learning task.
  • Cognitive learning is defined as learning which involves the attainment of abstract information which has general applicability outside of the learning task. Such information includes, for example, academic or scholastic material traditionally taught in schools. Examples of such academic information include multiplication tables and the content and order of the alphabet. "Cognitive learning” as used herein also includes learning other information, such as the steps of an industrial process. Cognitive learning broadly embraces learning involving mental concepts or skills, or speculative knowledge, which can be abstracted from the physical world and which has general applicability outside of the learning task.
  • the education system 700 prompts the student 704 to engage in full-body movement so as to raise his or her metabolic rate.
  • a reflector or beacon 712 which may be similar to the reflector or beacon 38 described above, is provided on the subject or student 704 to enable the tracking system 702 to track him or her. This tracking allows the student's position within the physical space 708 to be monitored. Preferably the tracking is in three dimensions, as described above with respect to other embodiments.
  • the display and task may involve updating in real time a view of a virtual space, the updating being made in response to movements of the student or subject 704 within the physical space 708.
  • the task may involve displaying cognitive learning elements, such as elements 716 and 718, on the display 710 for viewing by the subject 704.
  • the task may also involve movement through the virtual space of a student icon 720 representing the subject or student 704. In the illustrated example movement of the student 704 within the physical space 708 causes movement of the corresponding student icon 720 within the virtual space displayed on the display 710.
  • the exemplary cognitive learning task in the illustrated embodiment involves the solving of arithmetic problems.
  • the equation to be solved is shown as the cognitive element 716.
  • the cognitive elements 718 are manipulable virtual objects bearing representation of possible solutions of the equation. These cognitive elements 716 are shown as positioned at various points in the virtual space, the positions in virtual space corresponding to positions in the physical space 708.
  • the student 704 is able to manipulate one of the cognitive elements 718 within the virtual space by moving to a position in the physical space which corresponds to the position of the object in the virtual space.
  • a change in the virtual location of the sensor 712 caused by a change in posture of the student 704, for example crouching or bending down, may be used as a signal for the system to display the student icon 720 as picking up the nearby cognitive element 718.
  • the student 704 may then attempt to "solve” the equation by inserting the picked up cognitive element into the equation, in the virtual space. This may be accomplished for example, by moving to a location in the physical space 708 that corresponds to a preselected location in the virtual space, and/or by making a predetermined change in posture, for example by jumping.
  • the educational system may be used to teach fundamental skills, such as the alphabet, colors, numbers, vocabulary, shapes and spatial relationships. More complicated information, such as math concepts, language and sentence structure, geography, and musical principles may also be taught using the system.
  • the virtual environment may be represented as a traditional schoolroom or playground, for example, depicting objects and conditions associated with that environment, such as a chalk board or swing set, that serve as programmatic references or potentially active areas for activity selection and control.
  • the virtual environment may also depict real or abstract environments, for example historical locations or maps, that transmit information that is to be learned by the student 704.
  • the learning task described herein is progressive.
  • an educational game's primary goal is object recognition.
  • the virtual environment depicts a playroom backdrop with familiar static objects, such as a bookcase, desk, and a centrally-positioned toy box.
  • the student's viewing perspective for this environment, including his/her perceived distance from the objects, is chosen to evoke a sense of spaciousness and volume.
  • the student's two- dimensional icon in the virtual environment may be, for example, an animated stuffed figure able to move within the confines of the area surrounding the toy box.
  • a teacher avatar visually and/or audibly instructs the student to return a specific one of the toy objects to the toy box.
  • This instruction may involve, for example, stating the name of the object or showing a pictorial representation of the object.
  • the student directs movements of his/her icon to the correct horizontal position of the requested toy object by moving his/her position in the physical space in the real world.
  • the real world movements are mapped to movements in the virtual world or environment, but are scaled to fit the view of the display.
  • the student's icon may be represented as grabbing the toy when the student's icon is sufficiently close to the virtual toy object, and when the student for example sufficiently lowers his/her vertical body position.
  • This lowering of vertical body position may be represented in the display by an animation sequence which shows the icon performing a proper kneeling down technique.
  • the education system may combine informational learning with physical training by for example examining the position, velocity and acceleration of downward movement to data for a similar type of movement accomplished with proper technique.
  • the student may be required, for example, to repeat such a physical movement if it is not sufficiently close to the proper technique for such a movement.
  • the toy object When the student rises from the lowered body position, the toy object is displayed as being in the student icon's hands. Once the student icon possesses the toy, the student moves toward the toy box. When the student icon reaches the toy box, the toy is released into the toy box. The teacher avatar may then voice a congratulatory response and identify the next toy object to be retrieved.
  • the game score for such an activity may be based, for example, on correct identification of the toy objects and the time required to complete the activity.
  • the educational task may thus involve use of characters or avatars in the virtual environment which instruct or otherwise interact with the student and/or his/her icon. Cues or other feedback to the student regarding movements within the virtual environment or performance of the task may be auditory and/or visual.
  • performance criteria such as those described in detail above with regard to other embodiments of the invention, may be used to quantify movement of the student while performing the educational task.
  • a number of factors may be responsible for the enhanced ability to learn while the metabolism is elevated. For example, physical activities that elevate the metabolism increase blood flow to the brain and increase core body temperature. As blood flow is increased, hemoglobin releases oxygen more readily at higher temperatures. Additionally, facilitative nerve transmission also may occur at the higher core body temperatures caused by higher metabolic rates, thereby potentially assisting in improving reaction time.
  • the increased metabolic rate is achieved by physical movements which are part of the educational task.
  • the education system 700 preferably involves activities which integrate the body (by physical activity), the mind (by cognitive learning), and the spirit (by entertaining, engaging experiences).
  • the educational activities may be wholly or in part uncoupled from the physical activities which raise the metabolic rate.
  • a metabolic rate monitor 730 may be used to monitor the metabolic rate of the student 704.
  • Information from the metabolic rate monitor may be used to adjust the educational task to maintain the student's metabolic rate at a desired elevated level. For example, the pace of an educational task may be speeded up or slowed down to raise or lower the student's metabolic rate. It will be appreciated that other aspects of the educational task or challenge may be modified to make it more or less physically demanding, as required to maintain the desired elevation of metabolic rate.
  • An exemplary metabolic rate monitor is a heart rate monitor. It will be appreciated, however, that the practice of measuring heart rate to determine aerobic exercise intensity relies on the assumption that metabolic rate and heart rate are related. As noted above, several conditions may contribute to an increased heart rate which is not directly related to a proportional increase in metabolic rate or oxygen consumption. Anxiety and unresisted arm movement are two examples. Therefore the use of a heart rate monitor as a metabolic rate sensor is connected to the use of core body movements to raise the metabolic rate, as described above. The heart rate monitor may be the same or similar to that as described above with regard to earlier embodiments. Educational Game Implementation
  • the database is comprised of graphical objects, surface textures, view properties, and lighting management description that together creates familiar cueing regularly employed by current educational computer games.
  • the virtual environment may be represented as a traditional school room or playground, depicting objects and conditions associated with that environment, such as a chalkboard or swing set, that serve as programmatic reference or potentially active screen areas for activity selection and control.
  • the choice of virtual environment is not limited in scope according to real-world possibilities, but may depict fantasy places or historical locations. Regardless of thematic content, the virtual environment serves to promote and coordinate the desired learning objectives, while maintaining a consistent and suitable presentation for the intended student's age level.
  • the animation sequences are created using Autodesk 3D Studio or similar industry-standard animation design tool.
  • the 2D surfaces are created using JASC Paint Shop Pro or similar industry-standard graphics design tool.
  • the animation sequences may include a primary character or avatar that instructs the student on game play by demonstrating proper body movement and positioning. Or the animation sequences may be less interactive and secondary to the primary educational task, such as scrolling performance report cards on progress, or inanimate objects that "come alive" and perform brief and amusing monologues and actions as a personification of its intended educational function.
  • a suitable 2D and 3D graphics engine is required to facilitate this control, such as Image Space, Inc.'s CUBE Technology or similar industry-standard 3D graphics engines.
  • the suitable 3D graphics engine implementation is fully optimized in Pentium and Pentium MMX 32-bit mode, for both Win32 and extended DOS environments.
  • the suitable 3D graphics engine is capable of 6 degree-of-freedom polygon-based 3D graphics rendering, providing both texture- mapped and solid-color rendering, and supports the latest 3D graphics acceleration hardware, including Real3D StarFighter AGP or compatible manufacturer.
  • the suitable 2D graphics engine implementation supports full-functionality BITBLT in supported video modes for both Win32/Direct X and extended DOS environments.
  • CUBE Technology offers a library of functions characteristic of a 3D graphics engine for the application design, in the form of a proprietary application programming interface (API).
  • API application programming interface
  • the application program is designed utilizing Microsoft Visual Studio C/C++ development environment or similar industry- standard C/C++ development tools.
  • the application program describes the methods in which the graphical 2D/3D environment database is loaded and manipulated, including animation and light management, graphical object instantiation and control, view port settings, sound effects, frame buffer control, bitmaps and texture maps location, etc.
  • TRAZER's proprietary API is fully supported and integrated into the programmatic control of the game and/or kinematic control of the graphical object(s) representing the student within the virtual environment.
  • TRAZER reports the student's real world position coordinates, which the game's program reinterprets as screen coordinates associated to a particular graphical object or group of objects.
  • TRAZER numerically derives the student's instantaneous velocity and acceleration components of movement that are used by the game to ascertain certain performance criteria required by a specific type of movement. For example, the game may require the student move continuously from starting location to end location without hesitation. Simply measuring total distance between starting and end location and transit time to derive speed would not convey subtle details regarding body position along the movement path. The student may have abruptly accelerated towards his/her target, but then briefly stopped then started again due to lack of confidence or indecision. Another student may have quickly moved along a more convoluted, zig-zag path towards his/her target. And a third student may have less quickly followed the ideal straight line path to the target. In all examples, a simple speed calculation may have shown the same results, betraying the obvious differences in technique and ability. TRAZER's instantaneous velocity and acceleration measurements allow the game to more accurately evaluate movement technique when proper technique is crucial to satisfy the game's objectives.
  • the primary programming task is to utilize the CUBE and TRAZER's APIs library functions within the application to cause the student to move in a prescribed manner through visual and auditory feedback in order to successfully achieve a certain educational objective.
  • an educational game's primary goal is object recognition.
  • the virtual environment is designed that depicts a playroom backdrop with familiar static objects, such as a bookcase, desk, and a centrally positioned toy box.
  • the student's viewing perspective of this environment including his/her perceived distance from objects, is defined to evoke a sense of spaciousness and volume.
  • the student's 2D avatar is represented in this virtual environment as an animated stuffed figure that can move within the confines of the area surrounding the toy box. Since the student's viewing perspective does not allow visual examination of his/her avatar from the side or top, a 3D animation is unnecessary.
  • a random number of 2D toys are momentarily animated and escape from the toy box by bounding out and skipping to various locations on the floor.
  • a teacher avatar visually and/or audibly presents a copy of the toy object that the student should find and return to the toy box as quickly as possible.
  • the student directs the movements of his/her avatar to the correct horizontal position of the requested toy by moving his/her position in the real world.
  • the real world movements are mapped in the same Cartesian axis orientation as in the virtual world, but scaled to fit the smaller view port of the video screen.
  • the program compares the convergence of the toy and student's avatar horizontal plane coordinates and indicates correct positioning by employing a different avatar and/or toy animation sequence.
  • the student's avatar grabs the toy when the student sufficiently lowers his/her vertical body position, which action the program interprets as a correct response and changes the student's avatar animation sequence to demonstrate the proper kneeling down technique.
  • the program examines the position, velocity, and acceleration of downward movement by real time comparison to a stored template file consisting of sequential time slices of position, velocity, and acceleration data of the same technique performed correctly.
  • the program qualifies the technique using a windowed difference threshold comparison on sample-by-sample basis. A tolerance violation requires the student to repeat the movement to continue.
  • the original toy animation is removed from the screen and now the student's avatar displays the toy in hand.
  • the student moves towards the toy box.
  • the toy is released into the toy box.
  • the teacher avatar voices a congratulatory response and presents the next toy.
  • the game proceeds until all the toys have been returned to the toy box.
  • a score is awarded based on correct identification of the toys and time to complete the activity.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Physics & Mathematics (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biomedical Technology (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Educational Technology (AREA)
  • Business, Economics & Management (AREA)
  • Developmental Disabilities (AREA)
  • Child & Adolescent Psychology (AREA)
  • General Physics & Mathematics (AREA)
  • Psychology (AREA)
  • Educational Administration (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychiatry (AREA)
  • Theoretical Computer Science (AREA)
  • Social Psychology (AREA)
  • Physiology (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • Processing Or Creating Images (AREA)

Abstract

La présente invention concerne un système d'éducation comprenant un système de suivi en vue de déterminer les changements dans l'environnement physique global d'un étudiant, et un écran d'affichage pour présenter mots d'ordre pour que l'étudiant se livre à des mouvements corporels complets et s'engage dans une tâche d'apprentissage cognitif interactif. L'invention concerne également un procédé d'apprentissage qui consiste a inciter un étudiant à s'engager dans une tâche d'apprentissage cognitif interactif impliquant des mouvements corporels complets, permettant ainsi à l'étudiant d'atteindre une disposition améliorée à l'apprentissage qui résulte d'un taux métabolique élevé, et une mise en oeuvre synergique des aptitudes kinesthésiques d'apprentissage de l'étudiant.
PCT/US2000/041390 1999-10-20 2000-10-20 Systeme d'education sollicitant les systemes physiologiques et kinesthesique d'un sujet afin d'ameliorer la fonction cognitive de façon synergique WO2001029799A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/128,394 US6749432B2 (en) 1999-10-20 2002-04-22 Education system challenging a subject's physiologic and kinesthetic systems to synergistically enhance cognitive function

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16057199P 1999-10-20 1999-10-20
US60/160,571 1999-10-20

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US10/128,394 Continuation US6749432B2 (en) 1999-10-20 2002-04-22 Education system challenging a subject's physiologic and kinesthetic systems to synergistically enhance cognitive function

Publications (2)

Publication Number Publication Date
WO2001029799A2 true WO2001029799A2 (fr) 2001-04-26
WO2001029799A3 WO2001029799A3 (fr) 2002-01-03

Family

ID=22577441

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/041390 WO2001029799A2 (fr) 1999-10-20 2000-10-20 Systeme d'education sollicitant les systemes physiologiques et kinesthesique d'un sujet afin d'ameliorer la fonction cognitive de façon synergique

Country Status (1)

Country Link
WO (1) WO2001029799A2 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1912558A2 (fr) * 2005-07-26 2008-04-23 Vivometrics, Inc. Interfaces informatiques comportant des avatars guides physiologiquement
EP3113682A1 (fr) * 2014-03-06 2017-01-11 Virtual Reality Medical Applications, Inc. Système d'application médicale de réalité virtuelle
EP3061244A4 (fr) * 2013-10-25 2017-11-22 The Children's Hospital of Philadelphia Appareil et procédés de test de la fonction visuelle et de la vision fonctionnelle à différents niveaux de luminance

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998007129A1 (fr) * 1996-08-14 1998-02-19 Latypov Nurakhmed Nurislamovic Procede de suivi et de representation de la position et de l'orientation d'un sujet dans l'espace, procede de presentation d'un espace virtuel a ce sujet, et systemes de mise en oeuvre de ces procedes
WO1999044698A2 (fr) * 1998-03-03 1999-09-10 Arena, Inc. Dispositif et technique de suivi et d'estimation de la dexterite de mouvements dans un espace pluridimensionnel

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998007129A1 (fr) * 1996-08-14 1998-02-19 Latypov Nurakhmed Nurislamovic Procede de suivi et de representation de la position et de l'orientation d'un sujet dans l'espace, procede de presentation d'un espace virtuel a ce sujet, et systemes de mise en oeuvre de ces procedes
WO1999044698A2 (fr) * 1998-03-03 1999-09-10 Arena, Inc. Dispositif et technique de suivi et d'estimation de la dexterite de mouvements dans un espace pluridimensionnel

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1912558A2 (fr) * 2005-07-26 2008-04-23 Vivometrics, Inc. Interfaces informatiques comportant des avatars guides physiologiquement
EP1912558A4 (fr) * 2005-07-26 2010-01-20 Vivometrics Inc Interfaces informatiques comportant des avatars guides physiologiquement
EP2484276A3 (fr) * 2005-07-26 2012-08-29 adidas AG Interfaces d'ordinateur comprenant des avatars guidés physiologiquement
EP2484278A3 (fr) * 2005-07-26 2012-08-29 adidas AG Interfaces d'ordinateur comprenant des avatars guidés physiologiquement
EP2484277A3 (fr) * 2005-07-26 2012-08-29 adidas AG Interfaces d'ordinateur comprenant des avatars guidés physiologiquement
US8790255B2 (en) 2005-07-26 2014-07-29 Adidas Ag Computer interfaces including physiologically guided avatars
EP3061244A4 (fr) * 2013-10-25 2017-11-22 The Children's Hospital of Philadelphia Appareil et procédés de test de la fonction visuelle et de la vision fonctionnelle à différents niveaux de luminance
US10448823B2 (en) 2013-10-25 2019-10-22 The Children's Hospital Of Philadelphia Apparatus and methods for testing visual function and functional vision at varying luminance levels
EP3113682A1 (fr) * 2014-03-06 2017-01-11 Virtual Reality Medical Applications, Inc. Système d'application médicale de réalité virtuelle
EP3113682A4 (fr) * 2014-03-06 2017-03-29 Virtual Reality Medical Applications, Inc. Système d'application médicale de réalité virtuelle
US10220181B2 (en) 2014-03-06 2019-03-05 Virtual Reality Medical Applications, Inc Virtual reality medical application system
US10286179B2 (en) 2014-03-06 2019-05-14 Virtual Reality Medical Applications, Inc Virtual reality medical application system

Also Published As

Publication number Publication date
WO2001029799A3 (fr) 2002-01-03

Similar Documents

Publication Publication Date Title
US6749432B2 (en) Education system challenging a subject's physiologic and kinesthetic systems to synergistically enhance cognitive function
US8861091B2 (en) System and method for tracking and assessing movement skills in multidimensional space
US6308565B1 (en) System and method for tracking and assessing movement skills in multidimensional space
WO1999044698A2 (fr) Dispositif et technique de suivi et d'estimation de la dexterite de mouvements dans un espace pluridimensionnel
US20240157197A1 (en) Method and system for human motion analysis and instruction
US6073489A (en) Testing and training system for assessing the ability of a player to complete a task
Akbaş et al. Application of virtual reality in competitive athletes–a review
US9878206B2 (en) Method for interactive training and analysis
Hughes et al. Notational analysis of sport: Systems for better coaching and performance in sport
US6183259B1 (en) Simulated training method using processing system images, idiosyncratically controlled in a simulated environment
CN104661713B (zh) 互动认知的多感官交互设备与方法来评估、分析、培训和/或提高运动员和其他人群的运动能力
US6722888B1 (en) Method and apparatus for tutorial, self and assisted instruction directed to simulated preparation, training and competitive play and entertainment
US6098458A (en) Testing and training system for assessing movement and agility skills without a confining field
US7864168B2 (en) Virtual reality movement system
WO1997017598A9 (fr) Dispositif de surveillance ininterrompue d'une activite physique lors de mouvements non assujettis a des restrictions
US20110270135A1 (en) Augmented reality for testing and training of human performance
US20090300551A1 (en) Interactive physical activity and information-imparting system and method
KR20070095407A (ko) 운동동작의 분석 및 지도를 위한 방법 및 시스템
WO2001029799A2 (fr) Systeme d'education sollicitant les systemes physiologiques et kinesthesique d'un sujet afin d'ameliorer la fonction cognitive de façon synergique
Simon Investigating the Use of Augmented Reality to Enhance the Indoor Running Experience on a Treadmill
Dametto A classification of sport simulators
Qu et al. Digital Teaching Platform for Middle School Physical Education: Case Study on Tennis Lesson
Li et al. Sports Skill Analysis
WO2001009861A2 (fr) Procede et systeme d'entrainement interactif au mouvement et interface utilisateur utilisee a cet effet
Fitzgerald et al. Integration of kinematic analysis into computer games for exercise

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): CA JP US

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): CA JP US

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP