WO2023097304A1 - Système et procédé de mesure de performances lors d'une activité - Google Patents

Système et procédé de mesure de performances lors d'une activité Download PDF

Info

Publication number
WO2023097304A1
WO2023097304A1 PCT/US2022/080462 US2022080462W WO2023097304A1 WO 2023097304 A1 WO2023097304 A1 WO 2023097304A1 US 2022080462 W US2022080462 W US 2022080462W WO 2023097304 A1 WO2023097304 A1 WO 2023097304A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
motion
subject
images
combination
Prior art date
Application number
PCT/US2022/080462
Other languages
English (en)
Inventor
Yiming Li
Tie Li
Gang G XU
Original Assignee
Dreamsports Technology Development (Beijing) Co., Ltd.
Centrra Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dreamsports Technology Development (Beijing) Co., Ltd., Centrra Llc filed Critical Dreamsports Technology Development (Beijing) Co., Ltd.
Publication of WO2023097304A1 publication Critical patent/WO2023097304A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1079—Measuring physical dimensions, e.g. size of the entire body or parts thereof using optical or photographic means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1113—Local tracking of patients, e.g. in a hospital or private home
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1121—Determining geometric values, e.g. centre of rotation or angular range of movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
    • A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using image analysis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/45—For evaluating or diagnosing the musculoskeletal system or teeth
    • A61B5/4538—Evaluating a particular part of the muscoloskeletal system or a particular medical condition
    • A61B5/4561—Evaluating static posture, e.g. undesirable back curvature
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4866—Evaluating metabolism
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6898—Portable consumer electronic devices, e.g. music players, telephones, tablet computers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/743—Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/7435—Displaying user selection data, e.g. icons in a graphical user interface
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/744—Displaying an avatar, e.g. an animated cartoon character
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00—Evaluating a particular growth phase or type of persons or animals
    • A61B2503/10—Athletes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
    • A61B2560/02—Operational features
    • A61B2560/0223—Operational features of calibration, e.g. protocols for calibrating sensors
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/021—Measuring pressure in heart or blood vessels
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1118—Determining activity level
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30221—Sports video; Sports image

Definitions

  • the present disclosure is directed to a system for producing an evaluation report of one or more athletes performing an activity, such as a sport activity.
  • the present disclosure is also directed to a use of the system, such as in personal exercise, physical education and examination, sports education, athlete training, sports competition and other areas.
  • U.S. Patent Nos. 6,013,007, 8,172,722, 8,573,982 and 8,616,989 use specific devices affixed to a person, such as an athlete, to track and record the movements and assess the performance.
  • U.S. Patent Publication No. 20090319230A1 discloses the use of Global Position System (GPS) to track terrain and speed of athletes.
  • U.S. Patent Publication No. 20120130515A1 discloses a method for rating the performances of one or two athletes by measuring limited parameters, such jump heights, cycle time and distances. These methods all required specific devices and limited to certain sports.
  • This invention is directed to a method for producing an evaluation report of at least a subject performing an activity, the method comprising: capturing motion images of the subject performing the activity using an imaging device; producing motion data based on the motion images, wherein the motion data comprises timing data, horizontal motion data, vertical motion data, posture data, mode data, or a combination thereof, of the subject performing the activity measured from the motion images; producing calorie data of the activity of the subject based on the motion data; and producing the evaluation report based on the motion data and the calorie data and outputting the evaluation report to an output device; wherein, the motion images are captured when the imaging device is free from direct contact with the subject.
  • This disclosure is also directed to a system for producing an evaluation report of at least a subject performing an activity, the system comprising: an imaging device for capturing motion images of the subject performing the activity; a data processing device functionally coupled to the imaging device configured to receive the motion images; a data output device functionally coupled to the imaging device and the data processing device; and a non- transitory data storage device functionally coupled to or accessible from the imaging device, the data processing device, and the data output device, the non-transitory data storage device comprises computer readable codes stored therein, when executed, configured to cause the imaging device capturing the motion images, to cause the data processing device receiving the motion images from the imaging device, producing the motion data based on the motion images, wherein the motion data comprises timing data, horizontal motion data, vertical motion data, posture data, mode data, or a combination thereof, of the subject performing the activity measured from the motion images, producing calorie data of the activity of the subject based on the motion data; and producing the evaluation report based on the motion data and the calorie data; wherein, the
  • FIG. 1A-FIG 1C Representative examples of a system of this invention.
  • FIG.1 A an example of the system.
  • FIG. 1 B a part of a representative example of this invention.
  • FGI. 1 C a representative illustration of a part of the system.
  • FIG. 2A-FIG. 2G Additional examples of the system of this invention.
  • FIG. 2A an example of the system showing an image of a subject.
  • FIG.2B an example of the system showing a motion image of a subject.
  • FIG. 2C an example of the system with a stand.
  • FIG. 2D an example of the system with a tripod.
  • FIG. 2E an example of the system with an additional display device.
  • FIG. 2F an example of the system with a drone.
  • FIG. 2G an example of the system with an additional display device that is movable and has wired or wireless connection.
  • FIG. 3 An example of a display and graphical user interface (GUI) of the system of this invention.
  • GUI graphical user interface
  • FIG. 4 An example of a display of the system of this invention with motion image from a video feed captured from an imaging device.
  • FIG. 5A-FIG. 5D Examples of the use of the system.
  • FIG. 5A an example of multiple systems of this invention placed in a field and track sports facility.
  • FIG. 5B an example of multiple systems of this invention placed in a field and track sports facility with an alternate configuration.
  • FIG. 50 an example of multiple systems of this invention placed in an indoor facility.
  • FIG. 5D an example of a portable device of the system of this invention for personal exercise.
  • FIG. 5E and FIG. 5F Schematic illustrations of additional set up and use of the system.
  • FIG. 6A-FIG. 6B Examples of adjustments of the system placement.
  • FIG. 6A an example of a graphical user interface (GUI) at the beginning of adjusting placement of the system.
  • FIG. 6B an example of a graphical user interface (GUI) at the completion of adjusting placement of the system.
  • GUI graphical user interface
  • FIG. 7A-FIG. 7B Examples of images of a sport activity.
  • FIG. 7A a representative image showing a frontal view of a subject.
  • FIG. 7B a representative image showing a back view of the subject.
  • FIG. 8 A representative example of images and analysis of a long jump sport activity.
  • FIG. 9 An example of a wireless network connecting multiple systems, devices and remote computing devices.
  • FIG. 10 An example of a representative display and a graphical user interface (GUI) of an evaluation report displayed on a display device.
  • GUI graphical user interface
  • FIG. 11 An example of a representative system having a flat screen display and a set of cameras showing captured images including video images of a subject performing activities. The images are displayed to be visible to the subject.
  • FIG. 12 An example of schematic representations on the measurement of horizontal distances (Lh) and vertical motion data that can comprise the sum of vertical distances (L v ).
  • FIG. 13 An example of a representative display and a graphical user interface (GUI) of an evaluation report displayed on a flat screen display device.
  • the flat screen can be a touch screen.
  • FIG. 14 A representative example of a screen shot of a video captured with schematic illustration of the measurement of vertical distances (L v ) and the sum of vertical distances (Lv).
  • FIG. 15A - FIG. 15B Representative evaluation reports.
  • FIG. 15A A sample report showing successful performance.
  • FIG. 15B A sample report showing a failed action.
  • FIG. 16A - FIG. 16B Representative examples of multiple subject measurement.
  • FIG. 16A A schematic representative example of a set-up for multiple subject measurement.
  • FIG. 16B A representative example of a screen shot of a report.
  • FIG. 17 A representative example of multiple subject measurement with real time display.
  • FIG. 18 A representative example of posture and spine cord measurement.
  • FIG. 19 A representative example of multiple subject posture measurement and report.
  • FIG. 20A - FIG. 20B Representative illustrations of mode evaluation set-up.
  • FIG. 20A Facial image capture.
  • FIG. 20B Representative facial analysis.
  • this invention is directed to a system for producing an evaluation report of at least a subject performing an activity, the system comprising:
  • the motion images are captured when the imaging device is free from direct contact with the subject; and [36] wherein, the imaging device, the data processing device and the data output device are configured into a single unit mobile device.
  • the subject can be free from wearing an electromagnetic tracking device.
  • the system of this invention can produce an evaluation report of a subject performing an activity without having to affix any electromagnetic tracking devices to the subject.
  • the data processing device can process the motion images and producing the motion data in real time.
  • real time refers to a same time or substantially the same time, meaning that the motion data is produced at the same time or substantially the same time as the motion images are captured.
  • the data processing device can process the motion images and producing the motion data while the motion images are being acquired in one example, within a range of from 0.0001 second to 30 minutes in another example, 0.0001 second to 10 minutes in yet another example, 0.0001 second to 5 minutes in yet another example, 0.0001 second to 2 minutes in yet another, 0.0001 second to 1 minute in yet another example, 0.0001 second to 30 seconds in yet another example, 0.0001 second to 10 seconds in yet another example, 0.0001 second to 30 seconds in yet another example, 0.0001 second to 10 seconds in yet another example, 0.0001 second to 5 seconds in yet another example, 0.0001 second to 1 second in yet another example, 0.0001 second to 0.5 second in yet another example, 0.0001 second to 0.1 second in yet another example, 0.0001 second to 0.01 second in yet another example, and 0.0001 second to 0.001 second in yet another example, after the motion images are acquired.
  • the motion images can be captured in a digital form. Any current digital forms or any digital forms developed later that can be recorded, read, processed, displayed by a computing device, a digital processing device, a digital display device, a computer program or software, or a combination thereof, can be suitable.
  • the motion images can comprise pixels reflecting the motions, vector data, or a combination thereof.
  • Examples of digital forms can include JPEG/JFIF, JPEG 2000, Exit, TIFF, GIF, BMP, PNG, PPM, PGM, PBM, PNM, WebP, HDR formats, HDR raster formats, HEIF, BAT, container formats for graphics editors, such as metafile intermediate formats that are portable formats which can include both raster and vector information, WMF, EME, EMF, page description language that contain text, objects and images such as PostScript, PDF and PCL, BPG (Better Portable Graphics), EXIF, DEEP (IFF-style format used by TVPaint), DRW (Drawn File), ECW (Enhanced Compression Wavelet), FITS (Flexible Image Transport System), FLIF (Free Lossless Image Format), lossless WebP, lossless BPG and lossless JPEG2000, ICO, ILBM, IMG (ERDAS IMAGINE Image), IMG (Graphics Environment Manager (GEM) image file), JPEG XR (New JPEG standard based
  • the system of this invention can further comprise a display device for displaying the motion images, the stored standard data, the reference motion data, the motion valuation data, the evaluation report, or a combination thereof.
  • motion images such as a person who is playing a basketball can be displayed on a display device.
  • a standard data such as a person demonstrating the movements of Tai Chi can be displayed on a display device.
  • video images of a coach demonstrating tennis play movement can be displayed on a display device.
  • the system of this invention can comprise a display device that displays a combination of motion images of the subject and reference data comprising reference images, standard data comprising standard images, at the same time, on separate areas of the display device, or superimposed together.
  • the display device displays the motion images that are superimposed with reference images.
  • the standard images and the reference images can be stored images, such as stored video images, real time images such as a student’s motion images superimposed with a references images of a teacher performing the same actions at the same time.
  • the motion images can be configured to be displayed visible to the subject in real time on a display device. In some cases, the motion images can be configured to be displayed visible to the subject and superimposed with reference images in real time on a display device. In some cases, an evaluation report can be produced based on differences between the motion images of the subject and the reference images. In some cases, a lower evaluation score can be produced when significant differences between the motion images of the subject and the reference images are obtained. In some cases, a higher evaluation score can be produced when the motion images of the subject and the reference images are the same or significantly similar. In some cases, motion images of a person performing Tai Chi can be superimposed with a standard Tai Chi reference images and a high score can be produced in the evaluation report when the motion images of the person are substantially overlapping with the reference images meaning a good performance.
  • the system can be configured to receive weight data of the subject from the data input device and wherein the calorie data can be produced based on the motion data and further based on the weight data, and wherein the evaluation report can further comprise the weight data.
  • the system of this invention can comprise an imaging device, a data processing device and a data output device that are configured into a single unit mobile device.
  • the system can comprise a robot device.
  • the system can comprise a smart phone.
  • the system can comprise a laptop computing device.
  • the system can comprise a flat panel computing device, such as an iPad or a similar device.
  • the system can comprise a flat screen TV.
  • the system can comprise a flat screen TV equipped with a front camera and a rear camera.
  • the system can comprise a flat screen TV equipped with a front camera, a rear camera and one or more wireless communication devices.
  • the system can comprise a flat screen TV equipped with a front camera, a rear camera, one or more wireless communication devices.
  • the system can comprise a flat screen TV equipped with a front camera, a rear camera, one or more wireless communication devices and one or more audio capturing devices, such as one or more microphones for recording sounds.
  • the system of this invention can comprise a graphical user interface (GUI) functionally coupled to the imaging device, a data processing device, a data output device, a display device, or a combination thereof.
  • GUI graphical user interface
  • the GUI can be displayed on a display device and can receive input from a user.
  • the GUI can receive real time feedback for real time communication with the imaging device, the data processing device, the data output device, the display device, or a combination thereof.
  • the system of this invention can further comprise a mobility device and, optionally, a mobility control device, wherein the system is configured into an autonomous mobile device, a remote-controlled mobile device, or a combination thereof.
  • the mobility device can comprise wheels, motors, propeller, a portable supporting device, such as a tripod, a stand, and so on.
  • the mobility control device can comprise sensors, lightings, motor control devices, a remote controller, or a combination thereof.
  • the system is configured into an autonomous mobile device to receive a digital positioning signal and automatically drive into the position based on the positioning signal.
  • the system is configured to receive pre-determined digital signals to detect ground markings and to position the system into a predetermined location based on the ground markings.
  • the ground markings can comprise lines, grids, distance to an object, or a combination thereof.
  • the system is configured as a remote-controlled mobile device to receive real time digital positioning signals from a remote controller and to move around based on the real time digital positioning signals.
  • the system is configured into a drone that can fly over an area or hover at a specific spot over a specific location at a predetermined height.
  • the position can be a track field, a stadium, a classroom, an indoor exercise facility, or a specific location of a court, such as a basketball court, a tennis court, or a gymnasium floormat (FIG. 1 - FIG. 9).
  • the system of this invention can be a portable device.
  • the system can be a portable robot (1) in one example (FIG. 1A - FIG. 1C and FIG. 2E), a smart phone (1a) in another example (FIG. 2A - FIG. 2B), an iPhone (1b) in yet another example (FIG. 2A - FIG. 2B), an iPad in yet another example (FIG. 2C - FIG. 2D, FIG. 3 and FIG. 4), a portable computing device in yet another example, a laptop computing device (31) in yet another example (FIG. 9), a drone (1c) in yet another example (FIG. 2F), or a flat screen TV display device with cameras (15a and 15b) (FIG. 2G and FIG. 11) in yet another example.
  • the system of this invention can further comprise a data input device functionally coupled to the processing device, the imaging device, the output device, or a combination thereof, a reference database functionally coupled to or accessible from the processing device, an optional additional data processing device, an optional additional output device, or a combination thereof.
  • the data input device can be a keyboard, a touch pad, a touch screen, a receiver for a digital signal, a communication device comprising wired communication device, a wireless communication device, or a combination thereof.
  • the data input device can receive signals from a user or another computing device to perform desired functions, such as selecting sports programs, examination programs, reference data, standard data, or other functions.
  • the wireless communication device can comprise WiFi device, Bluetooth device, infrared device, cell phone signal device including 5G network device or other devices using a broad range of electromagnetic wavelengths to communicate, transmit and receive digital signals.
  • Multiple devices, systems, or a combination thereof can be interconnected via wired or wireless connections as schematically illustrated in FIG. 9.
  • the system of this invention can further comprise at least one additional display device, additional processing device, one or more remote computing devices, such as a smart phone, iPad, laptop, a server computing device, or a combination thereof, functionally coupled to the processing device, the imaging device, the output device, or a combination thereof via wired or wireless connections.
  • the system of this invention can comprise a flat screen TV display device that can further comprise one or more imaging devices, such as cameras that can capture motion images comprising photos, videos or a combination thereof.
  • the non-transitory data storage device can comprise a CD, a USB drive, a hard disc drive (HDD), a solid-state drive (SSD), a SD card, a micro SD card, a digital storage memory chip, other non-transitory data storage device, or a combination thereof.
  • the non-transitory data storage device can store the evaluation report, the motion images, the motion data, the standard data, reference motion data, motion valuation data, or a combination thereof.
  • the non-transitory data storage device can store one or more databases.
  • the non-transitory data storage device can be a local storage device configured as a part of the single unit mobile device of the system of this invention, a remote or cloud storage device functionally coupled to the single unit mobile device of the system of this invention via wired or wireless communications or connections, or a combination thereof. Any of the aforementioned communication devices can be suitable.
  • the evaluation report can comprise activity data comprising scores, judgement of the performance, grade of scores in numeric form such as 1 to 100 scaled numeric form, grade of scores letter grade form such as “A, B, C, D and F” grade form, a color or share coded form such as red, yellow, blue or black color codes for good, pass or fail, an itemized report for each activity, a graphic report for one or more activities, or a combination thereof.
  • the evaluation report can be a printed booklet, a printed loose page or pages on paper, a printed or digital certificate with score or results of the performance evaluation.
  • the report can comprise texts, images selected from the motion images, reference images, standard images, superimposed motion images and reference images, or a combination thereof.
  • One example of such evaluation report (32) that comprises graphic, curves, diagrams, etc., that is shown in FIG. 10, FIG. 13, FIG. 14 on display devices (15, 15c, 15d, respectively).
  • the system of this invention can comprise a robot (1) that can comprise a robot head (2), a robot body (5), a head connector (3) connecting the robot head and the robot body and a mobility device (4) (FIG. 1 A - FIG. 1C, FIG. 2E).
  • the robot can have a handle (14) for handling the robot and a display device (15), an optional additional display device (15a) (FIG. 2E).
  • the display device (15) and the additional display device (15a) can also be a graphic user interface (GUI) device for data input.
  • GUI graphic user interface
  • the robot head can comprise an imaging device comprising a first infrared camera (10a), a second infrared camera (10b), an RGB or HD camera (12) that can have zoom or tele-zoom function, or a combination thereof (FIG. 1C).
  • the system can also comprise an infrared or laser emitting device (9).
  • the system can further comprise one or more additional accessories (11a, 11 b) (FIG. 1 A, FIG. 1 B) either for decoration or for function, such as microphone, speaker, one or more sensors, or a combination thereof.
  • the robot head can be configured to move in rotational directions (16) and up-and-down directions (17). The rotational direction can be alone a rotational axis Z-Z’ of the robot head connector.
  • the head connector (3) can be adjustable for providing height adjustment (18) (FIG. 1 B).
  • the mobility device (4) can comprise a number of wheels (8) (FIG. 1 A).
  • the system of this invention can further comprise a power device that comprises one or more batteries for providing power to the imaging device, the data processing device and other devices, one or more motors that can drive the wheels, one or more receivers for receiving digital signals, one or more wired or wireless communication devices. Some or all of these devices can be installed or positioned in the robot body (5) (FIG. 1A and FIG. 2E) with wired or wireless connections to each other for desired functions.
  • the system of this invention can comprise a smart phone device (1a) (FIG. 2A - FIG. 2B), an iPad device or other Pad type computing device (1 b) (FIG. 2C - FIG. 2D), a drone device (1c) (FIG. 2F), a combination with an additional display device (15a), such as a large screen TV (1d) (FIG. 11), that is movable and has wired or wireless connection with the imaging device, the data processing device, the data output device (FIG. 2G), or a combination thereof.
  • the smart phone or the Pad computing device can each comprise an imaging device comprising a front camera (12a) and a rear camera (12b) (FIG. 2G, FIG. 3 - FIG. 4, FIG.
  • the system of this invention can further comprise a mobility device, such as a portable supporting device that can be small and flexible (4a) or rigid such as a device stand (4b) or a long tripod (4c) (FIG. 2A - FIG. 2D).
  • a mobility device such as a portable supporting device that can be small and flexible (4a) or rigid such as a device stand (4b) or a long tripod (4c) (FIG. 2A - FIG. 2D).
  • the system can comprise a drone device (1c) that comprises a drone body (6) coupled to a drone connector (3a) that is attached to a drone imaging assembly (7) (FIG. 2F).
  • the drone device can comprise a plurality of propellers (4d) as a mobility device.
  • the drone device can be configured to have the imaging device, data processing device, a data output device and a power device into a single unit mobile device (FIG. 2F).
  • the system (1d) of this disclosure can comprise a flat screen TV equipped with a front camera (12a) and a view camera (12b) (FIG. 11).
  • the system of this invention can comprise an additional display device (15a) (FIG. 2E) that is functionally coupled to the data processing device, data output device, the other display device via wired or wireless connections.
  • GUI graphic user interface
  • GUI can display a list of activities or sports that can be evaluated using the system, such as an example shown on an iPad (1b) (FIG. 3).
  • sports can include: badminton, basketball, cross country running, football, golf, gymnastics, field hockey, ice hockey, indoor track & field, outdoor track & field, soccer, tennis, volleyball, long jump, standing long jump, triple jump, standing triple jump, single leg long jump, sit-up, push up, pull up, high jump, pole vault, plank, rope jump, balance beam, ball drippling, shot put, hurdle, relay, swimming, polo, water polo, marshal art, ping pong, timed sports, distance measured sports, scored sports, and other sports or activities.
  • a user can select one item on the GUI to access stored data, such as references, standards, historical motion images including videos, scores, etc., or to start an evaluation (See at least in FIG. 3 and FIG. 13).
  • a video feed can be displayed on a display device, such as an iPad (1b) shown in FIG. 4.
  • the system of this invention can be placed in outdoor fields, such as in outdoor fields with different configurations (22 and 22a) (FIG. 5A and FIG. 5B), indoor training facilities, such as a training groom (23) (FIG. 5C), a personal exercise area (24) (FIG. 5D), or a combination thereof.
  • the system can comprise a robot (1), smart phone (1a), an iPad computing device (1b), drone (1c), a flat screen TV (Id), or a combination thereof (FIG. 5A - FIG. 5D, FIG. 11). Additional examples of system use and configurations are schematically illustrated in FIG. 5E and FIG. 5F wherein multiple devices such as flat screen TV (with cameras) (1e) can be placed in multiple locations in each of the multiple locations (23a - 23b) to capture motion images of the activities performed by multiple subjects.
  • the system can comprise a position sensing device that can be coupled to the imaging device for configuring or positioning the imaging device to capture full body images including video images of the subject, such as a person doing exercise.
  • a system comprising a smart phone (1a) can be positioned against a supporting surface (20c) at a position angle (19).
  • position adjustment (20b) By adjusting position adjustment (20b) to have a position marker (20) aligning to a position reference point (20a), a full body image of a subject (21) can be captured (FIG. 6A - FIG. 6B).
  • the system can comprise an imaging device for capturing full body images of the subject performing the activity and a display device displaying the full body images in real time, wherein the full body images can be displayed so that can be viewed by the subject.
  • the images can comprise real time video images.
  • the subject can be a person doing exercise. Representative examples can be seen at least in FIG. 2A-FIG. 2B, FIG. 5D, FIG. 6A-FIG. 6B, FIG. 8, FIG. 11 , and FIG. 14.
  • the system can comprise a size reference device for calibrating horizontal motion data and vertical motion data.
  • the size reference device can comprise a ruler, a set of markers with predetermined distances, an article having a pre-determined size, or a combination thereof.
  • the size reference device can comprise pre-spaced marker lines (28a), such as those shown in FIG. 8.
  • the evaluation report can comprise posture valuation data.
  • the posture valuation data can comprise posture data of the subject positioned in a classroom, positioned in reading, positioned in writing, positioned in standing, positioned in sitting, positioned in doing exercise, or a combination thereof.
  • the evaluation report can comprise posture data of a student in a classroom.
  • the posture data can comprise sitting position of a student in a classroom.
  • a report can comprise an assessment of normal or abnormal posture of a student in a classroom.
  • the evaluation report can comprise mode valuation data.
  • the mode valuation data can comprise mode data of said subject that comprises one or more facial images, eye motion images, responding time, responding body motion images, responding voices, optionally, responding physical data comprising heart-beat, blood pressure, sweet, skin temperature, a combination thereof, of said subject in responding to at least a mode prompt.
  • the evaluation report comprises psychological evaluation of the subject as described in detail.
  • the evaluation report can be produced for two or more subjects, such as 2-200 subjects, simultaneously, sequentially, or a combination thereof, as described in details hereafter.
  • the system can comprise two or more cameras to capture motion images of the multiple subjects simultaneously, sequentially, or a combination thereof.
  • 2-10 cameras can be positioned in a classroom to capture motion images of all students in the classroom.
  • the system can be configured to produce an evaluation report of the students, such as 2-100 students, in the classroom that can comprise posture data of each of the students.
  • the system of this disclosure can further comprise at least a measuring device that has direct contact with the subject for measuring physical data that can comprise heart-beat, blood pressure, sweet, skin temperature, or a combination thereof.
  • the measuring device can comprise blood-pressure measuring device, heart-beat measuring device including EKG or something similar, sweet measuring device, temperature measuring device, or a combination thereof.
  • the measuring device can comprise an iWatch, an iWatch coupled to an iPhone, or any suitable devices known to those skilled in the art.
  • the measuring device can be worn on the body or a part of the body of each subject.
  • the measuring device can comprise wired or wireless connections to the data processing device, the data output device, or a combination thereof.
  • this disclosure is directed to a system for producing an evaluation report of multiple subjects performing an activity, the system comprising:
  • a data processing device functionally coupled to the imaging device configured to receive the motion images
  • At least a data output device functionally coupled to the imaging device and the data processing device
  • a non-transitory data storage device functionally coupled to or accessible from the imaging device, the data processing device, and the data output device, wherein the non-transitory data storage device comprises computer readable codes stored therein, when executed, configured to cause the imaging device capturing the motion images, to cause the data processing device receiving the motion images from the imaging device, producing the motion data based on the motion images, wherein the motion data comprises timing data, horizontal motion data, vertical motion data, posture data, mode data, or a combination thereof, of the subjects performing the activity measured from the motion images, and producing the evaluation report based on the motion data of two or more the subjects; and
  • the motion images are captured when the imaging device is free from direct contact with each of the subjects.
  • the non-transitory data storage device can further comprise computer readable codes, when executed, configured to cause the data processing device producing motion data based on the motion images and producing activity data by analyzing the motion data and stored standard data, reference motion data, motion valuation data, posture valuation data, mode valuation data, or a combination thereof; wherein the evaluation report further comprises the activity data, and wherein the stored standard data, the reference motion data, the motion valuation data, or a combination thereof, are stored in one or more motion databases functionally coupled to or accessible from the data processing device.
  • the data processing device can process the motion images and producing the motion data in real time.
  • system of this disclosure can further comprise a display device for displaying the motion images, the stored standard data, the reference motion data, the motion valuation data, the evaluation report, or a combination thereof.
  • the motion images are configured to be displayed visible to the subject in real time on the display device. This can be particularly helpful for the subject to see his/her own motions in real time and can help in adjusting activities or motions according to the references or standard data.
  • the system can further comprise a mobility device and, optionally, a mobility control device, wherein the system is configured into an autonomous mobile device, a remote-controlled mobile device, or a combination thereof.
  • a mobility device and, optionally, a mobility control device, wherein the system is configured into an autonomous mobile device, a remote-controlled mobile device, or a combination thereof.
  • Any of the autonomous mobile device, remote-controlled mobile device, or a combination thereof, disclosed herein, can be suitable.
  • the system is a portable device.
  • system can further comprise a data input device functionally coupled to the processing device, the imaging device, the output device, or a combination thereof, a reference database functionally coupled to or accessible from the processing device, an optional additional data processing device, an optional additional output device, or a combination thereof.
  • the system is configured to receive weight data of the subjects from the data input device and wherein the evaluation report further comprises the weight data.
  • the weight data of the subject can be obtained from a weight measuring device, such as a scale, that is functionally coupled to the input device, the processing device, or a combination thereof.
  • the weight measuring device can be functionally coupled to the input device, the processing device, or a combination thereof, via wired or wireless connections.
  • the evaluation report can comprise posture valuation data.
  • the posture valuation data can comprise posture data of the subject positioned in a classroom, positioned in reading, positioned in writing, positioned in standing, positioned in sitting, positioned in doing exercise, or a combination thereof, as described herein.
  • the evaluation report comprises mode valuation data.
  • the mode valuation data can comprise mode data of the subject that comprises one or more facial images, eye motion images, responding time, responding body motion images, responding voices, optionally, responding physical data comprising heart-beat, blood pressure, sweet, skin temperature, a combination thereof, of the subject in responding to at least a mode prompt.
  • the evaluation report comprises psychological evaluation of the subject, as described in this disclosure.
  • the evaluation report is produced for two or more subjects simultaneously, sequentially, or a combination thereof.
  • the evaluation report can be produced for two or more subjects, such as 2-200 subjects, simultaneously, sequentially, or a combination thereof, as described in details hereafter.
  • the system can comprise two or more cameras to capture motion images of the multiple subjects simultaneously, sequentially, or a combination thereof.
  • 2-10 cameras can be positioned in a classroom to capture motion images of all students in the classroom.
  • the system can be configured to produce an evaluation report of the students, such as 2-100 students, in the classroom that can comprise posture data of each of the students.
  • this disclosure can be directed to a method for producing an evaluation report of at least a subject performing an activity, the method comprising:
  • motion data comprises timing data, horizontal motion data, vertical motion data, posture data, mode data, or a combination thereof, of the subject performing the activity measured from the motion images;
  • the motion images are captured when the imaging device is free from direct contact with the subject.
  • the method disclosed here can comprise using a size reference device for calibrating horizontal motion data and vertical motion data.
  • the size reference device can comprise a ruler, a set of markers with predetermined distances, an article having a pre-determined size, or a combination thereof.
  • the size reference device can comprise pre-spaced marker lines (28a), such as those shown in FIG. 8.
  • the method of this disclosure can further comprise receiving weight data of the subject using a data input device, wherein the calorie data can be produced based on the motion data and further based on the weight data, and wherein the evaluation report further comprises the weight data.
  • the method of this disclosure can further comprise receiving height data of the subject using a data input device, calibrating the horizontal motion data and vertical motion data based on the height data to produce calibrated horizontal motion data and calibrated vertical motion data, and wherein the calorie data is produced based on the motion data and further based on the calibrated horizontal motion data and calibrated vertical motion data.
  • the calibrated horizontal motion data and calibrated vertical motion data can be produced based on the aforementioned size reference device.
  • the motion data, the calorie data and the evaluation report can be produced using a data processing device functionally coupled to the imaging device and a non-transitory data storage device, wherein the non- transitory data storage device can comprise computer readable codes stored therein, when executed, configured to cause the imaging device capturing the motion images, to cause the data processing device receiving the motion images and producing the motion data, the calorie data and the evaluation report, and outputting the motion data, the calorie data, the evaluation report, or a combination thereof, from the data processing device to a data output device functionally coupled to the data processing device.
  • the non-transitory data storage device can comprise computer readable codes stored therein, when executed, configured to cause the imaging device capturing the motion images, to cause the data processing device receiving the motion images and producing the motion data, the calorie data and the evaluation report, and outputting the motion data, the calorie data, the evaluation report, or a combination thereof, from the data processing device to a data output device functionally coupled to the data processing device.
  • the motion data, the calorie data and the evaluation report can be produced in real time using the data processing device and displayed on the data output device.
  • the evaluation report can further comprise activity data of the activity of the subject produced based on the motion data by analyzing the motion data and stored standard data, reference motion data, motion valuation data, posture valuation data, mode valuation data or a combination thereof; wherein the evaluation report can further comprise the activity data.
  • the activity data can comprise scores, judgement of performance, grades, one or more itemized reports, one or more graphic reports, or a combination thereof, of the activity performed by the subject.
  • a method for producing an evaluation report of at least a subject performing an activity can comprise: [97] obtaining motion images of the subject performing the activity using an imaging device;
  • the imaging device, the data processing device and the data output device are functionally coupled and configured into a single unit mobile device;
  • the stored standard data, the reference motion data, the motion valuation data or a combination thereof are stored in one or more motion databases functionally coupled to or accessible from the data processing device;
  • the output device is configured to be functionally coupled to the imaging device, the data processing device, or a combination thereof.
  • a subject is free from wearing an electromagnetic tracking device.
  • the method of this invention can produce an evaluation report of a subject performing an activity without having to affix any electromagnetic tracking devices to the subject.
  • the method of this disclosure can produce the evaluation report comprises posture valuation data.
  • the posture valuation data can comprise posture data of the subject positioned in a classroom, positioned in reading, positioned in writing, positioned in standing, positioned in sitting, positioned in doing exercise, or a combination thereof.
  • the evaluation report can comprise posture data of a student in a classroom.
  • the posture data can comprise sitting position of a student in a classroom.
  • a report can comprise an assessment of normal or abnormal posture of a student in a classroom.
  • the evaluation report can comprise mode valuation data.
  • the mode valuation data can comprise mode data of the subject that comprises one or more facial images, eye motion images, responding time, responding body motion images, responding voices, optionally, responding physical data comprising heart-beat, blood pressure, sweet, skin temperature, a combination thereof, of the subject in responding to at least a mode prompt.
  • the evaluation report can comprise psychological evaluation of the subject.
  • a verbal prompt can be provided and responses of the subject can be measured from motion images captured before and after the prompt is provided.
  • facial movement can be used for identifying psychological symptoms of the subject.
  • multi-dimensional psychological symptoms of mental health of a subject can be evaluated using the Symptoms Checklist 90 (SCL- 90) using facial images.
  • a method described by Wang et al. can be used (Wang, X., et al., Frontiers on Psychiatry, Vol. 11 , 1 -11 , December 2020, D0l:10.3389/fpsyt.2020.607890) to measure key facial points that change the most with the scale scores in each symptomatic dimension.
  • psychological evaluation of the subject can comprise interpersonal sensitivity, depression, anxiety, hostility, phobic anxiety, psychoticism that an include aggression, impulsivity, aloofness, and antisocial behavior, or a combination thereof.
  • the psychological evaluation can include indications of a susceptibility to psychosis and psychopathic disorders.
  • the method of this disclosure can produce the evaluation report of two or more subjects simultaneously, sequentially, or a combination thereof.
  • the method can produce an evaluation report of two or more subjects, 2-200 subjects, 2-200 subjects, 2-100 subjects, 2-80 subjects, 2-60 subjects, 2-50 subjects, 2-40 subjects, simultaneously, such as in a signal display.
  • the method can produce an evaluation report of two or more subjects, 2-200 subjects, 2-200 subjects, 2-100 subjects, 2-80 subjects, 2-60 subjects, 2-50 subjects, 2-40 subjects, sequentially, such as in a multi-page display or a multi-page report.
  • the method can produce an evaluation report of two or more subjects, 2-200 subjects, 2-200 subjects, 2-100 subjects, 2-80 subjects, 2-60 subjects, 2-50 subjects, 2-40 subjects, in a combination report that can comprise a single page display and a multi-page detailed report on each of the subjects.
  • Some reports are schematically illustrated in FIG. 15A - FIG. 15B, FIG. 16A, FIG. 16B, and FIG. 19.
  • artificial intelligence can be utilized for generating reports.
  • mode valuation can be generated using Al based on facial expression of a subject.
  • the device and system of this invention disclosed herein can be suitable for the method.
  • the system can comprise a robot device.
  • the system can comprise a smart phone.
  • the system can comprise a laptop computing device.
  • the system can comprise a flat panel computing device, such as an iPad or a similar device.
  • the method of this invention can comprise displaying the motion images, the stored standard data, the reference motion data, the motion valuation data, the evaluation report, or a combination thereof on a display device.
  • the motion data, the evaluation report, or a combination thereof can be produced in real time as disclosed above.
  • the method can process the motion images and producing the motion data while the motion images are being acquired in one example, within a range of from 0.0001 second to 30 minutes in another example, 0.0001 second to 10 minutes in yet another example, 0.0001 second to 5 minutes in yet another example, 0.0001 second to 2 minutes in yet another, 0.0001 second to 1 minute in yet another example, 0.0001 second to 30 seconds in yet another example, 0.0001 second to 10 seconds in yet another example, 0.0001 second to 30 seconds in yet another example, 0.0001 second to 10 seconds in yet another example, 0.0001 second to 30 seconds in yet another example, 0.0001 second to 10 seconds in yet another example, 0.0001 second to 5 seconds in yet another example, 0.0001 second to 1 second in yet another example, 0.0001 second to 0.5 second in yet another example, 0.0001 second to 0.1 second in yet another example, 0.0001 second to 0.01 second in yet another example, and 0.0001 second to
  • the method of this invention produces an evaluation report that is different from the input data, such as motion images captured by the imaging device that comprise only the images of motions of the subject.
  • the motion images captured by the imaging device are free from processed motion data, standard data, reference motion data, motion valuation data, or a combination.
  • the motion images captured by the imaging device are free from scores, judgement of the performance, grade of scores, a graphic report, or a combination thereof.
  • the output of the method can comprise evaluation report, motion data, standard data, reference motion data, motion valuation data, or a combination, wherein the evaluation report can comprise scores, judgement of the performance, grade of scores in numeric form such as 1 to 100 scaled numeric form, grade of scores letter grade form such as “A, B, C, D and F” grade form, a color or share coded form such as red, yellow, blue or black color codes for good, pass or fail, an itemized report for each activity, a graphic report for one or more activities, or a combination thereof.
  • the evaluation report can be a printed booklet, a printed loose page or pages on paper, a printed or digital certificate with score or results of the performance evaluation.
  • the report can comprise texts, images selected from the motion images, reference images, standard images, superimposed motion images and reference images, or a combination thereof.
  • the evaluation report can be a printed booklet, a printed loose page or pages on paper, a printed or digital certificate with score or results of the performance evaluation.
  • the evaluation report can also be in digital form that can be suitable for displaying on a display device, stored in a database, transmitted or outputted to cloud storage devices, other computing device, smart phones, pad computing devices, or a combination thereof.
  • images of a subject who is performing an activity can be displayed on a display device, one or more additional display devices, or a combination thereof, such as shown in FIG. 2A, FIG. 2B, FIG. 2G, FIG. 4, FIG. 5D, FIG. 6A, FIG. 6B, FIG. 7A, FIG. 7B and FIG. 8).
  • the method of this invention can comprise displaying motion images of a subject (25) performing an activity, wherein the motion images are configured to be displayed visible to the subject in real time, such as shown in FIG. 5D.
  • Images of standard data or reference data can be superimposed with the motion images of the subject on a same display device. This can be particularly useful for a person who need to see real time motions of him/herself during exercise, training, or learning.
  • motion images of a subject such as motion images of a basketball player (26) can be superimposed with one or more basketball player motion markings (27) (FIG. 7A - FIG. 7B) or motion images of a person doing a long jump (26a) superimposed with jumping motion markings (27a) (FIG. 8).
  • the method can further comprise producing the motion data comprising the motion markings based on the motion images.
  • the method can further comprise produce additional markings that are specific to the activity that is evaluating. For example, distance markings can be produced and superimposed with a series of motion images of a long jumper for measuring the long jump distance d (28) (FIG. 8).
  • One advantage of this invention is that there is no need to remove irrelevant noise signals, such as the background in the basketball court (FIG. 7A - FIG. 7B) or the surroundings (FIG. 8).
  • the method of this invention can further comprise connecting one or more systems or devices using one or more wired or wireless communication devices.
  • Some examples are schematically shown in FIG. 9 that can include a laptop computing device (31), an iPad (1b and 30), a robot (1), a drone (1c), and a smart phone (1a) each having an internal wireless communication device, such as a Wifi, Bluetooth, or other wireless communication devices known to those skilled in the art.
  • This invention is further directed to a kit for a system for an evaluation report of at least a subject performing an activity, the kit comprising:
  • an imaging device configured to capture motion images of the subject performing the activity
  • a data processing device configured to receive the motion images, produce motion data, and produce the evaluation report by analyzing the motion data based on stored standard data, reference motion data, motion valuation data, posture data, mode data, or a combination thereof;
  • a data output device configured to be coupled to the data processing device, the imaging device, or a combination thereof;
  • a non-transitory data storage device configured to be functionally coupled to or accessible from the data processing device, functionally coupled to or accessible from the data output device, or a combination thereof;
  • an optional display device configured to be coupled to the imaging device, the data processing device, the non-transitory data storage device, or a combination thereof;
  • an optional communication device configured to be coupled to the imaging device, the data processing device, the non-transitory data storage device, the display device when present, or a combination thereof;
  • the imaging device and the data processing device are configured into a single unit mobile device
  • the mobility device and mobility control device when present, is configured to be coupled to the single unit mobile device.
  • the imaging device, the data processing device and the data output device can be functionally coupled and configured into a single unit mobile device, such as a robot device in one example, a smart phone in another example, a laptop computing device in yet another example, an iPad in yet another example, a drone in yet another example, or a combination thereof.
  • the data processing device, the date output device, the display device, or a combination thereof can be connected to a cloud server, a cloud computing device, a cloud data storage device such as a database, or a combination thereof via wired or wireless connections.
  • a system comprising a smart phone (1a) was placed in a personal training area (24) facing a person (25) who was performing an exercise.
  • the system displayed motion images (21) of the person on a display screen that was positioned to face the person and the motion images were visible to the person in real time (FIG. 5D).
  • a large flat screen TV display device (15a) was connected to a robot (1) via wireless connections, wherein the robot was configured to capture motion images of a person who was performing a standing long jump. Motion imaged captured by the robot were displayed on the TV together with motion data comprising graphic reports and historical data (FIG. 2G).
  • Each of the systems was configured to have a wireless communication device and were connected to an iPad (30) or a laptop computer (31) (FIG. 9). Motion images captured by the system were displayed on screens of the iPad and the laptop in real time. The laptop was also configured to provide input to start and end the capturing of the motion images and the evaluation.
  • a system (1d) having a flat screen TV display device (15b) was equipped with a front camera (12a) and a rear camera (12b) and a portable supporting device (4e) (FIG. 11).
  • the flat screen display was also equipped with WiFi for connecting to a central device.
  • a series of full body images of a person (21b) were captured and shown on the flat screen TV in real time as the person was performing exercise activity.
  • Each movement of a person (21c) was dissected into horizontal moves and vertical moves based on a gravity center (35) of the person to produce horizontal motion data comprise the sum of the horizontal distances (Lh) (33) and vertical motion data comprise the sum of vertical distances (L v ) (34) (FIG. 12) while the person is jumping up to a higher position (21d) or a lateral movement position (21e). Timing of the exercise was also recorded.
  • a flat screen display device was used to display a graphic user interface for selecting activity, starting evaluation, and displaying evaluation report (FIG. 13).
  • Measured calorie data for the person’s activity within a defined time was produced based on the sum of the Lvi through Lvn and Lhi through Lhm and the actual body weight (WA) of the person, m and n each is an integer equal to or greater than 1 .
  • the calorie data was generated based on the sum of vertical distances and the weight of the person.
  • calorie data were generated based on the action times, counts and body weight of each of the students.
  • FIG. 18 Schematic illustration of the measurements is shown in FIG. 18.
  • FIG. 20A - FIG.20B A representative screen shot (49) is shown in FIG. 20A - FIG.20B. Based on Symptoms Checklist 90 (SCL-90), a number of prompts were provided to the student. Facial expression and body movements were captured as video images with at least a camera. Facial expression was analyzed using the criteria published by Wang et al. (Wang, X., et al., Frontiers on Psychiatry, Vol. 11 , 1 -11 , December 2020, DOI:10.3389/fpsyt.2020.607890) to measure the facial image captured (51) on key facial points (52) (FIG.
  • mode valuation report is generated using Al based on facial expression of the subject.

Abstract

La présente invention concerne un système et un procédé permettant de produire un rapport d'évaluation comprenant les calories calculées comme ayant été brûlées lors d'un exercice par au moins un sujet effectuant une activité, telle qu'un sport ou de l'exercice. Le système et le procédé peuvent être utilisés pour l'évaluation d'activités sportives, pour l'éducation sportive, pour les cours d'exercice de groupe, pour l'entraînement personnel ou pour d'autres activités. Le système est conçu sous la forme d'un dispositif mobile comportant une seule unité. Le système peut être utilisé dans les écoles, les universités, les bureaux, les compétitions sportives, les établissements commerciaux ou à la maison.
PCT/US2022/080462 2021-11-24 2022-11-24 Système et procédé de mesure de performances lors d'une activité WO2023097304A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202163283203P 2021-11-24 2021-11-24
US63/283,203 2021-11-24

Publications (1)

Publication Number Publication Date
WO2023097304A1 true WO2023097304A1 (fr) 2023-06-01

Family

ID=86540375

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2022/080462 WO2023097304A1 (fr) 2021-11-24 2022-11-24 Système et procédé de mesure de performances lors d'une activité

Country Status (1)

Country Link
WO (1) WO2023097304A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120268592A1 (en) * 2010-12-13 2012-10-25 Nike, Inc. Processing Data of a User Performing an Athletic Activity to Estimate Energy Expenditure
WO2015057623A2 (fr) * 2013-10-14 2015-04-23 Nike Innovate C.V. Système d'entraînement physique permettant de fusionner des calculs relatifs à la dépense énergétique en provenance de multiples dispositifs
WO2015164389A1 (fr) * 2014-04-21 2015-10-29 Blast Motion Inc. Système et procédé de reconnaissance d'événement de mouvement et de synchronisation vidéo
US20160058329A1 (en) * 2014-09-02 2016-03-03 Apple Inc. Method and system to estimate day-long calorie expenditure based on posture
US20160171905A1 (en) * 2013-01-03 2016-06-16 Mark E. Nusbaum Mobile computing weight, diet, nutrition, and exercise management system with enhanced feedback and goal achieving functionality
US20170189752A1 (en) * 2014-09-21 2017-07-06 Stryd, Inc. Methods and apparatus for power expenditure and technique determination during bipedal motion

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120268592A1 (en) * 2010-12-13 2012-10-25 Nike, Inc. Processing Data of a User Performing an Athletic Activity to Estimate Energy Expenditure
US20160171905A1 (en) * 2013-01-03 2016-06-16 Mark E. Nusbaum Mobile computing weight, diet, nutrition, and exercise management system with enhanced feedback and goal achieving functionality
WO2015057623A2 (fr) * 2013-10-14 2015-04-23 Nike Innovate C.V. Système d'entraînement physique permettant de fusionner des calculs relatifs à la dépense énergétique en provenance de multiples dispositifs
WO2015164389A1 (fr) * 2014-04-21 2015-10-29 Blast Motion Inc. Système et procédé de reconnaissance d'événement de mouvement et de synchronisation vidéo
US20160058329A1 (en) * 2014-09-02 2016-03-03 Apple Inc. Method and system to estimate day-long calorie expenditure based on posture
US20170189752A1 (en) * 2014-09-21 2017-07-06 Stryd, Inc. Methods and apparatus for power expenditure and technique determination during bipedal motion

Similar Documents

Publication Publication Date Title
US11638853B2 (en) Augmented cognition methods and apparatus for contemporaneous feedback in psychomotor learning
US11210963B2 (en) Method and apparatus for providing personalised audio-visual instruction
Baca et al. Ubiquitous computing in sports: A review and analysis
US9370704B2 (en) Trajectory detection and feedback system for tennis
US11113988B2 (en) Apparatus for writing motion script, apparatus for self-teaching of motion and method for using the same
US20120238380A9 (en) Trajectory detection and feedback system for golf
JP5895253B2 (ja) ユーザーに対するカスタマイズ練習環境を提供する仮想ゴルフシミュレーション装置、これとネットワークで連結されるサーバー、及び仮想ゴルフシミュレーションを用いたユーザーカスタマイズ練習環境の提供方法
CN106310660A (zh) 一种基于力学可视化的虚拟足球运动控制系统
KR101555863B1 (ko) 태권도 품새 판독 및 교육 장치 및 그 방법
CN107551554A (zh) 基于虚拟现实的实现室内运动场景模拟系统和方法
WO2018195653A1 (fr) Système de capture de mouvement humain, de caractérisation de mouvement, et d'évaluation de mouvement augmentée par logiciel par pairs, auto-apprentissage ou consensus
CN103328053A (zh) 用于提供高尔夫球内容的装置，使用该装置的用于提供高尔夫球内容的系统，用于虚拟高尔夫球模拟的装置，用于提供高尔夫球内容的方法，以及用于虚拟高尔夫球模拟的方法
CN116271766A (zh) 网球训练的模拟方法及装置、电子设备及存储介质
TW201111014A (en) Human-body muscle training feedback system and method
TWI693090B (zh) 結合於運動器材之資訊傳輸收集裝置與運動器材
US20210016149A1 (en) Systems and Methods for Athletic Performance Assessment and Training
KR102171319B1 (ko) 동작 교본 저작 장치, 동작 자가 학습 장치 및 방법
CN110786825B (zh) 基于虚拟现实视听觉通路的空间知觉失调测训系统
WO2023097304A1 (fr) Système et procédé de mesure de performances lors d'une activité
CN112933581A (zh) 一种基于虚拟现实技术的体育动作评分方法与装置
CN116271757A (zh) 一种基于ai技术的篮球练习的辅助系统和方法
CN104434120B (zh) 灵敏素质测评价系统及测试评价方法
JP2008048972A (ja) 競技能力向上支援方法と同支援ツール
CN112717362A (zh) 用于测量活动表现的系统和方法及其用途
KR102385648B1 (ko) 스마트미러를 이용한 골프 레슨 시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22899572

Country of ref document: EP

Kind code of ref document: A1