JP2018512980A - Frameworks, devices and methods configured to enable delivery of interactive skill training content, including content with multiple expert knowledge variations - Google Patents

Abstract

The present invention relates to distribution of content driven by input from one or more performance sensor units, such as a performance sensor unit configured to monitor motion-based performance and / or audio-based performance. Embodiments of the present invention include software and hardware and associated methodologies associated with the generation, distribution, and execution of such content. Particular attention is paid to techniques that enable the delivery of skill training content that provides variations of expert knowledge in training content for various skills.

Description

  The present invention relates to content driven by input from one or more performance sensor units, such as a performance sensor unit configured to monitor motion-based performance and / or audio-based performance. Regarding delivery. Embodiments of the present invention include software and hardware and associated methodologies associated with the generation, distribution, and execution of such content.

  Any discussion of background art throughout this specification should in no way be construed as an admission that such techniques are widely known or form part of the common general knowledge in the field.

  Various technologies have been developed that allow integration between sensors that monitor human activity and training systems. For example, applying them in the context of sports-based training provides users with reports based on monitored attributes, such as heart rate, running pace, and distance traveled. In general, known techniques (e.g., again in the context of a running, human-running form) (e.g., running, Effective in providing reports on the results of human activity at a high level (in the context of travel distance). Thus, while useful as training tools, they only provide superficial and course tools for assessing human performance.

  In at least some embodiments, it is an object of the present invention to overcome or ameliorate at least one of the disadvantages of the prior art or provide a useful alternative.

  The following summary set of embodiments is provided to foresee potential claims based on the full set of technical features disclosed in the Detailed Description. They are not intended to limit in any way the scope of the claims that may be pursued.

  One embodiment provides a computer-implemented method that allows a user to configure the operation of a local performance monitoring hardware device, the method comprising:

  Providing an interface configured to allow a user of a client device to select a set of downloadable content, wherein the set of downloadable content relates to one or more skills; Steps and;

  Allowing the user to cause a download of data indicative of at least a portion of the selected set of downloadable content to local performance monitoring hardware associated with the user, the download comprising:

  (I) Sensor configuration data, one sensor configuration data that operates in a defined manner, thereby providing data representing the attempted performance of a particular skill. Or sensor configuration data including data constituting a set of performance sensor units;

  (Ii) state engine data, where the state engine data is a representation of the attempted performance of a particular skill based on data provided by a processing device by a set of one or more performance sensor units. State engine data, including data configured to allow identification of attributes; and

(Iii) user interface data, wherein the user interface data includes data configured to enable operation of the user interface based on identified attributes of the attempted performance of a particular skill data,
Including downloads,

  The method further includes allowing the user to select downloadable content defined by an expert knowledge variation for the selected skill or skills. There are several expert knowledge variations available for a set of

  One embodiment provides a computer-implemented method in which a first expert knowledge variation is associated with a first set of state engine data and a second expert knowledge variation is associated with a second different set of state engine data. However, the second different set of state engine data is configured to allow identification of one or more expert specific attributes of performance that are not identified using the first set of state engine data.

  One embodiment provides a computer-implemented method that relates to a style of performance in which expert-specific attributes are associated with an expert.

  One embodiment provides a computer-implemented method in which the style of performance is represented by a defined attribute of body motion that is observable using data obtained from one or more motion sensor units. To do.

  One embodiment provides a computer-implemented method related to coaching knowledge in which expert-specific attributes are associated with an expert.

  One embodiment provides a computer-implemented method in which one or more expert-specific attributes are defined based on a process configured to objectively define coaching idiosyncrasies.

  One embodiment provides a computer-implemented method, wherein there is a first selectable expert knowledge variation and a second selectable expert knowledge variation for a selected set of one or more skills:

  With respect to the first selectable expert knowledge variation, the downloadable data provides the client device with a first set of observable data conditions associated with a given skill in the data obtained from the set of performance sensor units. Configure to identify,

  With respect to the second selectable expert knowledge variation, the downloadable data is obtained from a second different set of observable data conditions associated with a given skill in data obtained from the set of performance sensor units. Configure to identify.

  In one embodiment, the difference between the first set of observable data conditions and the second set of observable data conditions is a human expert style difference associated with each expert knowledge variation ( A computer-implemented method is provided that describes style variances.

  One embodiment provides coaching advice in which the difference between the first set of observable data conditions and the second set of observable data conditions is obtained from a human expert associated with each expert knowledge variation. A computer-implemented method is provided.

  One embodiment provides a computer-implemented method, wherein there is a first selectable expert knowledge variation and a second selectable expert knowledge variation for a selected set of one or more skills:

  With respect to the first selectable expert knowledge variation, the downloadable data is the first feedback data to the user in response to observing the client device with defined observable data conditions associated with a given skill. Configured to provide a set of

  With respect to the second selectable expert knowledge variation, the downloadable data is sent to the user in response to observing a defined observable data condition associated with the given skill. Configure to provide a different set of.

  One embodiment describes a computer-implemented coaching advice in which the difference between a first set of feedback data and a second set of feedback data is obtained from a human expert associated with a respective expert knowledge variation Provide a method.

  One embodiment is a computer in which the difference between the first set of feedback data and the second set of feedback data includes different audio data representing the voice of a human expert associated with each variation of expert knowledge An implementation method is provided.

  One embodiment provides a computer-implemented method, wherein the performance sensor unit includes a plurality of motion sensor units.

  One embodiment provides a computer-implemented method that includes a POD device in which a client device is configured to process motion sensor data obtained from a plurality of motion sensor units, wherein the wearable garment is a motion sensor to the POD device. A plurality of sensor strands are provided that are configured to facilitate distribution of data.

  One embodiment provides a computer-implemented method, wherein each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope.

  One embodiment provides a computer-implemented method for generating data configured to enable delivery of skill training content for a defined skill, the method comprising:

  Generating a first set of observable data conditions, wherein the first set is observable configured to allow processing of input data obtained from one or more performance sensor units The input data represents the physical performance of the skill defined by the user, thereby identifying one or more attributes of the performance;

Generating a second set of observable data conditions, wherein the second set is configured to allow processing of input data obtained from the same one or more performance sensor units Including possible data conditions, the input data represents the physical performance of the skill defined by the user, thereby identifying one or more attributes of the performance; and
Including

  The second set of observable data conditions includes one or more expert-specific observable data conditions that are missing from the first set of observable data conditions. The unique observable data conditions are incorporated into the expert knowledge variation of the skill training content for the defined skills relative to the skill training content generated using only the first set of observable data conditions.

  One embodiment provides a computer-implemented method in which expert knowledge variations of skill training content account for style differences associated with a particular human expert relative to a baseline skill performance style.

  One embodiment provides a computer-implemented method in which expert knowledge variations of skill training content account for differences in coaching knowledge associated with a particular human expert relative to baseline coaching knowledge.

  In one embodiment, the expert knowledge variation of skill training content is: sensor configuration data, where the sensor configuration data operates in a defined way, thereby providing data representing the attempted performance of a particular skill Sensor configuration data, including data constituting a set of one or more performance sensor units; state engine data, wherein the state engine data is provided by the set of one or more performance sensor units State engine data, including data configured to allow the processing device to identify an attribute of the attempted performance of a particular skill based on the data to be obtained; user interface data, user interface data But the specific Including data configured to enable operation of the user interface based on the identified attributes of attempted performance of Le, comprising a user interface data, and provides a computer implemented method.

  One embodiment provides a computer-implemented method, wherein the performance sensor unit includes a plurality of motion sensor units.

  One embodiment is performed in hardware wherein a variation of expert knowledge of skill training content includes a POD device configured to process motion sensor data obtained from a plurality of motion sensor units, at least in part. A computer-implemented method is provided, and the wearable garment provides a plurality of sensor strands configured to facilitate delivery of motion sensor data to the POD device.

  One embodiment provides a computer-implemented method, wherein each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope.

  In one embodiment, for a defined skill, the cloud hosted marketplace is by one or more users: (i) a standard version of skill training content; and (ii) A computer-implemented method is provided that is configured to be available for procurement of expert knowledge variations.

  One embodiment provides a computer-implemented method for generating data configured to enable delivery of skill training content for a defined skill, the method comprising:

  Generating a first set of skill training content, wherein the first set of skill training content is for a skill defined based on processing of input data obtained from one or more performance sensor units. Configured to enable delivery of a skill training program, wherein the input data represents the physical performance of a defined skill by the user, thereby identifying one or more attributes of the performance;

Generating a second set of skill training content, wherein the second set of skill training content is configured to allow processing of input data obtained from the same one or more performance sensor units. The input data represents the physical performance of the defined skill by the user, thereby identifying one or more attributes of the performance;
Including

  The second set of skill training content is responsive to the same set of input data such that the second set of skill training content provides a variation of expert knowledge of the skill training content, depending on the given set of input data. Configured to provide different training program effects as compared to the first set of skill training content.

  One embodiment provides a computer-implemented method in which expert knowledge variations of skill training content account for style differences associated with a particular human expert relative to a baseline skill performance style.

  One embodiment provides a computer-implemented method in which expert knowledge variations of skill training content account for differences in coaching knowledge associated with a particular human expert relative to baseline coaching knowledge.

  One embodiment is that expert knowledge variations of skill training content are: sensor configuration data, where the sensor configuration data operates in a defined manner, thereby representing data that represents the attempted performance of a particular skill. Sensor configuration data, including data that configures a set of one or more performance sensor units to provide; state engine data, wherein the state engine data is provided by a set of one or more performance sensor units State engine data, including data configured to allow a processing device to identify an attribute of an attempted performance of a particular skill based on the data being played; user interface data, user interface Data is specific Including data configured to enable operation of the user interface based on the identified attributes of skill attempted performance, including the user interface data, and provides a computer implemented method.

  One embodiment provides a computer-implemented method in which the performance sensor unit includes a plurality of motion sensor units.

  One embodiment is implemented in hardware that includes a POD device in which a variation of expert knowledge of skill training content is configured to process motion sensor data obtained at least in part from a plurality of motion sensor units. Providing a computer-implemented method, the wearable garment provides a plurality of sensor strands configured to facilitate delivery of motion sensor data to a POD device.

  One embodiment provides a computer-implemented method, wherein each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope.

  One embodiment is that for a defined skill, the cloud hosted marketplace is by one or more users: (i) a standard version of skill training content; and (ii) expert knowledge variations of skill training content. A computer-implemented method is provided that is configured to be available for procurement.

  One embodiment provides a computer-implemented method in which a first set of training content data is associated with a first set of observable data conditions, wherein the second set of training content data is The second set is associated with the second set of observable data conditions such that the second set is configured to identify one or more attributes of performance that are not identified by the first set of training content data.

  One embodiment provides a computer-implemented method in which a first set of training content data is associated with a first protocol for mapping due to a symptom, wherein the second set of training content data is The second set of training content data is associated with a second protocol for mapping symptoms to causes so as to provide at least one expert-specific relationship between symptoms and causes.

  One embodiment provides a computer-implemented method in which a first set of training content data is associated with a first set of media content, and the second set of training content data is training content data. Is associated with the second set of media content such that the second set of is configured to provide personalized media content to a particular expert.

  One embodiment provides a computer-implemented method that allows a user to configure a local performance monitoring hardware device to provide training data associated with a selected one of a plurality of experts. :

  Providing an interface configured to allow a user of a client device to select a set of one or more skills to be trained;

  Allowing a user to select a variation of expert knowledge for one or more selected skills to be trained into a set of one or more skills to be trained There are multiple variations of expert knowledge available for a step;

  Client device associated with the user following selection of the user with a set of one or more skills to be trained and a variation of expert knowledge for the selected one or more skills to be trained The step of enabling the download process to provide downloadable data to the downloadable data on the client device:

  (I) to process the data obtained from the set of performance monitoring sensors, thereby analyzing one physical performance given by the user; and

(ii) Based on the analysis, via the user interface device, to provide training data specific to the selected expert knowledge variation,
Configure,
Steps.

  One embodiment provides a computer-implemented method in which, for a selected set of one or more skills, there are a first selectable expert knowledge variation and a second selectable expert knowledge variation:

  With respect to the first selectable expert knowledge variation, the downloadable data provides the client device with a first set of observable data conditions associated with a given skill in the data obtained from the set of performance analysis sensors. Configure to identify,

  With respect to the second selectable expert knowledge variation, the downloadable data is the second different set of observable data conditions associated with a given skill in the data obtained from the client device. Configure to identify.

  One embodiment provides a human expert style difference in which the difference between the first set of observable data conditions and the second set of observable data conditions is associated with each expert knowledge variation. A computer-implemented method is provided.

  One embodiment provides coaching in which the difference between the first set of observable data conditions and the second set of observable data conditions is obtained from a human expert associated with each expert knowledge variation. Provide a computer-implemented method of explaining advice.

  One embodiment provides a computer-implemented method, wherein there is a first selectable expert knowledge variation and a second selectable expert knowledge variation for a selected set of one or more skills:

  With respect to the first selectable expert knowledge variation, the downloadable data is the first feedback data to the user in response to observing the client device with defined observable data conditions associated with a given skill. Configured to provide a set of

  With respect to the second selectable expert knowledge variation, the downloadable data is sent to the user in response to observing a defined observable data condition associated with the given skill. Configure to provide a different set of.

  One embodiment describes a computerized coaching advice in which a difference between a first set of feedback data and a second set of feedback data is obtained from a human expert associated with a respective variation of expert knowledge. An implementation method is provided.

  One embodiment includes different audio data in which the difference between the first set of feedback data and the second set of feedback data represents the voice of a human expert associated with each variation of expert knowledge, A computer-implemented method is provided.

  One embodiment provides a computer-implemented method in which the performance analysis sensor includes a motion sensor.

  One embodiment provides a computer-implemented method, wherein a client device includes a POD device configured to be carried by a wearable garment, wherein the wearable garment includes a plurality of sensors carried by the wearable garment to the POD device. A plurality of sensor strands configured to allow distribution of data obtained from the unit is provided.

  One embodiment provides a computer-implemented method, wherein each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope.

  One embodiment is a system configured to allow a user to configure a local performance monitoring hardware device to provide training data associated with a selected one of a plurality of experts. Provide the system:

  Allows a client user interface device to interact with an interface configured to allow a client device user to select a set of one or more skills to be trained A server configured to allow the user to additionally select a variation of expert knowledge for the selected skill or skills to be trained. A server with a plurality of variations of expert knowledge available for one or more sets of skills to be configured and trained;

  The client associated with the user following the user's selection of a set of one or more skills to be trained and a variation of expert knowledge for the selected one or more skills to be trained A download manager component configured to enable a download process that provides downloadable data to a device, the downloadable data serving a client device:

  (I) to process data obtained from a set of performance monitoring sensors, thereby analyzing one physical performance given by the user; and

(ii) Based on the analysis, via the user interface device, to provide training data specialized for selected expert knowledge variations,
Configure,
And a download manager component.

  One embodiment provides a computer-implemented method, wherein there is a first selectable expert knowledge variation and a second selectable expert knowledge variation for a selected set of one or more skills:

  With respect to the first selectable expert knowledge variation, the downloadable data provides the client device with a first set of observable data conditions associated with a given skill in the data obtained from the set of performance analysis sensors. Configure to identify,

  With respect to the second selectable expert knowledge variation, the downloadable data is the second different set of observable data conditions associated with a given skill in the data obtained from the client device. Configure to identify.

  One embodiment provides a human expert style difference in which the difference between the first set of observable data conditions and the second set of observable data conditions is associated with each expert knowledge variation. A computer-implemented method is provided.

  One embodiment provides coaching in which the difference between the first set of observable data conditions and the second set of observable data conditions is obtained from a human expert associated with each expert knowledge variation. Provide a computer-implemented method of explaining advice.

  One embodiment provides a computer-implemented method, wherein there is a first selectable expert knowledge variation and a second selectable expert knowledge variation for a selected set of one or more skills:

  With respect to the first selectable expert knowledge variation, the downloadable data is the first feedback data to the user in response to observing the client device with defined observable data conditions associated with a given skill. Configured to provide a set of

  With respect to the second selectable expert knowledge variation, the downloadable data is sent to the user in response to observing a defined observable data condition associated with the given skill. Configure to provide a different set of.

  One embodiment describes a computerized coaching advice in which a difference between a first set of feedback data and a second set of feedback data is obtained from a human expert associated with a respective variation of expert knowledge. An implementation method is provided.

  One embodiment includes different audio data in which the difference between the first set of feedback data and the second set of feedback data represents the voice of a human expert associated with each variation of expert knowledge, A computer-implemented method is provided.

  One embodiment provides a computer-implemented method in which the performance analysis sensor includes a motion sensor.

  One embodiment provides a computer-implemented method, wherein a client device includes a POD device configured to be carried by a wearable garment, wherein the wearable garment includes a plurality of sensors carried by the wearable garment to the POD device. A plurality of sensor strands configured to allow distribution of data obtained from the unit is provided.

  One embodiment provides a computer-implemented method, wherein each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope.

  One embodiment provides a method that allows a user to configure a local performance monitoring hardware device to provide training data associated with a selected one of a plurality of experts. Is:

  Providing an interface configured to allow a user of a client device to select one or more skill sets to be trained;

  A step of allowing a user to select a variation of expert knowledge for one or more selected skills to be trained, the set of one or more skills to be trained There are several variations of expert knowledge available for a step;

  The client associated with the user following the user's selection of a set of one or more skills to be trained and a variation of expert knowledge for the selected one or more skills to be trained Providing a downloadable data to the device, enabling the download process, the downloadable data for the client device:

  (I) to process the data obtained from the set of performance monitoring sensors, thereby analyzing one physical performance given by the user; and

(ii) based on the analysis, configured to provide training data specific to selected expert knowledge variations via a user interface device;
Steps.

  One embodiment provides a method in which there is a first selectable expert knowledge variation and a second selectable expert knowledge variation for a selected set of one or more skills:

  With respect to the first selectable expert knowledge variation, the downloadable data provides the client device with a first set of observable data conditions associated with a given skill in the data obtained from the set of performance analysis sensors. Configure to identify,

  With respect to the second selectable expert knowledge variation, the downloadable data is the second different set of observable data conditions associated with a given skill in the data obtained from the client device. Configure to identify.

  One embodiment provides a human expert style difference in which the difference between the first set of observable data conditions and the second set of observable data conditions is associated with each expert knowledge variation. To provide a method.

  One embodiment provides coaching in which the difference between the first set of observable data conditions and the second set of observable data conditions is obtained from a human expert associated with each expert knowledge variation. Provide a way to explain advice.

  One embodiment provides a method in which there is a first selectable expert knowledge variation and a second selectable expert knowledge variation for a selected set of one or more skills:

  With respect to the first selectable expert knowledge variation, the downloadable data is the first feedback data to the user in response to observing the client device with defined observable data conditions associated with a given skill. Configured to provide a set of

  With respect to the second selectable expert knowledge variation, the downloadable data is sent to the user in response to observing a defined observable data condition associated with the given skill. Configure to provide a different set of.

  One embodiment describes a coaching advice in which a difference between a first set of feedback data and a second set of feedback data is obtained from a human expert associated with a respective expert knowledge variation. I will provide a.

  One embodiment includes different audio data in which the difference between the first set of feedback data and the second set of feedback data represents the voice of a human expert associated with each variation of expert knowledge, Provide a method.

  One embodiment provides a method wherein the performance analysis sensor includes a motion sensor.

  One embodiment provides a method in which a client device includes a POD device configured to be carried by a wearable garment, wherein the wearable garment is from a plurality of sensor units carried by the wearable garment to the POD device. A plurality of sensor strands configured to allow distribution of the resulting data is provided.

  One embodiment provides a method wherein each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope.

  One embodiment provides a system that enables a user to configure a local performance monitoring hardware device to provide training data associated with a selected one of a plurality of experts. Is:

  Configured to allow a client user interface device to interact with an interface configured to allow a user of the client device to select one or more sets of skills to be trained The interface is additionally configured and trained to allow a user to select a variation of expert knowledge for the set of one or more skills to be trained. A server having a plurality of variations of expert knowledge available for one or more skill sets to be

  The client associated with the user following the user's selection of a set of one or more skills to be trained and a variation of expert knowledge for the selected one or more skills to be trained A download manager component configured to enable a download process that provides downloadable data to a device, the downloadable data serving a client device:

  (I) to process the data obtained from the set of performance monitoring sensors, thereby analyzing one physical performance given by the user; and

(ii) Based on the analysis, via the user interface device, to provide training data specific to the selected expert knowledge variation,
Configure,
And a download manager component.

  One embodiment provides a system in which there is a first selectable expert knowledge variation and a second selectable expert knowledge variation for a selected set of one or more skills:

  With respect to the first selectable expert knowledge variation, the downloadable data provides the client device with a first set of observable data conditions associated with a given skill in the data obtained from the set of performance analysis sensors. Configure to identify,

  With respect to the second selectable expert knowledge variation, the downloadable data is the second different set of observable data conditions associated with a given skill in the data obtained from the client device. Configure to identify.

  One embodiment provides a human expert style difference in which the difference between the first set of observable data conditions and the second set of observable data conditions is associated with each expert knowledge variation. To provide a system.

  One embodiment provides coaching in which the difference between the first set of observable data conditions and the second set of observable data conditions is obtained from a human expert associated with each expert knowledge variation. Provide a system to explain advice.

  One embodiment provides a system in which there is a first selectable expert knowledge variation and a second selectable expert knowledge variation for a selected set of one or more skills:

  With respect to the first selectable expert knowledge variation, the downloadable data is the first feedback data to the user in response to observing the client device with defined observable data conditions associated with a given skill. Configured to provide a set of

  With respect to the second selectable expert knowledge variation, the downloadable data is sent to the user in response to observing a defined observable data condition associated with the given skill. Configure to provide a different set of.

  One embodiment describes a coaching advice in which a difference between a first set of feedback data and a second set of feedback data is obtained from a human expert associated with each expert knowledge variation. I will provide a.

  One embodiment includes different audio data in which the difference between the first set of feedback data and the second set of feedback data represents the voice of a human expert associated with each variation of expert knowledge, Provide a system.

  One embodiment provides a system in which the performance analysis sensor includes a motion sensor.

  One embodiment provides a system in which a client device includes a POD device configured to be carried by a wearable garment, the wearable garment from a plurality of sensor units carried by the wearable garment to the POD device. A plurality of sensor strands configured to allow distribution of the resulting data is provided.

  One embodiment provides a system in which each of a plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope.

  One embodiment provides a wearable garment, the wearable garment comprising: a plurality of sensor strands, each sensor strand comprising one or more sensor units, each sensor unit comprising: (i) a microprocessor; a plurality of sensor strands comprising: ii) a memory module; and (iii) a set of one or more motion sensor components; a sensor strand connection port, wherein the sensor strand connection port centralizes the plurality of sensor strands A sensor strand connection port configured to couple to the device; a central processing device, wherein the sensor processing unit includes (i) a power supply; (ii) a microprocessor; and (iii) a memory module; Multiple connected sensor units Executable by a microprocessor that allows the processing device to identify one or more sets of predefined observable data conditions in the sensor data, including sensor data received by the central processing device A central processing device configured to store software instructions.

  One embodiment provides a wearable garment, the wearable garment comprising: a plurality of sensor strands, each sensor strand including one or more attachment locations, each attachment location comprising a connection of a respective sensor unit and A plurality of sensor strands, each sensor unit comprising: (i) a microprocessor; (ii) a memory module; and (iii) a set of one or more motion sensor components; A sensor strand connection port, wherein the sensor strand connection port is configured to couple a plurality of sensor strands to the central processing device; to allow connection and attachment of the central processing device; A mounting position configured with a sensor The logical unit includes (i) a power supply; (ii) a microprocessor; and (iii) a memory module; A mounting location configured to store software instructions executable by a microprocessor that enables the processing device to identify one or more sets of observed observable data conditions.

  One embodiment provides a computer program product (computer program) for performing the methods described herein.

  One embodiment carries a non-transitory carrier medium that carries computer-executable code that, when executed on a processor, causes the processor to perform a method as described herein. )I will provide a.

  One embodiment provides a system configured to perform a method as described herein.

  References throughout the specification to “one embodiment (one embodiment)”, “some embodiments” or “an embodiment” refer to a particular configuration, structure, or characteristic described in connection with that embodiment. Is included in at least one embodiment of the invention. Thus, the appearances of the phrases “in one embodiment”, “some embodiments in” or “in embodiments” in various places throughout this specification are not necessarily all the same embodiment. May refer to the same embodiment. Furthermore, the particular individuality, structure, or characteristic may be combined in any suitable manner in one or more embodiments, as will be apparent to those skilled in the art from this disclosure.

  As used herein, unless otherwise specified, the use of adjectives “ordinary” “first”, “second”, “third”, etc., that represent ordinals for describing common objects is equivalent It simply indicates that the different cases of the object are mentioned, and the objects so described may be temporally or spatially, in a given order, ranked, or in any other way It is not intended to imply that it must be given.

  In the following claims and the description herein, any one of the terms comprising, comprising of, or comprising comprises at least the following elements / configurations, An open term that means not to exclude others. Thus, the term comprising, when used in the claims, should not be construed as limited to the means or elements or steps described thereafter. For example, the scope of the expression “a device including A and B” is not limited to a device including only elements A and B. As used herein, any one of the terms such as “including”, “which includes”, or “that includes” also includes at least its elements / configurations following that term. An open term that includes but does not exclude other elements / configurations. Thus, including is synonymous with “comprising” and means “comprising”.

  As used herein, the term “exemplary” is used in the sense of providing an example as opposed to indicating quality. That is, an “exemplary embodiment” is an embodiment provided as an example, as opposed to an exemplary quality embodiment.

  Embodiments of the present invention will now be described by way of example only with reference to the accompanying drawings.

FIG. 4 schematically illustrates a framework configured to enable content generation and distribution in accordance with one embodiment.

Fig. 4 schematically illustrates a framework configured to enable content generation and distribution in accordance with further embodiments.

Fig. 3 illustrates a skill analysis method according to one embodiment.

Fig. 3 illustrates a skill analysis method according to one embodiment.

Fig. 3 illustrates a skill analysis method according to one embodiment.

Fig. 3 illustrates a skill analysis method according to one embodiment.

Fig. 3 illustrates a skill analysis method according to one embodiment.

FIG. 6 illustrates a user interface display diagram for a user interface according to one embodiment.

2 illustrates an exemplary data collection table (data collection table).

2 illustrates an exemplary data collection table (data collection table).

2 illustrates a SIM analysis method according to one embodiment.

2 illustrates a SIM analysis method according to one embodiment.

Fig. 3 illustrates an ODC variation according to one embodiment.

Fig. 4 illustrates a process flow according to one embodiment.

Fig. 4 illustrates a process flow according to one embodiment.

Fig. 4 illustrates a process flow according to one embodiment.

Fig. 4 illustrates a sample analysis phase according to one embodiment.

Fig. 6 illustrates a data analysis phase according to one embodiment.

Fig. 4 illustrates an implementation phase according to one embodiment.

1 illustrates a standardization method according to one embodiment.

1 illustrates an analysis method according to one embodiment.

1 illustrates an analysis method according to one embodiment.

Fig. 3 illustrates an exemplary framework that includes server-side components and client-side components.

Fig. 4 illustrates a further exemplary framework that includes server-side components and client-side components.

Fig. 4 illustrates a further exemplary framework that includes server-side components and client-side components.

Fig. 4 illustrates a further exemplary framework that includes server-side components and client-side components.

Fig. 4 illustrates the operation of an exemplary framework.

Fig. 4 illustrates the operation of an exemplary framework.

Fig. 4 illustrates the operation of an exemplary framework.

Fig. 4 illustrates a method of operating a user equipment according to one embodiment.

2 illustrates a content generation method according to one embodiment.

1 illustrates a performance analysis instrument according to one embodiment.

1 illustrates a performance analysis instrument according to one embodiment.

1 illustrates a performance analysis instrument according to one embodiment.

1 illustrates a performance analysis instrument according to one embodiment.

Fig. 3 illustrates an MSU compatible garment according to one embodiment.

FIG. 3 illustrates an MSU-enabled garment according to one embodiment with exemplary connected equipment.

FIG. 3 illustrates an MSU-enabled garment according to one embodiment with exemplary connected equipment.

2 illustrates an MSU according to one embodiment.

Fig. 3 illustrates an MSU and housing according to one embodiment.

The characteristics of the hinge joint (hinge joint) are schematically illustrated.

The features of the elbow joint (elbow joint) are schematically illustrated.

The characteristics of the joint are schematically illustrated.

Fig. 4 schematically shows the joint motion of the human arm.

2 illustrates a guitar lesson configuration according to one embodiment.

2 illustrates an exemplary MSU-enabled garment portion.

Fig. 3 illustrates an exemplary structural loop according to one embodiment.

Fig. 4 illustrates a further exemplary framework with a process flow.

  Embodiments described herein relate to technical frameworks that use performance sensor units (PSUs) to monitor user skill performance and their PSUs. The attributes of user skill performance are determined by processing data derived from. For example, performance attributes are used to drive a computer program, such as a computer program configured to provide skill training. In other embodiments, the performance attributes are determined for alternative purposes, such as providing multi-user contention activity and the like.

  In the context of skills training, the framework described herein uses the PSU to collect data representing performance attributes, provides feedback to the user, and / or Or providing instructions to the user to help the user improve his / her performance. For example, this may include providing coaching advice, instructing the user to perform specific exercises, developing specific required basic sub-skills, and the like. By monitoring performance in real time through the PSU, the training program can adapt based on observations of whether the user's performance attributes improve based on the provided feedback / command. . For example, observing changes in performance attributes during repeated performance trials indicates whether the provided feedback / command has succeeded or failed. This enables the generation and distribution of a wide range of automatic adaptive skill training programs.

Although the nature of skill performance varies between implementations, the following two general categories are used for the purposes of the examples discussed herein.
● Human motion-based skill performance. These are performances in which human motion attributes represent critical characteristics of skills. For example, motion-based performance includes virtually any physical skill that encompasses the body movements of the performer. A significant class of motion-based performance is the performance of skills used in sports activities.
● Audio-based skill performance. These are performances where the acoustically perceptible attributes represent the critical characteristics of the skill. For example, audio-based skill performance includes musical and / or linguistic performance. A significant type of audio-based performance is the performance of skills associated with playing musical instruments.

  The examples provided below primarily focus on the relatively technical difficulties of motion-based skill performance, but the principles applied with respect to motion-based skills are easily applied to other situations. It will be understood that For example, the concept of using observable data conditions (ODC) in data received from a PSU is equally applicable to motion, audio, and other forms of performance.

  Some implementations relate to a computer-implemented framework that enables the definition, distribution and implementation of content experienced by end users in the context of performance monitoring. . This allows users to interact with skill training so that their skill performance is analyzed by processing performance sensor data (PSD) from one or more PSUs that are configured to be monitored by the user. Includes content configured to provide interactive skills training.

  Various implementations are described below with reference to an overall end-to-end framework. The overall framework is described as providing context for its components, some of which can be applied in different contexts. Only a subset of the overall described end-to-end framework features are claimed directly in the following claims, but the subject matter of the present invention is (e.g. specifically identified as such). It should be understood that it exists over a wide range of components (if not). For example, the subject of the invention is (i) understanding skills that are critical through analysis of skills, and (ii) defining one protocol or more by using one or more PUSs to automate skills. (Iii) provide interactive end-use content such as skill training by defining and delivering content using automated analysis, and (iv) adaptive skill training programs Implementation, (v) hardware and software that facilitates distribution of content to end users, (vi) hardware and software that facilitates end users to experience content, and (vii) human activity monitoring objectives Configuration of multiple motion sensor units for (config embodied over the features of the techniques and methodologies described herein, including, but not limited to, techniques and methodologies developed to facilitate uration and implementation.

Terminology For purposes of the embodiments described below, the following terms are used.
● Performance sensor unit (PSU). A performance sensor unit is a hardware device configured to generate data in response to physical performance monitoring. While embodiments of sensor units configured to process motion data and audio data are primarily contemplated herein, it will be understood that they are by no means limiting examples.
● Performance sensor data (PSD). Data distributed by the PUS is called performance sensor data. This data may include complete raw data from the PSU or a subset of that data (eg, based on compression, reduced monitoring, sampling rate (sampling rate), etc.).
● Audio sensor unit (ASU). An audio sensor unit is a category of PSUs that are hardware devices configured to generate and transmit data in response to sound monitoring. In some embodiments, the ASU is configured to monitor the effects of sound and / or vibration and convert them to digital signals (eg, MIDI signals). One example is a pick-up device that includes a transducer configured to capture mechanical vibrations of a stringed instrument and convert it into an electrical signal.
● Audio sensor data (ASD). This is data distributed by one or more ASUs.
● Motion sensor unit (MSU). A motion sensor unit is a category of PSUs that are hardware devices configured to generate and transmit data in response to motion. This data is most often defined relative to a local reference frame. A given MSU may include data obtained from one or more accelerometers, one or more magnetometers, and data obtained from one or more gyroscopes. Preferred embodiments utilize one or more 3-axis accelerometers, a 3-axis magnetometer, and a 3-axis gyroscope. The motion sensor unit may be “worn” or “wearable” and is configured such that the motion sensor unit is attached to a human body in a fixed position (eg, via clothing). Means that.
● Motion sensor data (MSD). Data distributed by the MSU is called motion sensor data (MSD). This data may include complete raw data from the MSU or a subset of that data (eg, based on compression, reduced monitoring, sampling rate, etc.).
● MSU compatible clothing. An MSU-enabled garment is a garment (such as a shirt or pants) configured to carry multiple MSUs. In some embodiments, the MSUs are attached in a predetermined mountain zone formed in the garment (preferably in a removable manner so that individual MSUs can be removed and replaced) Connected to communication line.
● POD device. A POD device is a processing device that receives a PSD (eg, an MSD from an MSU). In some embodiments, it is carried by an MSU-enabled garment, in other embodiments it is a separate device (eg, in one embodiment, the POD device is a processing device that couples to a smartphone, several In this embodiment, the POD device functionality is provided by a smartphone or mobile device). In some cases, the MSD is received via a wired connection, in some cases, received via a wireless connection, and in some cases, received via a wireless connection and a wired connection. The As described herein, the POD device processes the MSD, thereby identifying data conditions within the MSD (eg, allowing identification of the presence of one or more symptoms). )responsible. In some embodiments, the role of the POD device is performed in whole or in part by a multi-purpose end user hardware device such as a smartphone. In some embodiments, at least some of the PSD processing is performed by a cloud-based service.
● Motion capture data (MCD). Motion capture data (MCD) is data derived from using any available motion capture technology. In this regard, “motion capture” refers to a technique where, for example, a capture device is used to capture data representing motion using visual markers attached to a subject at a known location. One example is the motion capture technology provided by Vicon (however, the partnership between the inventor / applicant and Vicon should not be inferred). As discussed further below, the MCD is preferably used to provide a link between visual observation and MSD observation.
● Skills. In the context of motion-based activities, a skill is, for example, an individual motion (or set of linked motions) that is observed (visually and / or via MSD) in the context of coaching. The skill may be, for example, a rowing motion, a specific category of soccer kick, a specific category of golf swing, a specific acrobat operation, or the like. "Subskill" is also mentioned. This is mainly to distinguish between the skill being trained and the less important skills that form part of that skill, or the building blocks of that skill. For example, in the context of juggling skills, subskills are skills that throw a ball and catch it with the same hand.
● Symptoms. Indications are attributes of observable skills (eg, visually observed in the context of initial skill analysis and observed through MSD processing in the context of an end-user environment). In practical terms, a symptom is an observable motion attribute of a skill that is associated with a meaning. For example, the identification of symptoms may cause an action in providing an automated coaching process. Signs are visually observed (in the context of traditional coaching context) or via PSD (in the context of providing auto-adaptive skill training as discussed herein) May be observed.
● Cause. A symptom is associated with a cause in at least some cases (eg, a given symptom may be associated with one or more causes). The cause is also observable in the MSD in some cases, but that is not necessarily essential. From a coaching perspective, one approach is to first identify a symptom and then determine / predict the cause of the symptom (eg, the determination may be by analysis of the MSD, and the prediction may be by analysis of the MSD By other means). The determined / predicted cause may then be addressed by coaching feedback, followed by a performance evaluation, thereby determining whether the coaching feedback was successful in addressing the symptoms.
● Observable data conditions (ODC). The term observable data condition describes a condition that is observable in a PSD, such as MSD (typically based on monitoring the presence of an ODC or expected set of ODCs), thereby downstream Used to trigger functionality. For example, an ODC may be defined for a given symptom (or cause). If the ODC is specified for a given performance, such as an MSD, a determination is made that an associated symptom (or cause) is present in the performance. This in turn triggers an event in the training program.
● Training programs. The term “training program” is used to describe an interactive process that is provided through the execution of software instructions, which provides instructions to the end user how to perform and what their performance Provide feedback on how to modify, improve, or otherwise adjust. In at least some embodiments described below, the training program may analyze relevant end-users (e.g., analysis of their performance and / or personal attributes such as mental and / or physical attributes). “Adaptation,” which is a training program that runs based on rules / rules that allow process ordering, feedback selection, and / or other attributes of training to adapt based on Type training program.

  As described in more detail below, from an end-user product perspective, some embodiments allow a POD device to analyze a user's PSD (such as an MSD) for a given performance, thereby providing user attributes. Determining the presence of one or more indications that are indications belonging to a set defined based on (e.g., the user's ability level and indications known to the user from analysis of previous iterations) Utilize a technique that is structured as follows. Once the symptoms are identified via the MSD, the process is executed, thereby determining / predicting the cause. Next, select a feedback, thereby exploring how to deal with the cause. In some embodiments, a complex selection process is defined so that, for example, (i) the user's history, eg, prioritized feedback that was previously unsuccessful or previously successful with respect to previously failed feedback. (Ii) the user's learning style, (iii) user attributes, eg, mental and / or physical state at a given time, and / or (iv) in some cases a particular real world Select specific feedback for the user based on the coaching style based on the coach's style.

Exemplary End-to-End Framework FIG. 1A provides a high-level framework of an end-to-end framework that is exploited by a range of embodiments described herein. In the context of FIG. 1A, an exemplary skill analysis environment 101 is utilized, thereby analyzing one or more skills and providing data that enables generation of end-user content for those skills. For example, in some implementations, this includes analyzing skills and thereby determining ODCs that can be identified by the PSU (preferably ODCs associated with specific symptoms, causes, etc.). These ODCs may be utilized within content generation logic implemented by an exemplary content generation platform 102 (such as a training program). In that regard, generating content preferably includes defining a protocol in which a predetermined action is taken in response to the identification of a particular ODC.

  Preferably, multiple skill analysis environments and content generation platforms are utilized, thereby providing content to the exemplary content management and distribution platform 103. This platform is defined in some embodiments by a plurality of networked server devices. In essence, the purpose of the platform 103 is to make content generated by the content generation platform available to end users. In the context of FIG. 1A, it involves enabling download of content to the exemplary end user equipment 104. Downloading, in some embodiments, includes an initial download of content, followed by further downloads of additional required content. In some cases, the nature of the further download is affected by user interactions (eg, based on adaptive progression and / or user selection between skill training program components).

  Exemplary equipment 104 is illustrated in the form of an MSU-enabled garment that carries multiple MSUs and POD devices along with user interface devices (such as smart phones, headsets, HUD eyewear, retinal projection devices, etc.). Has been.

  In the example of FIG. 1A, a user downloads content from the platform 103 and causes the content to be executed via the device 104. For example, this may include content that provides an adaptive skill training program for a particular physical activity such as golf or tennis. In this example, the device 104 includes an exemplary content interaction platform 105, which is an external (eg, web-based) platform that provides additional functionality related to the distribution of downloaded content. Configured to interact. For example, various features of the adaptive training program and / or its user interface may be controlled by server-side processing. In some cases, the platform 105 may be omitted to allow the device 104 to distribute previously downloaded content in an offline mode.

As a general illustration, the following specific example of content is provided.
● Guitar training program. The user downloads a guitar training program configured to provide training on the required music. A PSU in the form of a pickup is used, thereby allowing analysis of the PSD representing the user's guitar performance. A training program is promoted based on the analysis of its PSD, thereby providing coaching to the user. For example, coaching is a hint for finger positioning, correction practice to practice progression between specific finger positions, and / or other content that is of interest to the user and / or may be helpful to the user Proposals (for example, alternative songs) may be included. An example is illustrated in FIG. 14 (showing a sound jack instead of a pickup in combination with a POD device that processes audio data and a tablet device that provides user interface data).
● Golf training program. The user downloads a golf training program that is configured to work with MSU enabled clothing. This includes downloading sensor configuration data and state engine data to the POD device provided by the MSU-enabled garment. A user is instructed to perform a specific form of swing (eg, using a specific strength, club, or equivalent), and multiple MSUs held by MSU-enabled garments provide an MSD that represents performance To do. Process the MSD, thereby identifying symptoms and / or causes and providing training feedback. This is repeated over one or more additional performance iterations based on training program logic designed to help the user improve his / her form. The instructions and / or feedback is provided by a retinal display projector that sends user interface data directly to the user's field of view.

  It will be understood that these are only examples.

  FIG. 1B provides a more detailed overview of a further exemplary end-to-end technology framework that exists in the context of some implementations. This example is particularly relevant to motion-based skill training, see skill analysis phase 100, curriculum construction phase 110, and end user delivery phase 120. Is exemplified by This is not intended to be a limiting example and is provided to demonstrate a specific end-to-end approach to defining and delivering content.

  In the context of the skill analysis phase 100, FIG. 1 illustrates several embodiments that support analysis of skills using MCD, and subsequently assist and / or validate the determination of ODC for MSD. In this embodiment, the selection of hardware used in the phase is shown. The illustrated hardware holds a plurality of motion sensor units and a plurality of motion capture (mocup) markers (which are optionally placed at similar locations on the garment) and a set of capture devices 106a-106c. The wearable sensor garment 106. There may be a smaller or greater number of capture devices, including capture devices configured for motion capture applications and / or camera devices configured for video capture applications. In some embodiments, a given capture device is configured for both applications. A series of exemplary processes are also illustrated. Block 107 represents a process that includes capturing video data, motion capture data (MCD), and motion sensor data (MSD) for multiple sample performances. This data is used by the process presented in block 108, which analyzes (eg, analyzes a given skill, thereby configuring the skill and affecting performance, preferably at multiple ability levels. Expert analysis (including determining the characteristics of motion and determining signs and causes for the required skills, including decisions specific to the signs and causes of the required skills) Based on disassembling skills into signs and causes. Block 109 presents a process that includes an ODC definition that enables detection of symptoms / causes from motion sensor data. These ODCs are then available in subsequent phases (eg, they are used in a given curriculum, applied in state engine data, etc.).

  Although phase 100 is described herein with reference to an approach that utilizes DCD, it is not intended to be a limiting example. In further embodiments, various other approaches, such as an MSD-based approach (eg, no need to use an MCD to support and / or verify an ODC decision on the MSD), a skill machine An approach using learning is implemented.

  Phase 110 is illustrated with reference to a repository of expert knowledge data 111 (expert knowledge data). For example, one or more databases are maintained, which contain information defined according to Phase 101 features and / or other research and analysis techniques. Examples of information are: (i) consensus data representing signs / causes, (ii) expert-specific data representing signs / causes, (iii) consensus data representing feedback on signs / causes (Iv) expert specific data representing feedback related to symptoms / causes, and (v) coaching style data (which may include objective coaching style data and personalized coaching style data). This is only a choice.

  In the example of FIG. 1B, expert knowledge data is used to distribute a training program relating to skills analyzed in phase 100. Block 112 represents a process that includes the configuration of an adaptive training framework. In this regard, in the example of FIG. 1B, a plurality of skill training programs associated with each skill and its features are delivered via a common adaptive training framework. This is preferably a technical framework configured to allow generation of skill specific adaptive training content that leverages underlying non-skill specific logic. For example, such logic automatically predicts learning styles, adjusts content delivery based on available time, and automatically based on previous interactions (including remediation classes for previously learned skills). It relates to methodologies for creating lesson plans, functionally recommending additional content to download, and other functionality. Block 113 represents a process that includes defining a curriculum for the skill. This includes defining a framework of rules for delivering feedback in response to identifying specific signs / causes. The framework preferably provides intelligent feedback based on acquired knowledge specific to individual users (eg, knowledge of the user's learning style, knowledge of past successful / failed feedback, etc.). An adaptive framework to provide. Block 114 represents a process that includes making a curriculum available for download by an end user, eg, making the curriculum available via an online store. As will be described in further detail below, a given skill may include providing a basic curriculum and / or providing one or more premium curriculums (preferably at different price points). As an example, the basic offering is based on consensus expert knowledge and the premium offering is based on expert specific expert knowledge in some embodiments.

  In the case of phase 130, an exemplary end user device is illustrated. This includes an MSU-enabled garment configuration 121 that includes a shirt and pants that hold a plurality of MSUs, with a POD device provided on the shirt. The MSU and POD devices are configured to be removable from clothing, for example, to allow cleaning and the like. A headset 122 is connected to the POD device by Bluetooth® (or other means) and is configured to audibly provide feedback and instructions to the user. A handheld device 123 (such as an iOS or Android smartphone) is configured to provide additional user interface content, such as educational video / animation. Other user interface devices may be used, for example, devices configured to provide augmented reality information (such as a display visible via wearable eyewear or the like).

  The user of the illustrated end user equipment downloads content for execution (eg, from platform 103), thereby participating in a training program and / or other forms of content that take advantage of the processing of the MSD. experience. For example, this may include browsing an online store or interacting with a software application, thereby identifying the desired content and subsequently downloading the content. In the illustrated embodiment, content is downloaded to the POD device, and the content includes state engine data and curriculum data. The former includes data that allows the POD device to process the MSD and thereby identify symptoms (and / or perform other forms of motion analysis). The latter can provide a training program that includes content delivered by a user interface (eg, instructions, feedback, etc.) and instructions for the delivery of that content (such as rules for the delivery of adaptive learning processes) Contains the data needed to make it. In some embodiments, engine data and / or curriculum data is continuously obtained from a remote server.

  Function block 125 represents the process by which the POD device performs a monitoring function, thereby monitoring user performance for the ODC as defined in the state engine data. For example, the user is instructed to “perform activity X” via device 123 and / or headset 122, and then the POD device processes the MSD from the user's MSU, thereby sending activity X to Identify the associated ODC (eg, allow identification of symptoms and / or causes). Based on ODC identification and curriculum data (and in some cases based on additional inputs), feedback is provided to the user via device 123 and / or headset 122 (block 126). For example, while performing “Activity X” repeatedly, the user is provided with audible feedback with guidance on how to modify those techniques. This is a loop process (eg, “trial loop” herein) that provides feedback and monitors the impact (eg, by observing changes in ODC derived from the MSD in subsequent performance iterations). Called). The curriculum data in some embodiments may include user attributes such as (i) success / failure of feedback to achieve a desired result with respect to activity improvement, and (ii) mental and / or physical performance attributes. Based on the combination of the training program feedback and / or stage.

Skill Analysis Phase—Overview As described above, in some embodiments, a skill analysis phase is performed, thereby analyzing skills to be observed in the end-user delivery phase. More specifically, the skill analysis phase preferably includes (i) attributes of skills, eg, attributes representing skills to be executed (particularly relevant when end-user functionality includes skill identification), and (end Analysis to determine attributes representing how the skill is performed, such as symptoms and causes (eg, particularly relevant when the functionality of the user includes skill training analysis in the context of delivery of skill training), and (Ii) the end user's hardware (PSU like MSU) can be configured for automated skill performance analysis (skills performed, and that skill such as signs and / or causes) Analysis that defines an ODC that allows automatic identification of skill attributes, such as performance attributes.

  The nature of the skill analysis phase varies significantly depending on the nature of a given skill (eg, between the motion-based skill and audio-based skill categories). Next, for illustrative purposes, an exemplary implementation is described with respect to the skill analysis phase in the context of motion-based skills. That is, embodiments will be described with reference to determining ODC used to configure a POD device that analyzes physical activity and thereby monitors data from a body-mounted MSU. This example illustrates a relatively difficult and complex context in which various new and progressive technical approaches have been developed to facilitate the task of generating effective ODC for motion-based skills. Selected to represent the skill analysis staged in. It will be appreciated that not all features of the methodologies described herein are present in all implementations, or are not used in the context of all activities. This technique is applicable to a wide range of physical activities with different levels of complexity (eg, regarding performance, coaching, and monitoring). However, the methodologies described herein are applicable across a wide range of activities, such as skills performed in the context of individual and team sports.

  The methodologies and techniques detailed below are described with reference to specific examples relating to specific physical activities (ie, specific skills), ie, rowing. Rowing has been chosen as an example primarily for the purpose of textual explanation, and techniques described with reference to that particular activity can be used to describe other activities (eg, kicks in certain forms of soccer balls, It will be readily understood how it can be easily applied to golf club swings, acrobatic maneuvers on snowboards, etc.

Generally speaking, there are a wide range of approaches for determining ODC for a given physical activity. These include, but are not limited to:
● Utilize secondary technology, thereby streamlining the understanding of MSD. For example, the examples provided below discuss an approach that utilizes a combination of MCD and MSD. MCD is primarily used because of the established nature of motion capture technology (eg, using a powerful high-speed camera). On the other hand, motion sensor technology is currently constantly evolving. The use of well-established MCD analysis techniques assists in understanding and / or verifying MSDs and observations made on MSDs.
● Direct use of MSD without MCD support. For example, MSD, like MCD, captures data, thereby generating a three-dimensional body model similar to that conventionally generated from MCD (eg, based on a body avatar with skeletal joints). Used in meaning. It will be understood that this assumes a threshold of MCD accuracy and reliability. However, in some embodiments this can be achieved, thus obviating the need for MCD support.
● For example, an MSD and / or MCD may contain multiple samples with objectively defined performance result data (eg, power output in the case of rowing and ball direction and trajectory in the case of golf) Machine learning methods collected for performance. A machine learning method is implemented, thereby enabling automatic definition of the relationship between ODC and the impact on skill performance. Such an approach, when implemented with a sufficient sample size, enables ODC computer identification and promotes prediction of skill performance results. For example, based on golf swing motion machine learning using MSD (or in some embodiments, MCD) sample performance collection, objectively defined results analysis is used to affect swing performance ODC is automatically identified, thereby enabling a reliable and automated prediction of results regarding the end user's swing using the end user's hardware (eg, MSU enabled clothing).
● Remote collection of analysis data from end users. For example, the end-user device has a “record” function, which is an MSD that represents a specific skill each performed by the end-user (optionally with information about symptoms, etc., specified by the user himself). Enable recording. The data recorded is central to compare the MSD for a given skill (or a specific skill with a specific symptom) for multiple users and thus identify the ODC for the skill (and / or symptom). Sent to the processing location. For example, this is accomplished by identifying common points in the data.

  Other approaches, including other approaches that utilize non-MSD data to validate and / or otherwise support MSD data, including other approaches that implement different techniques for defining and analyzing sample user groups May be used.

  With reference to specific exemplary embodiments directed to enabling subjective expert coaching knowledge that contributes to the development of ODC for signs and / or causes that can be used in the context of a skill training program, see above The first embodiment will be discussed in more detail below.

Skill Analysis Phase-Sample Analysis Example In some exemplary embodiments, for each skill being trained, one or more sample skill performers are used to perform an initial analysis of the motions contained in that skill. It is therefore necessary to be able to determine the difference between optimal performance and sub-optimal performance (hence enabling guidance towards optimal performance). Generally speaking, this starts with a visual analysis, which then (through one or more intermediate processes) analyzes motion sensor data (observable data conditions or Called monitoring for ODC).

The exemplary techniques described herein include obtaining data representing physical skill performance (for a given skill) by a plurality of sample subjects. For each physical skill performance, the data preferably includes:
(I) Video data captured by one or more capture devices from one or more capture angles. For example, in the rowing context, this may include a side capture angle and a back capture angle.
(Ii) Motion capture data (MCD) using any available motion capture technique. In this regard, “motion capture” refers to a technique that uses a capture device to capture data representing motion, for example, using visual markers attached to a subject at a known location. One example is the motion capture technology provided by Vicon (however, the partnership between the inventor / applicant and Vicon should not be inferred).
(Iii) Motion sensor data (MSD) using one or more body-mounted motion sensors.

  In any case, the preferred approach is to store both (i) raw data and (ii) data that has undergone some processing. This is especially true for motion sensor data. As newer / better processing algorithms become available, the raw data may be reprocessed over time, thereby improving end-user functionality.

  In general, the general concept is needed for final end-user functionality, including video data (which is most useful for real coaches) and coaching (through analysis of data obtained from MSU-enabled garments) ) Use MCD as a stepping stone with MSD. Since MCD is (i) a well-developed and reliable technology and (ii) suitable for monitoring precise relative motion of body parts, MCD presents a useful foothold in this regard To do.

  The overall technique consists of the following phases: (i) collecting data representing sample performance by selective subjects, (ii) visualizing sample performance by one or more coaches using video data. Analysis, (iii) transformation of visual observations made by one or more coaches into MCD space, and (iv) analysis of the MSD based on MCD observations, so that one person or Including identifying ODCs in MSD space that represent more coach observations. Each of these phases is discussed in further detail below. This is illustrated in FIG. 2A via blocks 201-204.

  An alternative method is to omit video data collection and instead perform visual analysis via a digital model generated using MCD. FIG. 2B (using MSD only, MSD based computer FIG. 2C (achieving visual analysis using a production model), FIG. 2D (no visual analysis, only data analysis of MCD identifying similarities and differences between samples), and machine via MSD Illustrated in FIG. 2E utilizing learning (MSD is collected for sample performance and data analysis is performed on the result data, which is an objective measurement of one or more result parameters of sample performance. , ODC is defined based on machine learning and enables prediction of results based on ODC).

  With respect to using “one or more” coaches, in some cases, multiple coaches are used, thereby defining a consensus position for the analysis and coaching of a given skill, In that case, a number of coaches may be used alternatively / additionally to define content specific to the coach. The latter allows the end user to choose between coaching based on a broader coaching agreement and coaching based on a particular coach's particular viewpoint. At a practical level, in the context of commercial implementation, the latter may be provided as a basis for providing premium content (optionally at higher price points). The term “coach” is used to describe a person who qualifies as a coach, or who works in coaching abilities for this purpose (such as athletes or other experts). Sometimes used.

Skill Analysis Phase—Subject Selection Example Subject selection involves selecting a group of subjects that represent a given skill. In some exemplary embodiments, sample selection is performed to allow normalisation over one or more of the following parameters.
(I) Ability level. Preferably, multiple subjects are selected so that there are sufficient representatives across a range of ability levels. This involves first determining a set of known competence levels to ensure sufficient number of subjects for each level, analyzing the first sample group and, based on that analysis, representing the ability level representatives from within that group. Identify and optionally expand to sample groups that do not represent a capability level, or other approaches. In the embodiment described herein, the user ability level is the center of an automated coaching process at multiple levels. For example, as discussed further below, an initial assessment of the user capability level is used to determine how the POD device is configured, for example with respect to the ODC that the POD device monitors. As a context, mistakes made by beginners are different from mistakes made by experts. Moreover, for example, providing training first, thereby achieving optimal (or near-optimal) performance at the beginner level and continuing to provide training, thereby optimizing (or optimal) at a more advanced level It is advantageous to provide coaching directed to the user's actual ability level by achieving performance (close to).
(Ii) Body size and / or shape. In some embodiments, or for some skills, body size and / or shape may have a direct impact on the motion attributes of the skill (eg, by reference to observable characteristics of symptoms). is there. An optional approach is to expand the sample so that the sample is representative of each of a plurality of body sizes / shapes, ideally at each ability level. As discussed further below, body size / shape standardization is alternatively achieved in some embodiments via a data driven sample expansion method, as discussed further below. In short, this involves multiple MCD / MSDs by applying a predetermined set of transformations to the collected data, thereby transforming the data over a range of different body sizes and / or shapes. Allows a data set to be defined for each sample user performance.
(Iii) Style. Users may have their own style that does not significantly affect performance. The sample preferably includes sufficient representatives that allow standardization across styles so that the observational characteristics of the signs are style independent. This allows coaching in a performance-based method regardless of individual style features. However, in some embodiments, at least the symptom selection is defined in a style specific manner. For example, this allows coaching to adopt a particular style (e.g., allows coaching towards a particular athlete's style).

For simplicity, the following description focuses on standardization for multiple capability levels. In the exemplary embodiment, there are “m” ability levels (AL _{1 to} Al _m ), and there are “n” subjects (SUB _{1 to} SUB _n ) at each ability level. That is, there are m ^* n subjects as a whole. The number of subjects at each individual ability level may not necessarily be equal (e.g., in some embodiments, additional subjects are observed at a given ability level, thereby providing more reliable data. can get).

  As described above, in some implementations, for example, based on the specification that additional data points are preferred, the sample is expanded over time.

Skill Analysis Phase-Performance Regime Definition Example In some exemplary embodiments, each test subject (test
subject) (SUB ₁ to SUB _n at each AL ₁ to AL _n) performs a predetermined performance regime (performance regime). In some embodiments, the performance regime is constant across multiple capability levels. In other embodiments, a specific performance regime is defined for each capability level. As a context, in some cases, the performance regime includes performance at various intensity levels, and certain intensity levels may be inappropriate below a threshold capability level.

Some embodiments provide a process that includes defining an analytical performance regime for a given skill. This regime defines multiple physical skills to be performed by each subject for the purpose of sample data collection. Preferably, the analysis performance regime is defined by instructions that execute a predetermined number of sets, each set having a predetermined set parameter. The set parameters preferably include:
(I) Number of iterations for each set. For example, the set may include n iterations (where n ≧ 1), and the subject repeatedly tries the skill with a predetermined parameter.
(Ii) Repeat instruction. For example, how long do you rest between iterations?
(Iii) Intensity parameter. For example, the set may be performed with a constant intensity (each iteration REF _{1 to} REP _n with the same intensity I _c ), increasing the intensity (performing the iteration R ₁ with the intensity I ₁ , then the intensity I ₂ REP ₂ at, where I ₁ > I _2, etc., or decrease the intensity (perform REP ₁ at intensity I ₁ and then execute R ₂ at intensity I ₂ , where , I ₁ <I ₂ etc.) or a more complex intensity profile. The way in which strength is defined depends on the activity. For example, intensity parameters such as speed, power, frequency, etc. may be used. Such measurements allow objective measurement and feedback in some cases. Alternatively, the percentage of maximum intensity (eg, “50% of maximum”) is subjective but often effective.

As an example, a given analytical performance regime for analyzing skills in the form of rowing motion on an erg machine (a form of indoor rowing equipment) may be defined as follows:
● Run ₆ sets (SET _{1 to} SET ₆ ) and take a 5-minute break between sets.
Perform 8 consecutive iterations for each set (REP _{1 to} REP ₈ ).
● Intensity parameters are SET ₁ at intensity = 100 W, SET ₂ at intensity = 250 W, SET ₃ at intensity = 400 W, SET ₄ at intensity = 550 W, SET ₅ at intensity = 700 W, and intensity = 850 W. SET ₆ .

  Reference to the rowing example further follows. However, it should be understood that this is only a representative skill provided for illustration and that the underlying principles are applicable to a wide range of skills.

Skill Analysis Phase-Exemplary Data Collection Protocol Data is collected and stored for each user completion of the performance regime. As noted above, for this example, in the main example considered herein, the data includes:
(I) Video data captured by one or more capture devices from one or more capture angles. For example, one or more of front, back, side, opposite, top, and other camera angles may be used.
(Ii) Motion capture data (MCD) using any available motion capture technology.
(Iii) Motion sensor data (MSD) using one or more body-mounted motion sensors.

  It is preferable to control the conditions under which data collection is performed, thereby achieving a high degree of consistency and comparability between samples. For example, this may include techniques such as using markers or the like to ensure consistent camera placement to assist in subject positioning, accurate positioning of the MSU on the subject, and the like.

  The collected data is organized and stored in one or more databases. Metadata is also preferably collected and stored, thereby providing additional context. In addition, in some cases, the data is processed to identify key events. In particular, events may be automatically and / or manually tagged in the data for motion-based events. For example, a given skill iteration may include multiple motion events, such as start, end, and one or more intermediate events. Events may include things like steps, moments when a ball is touched, key points during a rowing motion, etc. These events may be defined within each data set or on a timeline that can be synchronized across video data, MCD and MSD.

Skill Analysis Phase-Exemplary Data Synchronization Each form of data is preferably configured to be synchronized. For example, it is as follows.
● The video data and MCD are preferably synchronized and thereby configured to allow comparative review. This can be done, for example, by side-by-side video review (especially useful for comparative analysis of video / MCD captured from different viewing angles), or video / MCD captured specifically for common angles. Including an overlaid review with partial transparency.
The MSD is preferably configured to be synchronized so that data from multiple MSUs is converted / stored against a common time reference. This is, in some embodiments, each MSU that provides data to the POD device that represents a time reference to its own local clock and / or a time reference to an observable global time clock. Achieved by: Various useful synchronization techniques for time synchronization of data supplied by distributed nodes are known from other information technology environments including, for example, media data synchronization.

  Synchronization preferably includes, but is not limited to, time-based synchronization (configured such that the data is standardized to a common time reference). In some embodiments, event-based synchronization is used in addition to or as an alternative to time-based synchronization (or as a means to support time-based synchronization).

  Event-based synchronization refers to a process in which data such as MCD or MSD includes data representing an event. Events are typically defined relative to a local timeline for data. For example, an MCD may include a video file having a start time at 0:00: 00 and an event is defined by the time relative to that start time. An event may be automatically defined (eg, by referring to an event that may be specified by a software process such as a predetermined observable signal) and / or (eg, a visual visual of the data) It may be manually defined (marking video data during inspection and identifying the time when a particular event occurred).

  In the context of MCD, the data is preferably marked to allow synchronization based on one or more performance events. For example, in the rowing context, it marks various identifiable motion points during the rowing motion, thereby enabling synchronization of video data based on the commonality of the motion points. This is particularly useful when comparing video data from different sample users. It helps to identify different speed movements between such users. In some cases, motion point-based synchronization is based on a number of activities, and the video rate is calculated based on two common motion activities in the video data for two different samples (eg, different users, different iterations, different sets, etc.). It is adjusted (eg, the speed is increased or decreased) to show the same speed progression between these motion activities when viewed in parallel (or stacked). For example, if one rower has a stroke time of 1 second and another person has a stroke time of 1.2 seconds, motion activity-based synchronization will reduce the latter to 1 second, thereby Applied to allow a more direct comparison between the two rower motions.

Skill Analysis Phase-Exemplary Data Expansion Methodology In some implementations, MSDs and / or MCDs are converted for each subject through a data expansion process, thereby providing a plurality of additional data having different physical attributes. Define a “virtual subject”. For example, a transformation is defined to allow each MCD and / or MSD data activity to be transformed based on a plurality of different body sizes. This allows performance capture from subjects with specific body sizes to be extended to multiple sample performances that reflect different body sizes. The term “body size” refers to attributes such as height, torso length, upper limb length, lower limb length, waist width, shoulder width, and the like. It will be appreciated that these attributes actually change the path and relative position of the markers and MSUs used for MCD and MSD data collection, respectively.

  Data expansion is the body size in that the data collected from all sample performers can be expanded to a set of virtual performances that include one or more virtual performances by virtual performers with “standard” body sizes. It is also useful in the context of standardization. In some embodiments, a single “standard” body size is defined. The use of standard body size, and the conversion of MSD and MCD from sample performance to that standard body size, allows for a direct comparison of MCD and MSD despite the differences in body size of multiple sample performers. .

Skill Analysis Phase-Exemplary Virtual Analysis Methodology As described above and as shown in block 202 of FIG. 2A, features of an exemplary skill analysis methodology include visual analysis of sample performance via video data. In other embodiments, video analysis is performed using computer-generated models derived from MCD and / or MSD as an alternative to or in addition to video data. Thus, the following examples focus on inspections based on video data, but such examples are non-limiting, and video data is generated based on MCD and / or MSD in other embodiments. It should be understood that it is replaced with a model.

  Visual analysis is performed for a variety of purposes, including preliminary understanding of the skill and its components, initial identification of symptoms, and analysis of individual sample performance based on a predetermined analysis scheme.

  FIG. 3 illustrates an exemplary user interface 301 according to one implementation. It will be appreciated that specially adapted software is not used in all embodiments. The example of FIG. 3 is provided primarily to illustrate key functionality that is particularly useful in the visual analysis process.

  User interface 301 includes a plurality of video display objects 302a-302d, each of which is configured to play stored video data. In some implementations, the number of video display objects varies based on, for example, (i) the number of video capture camera angles for a given sample performance, and (ii) user controls. Provided about. With respect to user control, the user can be at a performance level (in this case, multiple video display objects are collectively configured for multiple video angles associated with that performance) or individual video bases (eg, 1 By selecting a particular angle from one or more sample performances, it is possible to select the video data to be displayed. Each video display object can be configured to display a single video or to display multiple videos simultaneously (eg, two videos overlap each other with some transparency, thereby overlapping) And allows visual observation of differences). The playback context display 304 provides details about what is displayed on the video display object.

  The video data displayed in the objects 302a-302d is synchronized, eg, time synchronized. A common scroll bar 303 is to allow synchronized navigation through multiple synchronized videos (which may include multiple overlaid video objects within each video display object, as described above). Provided. In some implementations, a toggle is provided to move between time synchronization and motion event based synchronization.

  The navigation interface 305 allows the user to navigate through available video data. This data is preferably configured to be sorted by referencing multiple attributes, thereby allowing the desired performance and / or video identification. For example, one approach is to first sort by skill, then sort by ability level, and then sort by user. In a preferred embodiment, the user is allowed to drag and drop performance video data sets and / or individual videos onto video display objects.

  FIG. 3 additionally illustrates an observation recording interface 306. This is used to allow the user to record observations that can be associated with the viewed performance data set (eg, completing a checklist, creating notes, etc.). When multiple performance data sets are viewed, there is preferably a master set and one or more overlaid comparison sets, and observations are associated with the master set.

Skill Analysis Phase—Exemplary Symptom Identification Through Visual Analysis In an exemplary implementation, a number of experts (eg, coaches) are involved in examining sample performance and thereby identifying symptoms. In some cases, this is facilitated by an interface, such as user interface 301, that provides an observation recording interface 306.

  Overall, each expert examines each sample performance based on a pre-determined examination process (via examination of video data, or examination of a model built from MCD and / or MSD). For example, the inspection process may be predetermined to require a certain number of views under certain conditions (eg, normal speed, slow motion, and / or overlaid “correct form” examples). May be. The expert makes observations about the identified signs.

  FIG. 4A shows an exemplary checklist used in one implementation. Such a checklist may be completed in hardcopy form or via a computer interface (such as interface 306 in FIG. 3). The checklist is the skill being analyzed by the inspector (ie, the expert / coach performing the inspection) (in this example “standard roaming action”), the person indicated in the sample performance identified by name or ID. Identify the data attributes, including the subject), the subject's ability level, and the set being examined. Additional details about any of these data attributes may be displayed along with other characteristics of the data.

  The checklist then includes a header line that identifies symptoms that the expert is instructed to observe. In FIG. 4A, these are shown as S1 through S6, but in practice (like “snatched arms” or “rushing slide” in the context of this rowing embodiment) It is preferable to record symptoms with reference to descriptive names / terms. The header row shows the individual iterations REP1 to REP8. The examiner notes the presence of each sign for each iteration. The set of symptoms may vary depending on the ability level.

  Data derived from the checklist (and other collection means) as shown in FIG. 4A is collected and processed, thereby determining the presence of symptoms in each iteration of each set for sample performance. This may include determining a consensus view for each iteration, for example, requiring a threshold number of experts to identify symptoms in a given iteration. In some cases, consensus view data is stored in combination with individual expert observation data.

  Video data, MSD, and MCD are associated with data representing the presence of symptoms. For example, an individual data set defining an MSD for a given iteration of a given set of sample performance is associated with one or more identified symptoms.

  In some implementations, a checklist such as the checklist of FIG. 4A is pre-populated with predictive symptoms based on analysis of MSDs based on a predefined set of ODCs. The inspector can verify the accuracy of the automated prediction based on MSD by confirming / rejecting those predictions based on visual analysis. In some embodiments, such verification is performed as background work without pre-populating checklists.

Skill Analysis Phase-Exemplary Symptom-to-Cause Mapping In some implementations, an analysis is performed that allows a symptom to be mapped to a cause based on visual analysis. As context, a given symptom may be due to any one or more of multiple root causes. In some cases, the first sign is the cause of the second sign. From a training point of view, it is useful to determine the root underlying the cause for a given sign. In that case, training can be provided to address the cause and thus help to correct the symptoms (in embodiments where “signs” show the wrong form).

As an example, referring again to the standard rowing motion, the following symptoms may be defined:
● Minimal rock over.
● Van shove (bum shove).
● Snatched arms.
● A rushing recovery slide.
● Over the mountain.
● knees bending before hands past knees.
● Recovery too short.
● C-shaped back.

Next, for each symptom, multiple possible causes are defined. For example, “struck arm” (“snatched
In the context of arms ”), the cause may be defined as follows:
● Loading arms early.
● Loading back early.
● A rushing recovery slide.

  Symptom-cause correlation analysis assists in predicting / determining which of the multiple causes are involved in the identified symptoms. If the cause is also a symptom (like the “rush recovery slide” above), the cause of the symptom is identified (potentially repeatable process) until the expected root cause is identified (etc.) Is done. The root cause can then be addressed.

In some embodiments, the expert performs additional visual analysis, thereby associating symptoms with causes. This may be performed at any one or more of multiple levels. For example, it is as follows.
● Association of symptoms with root cause at a general skill-based level.
• Correlate symptoms with root cause for each ability level.
• Association of symptoms with root cause for each individual athlete.
• Association of symptoms with root cause for each set performed by each individual athlete (eg, providing guidance on the relationship between ability, strength, and symptoms / cause relationships).
• Causal association with symptoms for each iteration of each set made by each individual athlete. This is more resource intensive but allows a detailed analysis of the MSD for a specific cause.

  Similar to symptom identification, in some embodiments a checklist is used. An exemplary checklist is provided in FIG. 4B. In this checklist, the examiner notes the correlation between the symptoms and causes identified for a given set (in this example, S1, S2, S4 and S5). In the case of a computer-implemented checklist, the header row may be filtered to reveal only the symptoms identified as being in the set. In some implementations, the expert is allowed to add additional cause columns to the checklist.

  An overlap matrix that aggregates data representing symptom-cause correlation across multiple examiners, thereby identifying a consensus view of the relationship between symptoms and causes as specified by multiple experts Define This may be ability level based, athlete based, set based, or repetitive based. In any case, the aggregation allows for the determination of data that allows for the prediction of the cause or possible cause when symptoms are identified for athletes of a given ability level. When an ODC is defined for an individual cause, it allows the processing of the MSD, thereby identifying the presence of any of the identified one or more possible causes.

In some implementations, symptom-cause correlations that do not match well among experts to be part of the consensus view are stored for premium content generation purposes. For example, in the context of a training program, there may be multiple levels of premium content.
● Base level using consensus view for symptom-cause correlation.
● Further symptom-cause correlation further associated with that particular expert (based on the observation that the specific correlation has been consistently identified by the particular expert but not reflected in the consensus view) A higher level that uses additional groups.

  The overlap matrix may be used to define the relative probabilities of specific causes involved in specific symptoms based on context (such as ability level). For example, at the first competence level, sign A is 90% likely to be the result of cause B, but at the second ability level, cause B is only 10% likely for the sign. First, cause C may be 70% likely.

  In some embodiments, an analysis is performed that associates each iteration with a cause (in a manner similar to the above symptoms), thereby helping to identify the ODC for the cause in the MSD. However, in other embodiments, the cause is identified on a probabilistic prediction basis without requiring analysis of the MSD.

Skill Analysis Phase-Illustrative Identification of Ability Level Indications In some embodiments, an important category indication is an indication that allows a subject to be categorized to a defined ability level. The classification to a given ability level may be based on the observation of a particular sign or one or more of a set of signs.

  As described further below, some embodiments may include training program logic that first makes a determination regarding a capability level based on, for example, an indication that represents an observation capability level, and then executes a downstream action based on that determination. Utilize. For example, monitoring for ODC in some cases depends on capability levels. For example, the ODC for a given symptom is defined differently at the first ability level compared to the second ability level. In practice, this is not the result of beginners making course errors that display symptoms, but experts may display symptoms through even more fine movement changes.

Skill analysis phase-exemplary determination of ODC (eg, for state engine data) Following visual analysis by experts / coaches, the skill analysis phase is expert knowledge derived from visual analysis of sample performance To a data analysis sub-phase that defines an ODC that enables automatic detection of symptoms based on MSD. For example, such an ODC is later downloaded to end-user hardware (eg, a POD device) so that the training program can operate based on input representing the detection of specific symptoms in the end user's physical performance. Used in state engine data.

It will be appreciated that a range of different methodologies are used in different embodiments to define an ODC for a given symptom. In some embodiments, a general methodology includes:
(I) Perform an analysis of the MSD, thereby identifying a combination of data attributes that are predicted to indicate the presence of symptoms based on the results of the visual analysis (eg, based on the MSD including acceleration rate and direction).
(Ii) Test their data attributes against data representing sample performance (eg, using the actual recorded MSD) and relate those data attributes (optionally on a capability level specific basis) Verify that it is present in all sample performances that display the indications.
(Iii) Test their data attributes against data representing sample performance (eg, using the actual recorded MSD) and verify that those data attributes (again optionally on a capability level specific basis) Verify that there is no sample performance that does not display related symptoms.

Examples include, but are not limited to:
● An approach that uses MCD as a foothold between visual analysis and MSD.
● An approach that shifts directly from visual analysis to MSD analysis.
● An approach to define ODC based on data obtained from individual sensors.
● An approach to defining ODC based on overall body motion using a virtual body model built from MSD.

  A set of examples is described in detail below.

  In some implementations, the ODC is tuned to efficiently utilize end-user hardware, for example, by defining less processor / power intensive ODC at the MSU and / or POD device. For example, this may be related in terms of sampling rate, data resolution, etc.

Skill Analysis Phase-Exemplary Transformation from Visual Observation to MCD Space As mentioned above, in some embodiments, MCD space is used as a foothold between visual observation and MSD data analysis. This is useful to avoid the challenges associated with accurately defining the virtual body model based on the MSD (eg, keeping in mind the challenges associated with converting the MSD to a common geometric reference frame) It is.

  Overall, for a given symptom, the process includes analyzing the MCD associated with the performance marked as displaying that symptom. This analysis is done in some embodiments on a capability level specific basis (noting that the symptom is observable from motion and depends to some extent on the capability level). For example, the analysis includes comparing an MCD (such as a computer-generated model derived from MCD) for a sample that displays relevant symptoms to an MDC for a sample that does not display symptoms.

FIG. 5 illustrates a method according to one embodiment. It will be appreciated that this is only an example and that various other methods are optionally used to accomplish a similar purpose. Block 501 represents a process that includes determining symptoms for analysis. For example, the symptom may be “snatched arms” in the context of a rowing. Block 502 represents a process that includes identifying sample data for analysis. For example, the sample data may include:
● MCD for all iterations associated with the indication.
• MCD for all iterations associated with symptoms at a particular intensity parameter. That is, the analysis considers how symptoms are present at a particular intensity parameter (as opposed to other intensity parameters).
• MCD for all iterations associated with symptoms at a particular ability level. That is, the analysis considers how symptoms are present at a particular ability level (as opposed to other ability levels).
• MCD for all iterations associated with symptoms at a particular intensity parameter and a particular ability level (ie, a combination of the previous two approaches).

  Other approaches may also be used. In some cases, many of the above approaches are used in combination to better understand the effects of factors such as strength and ability (which may or may not prove to be associated with a given symptom). Is done.

  The MCD used herein is preferably an MCD that has been standardized to a standard body size, for example, based on the sample expansion techniques discussed above. Similarly, the ODC resulting from such a process is destandardized using the transformation principle of sample expansion so that it can be applied to a range of body sizes that are variable (and potentially infinitely variable). It is possible.

  Function block 503 represents a process that includes identifying a potential symptom indicator motion (SIM). For example, this includes identifying attributes of motion that are observable in the MCD for each of the expected sample iterations that represent the associated symptoms. Indicator motion is defined in some embodiments by the attributes of the motion path (motion path) of the body part to which the MSU is attached. Motion path attributes include such things as angle, change in angle, acceleration / deceleration, acceleration / deceleration change, and the like. In this specification, this is referred to as “point path data” (“point path data”), which is data representing the motion attributes of points defined on the body. In this regard, a potential SIM is defined by one or more sets of “point path data” (ie, in some cases there is one set of point path data, in which case the SIM is 1 Based on the motion of only one body part, in some cases there are multiple sets of point path data, in which case the SIM is based on the motion of multiple body parts such as forearm and upper arm).

As context, a set of point path data may be defined to include the following data for a given point:
● X-axis acceleration: Minimum A, Maximum B
● Y-axis acceleration: Minimum C, Maximum D
● Z-axis acceleration: Minimum E, Maximum F

  Data other than acceleration may also be used. In addition, there may be a number of acceleration measurements, which may be time referenced to other events and / or measurements. For example, one set of point path data may be constrained by referring to a defined time period following observation of another set of point path data. As a context, this may be used to define a SIM that takes into account the relative movement of a point on the upper limb and a point on the forearm.

Function block 504 represents a testing process in which a potential SIM is tested against comparison data. In some embodiments, the test verifies the following.
(I) One or more sets of point path data are observed in the MCD for each iteration in the sample data. This verifies that the potential SIM is effective in identifying the presence of symptoms in the sample it is designed to work with.
(Ii) One or more sets of point path data are not observed in the MCD for iterations that are not associated with associated symptoms. This verifies that a potential SIM is not triggered if no indication is present.

  Decision 505 represents a determination of whether a potential SIM is verified based on a test at 505.

  If the potential SIM cannot be successfully verified, the SIM is refined (see block 506) and re-tested. In some embodiments, refinement and re-testing are automated via an interactive algorithm. For example, this narrows down the previously defined potential SIM underlying point path data definition to points that can be verified to be singular by referencing the MCD for performance iterations for which there are no associated symptoms. To work. In some cases, a given SIM cannot be verified following a threshold number of iterations, and a new starting point potential SIM is required.

  Block 508 represents the verification of the SIM following a successful test.

  In some embodiments, where the sample data is a subset of all MCD data for all iterations associated with the associated symptom, data is generated indicating that the SIM is also validated for any other subset of that total MCD data (E.g., the SIM is derived based on analysis at the first capability level, but is also verified at the second capability level).

  It should be understood that the process of determining a potential SIM may be primarily a manual process (eg, based on visual analysis of model data derived from video and / or MCD). However, in some embodiments, the process is assisted by various levels of automation. For example, in some implementations, the algorithm is configured to identify potential SIMs based on commonality in the MCD that displays symptoms compared to MCD in MCDs that do not have symptoms. Such an algorithm, in some embodiments, comprehensively comprehends the sample set specificity of the sample performance that displays indications for all other sample performances (sample performance is standardized for body size). Configured to define a set of potential SIMs to be defined (each SIM is defined by a respective one or more sets of point path data in MCD space or MSD space). In one embodiment, the algorithm outputs data representing a data set that includes all MCDs common to a selected symptom or set of signs (eg, a particular sensor, a particular time window in motion, data Allows filtering of the data set (based on solution constraints, etc.), thereby enabling practical application in the context of end-user hardware (eg, based on the MCD of MSU-enabled clothing provided to the end user) Configured to allow user-guided narrowing of data sets to potential SIMs with characteristics.

  In some embodiments, the testing process is additionally used to allow identification of symptoms in iterations where visual analysis has failed. For example, if the number of test failures is small, they are subjected to visual analysis to see if the symptoms are actually present or are present in a minor manner.

Skill analysis phase-exemplary transformation from MCD space to MSD space (ODC)
The SIM verified by a method such as the method of FIG. 5 is then converted to MSD space. As described above, each SIM includes data representing one or more sets of point path data, and each set of point path data defines motion attributes for defined points on the human body.

  The points on the human body where the point path data is defined are preferably points attached in the context of the MSU (i) the MSU configuration worn by the subject during the sample performance, and (ii) the MSU-enabled garment utilized by the end user. It is determined corresponding to. In some embodiments, end-user MSU compatible clothing (or variations thereof) is used for sample performance purposes.

  If point path data is defined for a point other than the point where the MSU is attached, it is preferable to perform a data conversion and thereby adjust the point path data to such point. Alternatively, such conversion may be integrated into subsequent steps.

  Overall, the MSD for one or more of the sample performance iterations in the sample data (sample data in block 502 of FIG. 5) is analyzed, thereby identifying the data attributes corresponding to the point path data. For example, the point path data may indicate one or more defined ranges of motion direction and / or acceleration direction relative to a reference frame (preferably a gravity reference frame).

In some embodiments, the conversion from (a) SIM obtained in MCD space to (b) data defined by MSD space includes:
(I) For each set of point path data, identify the MSD attribute present in each of the sample performances associated with the SIM that represents the point path data. In some cases, the relationship between point path data and MSD attributes is incomplete due to, for example, the nature of the MSD. In such cases, the identified MSD attributes may be wider than the motion defined by the point path data.
(Ii) Validate the MSD data attributes identified by a process similar to the iterative test of blocks 504-506 of FIG. 5 so that the identified MSD attributes are consistent within the MSD for sample performance displaying symptoms To verify that it is not present in all asymptomatic sample performance.

  This conversion process to MSD space is a data condition that indicates the presence of symptoms when observed in data obtained from one or more MSUs used during the acquisition phase (eg, block 201 of FIG. 2A). Bring. That is, the conversion process results in ODC for symptoms.

  The ODC determination defined in this way is defined by individual sensor data conditions of one or more sensors. For example, the ODC may use the velocity and / or acceleration at each sensor in combination with a rule (eg, timing rule: sensor X observes A and proximity sensor X observes B within a defined time). Observed based on the measured value.

  The ODC is then enabled to be integrated into the state engine data configured to be made available for download to the end user device, thereby monitoring the associated symptom of the end user. Device configuration is enabled.

  It will be appreciated that the ODC defined by the above conversion process is specific to the MSU used in the data collection phase. For this reason, it is convenient to use the same MSU and MSU positioning (eg, via the same MSU-enabled garment) during the collection phase as used by the end user. However, in some implementations, there are multiple versions of end-user MSU-capable clothing, for example, with different MSUs and / or different MSU positioning. In such a case, conversion to MSD space is optionally performed separately for each garment version. This may be accomplished by applying known data transformations and / or modeling of the collected test data via a virtual application of a virtual MSU configuration (corresponding to a particular end user equipment). For example, with respect to the latter, the virtual model derived from the MCD is optionally used as a framework that supports one or more virtual MSUs and determines computer predicted MSU readings corresponding to SIM data. This provides the ability to redefine the ODC over time based on hardware advancement, provided that the data collected through the analysis phase can be reused over time in such situations Will be understood.

  An exemplary process that is the process of defining an ODC or SIM generated based on MSC analysis is illustrated in FIG. A verified SIM is identified at 601. The first of the set of point path data is identified at 602, and this is analyzed through the process represented by blocks 603-608, which loops over each set of point path data. This looping process includes identifying potential MSD attributes corresponding to the point path data. For example, in some embodiments, this includes processing the collected MSD at the same time as the point path data for all or a subset of the associated collected MSD (MCD and MSD are time-synchronized). Note that it is stored in a manner configured for). Next, a test is performed at 604 to determine at 605 whether the identified MSD attribute is present in the MSD present in all relevant symptoms collected from the sample performance (and how many In such embodiments, the identified MSD attributes are guaranteed not to be present in MSDs where no indication is present). If necessary, refinement is performed at 606, otherwise the MSD attribute is verified at 607.

  Once the looping of blocks 603-608 is complete for all sets of point path data in the SIM, the verified MSD attributes are combined at 609, thereby defining a potential ODC for the indication. These are then also tested, refined, and verified through the process of blocks 610-613, so that the potential ODC is (i) all relevant sample performance where the relevant symptoms actually exist. Identified within the MSD and (ii) not relevant in all relevant sample performance MSDs for which there is no relevant indication (the term “relevant” may in some cases indicate that the Etc.).

  It will be appreciated that in further embodiments, various alternative methodologies are used, thereby defining the ODC for a given indication. However, in virtually all cases, the method can perform analysis and thereby be identified in the MSD (collected or virtually defined) for sample performance where the indication is present, Including defining observable data conditions that cannot be identified in sample performance where no indication is present.

Skill Analysis Phase-Alternative Transformation of Virtual Observation to MCD Space via MSD Space In a further embodiment, MCD is used to generate a virtual body model, which model is time synchronized Associated with MSD. As such, analysis can be performed using the MSD for one or more MSUs that are selective at a particular point in the skill performance motion.

  The MSD used at this stage is either an MSD for a specific performance or an MSD aggregated over a similar subset of performance (eg, performance by standardized body size at a defined ability level) is there. Aggregation uses (i) only those MSDs that are similar / identical in all of the performance subsets, and (ii) the aggregated MSDs are all (or statistically related) of the MSDs for the performance subsets. One or both of defining a data value range to include For example, with respect to the latter, the first performance MSD may include a value for A for a particular sensor's x-axis acceleration at a particular time, and the second performance MSD may be that at that particular time. It may have a value of B for the x-axis acceleration of a particular sensor. These can be aggregated into an aggregate MSD, where the value of the x-axis acceleration of that particular sensor at that particular point in time is defined as being between A and B.

Thus, an analysis can be performed to determine:
(I) A value (eg, accelerometer value) for one or more features of the MSD for a particular sensor at a particular point in motion for a particular performance.
(Ii) Comparison data that compares the value in (i) with other performances at the same point in movement (eg, other performances showing the same symptoms at the same ability level).
(Iii) Range of values for one or more features of the MSD for a particular sensor at a particular point in operation for a set of performance (eg, other performance showing the same indication at the same capability level) (For example, accelerometer values).
(Iv) identification at a particular point in operation for a particular performance with a particular indication when compared to the corresponding MSD for one or more further performances that do not display that particular indication Comparison data (eg accelerometer values) for one or more features of the MSD for the sensors.

  Such an analysis is used to determine the predicted ODC for a given symptom.

  Once the predicted ODCs are defined, they can be tested using a method such as that shown in FIG. The predicted ODC for a particular symptom is determined at 701 and then these are tested against the MSD for sample performance at 702. As in the previous example, this means that the predicted ODC is present in the MSD for the associated performance that displays the indication, and that the ODC is not present in the MSD for the associated performance that does not display the indication. Used to verify that. For example, “related” performance is sample performance at a common competence level, and in some implementations is normalized to standard body size. Based on the test, the ODC is refined at 704 or verified at 705.

Analytical Phase-Alternative Approach to Defining ODC via Body Modeling The above approach is based on ODC looking for one or more specific data attributes of individual sensors. An alternative approach is to define an ODC based on body motion and a virtual body model based on the MSD collected from the MSU. For example, data can be collected into a common reference frame so that MSDs can be collected and processed, thereby defining and maintaining a three-dimensional body model (or partial body model) based on motion data obtained from the MSU. Convert. An exemplary technique for deriving a partial and / or overall body model from an MSD includes converting MSDs from two or more MSUs into a common reference frame. Such conversion is optionally accomplished by any one or more of the following techniques.
• Precise positioning and / or measurement of MSU location and identification of known body position (eg start pose) at predefined points on the timeline.
● Utilizing a known positional relationship between a motion capture point (eg, a mocap marker) and the MSU.
• Using known body constraints, such as joint type, to associate the MSD from the first sensor on one side of the joint with the MSD on the other side of the joint.
• Use reference data common to multiple MSUs, for example, to allow global data conversion to a common reference frame using gravity acceleration direction and magnetic north direction.

  Of course, the first two are often advantageous in the context of skill analysis where the MSU is mounted in a controlled environment and secondary data such as MCD is available to support MSD interpretation. The last two are collected from wearers of end-user MSU-enabled garments, for example, in less controlled situations, for example, where the MSD is in a potentially uncontrolled (or relatively less controlled) environment More relevant in situations where Additional information regarding such approaches is further provided below.

Alternative Exemplary Methodology for Objectively Defining Physical Skills A further group of alternative methodologies for objectively defining physical skills is described below with reference to FIGS. 8A-8I . These methodological features are combined in some embodiments with the features described further above.

  These methodologies include, in a general sense, three phases (not necessarily clearly separable or proceeding through strict linear progression). The first phase is a sample analysis phase 801 that analyzes a given skill and thereby understands motion / location attributes for optimal performance and sub-optimal performance. Next, a data analysis phase 802 includes applying the understanding obtained in phase 801 to observable sensor data. This phase determines how a set of end-user sensors for a given end-user implementation can be used to identify specific motion / position attributes from phase 801 via sensor data. Including doing. This allows the understanding gained in phase 801 to be applied to the end user in the context of training, for example. It happens in phase 803. Content creators define software rules and the like that monitor end user performance via sensor data. For example, the rules may define feedback provided to the user based on knowledge from phase 801 when specific sensor data from phase 802 is observed.

  As mentioned above, these three phases are not clearly distinguished in all cases. May be mixed and / or overlapping. Furthermore, they need not be implemented as simple linear processes. In some cases there is a cycle between phases.

  The following examples are described with reference to performance analyzed with reference to motion attributes. For example, motion data may be derived from a plurality of sensors attached to a human user (e.g., provided on a garment), and in some cases, additional equipment (e.g., a skateboard, Obtained from one or more sensors attached to a tennis racket or the like. The sensor may take various forms. An example discussed herein that is not necessarily limiting and should be considered is the use of multiple sensor units, each sensor unit comprising: (i) a gyroscope, (ii) an accelerometer, and (Iii) Includes a magnetometer. Each of these is preferably a triaxial sensor. Such a configuration allows for the collection of data (eg, via the POD device disclosed herein) that provides accurate data representing human movement, eg, based on the relative movement of the sensors. . Examples of wearable garment technology are provided elsewhere in this specification.

  In the various figures, similar processes are indicated by functionally numbered functional blocks.

  FIG. 8B illustrates a method according to one embodiment, which includes the three phases of FIG. The method begins at a preliminary step 810 that includes determining a skill to be analyzed. For example, the skill may be a specific form of kick in football, a specific tennis swing, a skateboard maneuver, a long jump approach, etc. It will be appreciated that there are a virtually unlimited number of skills that exist during sports, recreation, and other activities that can be identified and analyzed by the methods discussed herein.

  Sample analysis phase 801 analyzes a number of performances of a given skill, thereby influencing the performance of that skill, in this case via visually-driven analysis at 811 Including developing an understanding of the characteristics of Visually driven analysis involves visually comparing multiple performances, thereby developing knowledge about how optimal performance differs from suboptimal performance. Exemplary forms of visual driven analysis include:

  The first example of step 811 includes visual driven analysis without technical assistance. Watches of observers (or set of observers) as skills are performed many times and decisions are made based on their visual observations.

  The second example of step 811 includes visual driven analysis using video. Video data captures a large number of performances, thereby enabling a visual comparison of subsequent repeatable performances. A preferred approach is to take advantage of digital video manipulation techniques that capture performance from one or more defined locations and overlay two or more performance videos from the same angle. For example, a skill in the form of a particular soccer kick can be taken from a predetermined back-angle position (behind the athlete) with the ball positioned at a defined target as well as at a defined target for each performance. May be. Video captured from two or more performances is based on a fixed common origin video frame (selected based on points in motion that are temporally aligned in the comparison video) with transparency Overlaid. Assuming this is shot in a controlled environment, only the player and ball positions should be different between the two video captures (and slight errors in camera position can be detected using background alignment). Can be considered). This allows the observer to identify more similarities and differences between performances based on changes in performance movement overlaid. Multiple angles are preferably used (eg, side view and top view).

  A third example of step 811 includes a visual driven analysis that utilizes motion capture data. Motion capture data can be generated using, for example, conventional motion capture technology, on-board sensors, depth sensitive video equipment (eg, depth sensor cameras as used by Microsoft Kinect) and / or other techniques. Collected for performance. This allows performance to be reconfigured within the computer system based on motion capture. Subsequent visual analysis may be similar to that utilized in previous video examples, but the motion capture approach may allow for more precise observation and additional control over the viewpoint. For example, a three-dimensional model built via motion capture technology allows free viewpoint control to identify motion and / or position differences by comparing multiple overlaid performances from multiple angles. to enable.

  Other approaches for visually driven analysis in phase 811 may be used.

  The observations that result from visually driven analysis are descriptive in some embodiments. For example, observations can be “inclination of the hip joint during the first second of approach”, “flexion of the elbow before the foot contacts the ground”, “ Sometimes defined in a descriptive form, such as “falling left shoulder”. The description format may include information about the artifact being described, eg, “inclination of the hip during the first second of the approach” causing the ball to swing to the left of the target (or its Such information).

  For the purposes of this specification, the results of phase 801 (and step 811) are referred to as “performance influencing factors”.

In FIG. 8B, phase 802 includes a functional block 812 that represents a process that includes the application of visually driven observation to technically observable data. This may still use comparative analysis, but in this case, for example, digitized information, such as a sensor or motion capture (which may be the same or similar to the sensor worn by the end user) Based on information collected using. The function block 812 identifies, for a given performance impact factor PAF _n , data resulting from one or more performances attributable to PAF _n . This includes a comparative analysis of data for one or more performances that do not indicate PAF _n and data for one or more performances that indicate PAF _n . As an example, we analyze the captured data demonstrating “inclination of the hip during the first second of the approach” and characterize the data resulting from “inclination of the hip during the first second of the approach”. Identify. This may be identified by comparison with data from a sample that does not demonstrate “inclination of the hip during the first second of the approach”.

As described herein, data analysis results in the determination of observable data conditions for each performance influencing factor. That is, PAF _n is associated with ODC _n . Thus, when sensor data for a given performance is processed, the software application can autonomously determine whether an ODC is present, and thus provide a result indicating the identification of PAF _n. Can do. That is, the software is configured to autonomously determine whether there is, for example, “inclination of the hip joint during the first second of the approach” based on processing of data obtained from the sensor.

In some implementations, a given PAF _n is associated with multiple ODCs. This is different from the ODC associated with the following: specific sensor technology / configuration (eg, some end users wear 16 sensor suits and others wear 24 sensor suits) ODC associated with physical attributes (e.g., when a different ODC is required for a wearer with long limbs as opposed to a wearer with short limbs). On the other hand, in some embodiments, the ODC is standardized for physical attributes, as discussed further below.

  In FIG. 8B, the implementation phase 803 includes a function block 813 that represents implementation to the training program (s). This includes defining end user device software functionality that is triggered based on observable data conditions. That is, each set of observable data conditions is implemented through a software application that processes the data obtained from the set of end-user motion sensors (motion sensors), thereby enabling the end-user physical performance of the skill to Allows monitoring of the presence of a set of related performance impact factors. In some implementations, a rule-based approach is used, eg, “if an ODC is observed, then perform action X”. It will be understood that rules of varying degrees of complexity can be defined (eg, using other operators such as OR, AND, ELSE, etc., or by utilizing more powerful rule construction techniques). I will. The precise nature of the rules is left to the discretion of the content creator. As a general principle, in some embodiments, the goal is to encourage end users to modify their behavior in subsequent performance, thereby potentially bringing closer to optimal performance. Is to define

  Continuing the above example, one set of observable data conditions indicates that the user has indicated “hip inversion during the first second of the approach” in the observed performance. Thus, during phase 803, such observable data conditions may cause the user to “invert the hip during the first second of the approach” and other motion attributes (eg, optimal performance is “motion A feedback command (or defined to assist in replacing the horizontal hip joint during the first second of the eye, which may require a hip joint tilt after the left foot touches the ground) A number of potential feedback instructions). The feedback need not relate to hip joint tilt at all, and coaching knowledge reveals that adjusting the hand position or starting posture, for example, can be effective in correcting the wrong hip position (In that case, observable data conditions may be defined for those performance influencing factors to allow secondary analysis related to hip position).

  FIG. 8C illustrates a method according to one embodiment illustrating an alternative set of functional blocks within phases 801-803, some of which have been described with reference to FIG. 8B.

Function block 821 represents a sample performance collection phase in which multiple samples of performance are collected for a given skill. The function block 822 represents sample data analysis via, for example, a visual driven technique as described above or by other techniques. This results in the definition of performance impact factors for the skill, which may be represented as S _i PAF ₁ through S _i PAF _n for skill S _i (see function block 823).

  The function block 824 analyzes performance data (eg, data obtained from one or more of motion capture, wear sensors, depth cameras, and other technologies), thereby providing data that is evidence of performance influencing factors. It represents the process of identifying data characteristics. For example, one or more performance-derived datasets known to exhibit performance impact factors are compared to one or more performance-derived datasets known to exhibit performance impact factors that are known not to exhibit performance impact factors. The In some embodiments using multiple mounting sensors, the attributed data is (i) relative angular displacement of the sensor, (ii) rate of change of relative angular displacement of the sensor, (iii) sensor Relative angular displacement timing, and sensor relative angular displacement timing and velocity.

Function block 825 represents a process that includes defining observable data conditions for each performance impact factor based on the analysis in function block 824. Observable data conditions are defined in a way that allows them to be identified autonomously (eg, as a trap condition) in sensor data derived from end-user performance. They may be represented as S _i ODC _{1 to} S _i ODC _n for skills S _i . As mentioned above, in some embodiments, a given PAF is associated with multiple ODCs. This is different from the following: ODC associated with a particular sensor technology / configuration (eg, some end users wear 16 sensor suits and others wear 24 sensor suits) ODC associated with other physical attributes (for example, when a different limb is required for a wearer with a long limb as opposed to a wearer with a short limb). On the other hand, in some embodiments, the ODC is standardized for body attributes, as discussed further below.

Alternative Example: Exemplary Analysis Methodology FIG. 8D illustrates an exemplary method for sample analysis in phase 801 according to one embodiment.

  The function block 831 represents a process that includes causing a subject, in this example an expert user, to execute a given skill multiple times. For example, in some embodiments, a sample size of about 100 performance is preferred. However, a range of sample sizes is used in the embodiments, and in some cases, the nature of the skill affects the required sample size.

  The function block 832 represents a process that includes a number of performance considerations. This includes, for example, as a video review (eg, using overlaid video data as described above) or a motion capture review (eg, use of a motion sensor in some cases) Utilize visual-driven analysis with virtual three-dimensional body structures obtained by motion capture technology.

  Based on the review at function block 832, the performance is classified. This includes identifying optimal performance (block 833) and identifying sub-optimal performance (block 834). The categorisation is preferably based on objective factors. For example, some skills have one or more quantifiable objectives such as power, speed, accuracy, and the like. Objective criteria may be established for any one or more of these goals. As an example, accuracy may be quantified as a target. If it hits the target, the performance is “optimal”. If you miss the target, the performance is “sub-optimal”. As another example, the pressure sensor may determine whether the impact resulting from performance is large enough to be “optimal”.

  Function block 835 represents a process that includes a sub-optimal performance classification. For example, defining objective criteria, thereby associating each sub-optimal performance with a category. In one embodiment where the skill's (or one) goal is accuracy, multiple “failure zones” are defined. For example, there is a central target zone and four “failure” quadrants (upper left, upper right, lower left, lower right). In that case, sub-optimal performance is classified based on the “failed” quadrant applied. For example, additional criteria may be defined for additional granularity, such as the degree of failure.

  Next, samples from each category of sub-optimal performance are compared with optimal performance, thereby identifying common points such as performance errors. This is accomplished through a loop process in the illustrated embodiment. That is, the next category is selected in function block 836, the sub-optimal performance of that category is compared to the optimal performance in function block 837, and the performance affecting factor is determined in function block 838. The method then loops based on decision 839 if there are sub-optimal performance categories to be evaluated.

  The performance impact factor determined at function block 838 is a visually identified performance impact factor that is observed to result in sub-optimal performance in the current category. In essence, these allow the prediction of a given performance result based on the observation of motion as opposed to the observation of the result. For example, the “Failure-Lower Left Quadrant” category may result in a performance influencing factor of “hip inversion during the first second of the approach”. This performance influencing factor is uniquely associated with that category of sub-optimal performance (ie, consistently observed within the sample) and is not observed in other categories of optimal performance or sub-optimal performance. Thus, the knowledge gained is that when “inclination of the hip during the first second of the approach” is observed, it is expected that there will be a failure in the lower left of the target.

  Following phases 802 and 803, this means that the software application has an observable data condition that is associated with the wear sensor data alone (ie, “inclination of the hip during the first second of the approach”). It will be appreciated that a given performance can automatically predict that it is likely that a failure has occurred in the lower left of the target (based on the identification in the sensor data). At a practical level, the end user may be provided with audio feedback from the virtual coach, such as “It failed down and left? Next, how about focusing on XXX?” . This is a significant result. It allows objective factors traditionally observed by visual coaching to be translated into an automated sensor driven environment.

  In some embodiments, sample analysis is enhanced by the involvement of a visual analysis process by a person providing sample performance. For example, this may be a well-known star athlete. The athlete provides his / her own insight into important performance influencing factors, which ultimately results in “expert knowledge”, based on the user's training and the specific expert interpretation of the skill Allows you to acquire specific skills. In this regard, individual skills may have many different variations of expert knowledge. As a specific example, a soccer chip kick is a first expert knowledge variation based on Player X's interpretation of an optimal form of chip kick, and a player Y's interpretation of an optimal form of chip kick. There may be two variations of expert knowledge. This allows the user not only to receive training on the desired skill, but also to receive training based on the knowledge of a selective expert on the desired skill (and in some embodiments, the selection May provide a user experience similar to training by a typical expert).

  As context, in relation to expert knowledge, the data downloaded to the POD device is selected by the user based on the selection of the desired expert knowledge variation. That is, for a selective set of one or more skills, there is a first selectable expert knowledge variation and a second selectable expert knowledge variation.

  In some implementations, for the first selectable expert knowledge variation, the downloadable data is the first of the observable data conditions associated with a given skill in the data obtained from the set of performance analysis sensors. Configure the client device to identify a set of ones, and for the second selectable expert knowledge variation, the downloadable data is associated with a given skill in the data obtained from the set of performance analysis sensors The client device is configured to identify a second different set of observable data conditions. For example, the difference between the first set of observable data conditions and the second set of observable data conditions takes into account the human expert style variations associated with the respective expert knowledge variations. In other cases, the difference between the first set of observable data conditions and the second set of observable data conditions is a coaching advice obtained from a human expert associated with each variation of expert knowledge. Consider.

  In some implementations, for the first selectable expert knowledge variation, the downloadable data is responsive to observing a defined observable data condition associated with a given skill. Configure the client device to provide a set of feedback data to the user, and for the second selectable expert knowledge variation, the downloadable data is defined and observable associated with a given skill In response to observing the data condition, the client device is configured to provide the user with a second different set of feedback data. For example, the difference between a first set of feedback data and a second set of feedback data takes into account coaching advice obtained from human experts associated with the respective expert knowledge variations. Alternatively (or additionally), the difference between the first set of feedback data and the second set of feedback data is different audio data representing the voice of the human expert associated with each expert knowledge variation. including.

Alternative Example: Data Analysis Methodology FIG. 8E illustrates an exemplary method for data analysis in phase 802, according to one embodiment. This method is described with reference to an analysis of sub-optimal performance categories, for example, as defined via the method of FIG. 8D. However, it should be understood that the corresponding method may be performed with respect to optimal performance (thus defining observable data conditions associated with optimal performance).

  Function block 841 represents a process that includes initiating data analysis for the next sub-optimal performance category. Using the performance influencing factors as a guide, for a plurality of sub-optimal performances, a comparison is made at function block 842 between sub-optimal performance data and optimal performance data. At function block 843, data patterns (such as similarity and difference) are identified. In some embodiments, the goal is to identify data characteristics common to all sub-optimal performances (but not to be observed with optimal performance in any other sub-optimal category), and those data characteristics Determine how it can relate to performance influencing factors. The function block 844 represents a process that includes defining one or more sets of observable data conditions for each performance impact factor. The process loops for performance categories that are less than optimal, based on decision 845.

Alternative Example: Implementation Methodology FIG. 8F illustrates an exemplary method for implementation in phase 803, according to one embodiment.

  Function block 851 represents a process that includes selecting a set of observable data conditions associated with performance impact factors via phases 801 and 802. Condition satisfaction rules are set in function block 851 that define when a selective set of observable data conditions are considered satisfied based on the input sensor data. For example, this may include setting a threshold or the like. Next, function block 853 includes defining one or more functionalities that are intended to be associated with observable data conditions (feedback, instructions to alternative activities, etc.). The rules and associated functionality are then exported at function block 854 for use in the training program authoring process at function block 856. The method loops at decision 855 if more observable data conditions are intended to be utilized.

  A given feedback instruction is preferably defined by consultation with a coach and / or other experts. It will be appreciated that the feedback instruction need not directly reference the relevant performance impact factors. For example, in the following example, the feedback command focuses on a specific task that may indirectly correct the inward hip tilt (eg, via hand positioning, eye positioning, starting posture, etc.). The user may be instructed to apply. In some cases, a large number of feedback commands may be recognizable that a particular feedback command resonates with a particular user, but not with other users, and a given set of observable data conditions May be associated.

Alternative Example: Standardization of Style and Physical Attributes In some implementations, phases 801 and 802 observe the performance of a number of sample users, thereby identifying the effects of style and physical attributes (and In some cases, standardize).

  As a context, different users essentially perform a given skill slightly differently. In some cases, the difference is a result of personal style. However, there is typically a significant overlap in similarities, despite the elements due to style. Some embodiments compare the performance of multiple subjects at the visual and / or data level, thereby defining observable data conditions common to performance subjects despite different styles. Is standardized. This brings style neutrality. Some embodiments, alternatively or additionally, compare the performance of multiple subjects at the visual and / or data level so that a tailored training program is tailored to train the user. Allows to follow a specific style (eg, individual skills may have many different variations of expert knowledge that the end user can purchase individually).

  Physical attributes, such as height, limb length, etc., also have an effect on observable data conditions in some cases. In some embodiments, a particular end user's body dimensions are determined based on sensor data, and observable data conditions (eg, scaling and / or selecting data conditions specific to size or size range) Implement observable data conditions so that they are adjusted accordingly. Other implementations implement an approach that normalizes observable data conditions for size, thereby negating end-user physical attribute effects.

  In some embodiments, the methodology compares the performance of multiple subjects at the visual and / or data level, so that (i) observable data conditions common to performance subjects, regardless of physical attributes. Defining and / or (ii) defining rules that scale one or more attributes of observable data conditions based on known end-user attributes and / or (iii) certain known Enhanced to standardize physical attributes by defining multiple sets of observable data conditions, tailored to each end-user with multiple physical attributes.

  FIG. 8G illustrates an exemplary method for body attributes and style standardization. Elements of this method are performed with respect to either phase 801 or phase 802. Function block 861 represents performing an analysis for the first expert to provide a comparison point. Next, as represented by function block 862, an analysis is also performed for a number of additional experts of similar skill levels. Function block 863 represents a process that includes identifying artifacts due to physical attributes, and functional block 864 represents standardization based on physical attributes. Function block 865 represents a process that includes identifying artifacts due to style, and function block 864 represents style-based standardization. In some implementations, one or both forms of normalization are performed without an initial step of identifying the causative artifact.

Illustrative Example: Application to Multiple Capability Levels In some implementations, phases 801 and 802 (and optionally 803) are performed for use of various capability levels. The fundamental reason is that experts are likely to make mistakes different from amateurs or beginners. For example, experts are most likely to consistently achieve something very close to optimal performance, and the required training / feedback is very elaborate with respect to precise movement. On the other hand, novice users are more likely to make worse mistakes, and elaborate observations and feedback related to the experts can greatly help or require feedback about them before they are relevant.

FIG. 8H illustrates a method according to one embodiment. Function block 861 represents an analysis for capability level AL1. This includes, in some embodiments, analysis of multiple samples from multiple subjects that allow for body and / or style standardization. Observable data conditions for capability level AL ₁ are output at function block 862. These, as represented by block 863 and 864 are repeated for the ability level AL _2. Next, the process (see block 865 and 866) that capability level AL _n to (desired depending on the granularity associated with the ability (granularity)) is repeated for any number of capability level.

  FIG. 8I is a diagram in which initial samples are taken for each ability level and then expanded for body size and / or style standardization, thereby providing observable data conditions for each ability level. 8G illustrates a combination between the features shown in FIG. 8G and FIG. 8H.

Curriculum Construction Phase: Overview As described above, following skill analysis phase 100, the exemplary end-to-end framework of FIG. 1B proceeds to curriculum construction phase 110. The detailed features of curriculum construction are outside the scope of this disclosure. A high level understanding of the curriculum-building approach is sufficient for skilled addressees to understand how this phase plays a role in the overall end-to-end framework. is there.

In general, when end-user functionality is related to skill training, curriculum construction includes defining a logical process to use ODC as an input that affects the delivery of training content. For example, the training program logic is configured to perform functions including, but not limited to:
● Make predictive decisions related to the user's ability level based on the identification of one or more defined ODCs.
Provide feedback to the user based on the identification of one or more defined ODCs. For example, this may include coaching feedback related to the symptoms and / or causes represented by the ODC.
● Navigate to different parts / phases of the training program based on the identification of one or more defined ODCs. For example, this may be (i) determining that a given skill (or sub-skill) is well acquired and proceeding to a new skill (or sub-skill), or (ii) if the user has certain difficulties Providing training to the user regarding different skills (or sub-skills) that are determined to be present and intended to provide repair training to address specific difficulties.

  These are just display choices. In essence, the underlying idea is to use ODC (ie, MSD, more generally data attributes that can be specified in PSD), thereby promoting functionality in the training program. At the actual level, this helps the user to master the progression of notes when playing music on the guitar, from helping the user to improve the gold swing movement. Make it possible to offer a wide range of training.

  Further embodiments may be used in contexts other than skill training, for example, activities that depend on identifying that particular skills have been performed (such as competitive activities), as well as attributes of those skills (eg, certain snowboard techniques It should be understood that it is applicable in the context of the (snowboarding trick) being performed and the time of flight measurement associated with that skill. In such an embodiment, the ODC is used for purposes including skill identification and skill attribute measurement.

  In some implementations, the feedback provided by the user interface in the preferred implementation can be a suggestion on how to improve motion to improve performance, or more specifically (motion sensor context ) Including a suggestion to more closely repeat motion attributes that are predefined as representing optimal performance. In this regard, the user downloads a training package and learns a particular skill, such as a sports skill (in some embodiments, the training package includes content for multiple skills). For example, training packages relate to a wide range of skills, including things like soccer (specific style kicks), cricket (eg specific bowling techniques), ski / snowboard (eg specific aerial maneuvers), etc. It's okay.

  In general terms, a common operational process performed by embodiments of the technology disclosed herein is (i) providing instructions to perform actions that define or associate skills with which the user interface is trained, (ii) ) The POD device monitors input data from the sensor and determines symptom model values associated with the user performance of the action; (iii) analyzes user performance; and (iv) performs user interface actions. (E.g. providing feedback and / or instructions that attempt to refocus on certain features of the motion). An example is shown in blocks 1103 to 1106 of method 1100 in FIG. 11A.

  Performance-based feedback rules are subjectively predefined to configure skill training content to function in an appropriate manner in response to observed user performance. These rules are based on symptoms, preferably observed symptom model data values and predefined baseline symptom model data values (eg, values for optimal performance and / or expected wrong performance) and Defined based on the deviation between The rule is, in some embodiments, a specific range for a particular symptom (or symptom) between a specified baseline symptom model data value (or values) and an observed value. Based on deviation in (or multiple ranges).

  In some cases, the set of rules is defined (or adjusted / weighted) by content creators specifically for individual experts. That is, expert knowledge is implemented through defined rules.

  FIG. 11B illustrates an example method 1110 for defining performance-based feedback rules. Rule creation begins at function block 1111. Function block 1112 represents a process that includes selecting a symptom. For example, this is selected from a set of signs that are defined for the skill with which the rule is associated. Function block 1113 represents a process that includes defining symptom model value characteristics. For example, this includes a range of values or a range of deviations from predefined values (eg, deviations from baseline values for optimal or incorrect performance).

  Decision 1114 represents the ability to combine further symptoms within a single rule (in this case, the method loops to 1112). For example, symptoms can be combined using “AND”, “OR”, and other such logical operators.

Function block 1115 represents the process of defining rule effect parameters. That is, functional blocks 1111 through 1114 are associated with the “IF” component of the rule, and functional block 1115 is associated with the “THEN” component of the rule. A range of "THEN" component types are available that include one or more of the following.
● Rules that provide specific feedback messages via the user interface.
● Rules that provide one of the specific feedback messages that are selective via the user interface (with secondary determination of which is based on other factors, eg, user historical data optionally) ).
● Rules that provide specific instructions via the user interface.
● Rules that provide one of the specific specific instructions through the user interface (with secondary determination as to which other factors are optionally based on the user's historical data, for example) .
● Rules that go to different stages in the progression path defined for a skill or activity.
● Rules that advance one of the selectively different stages in the defined path of travel (with a secondary decision as to which other factors are optional, eg, optionally based on the user's historical data) .
Rules that suggest downloading specific content (eg, content for training on different skills or activities) to the POD device.

  It will be appreciated that these are only examples, and that implementations optionally implement complex configurations that allow flexible and potentially complex rule definition capabilities.

  In some embodiments, the rules are integrated into a dynamic progression path that adapts based on user attributes. Some examples are discussed further below. As context, observation and feedback are not tied in a one-to-one relationship. A given performance observation (ie, the set of observed symptom model values) may be associated with a number of possible effects that depend on user attributes. An important example is “frustration mitigation”, which prevents the user from getting stuck in a loop that repeats mistakes and receives the same feedback. Instead, perform alternative approaches (eg, start different tasks that users are likely to succeed, etc.) after the number of failed attempts to perform in the commanded method exceeds a threshold To do.

The feedback provided by the user interface is configured in some implementations to conform based on either or both of the following user attributes: These user attributes in some cases include one or more of the following.
● Previous user performance. If the user fails many times to try the skill, the user interface adapts by providing the user with different feedback, different skills (or sub-skills) to try, and so on. This is preferably configured to reduce user frustration by preventing situations where the user repeatedly fails to achieve a particular result.
● User learning style. For example, in some cases, different feedback / command styles are provided to the user based on the user's preferred preferred learning style. The preferred learning style is determined algorithmically in some cases and is set by the user via the preference selection interface in some cases.
● User capability level. In some implementations, the feedback path takes into account the user's ability level (which is the preference that the user sets in this context). In this way, the feedback provided to the user at the first ability level may be different from the feedback provided to the user with respect to other ability levels. This is used, by way of example, to allow different levels of refinement in training to be provided to amateur athletes as compared to elite level athletes.

  Some embodiments provide a technical framework that enables content generation utilizing such adaptive feedback principles.

  FIG. 16 provides an example of curriculum operation / implementation according to one embodiment. The user is instructed to try the skill and how it is performed is shown. The performance attempted by the user is captured by the PSU and diagnosed using the ODC. The engine is then configured to make a feedback decision that may include identifying sub-skills that can be taught to make learning the primary skills easier. Next, feedback is delivered and the process loops. In a curriculum according to various embodiments, such “trial”, “display”, “observation”, “diagnosis”, “prioritization” and “response” loops are used.

Exemplary Downloadable Content Data Structure Following the following skill analysis and curriculum construction, content is enabled to be downloaded to the end user device. This is preferably made available via one or more online content marketplaces where users of web-enabled devices browse the available content and have each device download the content.

In the preferred embodiment, the downloadable content includes the following three types of data:
(I) Data representing a sensor configuration command, also referred to as “sensor configuration data”. This is data that is configured to provide configuration of one or more sets of PSUs to provide sensor data having specified attributes. For example, the sensor configuration data allows a given PSU to adopt active / inactive states (and / or progress between those states in response to defined prompts) and define defined protocols (eg, sampling rate and Instructions to cause sensor data to be distributed from one or more of its component sensor components based on (or resolution). A given training program may include multiple sets of sensor configuration data that are applied for each exercise (or in response to an in-program event prompting a particular form of ODC monitoring). In some embodiments, multiple sets of sensor configuration data are defined to be each optimized to identify specific ODCs in different configurations of end-user hardware. For example, some configurations of end user hardware may have additional PSUs and / or more advanced PSUs. In a preferred embodiment, sensor configuration data is defined to optimize the data delivered by the PSU to increase the efficiency of data processing when monitoring the ODC. That is, if a particular element of content monitors n particular ODCs, the sensor configuration data is defined to remove sensor data features that are unnecessary for the identification of those ODCs.
(Ii) processing input data received from one or more of the connected sets of sensors, thereby analyzing the physical performance sensed by one or more of the connected sets of sensors State engine data that constitutes a performance analysis device (eg, POD device). Importantly, this involves monitoring a set of one or more ODCs related to the content being delivered. For example, content is driven by logic based on observations of specific ODCs in data delivered by the PSU.
(Iii) User interface data that configures the performance analysis device to provide feedback and instructions to the user in response to an analysis of physical performance (eg, distribution of a curriculum that includes training program data). In some embodiments, the user interface data is periodically downloaded from a web server, at least partially.

  The manner in which downloadable content is delivered to end user devices varies from implementation to implementation, based on, for example, the nature of the end user hardware device, cloud-based data organization framework, and the like. Various examples are described below.

With respect to sensor configuration data, content data configures a set of PSUs to provide data in a well-defined way that a POD device (or other device) is optimized for that particular skill (or set of skills). Includes computer readable code that enables This is relevant in the context of reducing the amount of processing performed on the POD device. The amount of data provided by the sensor is reduced based on what is actually needed to identify the specific skill or skills that are being trained. For example, this may include:
● Activate / deactivate one or more sensors selectively (in some cases dynamically).
● Set the sampling rate for individual sensors.
● Set the data transmission rate and / or data batching sequence for individual sensors.
● Configure the sensor to provide only a subset of the data that the sensor collects.

  The POD device provides configuration instructions to the sensor based on the skill to be trained and subsequently applies the applied configuration (eg, function blocks 1101 and 1102 of FIG. 11A to enable delivery of the PSU driven training program. Receive data from the sensor or sensors.

  In some cases, the sensor configuration data includes various portions that are loaded into the POD device at different times. For example, the POD device is supplemented by one or more additional sets of code (which may be downloaded at the same time or different times) that increase the specificity with which the sensor configuration is implemented in a progressive manner, It may include a first set of such codes (eg, in its firmware) that is generic across all sensor configurations. For example, one approach is to have base level instructions, instructions specific to a particular set of MSUs, and instructions specific to the configuration of those MSUs for the particular skill being trained.

  The sensors are preferably configured based on specific monitoring requirements for skills regarding which training content is delivered. This is in some cases specific to a particular motion-based skill being trained, or even specific to a particular attribute of a motion-based skill being trained.

  In some embodiments, the state engine data configures the POD device with respect to how to process data obtained from connected sensors (ie, PSD) based on a given skill being trained. . In some embodiments, each skill is associated with a set of ODCs (optionally each representing a symptom), and the state engine data processes sensor data, thereby allowing the user's based on specific ODC observations. Configure the POD device to make an objective determination of performance. In some embodiments, this includes identifying the presence of a particular ODC and then determining that an associated symptom is present. In some cases, this continues to cause a secondary analysis to identify an ODC that represents one of the set of causes associated with that symptom. In other embodiments, the analysis includes a determination based on a variation between (i) symptom model data determined from sensor data based on user performance and (ii) a predefined baseline symptom model data value. . This is used, for example, to allow a comparison of the user's performance for each symptom with predefined characteristics.

  User interface data in some embodiments includes data rendered to provide graphical content that is rendered via the user interface. In some embodiments, such data is maintained on the POD device (eg, video data is streamed from the POD device to a user interface device, such as a smartphone or other display). Other implementation data defining graphic content for rendering via the user interface is stored somewhere (i) on the smartphone or (ii) in a cloud hosted location.

  The user interface data additionally includes data configured to cause execution of the adaptive training program. This includes logic / rules that respond to inputs including PSD (eg, ODC derived from MSD) and other factors (eg, user attributes such as ability level, learning style, mental / physical state). In some embodiments, such downloading of data allows operation in an offline mode where an active internet connection is not required for the user to participate in the training program.

Distributing Expert Knowledge Variations In some implementations, skill training content (for at least some skills) provides the user with (i) the desired skill, and (ii) the desired “expert knowledge” for that skill. Configured to allow selection of both sets.

  At a high level, “expert knowledge” allows the user to engage in training to acquire a specific skill based on the interpretation of a specific expert for that skill. In this regard, individual skills may have many different variations of expert knowledge. As a specific example, a soccer chip kick is a variation of the first expert knowledge based on player X's interpretation of an optimal form of chip kick, and a second based on player Y's interpretation of an optimal form of chip kick. And variations of expert knowledge. This not only allows the user to receive training on the desired skill, but also allows training based on the knowledge of selective experts on the desired skill (in some embodiments). , It can result in a user experience similar to that trained by that selective expert).

From a technical point of view, expert knowledge is distributed by any one or more of the following.
(I) Define an ODC specific to the expert. That is, the way in which specific trigger data (such as symptoms and / or causes) is specified is specific to a given expert. For example, a given expert may have a different view (view) than a consensus view (consensus view) on how a particular symptom is observed and / or defined. Additionally, symptoms and / or causes may be defined on an expert specific basis (ie, a particular expert identifies symptoms that are not part of the normal agreement).
(Ii) Define expert-specific symptom-to-cause mapping. For example, there may be a set of causes that may be involved in a given observed symptom, and an agreed view (consensus view) of the causes specific to one or more additional experts. This allows expert knowledge to be implemented, for example, when a particular expert looks for something outside the agreed wisdom that can be the root cause of symptoms.
(Iii) Define expert specific training data, such as feedback and training program logic. For example, the advice given by a particular expert to address a particular symptom / cause may be specific to the expert and / or an expert-specific repair training practice may be defined.

  In this way, expert knowledge can be implemented through a technique that provides an expert specific training program.

Expert knowledge may be implemented, as an example, to allow expert specific adjustments based on any one or more of the following.
● Expert style. For example, ODC, mapping and / or feedback may be defined to help the user learn to perform activities in the style associated with a given expert. This is relevant, for example, in the context of action sports where a particular maneuver is performed in a very different visual style by different athletes, and one specific style appears to be preferred by the user.
● Expert coaching knowledge. For example, ODC, mapping and / or feedback may be defined to provide the user with access to expert-specific coaching knowledge. For example, it is based on what a particular expert considers significant and / or important.
● Expert coaching style. For example, ODC, mapping and / or feedback may be defined to provide a training program that repeats a coaching style specific to a particular expert.

  A set of training data that includes data specific to a given expert (eg, ODC, mapping and / or feedback data) is called an “expert knowledge variation”. In some cases, a particular skill has numerous expert knowledge variations that can be downloaded.

  In a further embodiment, expert knowledge is implemented via an expert specific baseline symptom model data value for optimal performance (and optionally also baseline symptom model data). The value includes the expected incorrect performance value). This allows comparisons between measured symptoms with expert-specific baseline symptom model values, so that, for example, a particular expert sees the best performance and how the user actually performs. Objectively evaluate the deviation between As a specific example, a soccer chip kick is the first expert knowledge variation based on the interpretation of player X's optimal form of chip kick, and the optimal form of player Y's It has a second expert knowledge variation based on the interpretation of the chip kick. This allows the user not only to train on the desired skill, but also to receive training from an expert selected for that desired skill.

  One category of embodiments provides a computer-implemented method that allows a user to configure the operation of a local performance monitoring hardware device. The method provides (i) an interface configured to allow a user of a client device to select a set of downloadable content, wherein the set of downloadable content is one Or (ii) providing the user with data representing at least a portion of the selected set of downloadable content to the local performance monitoring hardware associated with the user. Enabling downloads to occur. For example, the server device provides an interface (such as an interface accessed by the client terminal via a web browser application or proprietary software), and the user of the client terminal accesses the interface. In some cases, this may include browsing available content and / or accessing content description pages made available via hyperlinks (including hyperlinks on third-party web pages). It is an interface that makes it possible. In this regard, in some cases, the interface is an interface that provides client access to the content marketplace.

  In some cases, the download occurs based on user instructions. For example, the user may, in some cases, perform an initial process whereby content is selected (and purchased / procureed) and subsequent processes where the content (or part thereof) is actually downloaded to the user hardware. . For example, in some cases, a user has a library of purchased content that is maintained in a cloud-hosted configuration and selects specific content to be downloaded to local storage as needed. As a practical situation, a user can purchase a training program for both soccer and golf, and may want to use the golf content exclusively on one day (thus necessary to run the golf content) Download the relevant part of the code).

  Download is (i) one or more performance sensor units that are sensor configuration data that operates in a defined manner and thereby provides data representing the attempted performance of a particular skill Sensor configuration data, including data constituting a set of; (ii) state engine data, wherein the state engine data is based on data provided by the set of one or more performance sensor units; State engine data, including data configured to identify attributes of attempted performance of a particular skill; and (iii) user interface data, wherein the user interface data is the attempted performance of a particular skill Based on the identified attributes of Including data configured to enable operation of the over The interface includes a download of the user interface data.

  It will be appreciated that not all data defining a particular training program need be downloaded at once. For example, if the user hardware is configured to maintain an internet connection, additional portions of content may be downloaded as needed. However, in some cases, the user hardware is configured to operate in an offline mode, at which time all data necessary to enable execution of the content is downloaded to the local hardware. This is particularly appropriate in the context of user interface data in the form of instructional videos. In some cases, the downloaded user interface data represents a web location where instructional video is accessed as needed (eg, via streaming), and in other cases, the downloaded user interface data is video Contains data. In some embodiments, richer content (eg, streaming video) is available only for online use. When a user operates local hardware in offline mode, certain rich media aspects of the content will not be viewable.

  The method further includes allowing a user to select downloadable content defined by a variation of expert knowledge for the selected skill or skills, and is available for the set of skills or skills There are several variations of expert knowledge. For example, at a practical level, an online marketplace may include “standard” level content that is not associated with a particular expert and one or more “premium” level content that is associated with a particular expert (eg, branded content). As) can be offered.

  Each expert knowledge variation is functionally different from other content offerings of the same skill. For example, the manner in which a given attempted performance is analyzed varies based on the specificity of expert knowledge.

In some cases, the first expert knowledge variation is associated with a first set of state engine data and the second expert knowledge variation is associated with a second different set of state engine data. The second different set of state engine data is configured to allow identification of one or more expert specific attributes of performance that are not identified using the first set of state engine data. Expert-specific attributes can be associated with either or both of the following:
● Performance style related to experts. For example, performance styles are represented by defined attributes of body movements that can be observed using data obtained from one or more motion sensor units. This is a practical example in the field of skateboarding, "Learn how to perform McTwist", "Learn how to perform McTwist in the style of Pro Skater A" and "Pro Skater B "Let's learn how to perform Mac Twist in style".
● Coaching knowledge related to experts. For example, expert-specific attributes may be defined based on a process that is configured to objectively define the specificity of coaching (eg, expert knowledge is the majority view (as described in the example above) different from consensus views). This is a practical example in the field of skateboarding, "Learn how to run Mac Twist", "Learn how to run Mac Twist from Pro Skater A", "Run Mac Twist from Pro Skater B"It's possible to provide 'learning how to do'.

  Variations of expert knowledge may also take into account coaching styles where, for example, the same advice is given for the same indication, but the advice is provided in different ways.

  In some cases, there is a first selectable expert knowledge variation and a second selectable expert knowledge variation, and (i) for the first selectable expert knowledge variation, the downloadable data is a client Configuring the device to identify a first set of first observable data conditions associated with a given skill in data obtained from the performance sensor unit; and (ii) a second selectable expert For knowledge variations, the downloadable data configures the client device to identify a second different set of observable data conditions associated with a given skill in the data obtained from the set of performance sensor units. To do. Again, this is optionally used to allow implementation of any one or more of style variations, coaching knowledge variations, and / or coaching style variations.

  In some cases, there is a first selectable expert knowledge variation and a second selectable expert knowledge variation, and (i) for the first selectable expert knowledge variation, downloadable data is: In response to observing defined observable data conditions associated with a given skill, configure the client device to provide the user with a first set of feedback data; (ii) a second For selectable expert knowledge variations, the downloadable data provides the user with a second different set of feedback data in response to observing defined observable data conditions associated with a given skill. Configure the client device as follows: Again, this is optionally used to allow implementation of any one or more of style variations, coaching knowledge variations, and / or coaching style variations. In some examples, the difference between the first set of feedback data and the second set of feedback includes different audio data representing the speech of a human expert associated with each variation of expert knowledge.

  Further embodiments provide a computer-implemented method for generating data configured to enable delivery of skill training content for a defined skill, the method comprising: (i) a first of observable data conditions Generating a set, wherein the first set includes observable data configured to allow processing of input data obtained from one or more performance sensor units; Representing the physical performance of the skill defined by the user to identify one or more attributes of the performance by: and (ii) generating a second set of observable data conditions The second set is input data obtained from the same one or more performance sensor units. Input data represents the physical performance of the skill defined by the user so as to identify one or more attributes of the performance , Steps. In this embodiment, the second set of observable data conditions includes one or more expert-specific observable data conditions that are missing from the first set of observable data conditions. Or, the observable data conditions specific to the plurality of experts are the knowledge of the expert knowledge of the skill training content with respect to the defined skills associated with the skill training content generated using only the first set of observable data conditions. Built into the variation. Variations in skill training content expert knowledge include: (i) style differences associated with specific human experts for baseline skill performance styles, (ii) coaching knowledge associated with specific human experts for baseline coaching knowledge And (iii) any one or more of the coaching style differences associated with a particular human expert relative to the baseline coaching style.

  One embodiment provides a computer-implemented method for generating data configured to enable delivery of skill training content for a defined skill, the method comprising: (i) a first set of skill training content The first set of skill training content enables delivery of a skill training program for a defined skill based on processing of input data obtained from one or more performance sensor units The input data represents a physical performance of the skill defined by the user so as to identify one or more attributes of the performance, and (ii) a second of the skill training content To generate a set of Wherein the second set of skill training content includes observable data conditions configured to allow processing of input data obtained from the same one or more performance sensor units, the input data comprising: Representing the physical performance of the skill defined by the user to thereby identify one or more attributes of the performance. In this embodiment, the second set of skill training content is responsive to the given set of input data such that the second set of skill training content provides a variation of expert knowledge of the skill training content; It is configured to provide a different training program effect compared to a first set of skill training content responsive to the same set of input data. Again, variations in expert knowledge of skill training content include (i) style differences associated with specific human experts for baseline skill performance styles, and (ii) specific human experts for baseline coaching knowledge. Any one or more of the associated coaching knowledge differences and (iii) the coaching style differences associated with a particular human expert relative to the baseline coaching style will be described.

Exemplary Training Process Flow FIG. 16 illustrates, in an exemplary embodiment, how the techniques disclosed herein reproduce and scale one-to-one expert coaching.

  Appropriate teachers can make amazing differences by teaching and accelerating the learning process. However, successful teaching methods require direct two-way communication, and teachers and coaches are time-constrained with respect to the number of students they can teach meaningful skills. As a result, often the best coaches are professionals, not the general public.

Utilizing the knowledge and experience of professional coaches and teachers, technology reproduces the capabilities of great coaches as follows:
● Observe and analyze. When a user attempts a skill or activity, data is captured by a motion sensor or sound sensor. The POD device identifies the student's ability level in order to place the student's ability level at the appropriate level of the curriculum and provide appropriate analysis.
● Diagnose and prioritize. Each set of engine data executed by the POD device is programmed with expert knowledge for optimal execution of a particular skill or activity. The engine compares (with high accuracy) the user's technique within the skill to the skill's optimal technique and uses error detection algorithms to determine and analyze the variance. The engine also preferably distinguishes between root cause mistakes and different types of surface “shallow” mistakes. This allows the engine to analyze the captured data, compare it with the best technique, and identify the root cause of the error.
● Respond. This technology then provides real-time personalized instructions and a remedy for the root cause of mistakes to advance the user, like a coach with a real teacher or student. The instructions include real-time audio and visual instructions as needed. Additional command interfaces are currently being developed that include haptics (vibration) and light (illuminated nodes of clothes).
● Show. Instructions are also provided by gamification and video tutorials and drills that break down the skill into its components, focusing on the key areas returning the user from advancing to the next level of mastering the skill. The tutorial can be displayed on a WiFi or Bluetooth compatible screen, tablet, or smartphone.

  Unlike traditional coaching, the technology disclosed herein provides a system that is available whenever a student is ready to learn, and is efficient and affordable to specialized personalized coaching. Represents valid access.

Assisted content selection In some embodiments, this technique provides a personal curriculum to the user. Users can build individually tailored interactive “playlists” of skills, activities, training tools and related content.

  As the system collects user data, automated suggestions regarding skills, activities and challenges are made based on user preferences and abilities. This allows the assisted construction of the curriculum to help the user achieve the desired result.

  In some embodiments, assisted content selection can be used to advertise third party products / services, such as equipment proposals, pro tournaments, tournament accommodations, and other supplements such as training schedules and golf movies. Range of typical activities. In this way, this technology offers a variety of revenue opportunities from targeted third-party advertising and placement.

Exemplary Content Distribution Methods As described above, in some embodiments, content is made available to users via an online marketplace (eg, an online marketplace distributed by a cloud-hosted platform). A user accesses the marketplace (eg, via a web browser application running on a personal computer or mobile device) to obtain the desired training content. Based on the acquired content, the user can select the desired activity and / or The POD device is configured to perform functions including functions related to providing training on skills. Based on this configuration, a set of training program rules is executed on the POD device (or in a further embodiment, a second device coupled to the POD device) to provide an interactive training process. Can do. The interactive training process provides the user with feedback / commands that respond to inputs representing user performance. This input is obtained from the PSU and processed by the POD device. The interactive training process may, in some embodiments, (i) observed user performance attributes associated with predefined performance attributes; (ii) user attribute data including historical performance data; (iii) skill training progress. Operate based on a complex set of rules that take into account the path (which can be a dynamic variable); and (iv) other factors.

  The present disclosure primarily includes a set of motion sensors (eg, wearable motion sensors coupled to clothing; the motion sensors are configured to allow analysis of user body position variations in three dimensions Focus on examples of POD devices that receive user performance data obtained from For example, this is particularly applicable to training on physical activities such as sports and other activities involving human movement. However, this technique is equally applicable to data obtained from other forms of sensors. Examples include sensors that monitor audio, video, location, humidity, temperature, pressure, and the like. It will be appreciated that data from such sensors may be useful for skill training across a wide range of activity types. For example, audio sensors are particularly useful for training activities such as language skills, singing, and playing musical instruments.

At a general level, the techniques disclosed herein are, in some embodiments, configured to gain expert wisdom, thereby providing a pair between a coach and a student. Reproduce one conversation. In this regard, some case features include the following:
● Bidirectional interaction. Digital technology is versatile and highly scalable, and can be applied to virtually any skill or activity. By using sensors and related technologies, each interaction has the ability to teach better with each interaction while adapting to the individual user's style and physiology in a real-time coaching experience.
● Real-time instructions. The sensor diagnoses motion and technical errors and allows for automated (and substantially instantaneous) delivery of personalized haptic and / or audiovisual feedback and / or instructions.
● Advanced performance. In addition to tracking, users are constantly coached. The measurable rise that occurs as a result of performance helps the user to reach milestones early and reach goals with greater certainty.

  It will be understood based on the description herein how these features are achieved by the various embodiments.

  Skill training content is rendered via a user interface (eg, graphical and / or audible). As mentioned above, there are various technical configurations in which this is achieved. A preferred approach is that the training content is downloaded directly to the POD device 150 and rendered via a separate device that includes video and / or audio output that allows the user to experience the rendered content. Separate devices include a smartphone (in some embodiments running an application configured to render content provided by the POD device 150), a headset, a set of glasses with an integrated display, One or more of a retinal display device and other such user interface devices may be included.

  In some embodiments where a mobile device (such as a smart phone) is used, the POD device provides a local web server configured to deliver content to the mobile device. The mobile device executes a web browser application (or possibly a dedicated application), which navigates to a web address regarding which code is obtained from the POD device as a local web server.

  Skill training content is obtained from an online marketplace in the preferred embodiment. This marketplace preferably allows the user to select and obtain a variety of different skill training packages and manage their download to the user's POD device (s). The term “skill training package” represents an acquirable set of skill training content. This may relate to a single skill, various skills associated with a common activity, or various other configurations. This disclosure should be limited by reference to any specific implementation options for structuring how skill training data is organized, made available for procurement, monetized, etc. is not.

Exemplary Content Distribution Framework The following sections describe various exemplary technical frames for distribution of content, such as adaptive skills training content, driven by the processing of PSDs (such as MSD) to end-user devices. Explain the work.

In summary, any one or more of the following approaches or combinations thereof may be used:
Browsing and selecting downloadable content via the first web-enabled device, where content download subsequently occurs on the second web-enabled device. For example, content is viewed on a smartphone and then downloaded directly from a web source to a POD device.
Browsing and selection of downloadable content via a first web-enabled device, where the download of the content subsequently occurs on that first web-enabled device. There may then be a secondary download of some or all of the content from the first web-enabled device to a second device, such as a POD device (e.g., sensor configuration data and state engine data are first transferred to the mobile device). Downloaded and then delivered to the POD device).
● Use of POD devices separated from user interface devices. For example, a mobile device is used to provide a user interface, and a POD device is a processing unit attached to an MSU enabled garment.
● Use of POD devices integrated with user interface devices. For example, in some embodiments, a smartphone serves as a POD device.
● Use of POD devices that are physically coupled to existing end-user mobile devices. For example, a POD device is defined as a processing unit that couples to a smartphone, for example, via a cradle type mount.

  FIG. 9A illustrates an exemplary computer-implemented framework according to one embodiment. Various alternative embodiments are shown in FIGS. 9B-9D, with similar features indicated by corresponding reference numbers.

  Each illustrated framework performs functionality (eg, by executing computer-executable code (which may be stored on a computer-readable carrier medium) using one or more microprocessors (also referred to simply as “processors”). A plurality of computing devices (also referred to as “machines” or “terminals”), each configured to provide “performance of a“ computer-implemented method ”. It will be understood that the various computing devices include a range of other hardware components not specifically illustrated.

  The example of FIG. 9A shows a central management and content management platform 900. The platform can be defined by a single computing device (eg, a server device) or more preferably by multiple network computing devices. The components of the server are described functionally without particular reference to various configurations of computing devices that are configured to provide related functionality individually or collectively. It should be understood that such matters are a matter of design choice and that a wide range of network and server architectures are well known in the art. Further, in some embodiments, there are multiple examples of platforms 900 operating in parallel.

  Platform 900 is configured to provide functionality that is accessed by a plurality of users (such as the above-described subject) via computing devices operated by these users. FIG. 9A shows a set of user-side equipment 920 that is operated in connection with an exemplary user. In practice, each of a plurality of users operates a respective set of similar devices 920 (not shown).

  Device 920 includes a mobile device 930. For example, in this embodiment, mobile device 930 takes the form of a smartphone. However, in other embodiments, different mobile devices such as tablets, PDAs, portable gaming devices, etc. are used. In some embodiments, the mobile device 930 is defined by purpose-configured hardware and is specifically intended to provide functionality related to the overall framework described. In summary, the primary function of the mobile device 930 is to deliver content obtained from the platform 900 via a user interface. This content can be downloaded on an “as needed” basis (in online mode), pre-downloaded (so as to allow operation in offline mode), or both It can be performed.

  Mobile device 930 is one of external user interaction hardware such as external headphones, microphones, wearable devices that provide graphical displays (eg, augmented reality displays, glasses configured to provide retinal projection displays), and the like. It can be combined into one or more pieces.

  In the example of FIG. 9A, the mobile device 930 is configured to interact with the platform 900 via a mobile app (eg, an iOS or Android app) downloaded from an app download server 971. The (In this embodiment, server 971 is a server operated by a third party, but other embodiments use a first party server). Such mobile applications are stored in the memory device 934 and executed via the processor 933. The mobile application configures the mobile device 930 to communicate with the application interaction server 972 via an available internet connection, and the application interaction server 972 provides a gateway to data available via the platform 900.

  In the example of FIG. 9B, the mobile device 930 is configured to interact with the platform 900 via a web browser application that utilizes the mobile device 930 when navigating to a predefined web address. Configure to communicate with the mobile device web server 974 via a possible internet connection. Web server 974 then provides a gateway to the data available through platform 900. The web browser application is executed based on code stored in the memory 934 of the mobile device 930 and is user interface specific to the platform 900 via browser renderable user interface code downloaded to the device 930 via the server 974. I will provide a.

The device 920 further includes a personal computer (PC) 940. This can be virtually any computing device that is accurately and properly configured to allow additional hardware devices in the form of POD devices 950 to communicate with the platform 900. For example, in one embodiment, the POD device connects to the PC 940 via a wired connection (such as a USB connection) or a wireless connection (such as a WiFi connection or a Bluetooth connection). Functionally, this allows data to be downloaded from the platform 900 to the POD device 950.
Alternative configurations and connections can be implemented, thereby enabling, for example, communication between the following POD devices 950:
A POD device 950 that accesses the platform 900 via the mobile service 930 and a web server 973 (see FIG. 9C). This includes accessing specific functions of the device 930 related to the operation of the POD device 950 or, in some embodiments, simply accessing an internet connection provided via the mobile device 930.
A POD device 950 that accesses the platform 900 via the web server 973 (see FIG. 9D).

  In some such cases, for example, if the POD device 950 does not provide a user interface in a unique manner, a given user can access the user interface (eg, mobile application or web page) with the mobile device 930 ( Or other appropriately configured computing device), thereby instructing the platform 900 to deliver specific data to the POD device 950 associated with that user. In such an embodiment, the data is downloaded directly to the POD device 950 via an available internet connection.

  In some embodiments, skill training content rendered on mobile device 930 is first downloaded to POD device 950. This is done so that the mobile device 930 can provide skill training data in an offline mode (without internet connection), and the required content is provided by the POD device 950. This is particularly appropriate in instances where there is no mobile device 930, and the user interface is provided via a user interface delivery device 990 that only communicates with the POD device 950 (eg, headset, glasses with built-in display, retina Projection device, etc.).

  FIG. 17 schematically illustrates a further framework, along with an example process flow associated with that framework.

Exemplary POD Device and Sensor Configuration POD device 950 is configured to perform processing of data collected from one or more PSUs 960. These PSUs are connected to POD 950 via wired and / or wireless connections. For example, in one embodiment, the POD device is connected to the first set of PSUs via direct wired coupling and the second set of PSUs via an RF link to a bridging component. And the bridging component is connected to the second set of PSUs via a direct wired connection.

The PSU range is used across various embodiments depending on the nature of the data collected. Secondly, the nature of the data collected depends on the skill or activity being performed by the user. For example, the following users are relevant to the many examples and embodiments discussed herein:
● A wearable MSU. The MSU is incorporated into a garment (MSU compatible garment) configured to be worn by a subject. Examples of such garments include compression-type garments (such as shirts or trousers) that each include a plurality of spaced MSUs at known locations. In some cases, the garment includes a pre-formed attachment location for releasably receiving each MSU to allow movement of the MSU between available attachment positions. In one embodiment, the compression shirt supports a plurality of motion MSUs and attaches the POD device to the MSU via a wired connection where the attachment extends through the shirt and is wrapped in the shirt. A mounting portion for complementary and releasable reception; The shirt can be coupled to a complementary set of compressed pants that includes a plurality of additional motion MSUs wired to a common RF communication module. The RF communication module allows the MSD to communicate with a further RF module provided on the shirt or by a POD device, thereby allowing the POD device to receive data from all MSUs on the shirt and pants. .
● ASU. In different embodiments, different audio sensors are used. Examples of available sensors include a microphone-based sensor, a sensor that plugs into an audio input port (eg, via a 2.5 mm or 3.5 mm jack connector) to receive an audio signal, and generates a MIDI signal Including pickups to do.

  It is understood that the POD device 950 can be configured via software that processes data from virtually any form of PSU that provides an output signal (eg, a digital output signal) received by the POD device. It will be.

Some embodiments provide multiple different hardware configurations of POD devices, each manufactured to interact with a particular PSU. For example, an exemplary POD device may include:
A POD device configured to be carried by a garment and physically coupled to a plurality of MSUs that are also carried by the garment (and possibly directly or indirectly to one or more additional MSUs) POD device).
● POD devices including microphones.
● POD devices that include an audio input port (such as a 3.5mm headphone jack).

  In addition, it will be appreciated that various forms of PSU allow training on a wide range of skills. For example, POD devices coupled to one or more ASUs are sometimes used to provide training for various musical skills (eg, singing, playing musical instruments, etc.).

Exemplary Configuration for User Interface Delivery The manner in which the user interface provides feedback and / or instructions varies based on the hardware configuration. In some embodiments, the user interface is audio only (eg, using headphones), where the instructions and feedback are audio based. In some embodiments, the user interface includes visual information that requires a display screen (eg, a display screen provided by a smartphone device, appropriate glasses and / or a retinal display device, etc.).

  The configuration of the user equipment in FIG. 9A can be configured to function as shown in FIG. 10A. More specifically, the marketplace platform is technically designed to enable the configuration of POD devices that deliver POD / engine data to POD devices and deliver training content for a particular skill (or set of skills). Composed. The POD device is configured to process received data from the sensor based on POD / engine data previously downloaded from the marketplace. Based on this processing, the POD device instructs the mobile device to display platform content via its user interface (eg, to provide feedback and instruct the user to perform a specific task). I will provide a. The mobile device downloads relevant platform content from the platform.

  In other embodiments (eg, audio devices, glasses with digital displays, etc.), an additional feedback device is used, which is shown in FIG. 10A as being directly coupled to the POD device.

  FIG. 10B illustrates an alternative configuration where the mobile device operates in an offline mode. In this example, user interface data is downloaded to the POD device and provided to the mobile device via the POD device. In addition, an alternative configuration is shown in FIG. 10C where there is no mobile device and the POD device can provide feedback / commands via a feedback device (such as headphones, screened glasses, retinal projection device, or other feedback device). Provide directly.

Exemplary End User Hardware Configurations Incorporating MSUs Described below are various hardware implemented in an embodiment for enabling end user attempted performance monitoring for a given skill A configuration, which includes the identification of predefined observable data conditions (eg, observable data conditions defined by the methodology described above) in sensor data collected during attempted performance.

  It should be understood that: (i) these are merely examples, and the techniques disclosed herein may be implemented with alternative hardware configurations, (ii) provided diagrams Is schematic and not to scale, (iii) The diagram provides functional representations showing the main components and does not represent aspects such as PCB design, sensor unit positioning, connection wiring, etc.

  Various embodiments provide a wearable garment. For example, these may include any one or more of bodysuits, shirts (short or long sleeve), trousers (short or long), gloves, footwear, hats, and the like. In some cases, the wearable garment is defined by a plurality of separable garment items (eg, shirts and trousers) configured to communicate with each other (eg, via wired coupling or wireless communication). It is done. The garment is preferably manufactured from an elastic material, for example a compression garment. This helps keep the sensor component stationary relative to the wearer's body. The garment is preferably manufactured to allow removal of electrical components (such as sensor units and POD devices), for example to allow maintenance and the like.

  The garment includes a plurality of sensor strands, each sensor strand including one or more sensor units. The sensor strands each start from a sensor strand connection port 1208, and the sensor strand connection port is configured to couple a plurality of sensor strands to a central processor, the central processor being in a manner consistent with the above disclosure. It is called a POD device. The sensor strand may include a single sensor unit or multiple sensor units.

If the sensor strand comprises a plurality of sensor units, they are preferably connected in-line. That is, the sensor units SU ₁ . . . In the case of including SU _n , communication to the sensor unit SU _i is performed by SU ₁ . . . Received and retransmitted by each of SU _i-1 . Various addressing protocols may be used, but these are configured such that the communication is addressed based on the mounting location of the sensor unit. This allows the sensor unit to be installed without the need to ensure that a given specific sensor unit is installed at a specific mounting position (this removes the sensor unit for garment washing) It is also particularly useful in cases where it also allows replacement from the sensor unit (eg in case of failure).

  In some cases, the addressing protocol is based in part on an identifier associated with an individual sensor unit, in which case the POD device performs an automatic configuration step when it recognizes the sensor unit, thereby , Identifying the mounting position where the sensor unit is installed, and associating the sensor identifier with the mounting position. In some embodiments, addressing includes a retransmission count in the message (eg, the message includes a retransmission integer that is set by the POD device that is decremented at each transmission, and the message has a decrement count of Achieved by techniques that do not require knowledge of the sensor identifier (such as received and processed by the sensor unit when zero is reached). The latter approach has several advantages that allow the sensor unit to be replaced / replaced without requiring subsequent resetting of addressing parameters in the POD device.

  In a preferred embodiment, each sensor unit includes a circuit board component mounted in a sealed container. The sealed container includes two connection ports: one for upstream communication along the sensor strand and one for downstream communication along the sensor strand. In some embodiments, the sensor unit can identify the installed orientation as if which ports are upstream and downstream ports determined based on the installation orientation. In other embodiments, there is a predefined installation orientation so that the sensor unit cannot be installed in reverse. The connection port is preferably snap-locking to a complementary connection port on the sensor strand so that the physically observable coupling correspondingly provides electronic / communication coupling. mounting).

  The sensor strand includes connection lines including one or more lines for communication and one or more lines for power supply (power for the sensor unit is supplied by the POD device). . The connecting lines are sealed and soaking the clothes in water (eg during cleaning) will not damage the lines. Preferably, the connector module providing the connection to the connection line of the POD device and the sensor unit provides a water tight seal. Further, in a preferred embodiment, when the POD device and sensor unit are installed in a garment, all electrical components are provided in a waterproof or water resistant structure (eg, to the sensor strand connection port of the POD device and sensor unit connection port). Snap lock engagement provides a water tight or water resistant seal).

  On a given sensor strand comprising a proximal sensor unit and one or more downstream sensor units, the proximal sensor unit is (i) provided by a central processing unit and addressed to one or more of the downstream sensor units. And (ii) relay sensor data provided to the central processing unit by a given one of the downstream sensor units in the upstream direction. This may include start / stop instructions. The sensor instructions also include sensor configuration data, which configures the sensor unit to provide sensor data in a defined manner. Sensor configuration data, in some cases, references sampling rate, reduced selection of information observable by sensor components, and other configuration attributes defined specifically for the skill being observed by the POD device Is defined by

  Each sensor unit includes (i) a microprocessor; (ii) a memory module; and (iii) a set of one or more motion sensor components. A more detailed disclosure of exemplary sensor hardware is further provided below. However, these basic components allow the sensor component to receive communications from the POD device and provide observation data from the sensor component in a predefined manner (see eg, resolution, sample rate, etc.). Defined). In some embodiments, each sensor unit includes a local power source, but power is supplied along the sensor strand from the POD device (or another central power source) rather than requiring individual charging of the sensor unit battery. It is preferable.

  For an exemplary sensor unit, the set of one or more sensor components includes one or more of (i) a gyroscope; (ii) a magnetometer; (iii) an accelerometer. In the preferred embodiment described below, each of these components is one and each is configured to provide triaxial sensitivity. In a further embodiment, there are multiple components of one or more of the component types, for example two accelerometers. This can be different configurations, for example, one is configured to observe course movements at a given resolution and the other is configured to observe specific fine movements at a higher resolution. to enable.

  The central processing unit (POD device) includes (i) a power supply; (ii) a microprocessor; and (iii) a memory module. The memory module is configured to store software instructions executable by a microprocessor that enables the processing device to perform various functions, transmits sensor data in a predefined manner, and pre-stores sensor data. It includes a sensor unit configuration for identifying one or more sets of defined observable data conditions, including sensor data received by a central processing unit from a plurality of connected sensor units. In a preferred embodiment, the POD device also includes a sensor component (e.g., the same sensor component as the sensor unit) that thereby enables motion observation at the position of the POD device. In some embodiments, the POD device is attached to the garment in a pouch provided at a location that is near the upper center of the user's back (eg, between the shoulder blades) when in use.

  FIG. 12A illustrates the selection of hardware components of a wearable garment according to one embodiment. It will be understood that these are illustrated without reference to the geometric / spatial configuration resulting from the configuration of the garment itself.

The POD device 1200 of FIG. 12A includes a processor 1201 coupled to a memory module 1202, which is configured to store software instructions and thereby provide the functionality described herein. They are:
A training program (or multiple training programs) that includes logic to navigate through the training program and user interface data that communicates outside the POD device rendered by other components (such as headsets, display devices, etc.) Data representing
● Multiple skills to be trained for the training program (or each training program). Each skill is defined by sensor configuration instructions, rules that identify observable data conditions in the sensor data, and rules for feedback (and / or other actions) when specific observable data conditions are identified. The For example, these are defined by processes such as phases 501-503 in FIG. 5A.

  It will be appreciated that various other aspects of software instructions are also provided.

  A rechargeable power source 1203 provides power to the POD device 1200 and one or more connected devices (including a sensor unit and, if provided, one or more control units). A local sensor component 1205 (eg, a 3-axis magnetometer, 3-axis accelerometer, and 3-axis gyroscope) allows the POD device to function as a sensor unit. Input / output 1206 is also provided and may include: a power / reset button; a light configured to display operating characteristics; and, in some embodiments, a display screen. However, in the embodiments described herein, the primary mode of communication between the POD device and the user is by an external (and self-powered) user interface device.

The POD device 1200 includes one or more wireless communication modules 1204, thereby enabling communication / interaction with one or more remote devices. For example, the communication module may include one or more of the following:
● Wi-Fi. For example, WiFi is used in some embodiments to deliver user interface content (including image, text, audio and video data) for rendering on UI display 1231. This may include smart phones, tablets, devices with head-up displays (such as augmented reality headsets or eyewear), and other such devices. The Ul display can be used to select and / or navigate training content available to be delivered via a POD device.
● Bluetooth. For example, Bluetooth is used in some embodiments to deliver renderable audio data to a Bluetooth headset or the like, thereby providing audible instructions / feedback to the user.
● ANT + (or other such communication module) configured to allow interaction with a monitoring device such as a heart rate monitor.
● RF communication module. In some embodiments, one or more such modules thereby communicate with a wireless sensor unit, eg, a sensor unit configured to be attached to a device (skateboard, gold club, etc.). Provided to enable. In some cases, this includes a wireless sensor strand defined by a plurality of wired sensor units connected to a common hub that communicates wirelessly with the POD device.

  There may be various other wireless communication modules for various other external devices 1233.

  The POD device includes a circuit board and optionally additional hardware components provided in a sealed or sealable container (waterproof or water resistant). The container can be attached to a garment (or an example of a specifically configured bag), the attachment including the connection of one or more couplings. Preferably, a single coupling connects the POD device to all available sensor strands. Again, this can be a snap lock coupling (waterproof or water resistant) that provides both physical and electronic coupling at substantially the same time.

  FIG. 12A shows a plurality of sensor strands (strand 1... Strand n) coupled to sensor connection port 1208. Each sensor strand includes a plurality of sensor units (sensor unit 1... Sensor unit n), but it is understood that in some embodiments, a given strand includes only a single sensor unit. Should.

  FIG. 12B shows an alternative arrangement of sensor strands. In context, some embodiments provide a garment composed of one or more “partial” sensor strands. Each partial sensor strand includes (i) no or multiple sensor units; and (ii) a connector module configured to couple to a complementary connector module provided by a secondary garment. The expression “no or more” means that in some cases the partial sensor strand is defined by a sensor strand line that connects the POD device to the connector module without an intervening sensor unit, and in other cases the partial sensor strand. A strand indicates that the strand is defined by a sensor strand line provided with one or more sensor units terminating in a connector module.

  The coupling of the connector module to the complementary connector module provided by the secondary garment functionally connects one or more of the partial sensor strands to the corresponding one or more secondary garment partial sensor strands. Thereby enabling communication between (i) one or more sensor units provided on one or more secondary garment part sensor strands; and (ii) a central processing unit.

  In the example of FIG. 12B, the garment includes a shirt and trousers. There are four shirt sensor strands and two trouser sensor strands. The connector device 1209 couples the partial trouser strands to allow communication between the sensor unit provided on the trousers and the pod device (and the power supply of these sensor units by the POD device). In further embodiments, this type of arrangement is used to allow connection to sensor units provided on footwear, gloves, hats, and the like. For example, in some embodiments, connector ports are provided in the proximal arm, neck, and foot openings, thereby providing by one or more additional sensor units carried by additional clothing items or devices. Allows the sensor strand to be extended.

  In some embodiments, sensors carried by secondary garments such as gloves or footwear include specialized sensor components that measure attributes other than movement. For example, a pressure sensor component can be used (eg, to measure the force applied to the ground or other object thereby measuring the grip strength of a gold club, etc.). The POD device is configured to know the sensor placement that will be provided for a given training program. For example, the user is given instructions regarding the sensor unit to be connected and the POD device performs a check to ensure that the sensor is responding and that the expected sensor data is provided.

  FIG. 12B also shows a device attachable sensor unit 1240. This unit includes a processor 1241, memory 1242, and sensor component 1245 in substantially the same manner as sensor unit 1220. However, it further includes a wireless communication module 1246 for enabling wireless communication (eg, RF communication) with the POD device 1200, and a local power supply 1243. Input / output (lights, power / reset button, etc.) are also provided.

  FIG. 12C expands FIG. 12B by providing a control unit 1230. This control unit is physically coupled to one distal end of the shirt strand, for example as a control unit attached to the wrist. In some embodiments, the control unit is integrated with the sensor unit. The control unit 1230 includes an input device 1231 such as one or more buttons and an output device 1232 such as one or more lights and / or a display screen (preferably a low power screen). A control unit 1230 is provided to assist the user in providing basic commands for controlling the supply of training content via the POD device. For example, the commands may include “previous” and “next”, for example, to repeat the previous audible command or to advance to the next stage of the training curriculum. In some embodiments, audible content is provided to assist the user in manipulating the input device, eg, by audibly providing selectable menu items.

  In the embodiment of FIG. 12D, the control unit 1230 further includes a wireless communication module (eg, RF) configured to receive a wireless signal provided by the device attachable sensor unit 1240. In this way, the wireless sensor unit data is sent directly at the POD device (via module 1204) and (via module 1233, via control unit 1230 and along the sensor strand, in this case the shirt sensor strand. 4) can be received both indirectly. This provides wireless communication redundancy; it should be understood that it is difficult to reliably receive wireless communication where the signal passes through the human body (mainly water). Having two spaced positions (as shown in FIG. 12D or via an alternative arrangement) significantly increases the chance that all sensor data from unit 1240 is received and available for analysis. . The POD device implements a data integrity protocol, thereby determining how to synthesize / select the data provided by each of the two paths. In some embodiments, for example, if the external sensor unit is more reliable, there may be a plurality of redundant wireless communication units located at various locations on the garment.

  In some embodiments, the unit 1230 is provided on its own strand rather than a sensor strand that includes a terminal connector for attachment of a sensor-enabled glove component.

  FIG. 12E provides a schematic representation (not to scale) of a two-piece garment according to one embodiment. This is indicated by a reference number corresponding to the previous figure. The illustrated garment is defined by three sensor strands on the shirt component and two sensor strands that provide a sensor unit on the trouser component (with a connector 1209 coupling the sensor strands between the garment components). Two-piece clothing.

  The illustrated arrangement of sensor units is not intended to be limiting in any way, but instead provides a rough guide for the position of potential sensor units in clothing having this number of sensor units. The general principle shown in FIG. 12E is to place the sensor away from the joint. The data collected from the gyroscope, accelerometer and magnetometer of each sensor unit thereby allows a process to determine the relative sensor position, angle, movement, etc. across multiple axes (three Note that providing a 3-axis sensor actually provides nine degrees of sensitivity for each sensor unit). Accordingly, rich data relating to body movement can be determined. In addition, the configuration data provided by the POD device allows the sensitivity / motion of each sensor to be specific to a particular skill, for example to set a level for each individual sensor component and report only on specific motion artifacts. Can be selectively adjusted. This reduces power consumption in the sensor unit, reduces processing overhead in the POD device, and increases sensitivity to certain important motion artifacts (in contrast to the movement of a person walking toward the rowing machine, the movement in the rowing action). High-resolution monitoring, such as by applying a kinematic model that only monitors movements having specific defined characteristics).

  FIG. 12F extends FIG. 12E to show a piece of remote equipment, which in this case is a skateboard carrying a wireless sensor unit 1240. As described above, sensor unit 1240 preferably communicates wirelessly with POD device 1200 via multiple communication paths, thereby addressing limitations associated with wireless communication. For example, in the illustrated example, the signal transmitted by the sensor unit 1240 is transmitted by the wireless communication module provided by the POD device 1200 and (via the sensor strand to which the received sensor data is connected). ) Configured to be received by a wireless communication module provided by wrist control unit 1230;

  FIG. 12G extends FIG. 12F by showing a mobile device 1281 and a wireless headset 1282.

  POD device 1200 communicates with mobile device 1281 (eg, a smartphone or tablet that can run any of a range of operating systems including iOS, Android, Windows, etc.), thereby rendering content on a user interface screen. Provide mobile device data configured to enable the content there to help guide users through skill training programs. For example, the content can include video data, text data, images, and the like. In some embodiments, the POD device 1200 operates as a local web server for distribution of such content (ie, the mobile device connects to a wireless network that is notified by the POD device).

  A headset 1282 (not necessarily a headset of the illustrated design configuration) allows the user to receive audible feedback and / or instructions from the POD device without having to carry or reference the mobile device 1281 To. This is related to the context of skills that are not feasible or generally inconvenient to refer to, for example, mobile devices, for example during rowing, jogging, swimming, snowboarding, etc. In some embodiments, a wired headset can be used, for example, with a 3.5 mm headphone jack provided by a garment preferentially connected to the POD device.

  FIG. 12H illustrates a sensor strand according to one embodiment. This includes a plurality of sensor units 1220. Each sensor unit includes a processor 1221 coupled to memory 1222. Upstream and downstream data connections 1223 and 1224 are provided (which in some embodiments can be functionally differentiated based on installation orientation). Input / output 1225 may be provided, such as a light and / or power / reset button. The illustrated embodiment may be used to assist in providing feedback to the user (eg, activating tactile feedback to the right arm sensor unit corresponding to an instruction to do something with the user's right arm). A unit 1226 is included. The illustrated sensor components 1227 are a 3-axis magnetometer 1227a, a 3-axis accelerometer 1227b, and a 3-axis gyroscope 1227c.

  FIG. 12I illustrates an exemplary sensor unit 1220 illustrating a housing 1296 according to one embodiment. This housing is formed of a plastic material and watertightly surrounds the circuit board 1297 that provides the components shown in FIG. 12H. Connector 1298 allows connection to a sensor strand provided by clothing.

  FIG. 17 provides an alternative view of an MSU-enabled garment showing a stretch / compression fabric that provides sensor strands and MSU attachment locations.

Configuration of MSUs and MSU-enabled garments: Overview In some cases, end-user equipment ODC identification is: (i) knowledge of the actual location of a given user's MSU; and (ii) relative location of the MSU. Need knowledge. Since each MSU conventionally provides motion data for its own reference frame, there is a challenge in meaningfully combining data from multiple MSUs.

  The various embodiments described above utilize data derived from a set of sensor units, thereby enabling analysis of physical performance. These sensor units are attached to the user's body, for example, by wearable clothing configured to carry a plurality of sensor units. This section, and the following sections, are illustrative examples relating to the configuration of the sensor unit in some embodiments, thereby enabling analysis of movement, such as human movement, based on data obtained from the sensor. A method will be described.

  By way of background, a known and common approach to collecting data representing physical performance is to use optical motion capture techniques. For example, such techniques use optical capture techniques to place optical markers that are observable at various locations on the user's body and derive data representing the position and movement of the markers. The analysis uses a virtually constructed body model (e.g., complete skeleton, facial representation, etc.) and translates marker positions and movements into a virtually constructed body model. In some prior art examples, a computer system can reproduce the exact movement of a physical human user in substantially real-time with a virtual body model defined in the computer system. For example, such technology is provided by the motion capture technology organization Vicon.

  Motion capture techniques typically capture (i) the user places markers at various locations on their body, and (ii) capture the user's performance using one or more camera devices. In view of the fact that both are required, the usefulness is limited. Some technologies (eg, technologies that use depth-sensing cameras) can reduce reliance on the need for visual markers, but nevertheless, motion capture technologies do not have one or more It is inherently limited by the performance needs that arise where it can be captured by the camera device.

  The embodiments described herein use a motion sensor unit, thereby overcoming limitations associated with motion capture technology. A motion sensor unit (also called an inertial measurement unit, or IMU), for example, a motion sensor unit that includes one or more accelerometers, one or more gyroscopes, and one or more magnetometers is essentially Can provide data representing their own movements. Such sensor units measure and report parameters including speed, orientation, and gravity.

The use of motion sensor units presents a range of challenges by comparison with motion capture technology. For example, technical challenges arise when using multiple motion sensors for at least the following reasons:
● Each sensor unit provides data based on its own local reference frame. In this regard, each sensor essentially provides data as if it essentially defined the center of its own area. This is different from motion capture where the capture device can essentially analyze each marker against a common reference frame.
● Each sensor unit cannot know exactly where the limb is. While sensor garments can define approximate locations, individual users have different body attributes that affect accurate positioning. This is different from motion capture technology where markers are typically positioned with high accuracy.
All sensors operate completely independently as if they were placed in an electronic “soup bowl”, without the bones / limbs connecting them. That is, each data output of the sensor is independent of the relative positioning on any type of virtual body, unlike the markers used in motion capture.

The techniques and methods described below allow processing of sensor unit data, thereby providing a common body-wide reference frame. For example, this defines (i) a transformation configured to convert motion data for sensor units SU ₁ to SU _n into a common reference frame; and (ii) between sensor units SU ₁ to SU _n Determining the skeletal relationship of either or both. It will be appreciated that in many cases they are closely linked: conversion to a common reference frame allows determination of skeletal relationships.

  In some embodiments, the processing of sensor data leads to defining data that represents a virtual skeletal body model. This actually allows the data collected from the motion sensor suit configuration to provide a form of analysis similar to traditional motion capture (which also provides data representing the virtual skeletal body model).

The processing techniques described below find application at least in the following contexts:
● Build a skeleton model suitable for comparison with the model provided by the defined motion capture technology. For example, both motion capture data and sensor-derived data can be collected during the analysis phase, whereby the skeletal model data obtained from the processing of the motion sensor data is correspondingly derived from the motion capture technology. It can be verified whether it matches the skeletal model. This is applicable in the context of a process for objectively defining skills (described above), or more generally in the context of testing and validating data sensor data processing methods.
● Automated “non-pose specific” configuration of worn sensor-compatible clothing. That is, rather than requiring the user to take one or more pre-defined configuration poses for sensor configuration, the processing techniques described below are essentially free from any movement. By processing the resulting sensor data, it is possible to convert the data for each sensor into a common reference frame (eg, by assembling a skeletal model). That is, the following approach requires a fairly common “motion” for the purpose of comparing the movement of one sensor to another. The exact nature of the movement is of limited importance.
● Enable accurate monitoring of the physical performance of skills (eg, in the context of skills training and feedback). For example, this may include monitoring observable data conditions in the sensor data (representing performance influencing factors as described above).

  Several approaches are described below. These can be applied individually or in combination (eg, in overlapping and / or hybrid arrangements).

をそれぞれそれらのローカルフレームとする（すなわち、ＩＭＵを“Ｓ”で表し、１つ又は複数のＩＭＵおよび任意選択で他のセンサハードウェアを含み得るセンサユニットは、“ＳＵ”によって示される）。 The example discussed below considers two sensor units including an inertial measurement unit (IMU) that provides samples of acceleration and angular velocity represented in its own reference frame. These IMUs are designated S ₁ and S ₂ , respectively, and
(Outside 1)

Are their local frames (ie, IMUs are denoted by “S”, sensor units that may include one or more IMUs and optionally other sensor hardware are denoted by “SU”).

内に表されるベクトル
（外３）

は、左上付き表記を使用して示される：
（外４）

By convention, frame (outside 2)

Vector represented in (outside 3)

Is indicated using the upper left notation:
(Outside 4)

は、変換行列によってリンクされる。
ベクトル
（外６）

を
（外７）

で表される別のものに変換するそのような行列は、
（外８）

で示され、以下のように書かれる：

At each moment, two sensor frames,
(Outside 5)

Are linked by a transformation matrix.
Vector (outside 6)

(Outside 7)

Such a matrix that transforms into another represented by
(Outside 8)

And is written as follows:

Sensor Unit Configuration: Joint Constraints Some exemplary methodologies utilize joint performance knowledge. That is, the first sensor unit SU ₁ and the second sensor unit SU ₂ is attached to the link member on opposite sides of the known joints. Using knowledge about the type of joint, the methodology described below allows processing, thereby allowing each sensor's data to be converted into a common reference frame. That is, the method includes determining a relationship between motion data for SU ₁ and SU ₂ based on a defined set of joint constraints. For example, this includes, based on the respective reference frame defined by the SU ₁ and SU _2, to identify the position and movement of the joints between the SU ₁ and SU _2.

  A practical example is a human body, and the link member is a human body part of the human body. For example, the sensor unit is attached to the upper arm position and the forearm position having an elbow (hinge joint) therebetween. Analysis of the motion data from these sensors allows for the conversion of the motion data from each into a common reference frame, using joint constraints defined for the elbow joint hinge. This is performed for multiple pairs of sensor units that are attached to the body location on opposite sides of a plurality of known body joints (known joints of known joint type, eg hinges, spheres, or universal). Thereby defining a transformation configured to transform motion data from each of the sensor units into a common reference frame of the human body. This optionally results in maintaining a human skeletal motion model based on the application of defined transformations to motion data received from multiple sensor units.

及び
（外１０）

を、個々のＩＭＵセンサによって報告される角速度とする。これらのセンサは、ヒンジ制約（すなわち、１つの角度自由度）によって互いに接合される２つのリンクに取り付けられると考える。センサは所定のレート（例えば、５０Ｈｚ）でサンプルを提供するので、パラメータとして時間を各角速度ベクトルに加える必要がある。これは、サンプルの間で区別するのに役立つ。さらに、これらのサンプルは、異なるローカルフレーム、すなわちそれらを測定するセンサのフレームで表わされる。したがって、ある時間の例ｔにおいて、次の量：^１ｇ_１（ｔ）及び^２ｇ_２（ｔ）を知る。 Looking at the details,
(Outside 9)

And (outside 10)

Are the angular velocities reported by individual IMU sensors. These sensors are considered to be attached to two links that are joined together by a hinge constraint (ie, one angular degree of freedom). Since the sensor provides samples at a predetermined rate (eg, 50 Hz), time must be added as a parameter to each angular velocity vector. This helps to distinguish between samples. Furthermore, these samples are represented in different local frames, ie the frames of the sensors that measure them. Thus, at some time example t, we know the following quantities: ¹ g ₁ (t) and ² g ₂ (t).

がワールド空間（world space）におけるヒンジ関節の単位軸である場合、以下の制約が時間ｔの任意の瞬間に当てはまる：

The following should be understood:
(Outside 11)

Is the unit axis of the hinge joint in the world space, the following constraints apply at any instant in time t:

As a proof, it is possible to establish a connection between angular velocity vectors using hinge constraints. Normally, if the hinge joint does not rotate at all, the two gyroscopes should report the same magnitude of angular velocity and can be converted to each other via a fixed rotation matrix. When the hinge joint rotates, angular transmission speed (angular transport
velocity) with the following equivalent:

は
（外１３）

ヒンジ軸回りの回転によって生じる角速度であり、１／２Ｒ（ｔ、θ）は、関節角度がθであるときの時間ｔにおける２つのセンサフレームを関連付ける変換の回転部分である。式（２）の両辺に１／２Ｒ（ｔ、θ）^−１を乗じて次の式を得る：

here,
(Outside 12)

Is (outside 13)

Angular velocity produced by rotation about the hinge axis, 1 / 2R (t, θ) is the rotational part of the transformation that relates the two sensor frames at time t when the joint angle is θ. Multiply both sides of equation (2) by 1 / 2R (t, θ) ⁻¹ to obtain the following equation:

Which is equivalent to

Or better written as:

は両方のフレームで表現可能であり、その向きにのみ関心があるので、次のように書くこともできる：

Shaft (Outside 14)

Since can be expressed in both frames and is only interested in its orientation, it can also be written as:

と組み合わせると、次の式を得る：

Equations (3) and 4) can be transformed into rotation matrix versus cross product property
(Outside 15)

Combined with, you get the following formula:

This is equivalent to the following norm constraint:

ヒンジ関節の周りの角速度は、以下の式によって与えられることが理解されるべきである：

In relation to the angular velocity of the hinge joint, at any time,
(Outside 16)

It should be understood that the angular velocity around the hinge joint is given by:

The following opinions are stated as proof. On the other hand, the angular velocity of the second gyroscope can be expressed in the frame of the first sensor as described in Equation 2, but also by using the rotating part of the transformation matrix directly, i.e. Can be represented as:

との内積（dot product）を計算することは、次の式をもたらす：

(Outside 17) on both sides of Equations (8) and (2)

Computing dot product with yields the following formula:

を思い出すと、次のように書くことができる：

Here, equation (4) and inner product characteristics (Outside 18)

Remember, you can write:

This is further simplified as follows:

  That is, the assertion of Expression (7) is proved in this way.

で報告されたセンササンプルに依存する特定の制約関数
（外２０）

が与えられる場合、この制約に関連するエラーは
（外２１）

として形式的に表すことができる。代数的には、これは次の記載と等価である：

Time (outside 19)

Specific constraint function depending on the sensor sample reported in (20)

The error associated with this constraint is (outside 21)

Can be expressed formally as Algebraically, this is equivalent to the following:

は、時間サンプルのＮ次元ベクトルであり、
（外２３）

は制約関数ｆの引数としてフィードするｍ次元のサンプルベクトルであり、
（外２４）

は、エラーを最小限に抑えるために見つける必要がある主ｎ次元ベクトル引数（main n-dimensional vector argument）である。このベクトル値のエラー関数は、入力のスカラー値関数として表すこともできる：

here,
(Outside 22)

Is an N-dimensional vector of time samples,
(Outside 23)

Is an m-dimensional sample vector fed as an argument of the constraint function f,
(Outside 24)

Is the main n-dimensional vector argument that needs to be found to minimize errors. This vector value error function can also be represented as an input scalar value function:

  This needs to be minimized.

Using the hinge joint example, for the hinge joint constraint represented by equation (1), the corresponding constraint function is:

および
（外２６）

を用いて単純化のために連結された行ベクトルとして書かれる。 (Outside 25)

And (outside 26)

Is written as a concatenated row vector for simplicity.

Ideally, the value of the constraint function in equation (12) should always be zero, so a minimum for both the vector function equation and the scalar function equation for error should equal zero. Since joint vectors must have a unit norm, additional constraints must be described:

で作業することである。 This further complicates the task of minimizing either (10) or (11) since these additional constraints are not included in the objective. One approach is spherical coordinates, ie

To work with.

に関して、著者が提案する解決策はベクトルエラー表現を含み、これに関して
（外２８）

は未知であり、ジャイロスコープ角速度は係数を提供する。得られた系は過剰に決定され（overdetermined）（通常Ｎ＞６）かつ非線形であるため、著者はガウス−ニュートン法を用いてｅ（ｔ，ｘ）＝０を反復的に解くことを提案する。簡潔にするために、時間サンプルベクトル
（外２９）

を落とし、あるベクトル成分を示すためにｋの添え字を用いる。
（外３０）

のヤコビアンが計算される必要がある。球座標が使用される場合、ｘ＝（φ_１，θ_１，φ_１，θ_１）である。この座標の変化は、ヤコビアンの計算をより退屈にし得るが、非線形等式制約非線形最小化問題（nonlinear equality constrained nonlinear minimization problem）を直接的に回避する（すなわち、非線形目的関数を最小にするだけでよい）。 (Outside 27)

The solution proposed by the author includes a vector error representation, in this regard (outside 28)

Is unknown and the gyroscopic angular velocity provides a coefficient. Since the resulting system is overdetermined (usually N> 6) and non-linear, the authors propose to iteratively solve for e (t, x) = 0 using the Gauss-Newton method. . Time sample vector (outside 29) for brevity

And subscript k is used to indicate a certain vector component.
(Outside 30)

The Jacobian of needs to be calculated. When spherical coordinates are used, x = (φ ₁ , θ ₁ , φ ₁ , θ ₁ ). This change in coordinates can make the Jacobian computation more tedious, but directly avoids the nonlinear equality constrained nonlinear minimization problem (ie, only minimizes the nonlinear objective function). Good).

If we want to solve the problem using equation constraints (14), we can formulate based on the Lagrange multiplier method:

  An important observation is when considering the following possibilities for hinge joint setup:

The first link does not move, ie ¹ g ₁ = 0

The second link is rotated by the joint action. As an example, assume that the angular velocity is aligned with the local z-axis, ie
(Outside 31)

及び
（外３３）

に対する推測を伴って開始される必要がある。
（外３４）

に設定すると、問題は収束しない。この状況では、ｇは、目的関数内で作用する唯一の速度である。目的関数の等値面（isosurfaces）は、その軸が角速度（すなわち、この特定の場合にはｚ軸）と整列する円筒の族（family）である。一方、関節ベクトルの等式制約は、単位球を記述する。角速度がその単位球の南北磁極軸である状態でラグランジュ乗数法を使用しかつ赤道上のどこかで関節ベクトルの推測で始まる場合、反復プロセスは関節ベクトルの推測を修正できない。これは、複数の理由のために起こる：シリンダ及び球の勾配が揃えられるが、目的関数は最小化されない。通常、目的関数の勾配は、推測を変更し、逆の勾配方向にそれを引っ張る。そして、修正された推測が等式制約多様体（equality constraint manifold）（単位球）上に戻って投影されます。単位球の赤道から開始しない場合、アルゴリズムは収束し、解がＮ‐Ｓ軸にある（すなわち、角速度ベクトルと同一線上）ように確立する。 The iterative algorithm is
(Outside 32)

And (outside 33)

Needs to be started with a guess for.
(Outside 34)

If set to, the problem does not converge. In this situation, g is the only speed that operates within the objective function. The isosurfaces of the objective function are a family of cylinders whose axes are aligned with the angular velocity (ie, the z-axis in this particular case). On the other hand, the joint vector equation constraint describes a unit sphere. If the Lagrangian multiplier method is used with the angular velocity being the north-south pole axis of the unit sphere and it begins with a joint vector guess somewhere on the equator, the iterative process cannot correct the joint vector guess. This occurs for several reasons: the cylinder and sphere gradients are aligned, but the objective function is not minimized. Usually the gradient of the objective function changes the guess and pulls it in the opposite gradient direction. The modified guess is then projected back onto the quality constraint manifold (unit sphere). If not starting from the equator of the unit sphere, the algorithm converges and establishes that the solution is on the NS axis (ie, collinear with the angular velocity vector).

軸が、ちょうど図７Ｂに描かれるように、それらの支持肢の骨と完全に整列するような方法で肢に取り付けられることを仮定することができる。この仮定は、任意のローカルフレームにおいて以下の幾何学的観察を書くことができる：

In order to further simplify the search for joint axes in the case of hinge joint constraints in terms of simplifying the hinge joints, the IMU sensor frames have their local (outside 35)

It can be assumed that the axes are attached to the limbs in such a way that they are perfectly aligned with the bones of their supporting limbs, just as depicted in FIG. 7B. This assumption can write the following geometric observations in any local frame:

平面内の単一の単位円に制限する。これは、各ローカルフレームにおける関節単位ベクトルを記述するために必要な２つの球面角の代わりに、単一の角度のみを必要とすることを意味し、次のように書くことができる：

Equation (17) further calculates the search space for the hinge axis from the unit sphere to the local (outside 36) of each frame.

Restrict to a single unit circle in the plane. This means that instead of the two spherical angles needed to describe the joint unit vector in each local frame, only a single angle is needed and can be written as:

Here, θ _i is an angle shown in FIG. 7B. In this context, the norm of the cross product between the angular velocity and the joint axis is:

In order to find an approximate solution that minimizes the vector error in equation (10), the Jacobian calculation must calculate the Jacobian of the N-dimensional vector value error function for the two angular parameters θ ₁ and θ ₂ . Thus, the components of the Jacobian matrix are:

軸を肢の骨と整列させることにより、探索空間を４次元から２次元に、すなわち（θ_１，θ_２）の角度に縮小した。ガウス−ニュートン反復を使用して一般的な場合の解を見つけることができ、手順は明らかに削減された問題に依然として適用可能である。同期したノイズのないセンサデータがない場合、単純化されたアーム表現及び式（２）を使用することにより人工的に生成されたデータを使用した。その結果として、ヤコビアン方程式（２０）も提供することによって、レーベンバーグ−マーカート（Levenberg-Marquardt）非線形最小二乗アルゴリズムを使用して問題を解くマトラボ（Matlab）スクリプトを作成した。より具体的には、第１センサに対して一定の角速度を設定するとともに使用し、回転がローカル
（外３８）

軸の周りで起こると仮定したので、回転行列を計算することは取るに足らない。式は次のとおりである：

Local (Outside 37)

By aligning the axes with the bones of the limbs, the search space was reduced from four dimensions to two dimensions, that is, to an angle of (θ ₁ , θ ₂ ). Gauss-Newton iterations can be used to find general case solutions, and the procedure is still applicable to reduced problems. In the absence of synchronized noiseless sensor data, artificially generated data was used by using the simplified arm representation and equation (2). As a result, a Matlab script was created that solved the problem using the Levenberg-Marquardt nonlinear least squares algorithm by also providing the Jacobian equation (20). More specifically, a constant angular velocity is set and used for the first sensor, and the rotation is local (outside 38).

Since it was assumed to happen around the axis, it is trivial to calculate the rotation matrix. The formula is:

Sensor Unit Configuration: Common World Directions Identification Another approach to solving both the problem of finding the angle between two links and their relative orientation matrix is in the sensor unit: Combining an IMU (accelerometer) and a magnetometer (eg, as described in the various examples provided above).

In summary, some embodiments: the first sensor unit SU ₁ comprising the steps of: receiving the data, data from SU ₁ comprising the steps based on the reference frame defined by the SU _1; second motion sensor unit the method comprising: receiving data from SU _2, steps and the data from the SU ₂ based on the reference frame defined by the SU _2; SU ₁ and SU _2, the link member on opposite sides of the known joints attached to; a step of processing the data received from the data from the sensor unit SU ₁ and the sensor SU _2, whereby two or more common in each of the sensor data from the sensor unit SU ₁ and the sensor SU ₂ Determining the world direction; based on determining two common world directions There are, determining a skeleton relationship between the sensor unit SU ₁ and the sensor SU _2; the method comprising. For example, this involves defining data representing a virtual skeletal body model based on the determination of two common world directions.

  In some embodiments, the at least two world directions are defined by (i) a magnetic field direction and (ii) a gravitational acceleration direction. In this regard, each sensor unit includes (i) a magnetometer that provides data representing the magnetic field direction; and (ii) an accelerometer that provides data representing the gravitational acceleration direction.

において、加速度計が示す値、^ｉａ_ｇは、重力加速度ベクトルの近似値である。
● 磁北：同じ瞬間に、^ｉｍ磁場配向ベクトル（magnetic field orientation vector）を測定する。 Turning to the details, an exemplary approach is to identify an approximate period of lack of exercise and measure the following quantities:
● Gravity acceleration: frame (outside 39)

, ^I a _g is an approximate value of the gravitational acceleration vector.
● magnetic north: at the same moment, to measure the ^{i m} magnetic field orientation vector (magnetic field orientation vector).

From this point, the sensor unit intermediate quaternion orientation value supplied by the fusion output (intermediate quaternion orientation values) can be used to calculate ⁱ a _g and ^{i m} both local expression (local expressions) continuously Can.

および
（外４１）

と表す。現在の目標は、２つのフレームを整列させる
（外４２）

回転行列を導出することである。当然ながら、次の恒等式（identities）が保持される：

In some embodiments, a triad method is applied to restore the relative orientation matrix. In the following, two limbs connected by a spherical joint are assumed. For simplicity, the frames of the first and second limb sensors are respectively (outside 40)

And (outside 41)

It expresses. Current goal is to align two frames (outside 42)

Deriving a rotation matrix. Of course, the following identities are retained:

を復元するために、以下の単純なステップからなるトライアド法を使用する：
１． 正規化する：

及び

２． 正規直交基底を作る：

、

Rotation matrix (outside 43)

To restore a triad method consisting of the following simple steps:
1. Normalize:

as well as

2. Create an orthonormal basis:

,

これは解につながる：

Organize equation (22) in matrix form:

This leads to a solution:

  This allows the transformation of the skeleton model and / or the definition of the configuration for the sensor unit. That is, as described above, this approach allows a direct recovery of the relative conversion between the two sensor reference frames. This assumes that the sensors are detectably and securely attached to the limb (ie they have negligible roll / pitch / yaw offset and minimal sway, heave and (Surge translational movement, rotating with limbs).

  In some embodiments, each sensor unit (or each of a subset of sensor units) includes a plurality of accelerometers. For example, the sensor unit may: (i) a first magnetometer that provides data below a threshold motion-influenced saturation point that is adjusted to a first sensitivity range and thereby affected by a threshold motion; ii) adjusted to the second sensitivity range so that at least one sensor unit provides continuous data representing the direction of the magnetic field despite movement above the saturation point affected by the threshold movement, A second accelerometer is provided that provides data including data above a saturation point affected by a threshold motion. This allows one accelerometer to provide data appropriate for the sensor configuration and another accelerometer to provide more detailed / accurate data over a specific motion acceleration range for skill monitoring purposes. For example, the range may be set on a skill-specific basis based on associated observable data condition attributes.

Sensor Unit Configuration: Inverse Kinematic Posture Estimation Some embodiments utilize an inverse kinematics corrective model. In summary, the general principle is to track end effectors (such as hands and feet) as if viewed from the base (such as shoulders and buttocks). When using acceleration and orientation, the processing technique determines how the limbs between the base and the end effector are joined together (ie their relative relatives) when the base looks at the end effector at a particular position. Angle) can be inferred.

  As a practical example, it is possible for a person to grab an item while looking only at his hand. This includes the process of inverse kinematics at the subconscious level. The person does not know exactly how the elbow bends when reaching the item, but the brain looks at your hand and the item and commands the arm muscles to bend into the elbow as the hand approaches the item . In the current technical situation, the same process is possible considering two sensors, hand and shoulder. However, as an added level of complexity, there are several ways to put a hand on an item so that the entire arm can be in multiple possible configurations. Intermediate sensors (eg, sensors on each of the forearm and upper arm) allow processing to discriminate between actual posture and other possibilities.

One embodiment includes receiving motion data of SU _n from a plurality of sensor units SU _1, motion data of each sensor unit is based on the respective local reference frame, each sensor, the wearer The sensor units SU ₁ to SU _n are attached to the respective body links of the body and are:
(I) a base sensor unit; and (ii) an end effector sensor unit;
including.

  The method additionally determines the motion of the end effector sensor relative to the base sensor; and based on the kinematic model, the position and motion data of one or more joints between the base sensor unit and the end effector sensor unit. Including. For example, this includes defining data representing a virtual skeletal body model based on an estimate of the position and motion data of one or more joints between the base sensor unit and the end effector sensor unit. The plurality of sensor units preferably includes one or more intermediate sensor units, the one or more intermediate sensor units being disposed on an intermediate body link between the base sensor unit and the end effector sensor unit. . These are used to identify the “right” out of several possible solutions to the kinematic estimation process. In one example, the base sensor is disposed proximate to the shoulder, the end effector sensor is disposed proximate to the hand, and the one or more intermediate sensor units are attached to the upper arm and / or the forearm. Another example works with the waist, legs and feet.

  Looking in detail, one can assume an initial pose in which the relative transformation between adjacent link frames is known up to a certain error. This is because each sensor w. r. t. The position of the link is known (via the suit design print), so it is possible. As a result, it is possible to formulate inverse kinematics problems, potentially using Denavit-Hartenberg conventions, by looking at the joints of the arm as depicted in FIG. 7D. .

であると仮定することができる。エンドエフェクタは手である。初期化段階では、
（外４５）

ハンドフレームの姿勢は
（外４６）

フレームに対するｗ．ｒ．ｔ．と知られることになる。これは、腕リンクの解剖学的な割合に依存し、以下のようにまとめられる：
● 成人の伸長Ｈが仮定される。
● アームリンクの長さ（肩と肘関節の間の長さ）は約０．１６Ｈである。
● 前腕リンクの長さ（肘と手首関節の間の長さ）は約０．１４Ｈである。
● 手の長さ（手首と中指の先端の間）は約０．１１Ｈである。
● 肘関節での角度
（外４７）

が静止位置にあると仮定されることができる。 For each arm, the base reference system on which all calculations are performed is the shoulder,
(Outside 44)

Can be assumed. The end effector is a hand. In the initialization phase,
(Outside 45)

Hand frame posture (outside 46)

W. r. t. Will be known. This depends on the anatomical proportion of the arm link and can be summarized as follows:
● Adult elongation H is assumed.
● The length of the arm link (the length between the shoulder and elbow joint) is about 0.16H.
● The length of the forearm link (the length between the elbow and wrist joint) is about 0.14H.
● The length of the hand (between the wrist and the tip of the middle finger) is about 0.11H.
● Angle at elbow joint (outside 47)

Can be assumed to be in a rest position.

、
（外４９）

時間インスタンスｔ_ｉ＋１＞における初期姿勢に対する手および肩の回転行列。Ｇの上付き文字は、初期姿勢が異なるフレーム間で変換するために使用しなければならないグローバル基準であるという仮定を強調している。また
（外５０）

及び
（外５１）

は、時間ｔ_ｉ＋１におけるそれぞれのＩＭＵによって読み取られた加速度であり、それらのローカルフレームでも表される。また、^ｓｒ（ｔ_ｉ）は、
（外５２）

で表される腕フレームのベクトルオフセットである。最後に、各関節（全体で７つある）について、角度オフセットθ_ｋ（ｔ_ｉ）がインスタンスｔ_ｉ、ｋ＝
（外５３）

で分かっていると仮定する。
● 出力：ジョイント角度オフセット

。 It may rely on data obtained from the IMU to estimate hand posture after an initialization epoch. In essence, angular velocity provides a way to integrate and ultimately recover attitude estimates over time with respect to the initial attitude of that IMU frame. However, acceleration theoretically makes it possible to measure translational offsets. What To better understand how is expected to be seen with the unknown and what two consecutive time instances (time instances) t _i and t _{i + 1,} the input and output of the approach we are looking List the elements that make up:
● Input: t _i , t _{i + 1} > 0 Time instance when IMU sample was read,
(Outside 48)

,
(Outside 49)

Hand and shoulder rotation matrix for initial pose at time instance t _{i + 1} >. The G superscript emphasizes the assumption that the initial pose is a global reference that must be used to convert between different frames. Also (outside 50)

And (outside 51)

Are the accelerations read by the respective IMUs at time t _{i + 1} and are also represented in their local frames. And ^s r (t _i ) is
(Outside 52)

It is a vector offset of the arm frame represented by. Finally, for each joint (there are 7 in total), the angular offset θ _k (t _i ) is an instance t _i , k =
(Outside 53)

Assuming that
● Output: Joint angle offset

.

は、インスタンスｔ_ｉ＋１における並進オフセットを取り出すのに役立つ。ｔ_ｉ＋１で測定された角速度は、肩フレームがこの短期間にどのように回転したかを記述する相対的な変換、すなわち、
（外５５）

を明らかにする。したがって、
（外５６）

は、回転だけが起こったと仮定して、時間ｔ_ｉ＋１において肩フレーム内で肩から手ベクトルがどのように見えるかを示す。多くの状況において、肩に対する手の輸送加速度（transport acceleration）は、肩から手ベクトルの長さを修正する：

Explanation (Outside 54)

Helps to retrieve the translation offset at instance t _{i + 1} . The angular velocity measured at t _{i + 1} is a relative transformation that describes how the shoulder frame has rotated during this short period, ie
(Outside 55)

To clarify. Therefore,
(Outside 56)

Shows how the hand vector looks from the shoulder in the shoulder frame at time ti _{+ 1} , assuming that only rotation has occurred. In many situations, transport acceleration of the hand relative to the shoulder modifies the length of the hand vector from the shoulder:

Euler integration can be used to update the transport linear velocity and retrieve the corrected offset vector. More specifically,

An orientation matrix is easier to obtain:

  From equations (27) and (28), it can be seen that all preconditions for the formulation of inverse kinematics are in place. One possible approach is to use cyclic coordinate descent (CCD), which reads data from the sensor and makes an empirical guess rather than which joint to modify first. To understand what this means, imagine that the angle of the elbow decreases during abduction (which grabs the apple and takes it to the mouth). The CCD usually adjusts the angle from the root towards the end effector. In this case, the arm and forearm gyroscopes should exhibit more intense movement due to the elbow joint. Therefore it must be the most promising axis to optimize first. In a sense, the sensor provides a unique order for applying CCD iterations to individual joints.

Once the θ _k (t _{i + 1} ) angle is retrieved, the IMU sensor orientation estimate is corrected.

  It will be appreciated that these are provided as exemplary techniques for the construction of the MSU and are not intended to be limiting in any way. Further, in some embodiments, the ODC is defined in a manner that does not require conversion of MSDs from multiple MSUs to a common reference frame, and instead to self-referenced aspects of MSU-specific data. It should be understood that (depending on the path that a given MSU accelerates according to its own reference frame, this is optionally combined with the path that the second MSU accelerates in its own reference frame. )

Conclusion and Interpretation The techniques described above are not limited to the following, but (i) an analysis of skills to understand the defining characteristics thereby; (ii) one or more thereby Definition of protocols that enable automated analysis of skills using PSUs of; (iii) Definition and distribution of content using automated analysis, thereby providing interactive end-use content such as skills training (Iv) adaptive implementation of skill training programs; (v) hardware and software that facilitates delivery of content to end users; (vi) hardware and software that facilitates content experiences for end users; and (Vii) Human activity monitoring It will be appreciated that it provides advances over the range of features described, including techniques and methodologies developed to facilitate the construction and implementation of multiple motion sensor units for the purpose of .

  Unless otherwise specified, as will be apparent from the following description, "process", "computing", "calculating", "determining", and "analyzing" are made throughout the specification. The discussion using terms such as a computer or computer system or similar electronic computing that manipulates and / or converts data represented as physical quantities, such as electronic quantities, into other data, also represented as physical quantities It is understood that it refers to the operation and / or process of the device.

  Similarly, the term “processor” refers to any processing that converts electronic data from, for example, a register and / or memory, into electronic data that can be stored, for example, in a register and / or memory. Can refer to a device or part of a device. A “computer” or “computing machine” or “computing platform” may include one or more processors.

  The methodology described herein, in one embodiment, includes a computer readable (machine) that includes a set of instructions that, when executed by one or more of the processors, perform at least one of the methods described herein. It can be executed by one or more processors that accept code (also called readable). Any processor capable of executing a set of instructions (sequence or other) that specifies the action to be taken is included. Thus, one example is a typical processing system that includes one or more processors. Each processor may include one or more of a CPU, a graphics processing unit, and a programmable DSP unit. The processing system may further include a memory subsystem including main RAM and / or static RAM and / or ROM. A bus subsystem may be included for communication between components. The processing system may further be a distributed processing system having processors coupled by a network. Where the processing system requires a display, such a display, such as a liquid crystal display (LCD) or a cathode ray tube (CRT) display, may be included. If manual data entry is required, the processing system also includes one or more input devices such as an alphanumeric input unit such as a keyboard, a pointing control device such as a mouse, and the like. The term memory unit as used herein is clear from the context and includes storage systems such as disk drive units unless otherwise specified. The processing system in some configurations may include a sound output device and a network interface device. Accordingly, the memory subsystem carries computer readable code (eg, software) that includes a set of instructions that, when executed by one or more processors, cause one or more of the methods described herein to be performed. Computer readable carrier media. It should be noted that where a method includes several elements, eg, several steps, the ordering of such elements is not implied unless specifically stated. The software may reside on the hard disk during execution by the computer system, or may reside entirely or at least partially in the RAM and / or the processor. Thus, the memory and processor also constitute a computer readable carrier medium carrying computer readable code.

  Further, the computer readable carrier medium may form a computer program product or may be included in a computer program product.

  In alternative embodiments, one or more processors may operate as stand-alone devices or may be connected to a networked arrangement, eg, networked to other processor (s). Multiple processors may operate at the capabilities of a user machine in a server or server-user network environment, or as a peer machine in a peer-to-peer or distributed network environment. One or more processors are taken by a personal computer (PC), tablet PC, set top box (STB), personal digital assistant (PDA), mobile phone, web appliance, network router, switch or bridge, or machine thereof Any machine capable of executing a series of instructions (sequence or other) that specify an action to be performed may be formed.

  Although the drawings show only a single processor and a single memory carrying computer readable code, those skilled in the art will include many of the components described above, but may obscure aspects of the present invention. It will be understood that it has not been explicitly shown or described so as not to For example, although only a single machine is illustrated, the term “machine” refers to a set (or sets) of instructions for performing one or more of the methodologies discussed herein. Including any set of machines that run on or jointly.

  Thus, one embodiment of each of the methods described herein is on a set of instructions, eg, one or more processors, eg, one or more processors, that are part of a web server configuration. In the form of a computer readable carrier medium carrying a computer program for execution on a computer. Accordingly, as will be appreciated by those skilled in the art, embodiments of the present invention are embodied as a method, a device such as a dedicated device, a device such as a data processing system, or a computer readable carrier medium such as a computer program product. obtain. The computer readable carrier medium carries computer readable code that includes a set of instructions that, when executed on one or more processors, cause the processor or processors to perform the method. Accordingly, aspects of the invention may take the form of a method, a fully hardware embodiment, a fully software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a carrier medium (eg, a computer program product on a computer readable storage medium) carrying computer readable program code embodied in the medium.

  The software may further be transmitted or received over a network via a network interface device. Although the carrier medium is shown in the exemplary embodiment being a single medium, the term “carrier medium” refers to a single medium or multiple media that store one or more sets of instructions (eg, , Centralized or distributed databases, and / or associated caches and servers). The term “carrier medium” can also store, encode or carry a set of instructions for execution by one or more processors, and any one of the methodologies of the present invention stored on one or more processors. Or any medium that causes one or more to execute. A carrier medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media includes, for example, optical disks, magnetic disks, and magneto-optical disks. Volatile media includes dynamic memory, such as main memory. Transmission media includes coaxial cable, copper wire, and optical fiber, including wires with a bus subsystem. Transmission media can also take the form of acoustic or light waves, such as those generated during radio wave and infrared data communications. For example, the term “carrying medium” is thus, but not limited to, computer products incorporated in solid-state memory, optical media and magnetic media, detectable by and executed by at least one processor of one or more processors. And a transmission medium in a network that produces a propagation signal that is detectable by at least one of the one or more processors and produces a propagation signal that represents the instruction set. Is to be interpreted as including.

  The method steps discussed are, in one embodiment, performed by an appropriate processor (or processors) of a processing (ie, computer) system that executes instructions (computer readable code) stored in a storage device. Will be understood. It is also understood that the invention is not limited to a particular implementation or programming technique, and that the invention can be implemented using any suitable technique for performing the functions described herein. It will be. The present invention is not limited to a particular programming language or operating system.

  In the above description of exemplary embodiments of the invention, various features of the invention may sometimes be represented by a single entity for the purpose of streamlining the disclosure and assisting in understanding one or more of the various features of the invention. Summarized in the embodiment, drawing, or description. This method of disclosure, however, should not be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, aspects of the present invention reside in less than all features of a single previously disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

  Further, some embodiments described herein include some features included in other embodiments, but do not include other features, and combinations of features of different embodiments may It is intended to form different embodiments that are within the scope and will be understood by those skilled in the art. For example, in the following claims, any of the embodiments recited in the claims can be used in any combination.

  Furthermore, some of the embodiments are described herein as a method or combination of elements of a method that can be implemented by a processor of a computer system or by other means of performing the function. Accordingly, a processor having the necessary instructions to perform such a method or method element forms the means for performing the method or method element. Furthermore, elements described herein of apparatus embodiments are examples of means for performing the functions performed by the elements for the purpose of implementing the invention.

  In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In other instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.

  Similarly, it should be noted that the term “coupled”, when used in the claims, should not be construed as limited to direct connections only. The terms “coupled” and “connected” can be used with their derivatives. It should be understood that these terms are not intended as synonyms for each other. Thus, the scope of the representation of device A coupled to device B should not be limited to devices or systems where the output of device A is directly connected to the input of device B. This means that there is a path between the output of A and the input of B, which can be a path involving other devices or means. “Coupled” means that two or more elements are in direct physical or electrical contact, or two or more elements are not in direct contact with each other, but still cooperate or interact with each other Can mean that.

Thus, while what has been considered to be a preferred embodiment of the present invention has been described, those skilled in the art can make other or further modifications without departing from the spirit of the present invention, such as It will be appreciated that all changes and modifications are intended to be included within the scope of the present invention. For example, any equations given above are merely representative of procedures that may be used. Functions may be added or removed from the block diagram, and operations may be exchanged between function blocks. Steps may be added or deleted to the methods described within the scope of the present invention.

Claims (54)

A computer-implemented method that allows a user to configure the operation of a local performance monitoring hardware device, the method comprising:
Providing an interface configured to allow a user of a client device to select a set of downloadable content, wherein the set of downloadable content relates to one or more skills When;
Enabling the user to cause a download of data indicative of at least a portion of the selected set of downloadable content to the local performance monitoring hardware associated with the user, the download comprising: :
(I) sensor configuration data, wherein the sensor configuration data operates in a defined manner, thereby providing data representative of the attempted performance of a particular skill. Sensor configuration data, including data comprising a set of;
(Ii) state engine data, wherein the state engine data processes the attribute of the attempted performance of the particular skill based on the data provided by the set of one or more performance sensor units. State engine data, including data configured to allow a device to identify; and (iii) user interface data, wherein the user interface data is indicative of the attempted performance of the particular skill. User interface data, including data configured to enable operation of the user interface based on the identified attribute;
Including downloads,
Including steps;
The method further includes allowing the user to select the downloadable content defined by variations of expert knowledge related to the selected one or more skills, the one or more There are multiple expert knowledge variations available for a set of skills,
Method. A first expert knowledge variation is associated with the first set of state engine data, a second expert knowledge variation is associated with the second different set of state engine data, and the second different of the state engine data. The set is configured to allow identification of one or more expert specific attributes of performance not identified using the first set of state engine data.
The method of claim 1. The expert specific attribute relates to the style of performance associated with the expert,
The method of claim 2. The performance style is represented by defined attributes of body movement that are observable using data obtained from one or more motion sensor units.
The method of claim 2. The expert-specific attribute relates to coaching knowledge associated with the expert,
The method of claim 1. The one or more expert specific attributes are defined based on a process configured to objectively define the coaching attributes.
The method of claim 5. For the selected set of one or more skills, there is a first selectable expert knowledge variation and a second selectable expert knowledge variation:
With respect to the first selectable expert knowledge variation, the downloadable data includes a first of observable data conditions associated with a given skill in the data obtained from the set of performance sensor units. Configure to identify a set of 1
With respect to the second selectable expert knowledge variation, the downloadable data includes an observable data condition associated with the given skill in data obtained from the set of performance sensor units. Configuring to identify a second different set;
The method of claim 1. Differences between the first set of observable data conditions and the second set of observable data conditions account for differences in human expert styles associated with each of the expert knowledge variations. ,
The method of claim 7. The difference between the first set of observable data conditions and the second set of observable data conditions describes coaching advice obtained from a human expert associated with each of the expert knowledge variations. To
The method of claim 7. For the selected set of one or more skills, there is a first selectable expert knowledge variation and a second selectable expert knowledge variation:
With respect to the first selectable expert knowledge variation, the downloadable data is fed back to the user in response to the client device observing a defined observable data condition associated with a given skill. Configure to provide a first set of data;
With respect to the second selectable expert knowledge variation, the downloadable data is sent to the user in response to the client device observing the defined observable data condition associated with a given skill. Configuring to provide a second different set of feedback data;
The method of claim 1. The difference between the first set of feedback data and the second set of feedback data describes coaching advice obtained from a human expert associated with the respective variation of expert knowledge;
The method of claim 10. The difference between the first set of feedback data and the second set of feedback data comprises different audio data representing the voice of a human expert associated with each variation of the expert knowledge;
The method of claim 10. The performance sensor unit includes a plurality of motion sensor units;
The method according to claim 1. The client device includes a POD device configured to process motion sensor data obtained from the plurality of motion sensor units, such that a wearable garment facilitates delivery of the motion sensor data to the POD device. Providing a plurality of sensor strands,
The method of claim 13. Each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope;
The method according to claim 14. A computer-implemented method for generating data configured to enable delivery of skill training content for a defined skill, the method comprising:
Generating a first set of observable data conditions, wherein the first set is configured to allow processing of input data obtained from one or more performance sensor units; Including possible data conditions, wherein the input data represents a physical performance of the defined skill by a user, thereby identifying one or more attributes of the performance; and an observable data condition Generating a second set of observable data configured to allow processing of input data obtained from the same one or more performance sensor units. And the input data represents a physical performance of the defined skill by the user. Thereby identifying one or more attributes of said performance;
Including
The second set of observable data conditions includes one or more expert-specific observable data conditions that are missing from the first set of observable data conditions, and the one or more Expert-specific observable data conditions of the skill training content for the defined skill for the skill training content generated using only the first set of observable data conditions Incorporated into the variation of
Method. Variations in expert knowledge of the skill training content account for style differences associated with specific human experts relative to baseline skill performance styles;
The method of claim 16. Variations in expert knowledge of the skill training content account for differences in coaching knowledge associated with a particular human expert relative to baseline coaching knowledge;
The method of claim 16. Variations in expert knowledge of the skill training content are: sensor configuration data, wherein the sensor configuration data operates in a defined manner, thereby providing data representing the attempted performance of a particular skill. Sensor configuration data, including data constituting a set of one or more performance sensor units; state engine data, wherein the state engine data is provided by the set of one or more performance sensor units State engine data, including data configured to allow a processing device to identify an attribute of the attempted performance of the particular skill based on the data; user interface data, the user Interface data But including, and user interface data, including data formed to allow the operation of the user interface based on the identified the attributes of the being the attempted specific skills performance,
The method of claim 16. The performance sensor unit includes a plurality of motion sensor units,
The method of claim 16. A variation of expert knowledge of the skill training content is performed at least in part in hardware including a POD device configured to process motion sensor data obtained from the plurality of motion sensor units, and the wearable garment includes: Providing a plurality of sensor strands configured to facilitate delivery of the motion sensor data to the POD device;
The method of claim 20. Each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope;
The method of claim 21. For the defined skills, a cloud-hosted marketplace may procure by one or more users: (i) a standard version of skill training content; and (ii) expert knowledge variations of the skill training content. Configured to be available for
The method of claim 16. A computer-implemented method for generating data configured to enable delivery of skill training content for a defined skill, the method comprising:
Generating a first set of skill training content, wherein the first set of skill training content is based on processing of input data obtained from one or more performance sensor units. The input data represents a physical performance of the defined skill by a user, thereby defining one or more attributes of the performance. Identifying; and generating a second set of skill training content, wherein the second set of skill training content is processing input data obtained from the same one or more performance sensor units To enable The input data represents physical performance of the defined skill by the user, thereby identifying one or more attributes of the performance ;
Including
The second set of skill training content is the same set of input data such that, depending on the set of input data provided, the second set of skill training content provides a variation of expert knowledge of the skill training content. In response to the first set of skill training content configured to provide a different training program effect,
Method. Variations in expert knowledge of the skill training content account for style differences associated with specific human experts relative to baseline skill performance styles;
25. A method according to claim 24. Variations in expert knowledge of the skill training content account for differences in coaching knowledge associated with a particular human expert relative to baseline coaching knowledge;
25. A method according to claim 24. Variations in expert knowledge of the skill training content are: sensor configuration data, wherein the sensor configuration data operates in a defined manner, thereby providing data representing the attempted performance of a particular skill. Sensor configuration data, including data constituting a set of one or more performance sensor units; state engine data, wherein the state engine data is provided by the set of one or more performance sensor units State engine data, including data configured to allow a processing device to identify an attribute of the attempted performance of the particular skill based on the data; user interface data, the user Interface data But including, and user interface data, including data formed to allow the operation of the user interface based on the identified the attributes of the being the attempted specific skills performance,
25. A method according to claim 24. The performance sensor unit includes a plurality of motion sensor units,
25. A method according to claim 24. A variation of expert knowledge of the skill training content is performed at least in part in hardware including a POD device configured to process motion sensor data obtained from the plurality of motion sensor units, and the wearable garment includes: Providing a plurality of sensor strands configured to facilitate delivery of the motion sensor data to the POD device;
30. The method of claim 28. Each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope;
30. The method of claim 29. For the defined skills, a cloud-hosted marketplace may procure by one or more users: (i) a standard version of skill training content; and (ii) expert knowledge variations of the skill training content. Configured to be available for
25. A method according to claim 24. The first set of training content data is associated with a first set of observable data conditions, and the second set of training content data is the second set of training content data. Associated with a second set of observable data conditions so as to be configured to identify one or more attributes of the performance that are not identified by the first set of
25. A method according to claim 24. The first set of training content data is associated with a first protocol for mapping symptoms, and the second set of training content data is a second set of training content data. Associated with a second protocol for mapping symptoms to causes so as to provide at least one expert-specific relationship between causes;
25. A method according to claim 24. The first set of training content data is associated with a first set of media content, and the second set of training content data is media on which the second set of training content data is personalized to a particular expert. Associated with the second set of media content to be configured to provide content;
25. A method according to claim 24. A computer-implemented method that allows a user to configure a local performance monitoring hardware device to provide training data associated with a selected one of a plurality of experts, the method comprising:
Providing an interface configured to allow a user of a client device to select a set of one or more skills to be trained;
Allowing a user to select a variation of expert knowledge for the selected one or more skills to be trained, wherein the one or more skills to be trained There are several expert knowledge variations available for the set, step;
Following the user's selection of the set of one or more skills to be trained and the variation of the expert knowledge for the selected one or more skills to be trained, the user Enabling a download process to provide downloadable data to a client device associated with the downloadable data, wherein the downloadable data:
(I) to process data obtained from a set of performance monitoring sensors, thereby analyzing one given physical performance of the skill by the user; and
(ii) Based on the analysis, via a user interface device, to provide training data specific to the selected variation of the expert knowledge,
Configure,
Including steps,
Method. For the selected set of one or more skills, there is a first selectable expert knowledge variation and a second selectable expert knowledge variation:
With respect to the first selectable expert knowledge variation, the downloadable data includes a first of observable data conditions associated with a given skill in the data obtained from the set of performance analysis sensors. Configure to identify a set of 1
With respect to the second selectable expert knowledge variation, the downloadable data includes an observable data condition associated with the given skill in data obtained from the set of performance analysis sensors. Configuring to identify a second different set;
36. The method of claim 35. Differences between the first set of observable data conditions and the second set of observable data conditions account for differences in human expert styles associated with each of the expert knowledge variations. ,
37. A method according to claim 36. The difference between the first set of observable data conditions and the second set of observable data conditions describes coaching advice obtained from a human expert associated with each of the expert knowledge variations. To
37. A method according to claim 36. For the selected set of one or more skills, there is a first selectable expert knowledge variation and a second selectable expert knowledge variation:
With respect to the first selectable expert knowledge variation, the downloadable data is fed back to the user in response to the client device observing a defined observable data condition associated with a given skill. Configure to provide a first set of data;
With respect to the second selectable expert knowledge variation, the downloadable data is determined by the user in response to the client device observing the defined observable data condition associated with the given skill. To provide a second different set of feedback data.
36. The method of claim 35. The difference between the first set of feedback data and the second set of feedback data describes coaching advice obtained from a human expert associated with the respective variation of expert knowledge;
40. The method of claim 39. The difference between the first set of feedback data and the second set of feedback data comprises different audio data representing the voice of a human expert associated with each variation of the expert knowledge;
40. The method of claim 39. The performance analysis sensor includes a motion sensor;
36. The method of claim 35. The client device includes a POD device configured to be carried by a wearable garment, wherein the wearable garment distributes data obtained from a plurality of sensor units carried by the wearable garment to the POD device. Providing a plurality of sensor strands configured to enable;
36. The method of claim 35. Each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope;
44. The method of claim 43. A system configured to allow a user to configure a local performance monitoring hardware device to provide training data associated with a selected one of a plurality of experts, the system Is:
Configured to allow a client user interface device to interact with an interface configured to allow a user of the client device to select one or more sets of skills to be trained A server, wherein the interface additionally allows the user to select a variation of the expert knowledge for the selected one or more skills to be trained. A server configured and having a plurality of variations of expert knowledge available for the set of one or more skills to be trained;
Following the selection of the user of the set of one or more skills to be trained and the variation of the expert knowledge for the selected one or more skills to be trained, the user A download manager component configured to enable a download process that provides downloadable data to a client device associated with the downloadable data:
(I) to process data obtained from a set of performance monitoring sensors, thereby analyzing one given physical performance of the skill by the user; and
(ii) Based on the analysis, via a user interface device, to provide training data specific to the selected variation of the expert knowledge,
Configure,
Including a download manager component,
system. For the selected set of one or more skills, there is a first selectable expert knowledge variation and a second selectable expert knowledge variation:
With respect to the first selectable expert knowledge variation, the downloadable data includes a first of observable data conditions associated with a given skill in the data obtained from the set of performance analysis sensors. Configure to identify a set of 1
With respect to the second selectable expert knowledge variation, the downloadable data includes an observable data condition associated with the given skill in data obtained from the set of performance analysis sensors. Configuring to identify a second different set;
46. The system of claim 45. Differences between the first set of observable data conditions and the second set of observable data conditions account for differences in the style of human experts associated with the respective variations of expert knowledge. ,
48. The system of claim 46. The difference between the first set of observable data conditions and the second set of observable data conditions describes coaching advice obtained from a human expert associated with each of the expert knowledge variations. To
48. The system of claim 46. For the selected set of one or more skills, there is a first selectable expert knowledge variation and a second selectable expert knowledge variation:
With respect to the first selectable expert knowledge variation, the downloadable data is fed back to the user in response to the client device observing a defined observable data condition associated with a given skill. Configure to provide a first set of data;
With respect to the second selectable expert knowledge variation, the downloadable data provides feedback data to a user in response to observing the client device with a defined observable data condition associated with a given skill. Configured to provide a second different set of
46. The system of claim 45. The difference between the first set of feedback data and the second set of feedback data describes coaching advice obtained from a human expert associated with each of the expert knowledge variations;
50. The system of claim 49. The difference between the first set of feedback data and the second set of feedback data includes different audio data representing the voice of a human expert associated with the respective variation of expert knowledge,
50. The system of claim 49. The performance analysis sensor includes a motion sensor,
46. The system of claim 45. The client device includes a POD device configured to be carried by a wearable garment, and the wearable garment is capable of delivering data obtained from a plurality of sensor units carried by the wearable garment to the POD device. Providing a plurality of sensor strands configured to:
46. The system of claim 45. Each of the plurality of sensor units includes: an accelerometer, a magnetometer, and a gyroscope;
54. The system of claim 53.

Images