WO2018042007A1 - Methods for determining a state of a user during fitness activity - Google Patents

Methods for determining a state of a user during fitness activity Download PDF

Info

Publication number
WO2018042007A1
WO2018042007A1 PCT/EP2017/071996 EP2017071996W WO2018042007A1 WO 2018042007 A1 WO2018042007 A1 WO 2018042007A1 EP 2017071996 W EP2017071996 W EP 2017071996W WO 2018042007 A1 WO2018042007 A1 WO 2018042007A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
state
data
ski lift
run
Prior art date
Application number
PCT/EP2017/071996
Other languages
French (fr)
Inventor
Lojini LOGESPARAN
Eveline Anna KLEINJAN
Davide ZILIO
Natalie Wesdorp-Jansen
Original Assignee
Tomtom International B.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tomtom International B.V. filed Critical Tomtom International B.V.
Publication of WO2018042007A1 publication Critical patent/WO2018042007A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/38Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
    • G01S19/39Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/01Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/13Receivers
    • G01S19/14Receivers specially adapted for specific applications
    • G01S19/19Sporting applications

Definitions

  • This invention relates to methods and systems for determining a state of a user during skiing or snowboarding activity based on obtained data indicative of the movement of one or more devices associated with the user.
  • the present invention is directed to methods and systems for determining when the user is on a ski lift (in a "ski lift" state).
  • the determined state of the user may be used in various manners, e.g. to determine metrics for transmittal to a device and/or to trigger the output of data to the user.
  • Various devices associated with a user may be used during skiing or snowboarding activity to sense data which may be used to determine metrics relating to the skiing or snowboarding activity of the user.
  • data relating to the movement of the device, and hence the user may be sensed by a mobile device associated with the user, or by a wearable device, such as a fitness watch, associated with the user.
  • the sensed data may be processed to determine metrics relating to the user's skiing or snowboarding activity, which may then be displayed to the user.
  • the metrics may include statistics relating to a previous run performed by the user, such as a length of the run, the maximum speed achieved during the run, etc and/or relating to the overall skiing or snowboarding activity of the user during a particular ski or
  • snowboarding session including multiple runs, such as the total descent.
  • skiing or snowboarding activity refers to at least a portion of one or more ski or snowboarding sessions of a user.
  • a ski or snowboarding session will typically include multiple ski or snowboarding runs, separated by periods spent on a ski lift.
  • skiing or snowboarding activity herein refers to the overall session(s) within which there may be active periods of skiing or snowboarding and non- active periods, e.g. travel on a ski lift.
  • Previous techniques to automatically detect a state of a user during skiing activity to determine when the user is on a ski lift have involved consideration of a change in altitude of a device associated with the user.
  • a change in altitude indicates that the device is moving uphill, it is inferred that the user cannot be on a ski run, and that the device and user are therefore on a ski lift.
  • the Applicant has realised that such techniques suffer from certain drawbacks. There may be a delay in determination that the user is on a ski lift, as a significant change in altitude may be required in order to be able to infer with an appropriate level of confidence that the movement is the result of the user being on a ski lift.
  • periods spent on a ski lift may not necessarily be associated with movement uphill. This may be the case where a ski lift includes a downhill section, such as where a lift goes downhill after an initial ascent. Such sections may also be present where a lift extends over a valley, or does not stop at a summit. Similarly, a lift may include a level section. If altitude alone is considered, a ski run may be erroneously detected and/or the end of a previous run not detected when a ski lift enters a downhill section. There may therefore be difficulties in reliably and rapidly identifying that a user is on a ski lift. Prior art techniques based on altitude may accordingly be unable to reliably provide data that relates to individual ski runs and/or that is unskewed by movement associated with periods spent on a ski lift.
  • a method of determining a state of a user during skiing or snowboarding activity comprising:
  • the user is on a ski lift based on obtained data indicative of the movement of the user (with respect to time) when one or both of two conditions are satisfied.
  • the data indicative of the movement of the user with time can be data indicative of the movement of one or more devices associated with the user.
  • the user is determined to be on a ski lift when the obtained data indicates that the user has ascended by a distance greater than a predetermined threshold and/or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold.
  • the obtained data indicates that the user has ascended by a distance greater than a predetermined threshold and/or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold.
  • the user is determined to be on a ski lift when the obtained data indicates that the user has travelled at a constant speed for a period exceeding a predetermined threshold. Travel at a constant speed for an extended period has been found to provide a reliable indication that the user is on a ski lift. Such travel is not normally associated with travel down a ski run. This may be referred to as the "second condition" herein.
  • first and second conditions have been found to enable a ski lift to be detected more rapidly, and with greater accuracy, than prior art techniques relying on altitude change alone allow.
  • the present invention is described with particular reference to skiing activity. However, it will be appreciated that, if not explicitly stated, the invention is equally applicable to snowboarding activity, or indeed other types of snow based activity in which runs are punctuated by periods on a ski lift. Any reference to skiing activity, or skiing, should be understood to refer to skiing or snowboarding activity, or skiing or snowboarding as appropriate, if not explicitly stated.
  • a system for determining a state of a user during skiing or snowboarding activity comprising:
  • this further aspect of the present invention can and preferably does include any one or more or all of the preferred and optional features of the invention described herein in respect of any of the other aspects of the invention, as appropriate.
  • the system of the present invention herein may comprise means for carrying out any step described in relation to the method of the invention in any of its aspects or embodiments, and vice versa.
  • the present invention is a computer implemented invention, and any of the steps described in relation to any of the aspects or embodiments of the invention may be carried out under the control of a set of one or more processors.
  • the means for carrying out any of the steps described in relation to the system may be a set of one or more processors.
  • the step of determining when the user is on a ski lift based on the obtained data may be performed by one or more algorithms arranged to detect when the user ascends by a distance greater than a predetermined threshold and/or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold based on the obtained data, and/or when the user travels at a constant speed for a period exceeding a predetermined threshold based on the obtained data.
  • the system may be a mobile device or a wearable device, such as a fitness watch associated with the user.
  • the first condition takes into account a speed of the user.
  • the obtained data indicative of the movement of the one or more devices associated with the user will then include data indicative of a speed of a device associated with the user.
  • the speed is a vertical speed.
  • the obtained data that is used in determining the state of the user may additionally include the altitude of a device associated with the user.
  • Altitude data may be used in determining the vertical direction of travel, i.e. uphill or downhill. It has been found that by using a condition that takes into account speed in this way, i.e.
  • a ski lift state may be identified more rapidly, and with greater accuracy.
  • the predetermined thresholds in respect of uphill distance/time travelled and speed may be selected as desired to give an appropriate level of certainty that the user is on a ski lift for a given application. It will be appreciated that different thresholds may be used in respect of uphill distance travelled and time travelled uphill. Where the user travels at a constant speed, the second condition may additionally be met. However, it will be appreciated that the second condition does not necessarily require the constant speed to be in the uphill direction.
  • the second condition considers whether the user has travelled at a constant speed for a given time.
  • the predetermined threshold in respect of the time that the constant speed is travelled to result in a determination that the user is on a ski lift may be selected as desired to provide a determination with an appropriate level of confidence for a given application.
  • the constant speed considered in the second condition may be in any direction i.e. uphill, downhill, or a combination thereof.
  • a constant speed should be understood as being a substantially constant speed.
  • the constant speed may be defined as a speed which does not vary by more than a prescribed amount.
  • the constant speed considered in the second condition may be a vertical speed or a horizontal speed. The obtained data should then include the vertical speed or the horizontal speed of one or more device associated with the user as appropriate.
  • the obtained data that is used in determining the state of the user may additionally include the altitude of one or more device associated with the user.
  • the altitude data may be used to determine the vertical direction of travel, i.e. uphill or downhill. Travel at a constant speed, in any direction, has been found to be indicative of being on a ski lift.
  • the use of a method which includes a constant speed check in this way is therefore advantageous in being able to detect the user being on a ski lift regardless of the nature of any altitude change associated with the lift. This is in contrast to prior art methods relying upon detecting uphill movement to indicate a ski lift. A ski lift may also be detected more rapidly than when looking at altitude change alone.
  • the first condition may additionally be met. However, it will be appreciated that the first condition does not necessarily require the ascent to be at constant speed.
  • the constant speed considered in determining whether the second condition is met is in the uphill direction.
  • the method may comprise the step of determining that the user is on a ski lift when the user travels uphill at a constant speed for a period exceeding a predetermined threshold.
  • the constant speed considered in determining whether the second condition is met is in the downhill direction.
  • one or more additional checks are performed to confirm the determination that the user is on a ski lift.
  • Such checks are performed to ensure that travel at a constant speed on a ski lift can be distinguished from skiing or snowboarding with a desired degree of confidence.
  • the one or more additional checks are performed when the user is found to have travelled downhill, as such movement may be more easily confused with downhill skiing or snowboarding.
  • One additional check comprises obtaining data indicative of the hand and/or arm movement of the user during the (e.g. downhill) movement, and confirming the determination that the user is on a ski lift when the level of hand and/or arm movement is below a predetermined threshold.
  • the hand and/or arm movement data is obtained from one or more device associated with the user.
  • Data indicative of the hand and/or arm movement of the user may be obtained from any suitable sensor(s) associated with one or both hands and/or arms of the user.
  • the sensor(s) may include an accelerometer or a gyroscope, and preferably both an accelerometer and a gyroscope.
  • the one or more devices associated with the user may include a device wearable about the hand or wrist of the user that includes one or more sensors for determining data indicative of the movement of the hand and/or arm of the user.
  • a device may be a glove, wristband, fitness watch, etc. This check is preferably performed when the user is found to have travelled downhill at a constant speed meeting the second condition.
  • Another additional check which may be alternatively or additionally performed comprises obtaining data indicative of a bearing of the user, and using the bearing data to confirm the determination that the user is on a ski lift.
  • the bearing data is obtained from one or more device associated with the user. Such data may be based on compass measurements and/or satellite based, e.g. GPS, positional data. In general, a ski lift will be associated with travel in a relatively straight line.
  • the method may comprise confirming the determination that the user is on a ski lift when the bearing data is indicative of travel substantially in a straight line.
  • An additional check based on bearing data may equally be used to confirm a determination that the user is on a ski lift determined based on the first condition, or the second condition, and is not limited to the case in which the user travels downhill.
  • the method may comprise generating data indicative of a change of state of the user to a ski lift state once a determination that the user is on a ski lift has been made.
  • the data may be generated once one or both of the first or second conditions is satisfied, i.e. when the user ascends by a distance greater than a predetermined threshold or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold, or when the user travels at a constant speed for a period exceeding a
  • the state data may be generated only once the determination that the user is on the ski lift has been confirmed by the one or more additional checks performed.
  • the generated change of state data may be used in various manners. Any or all of the steps described below may be performed, to the extent that they are not mutually exclusive.
  • Data indicative of the change of state may be stored.
  • data indicative of the change of state may be transmitted to a remote device.
  • the determination of the change of state may be made by a wearable device of the user, e.g. a fitness tracker, and transmitted to a mobile device of the user for use by the device, e.g. for further processing and/or output to the user.
  • the generated change in state data may be used to generate data indicative of metrics relating to the skiing or snowboarding activity of the user and/or to trigger the output of data to a user. These steps may be performed by a device that generated the change in state data, or by a remote device that has received such data.
  • the data output to the user comprises metrics relating to the skiing or snowboarding activity of the user.
  • the data output to the user may comprise an alert indicating that metrics relating to the skiing or snowboarding activity of the user are available and/or including such metrics.
  • the metrics may be displayed to the user together with the alert, or the alert may prompt the user to perform an action to result in the metrics being displayed, e.g. touch a touchscreen, etc.
  • the alert may be accompanied by an alarm.
  • the alert may be displayed to a user until the user dismisses the alert or a change in state of the user is detected indicating that the user is no longer on a ski lift.
  • the metrics relating to the activity of the user to which the generated or output data relates in the applicable embodiments preferably comprise metrics relating to the previous run.
  • Such metrics may include one or more of: a run distance; a run duration; a run number; a run descent; a maximum gradient on the run; a maximum speed attained during the run; a time during the run at which a maximum gradient was attained; and a time during the run at which a maximum speed was attained.
  • metrics may relate to the overall ski or snowboarding session of the user. The metrics may be based on the cumulative totals of each run performed during the session.
  • Such metrics may include one or more of: a total descent for all runs during the session; a total duration of all runs during the session; and a total distance for all runs during the session.
  • the data that is output to a user may be output by the same device that performs the method of determining the ski lift state or which receives data indicative of a generated change in state, when this is transmitted to a remote device.
  • the data may be output via a mobile device or wearable device, such as a fitness watch of the wearer.
  • generated data indicative of metrics relating to the activity of the user is transmitted to a remote device, where the data may be output to a user.
  • the data may be transmitted to a mobile device of the user for output.
  • the data may then be transmitted from a wearable device, e.g. a fitness watch, for output to a user.
  • the method may comprise using the generated change of state data to update a state of a state engine indicative of a state of the user. It will be appreciated that this step may be performed by a device remote to that which generated the change of state data, and which has received the data, or may be performed by the same device that generated the change of state data.
  • the method may comprise using the generated change of state data to update a state of a state engine indicative of the state of the user from a state indicative of a lesser likelihood of being on a ski lift to the ski lift state.
  • the state indicative of a lesser likelihood of the user being on a ski lift may be a state indicative of the user not being on a ski lift (a "not ski lift” state). This may be appropriate where a state engine cycles between two states, a ski lift state, and a not ski lift state. However, it has been found that it may be advantageous for a state engine to transition between at least three states: a "not ski lift” state; a "ski lift” state; and an intermediate “potential ski lift” state.
  • the state indicative of the lesser likelihood of the user being on a ski lift may then be a potential ski lift state.
  • the method of the present invention may be used to confirm an initial determination of a potential ski lift state. By requiring a further level of confirmation, the present invention may provide greater certainty in the determination of the ski lift state, reducing the likelihood of false positives.
  • the method may comprise updating a state of the state engine from a not lift state to a potential lift state when the obtained data is indicative of the user travelling uphill.
  • a determination that the user is travelling uphill may only provide an initial indication that the user is on a ski lift, which must be further confirmed by determining whether the first and/or second condition described above is met, before the ski lift state can be determined.
  • a change in state from to a ski lift state may trigger the generation and output of metrics relating to a previous run to the user.
  • a change in state from a non lift state to a potential lift state, where used, may trigger a determination that a previous run has finished, and a determination of appropriate metrics relating to the previous run. If the ski lift state is then confirmed, this ensures that the metrics do not include the further period after the end of the run, before the lift state was confirmed. If the potential lift state is found to be incorrect, and the state reverts to a non lift state, the previous run may be deemed to still be in progress, and metrics derived including the period spent in the potential lift state.
  • a state engine may include two states, or three states, or a greater number of states.
  • the above embodiments are merely exemplary of some preferred embodiments for transitioning between states of a state engine, and it will be understood that the state engine may include further states, and/or the conditions required to transition between states may be adjusted as required.
  • the number of states used may be selected as desired, depending e.g. upon the way in which the provision of metrics to a user or another device is to be triggered.
  • potential run and run states might be added.
  • the potential run and potential lift states may be used when it is detected that the user is not moving on a run or lift, or before a run or lift is confirmed.
  • the addition of the potential run and run states may enable metrics to be provided to a user or another device when the user pauses on a run, i.e. when a transition to the run state is detected. This is similar to the way in which metrics may be provided to a user or another device when the user is on a ski lift in the embodiments described herein.
  • the method comprises the step of obtaining data indicative of the movement of one or more device associated with the user.
  • the or each device is associated with the user, such that data indicative of the movement of the device is indicative of the movement of the user.
  • the obtained data indicative of the movement of one or more device associated with the user may be any suitable data.
  • the method comprises the step of obtaining data indicative of the altitude of a device associated with the user, and at least one of a horizontal speed and a vertical speed of a device associated with the user, and using the obtained data in determining that the device is in a ski lift state.
  • the movement data may include satellite based positional data.
  • Satellite based positional data may be provided by a GNSS sensor or sensors, such as GPS data, or any other data which may be obtained by one or more GNSS sensor, e.g. GLOSNASS, COMPASS or IRNSS. Such data may be used to provide data indicative of a horizontal speed, e.g. a horizontal GPS speed.
  • the vertical speed data is preferably based on altitude changes determined by pressure measurement.
  • Pressure measurements may be obtained by one or more pressure sensor.
  • the pressure measurement data is indicative of atmospheric pressure.
  • the one or more devices associated with the user comprise a device including a pressure sensor, e.g. a barometer for providing pressure measurement data.
  • the data indicative of a vertical speed of the user is determined based on pressure measurement
  • data may also be obtained using satellite based positional data.
  • satellite based e.g. GPS
  • data may be used to provide an estimate as to altitude.
  • the data indicative of a vertical speed of the user is determined based on altitude changes determined by pressure measurement, and satellite based positional data is used to correct errors in the pressure measurement data. Such errors might arise e.g. where a pressure sensor has failed, or due to pockets of high or low pressure that can affect pressure-based altitude measurements.
  • the satellite based positional data may be GPS elevation data.
  • a vertical direction of movement of the user i.e. uphill or downhill
  • the direction may be a net direction based on the movement of the user over a period of time. This may ensure that small variations in vertical direction of travel do not skew results.
  • the direction of the vertical speed may be used to determine uphill and downhill distances travelled over a period of time.
  • the direction of movement may be obtained using altitude data, preferably obtained from pressure measurement, but alternatively obtained from satellite based positional data, e.g. GPS elevation data.
  • the one or more devices associated with the user to which the obtained data relates may be any suitable device(s) which may provide data indicative of the movement of the device, and hence user, during skiing or snowboarding activity of the user.
  • a device may simply be a sensor arranged to transmit data, or may be a computing device arranged to detect movement.
  • Such a computing device may comprise one or more sensors.
  • a single device may be associated with the user, for providing the movement data.
  • a device may be a wearable device, such as a fitness watch, or a mobile device.
  • multiple devices may be used.
  • the devices may then include appropriate sensors for providing different types of movement data for use in embodiments of the method described herein.
  • a mobile device may be used together with a wearable device.
  • the wearable device might provide data relating to the movement of a part of the body of the wearer e.g. a hand movement, while the mobile device may provide data relating to the overall movement of the user, e.g. speed and altitude.
  • the one or more devices comprise a wearable device.
  • the wearable device may be any suitable device including appropriate sensor(s).
  • the wearable device is a fitness watch.
  • other types of wearable device may be used, which need not necessarily provide watch functionality.
  • any wearable fitness tracker may be used.
  • a wearable device need not necessarily be associated with the wrist or hand of a user. It is further envisaged that multiple devices may be associated with different parts of the wearer's body.
  • the one or more devices preferably include a device that is wearable about the wrist, such as a wristband or fitness watch.
  • the one or more devices include a mobile device, such as a mobile phone. Any mobile device may be used that may be associated with the wearer during skiing or snowboarding activity.
  • the step of obtaining the data indicative of the movement of one or more devices associated with the user may comprise receiving the data.
  • the data may be received from one or more remote device.
  • the device that processes the data in accordance with the present invention may be the or a device to which the movement data relates.
  • the method may then comprise a state determining subsystem of the device receiving the data from a subsystem or subsystems of the device that generates the data indicative of the movement of the device.
  • the processing of the obtained movement data in accordance with the invention in any of its aspects or embodiments may be carried out by any suitable computing device or devices.
  • the device(s) may or may not be the same device(s) to which the movement data relates.
  • the method is performed by a device associated with a user, and comprises obtaining data indicative of the movement of the (same) device. This may involve a state determining subsystem receiving the data from a suitable subsystem of the device. Data may or may not additionally be obtained from another device associated with the user, e.g. relating to different aspects of movement.
  • the device that performs the processing to determine the state of the user is a device associated with the user.
  • processing could be carried out remote from a user, e.g. by a server, using data received from the one or more devices associated with the user.
  • the determined state may then be transmitted to a device associated with the user, e.g. for output to the user, etc, or might be used to determine metrics for later viewing by the user, e.g. via a user area.
  • the method may be performed by a mobile device, e.g. a mobile phone or tablet, using movement data received from one or more wearable devices associated with the user, such as a fitness watch or fitness tracker.
  • the method may be implemented by running an appropriate app on the mobile device.
  • the method may be performed by a fitness watch or a mobile device e.g. phone to which the movement data relates.
  • the method is performed by a mobile device or a fitness watch associated with the user.
  • the method may be performed based on movement data relating to the mobile device or a wearable device, such as a fitness watch associated with the user.
  • the method may be performed based on movement data relating to the fitness watch.
  • some processing of received movement data may be required to provide data of the type used in the method e.g. to obtain vertical speed data based on pressure sensor data etc.
  • the data relates to a remote device or devices
  • processing may be carried out by the remote device prior to transmission of the data, or may be carried out by the device that receives the data in order to obtain the data that is used in the method.
  • the device may be arranged to process the raw positional data to determine the required data.
  • the step of obtaining the data indicative of the movement of one or more device associated with the user of a particular form described in embodiments herein, e.g. vertical speed data may comprise determining such data based on received data (whether received from a remote device or a subsystem of the same device that performs the method).
  • Received data may be in the form of positional data with respect to time, e.g. a plurality of position data samples. Each may be associated with a timestamp.
  • Such data may be satellite based.
  • the methods in accordance with the present invention may be implemented at least partially using software. It will thus be seen that, when viewed from further aspects and in further embodiments, the present invention extends to a computer program product comprising computer readable instructions adapted to carry out any or all of the method described herein when executed on suitable data processing means.
  • the invention also extends to a computer software carrier comprising such software.
  • a software carrier could be a physical (or non-transitory) storage medium or could be a signal such as an electronic signal over wires, an optical signal or a radio signal such as to a satellite or the like.
  • Figure 1 shows schematically a state engine of a device according to an embodiment of the present invention
  • Figure 2 shows schematically another state engine of a device according to a further embodiment of the present invention
  • Figure 3 shows an example of an alert that may be provided to a user when it is determined that the user is currently on a ski lift
  • Figure 4 shows an example of the data that may be provided to a user
  • Figure 5 shows schematically a first approach for determining that a user is currently on a lift
  • Figures 6A and 6B show schematically a second approach for determining that a user is currently on a lift
  • Figure 7 is a schematic illustration of electronic components of a fitness watch according to a preferred embodiment.
  • Figure 8 is a schematic illustration of the manner in which a fitness watch may receive information over a wireless communication channel.
  • a computing device in the form of a fitness or sports watch. It will be appreciated however that the techniques of the present invention are not limited to fitness or sports watches and may generally be implemented on any suitable device, such as a mobile device, or a dedicated fitness tracker worn or carried by a user, or connected or docked in a known manner to a user's clothing or sports equipment. While the embodiments will be described, for ease of reference, with particular reference to a single device implementation, it will also be appreciated that the techniques described herein may be implemented across multiple devices.
  • different devices including appropriate sensors associated with a user may be used to record or capture movement data which is then transmitted to the fitness or sports watch or other computing device for processing in accordance with the methods of the invention to determine a state of the user.
  • the fitness or sports watch or other device that performs processing of the data to determine a state of the user may be arranged to transmit data indicative of the state, or generated in response to a detected change in state, onto another device, or to an external server.
  • GPS Global Positioning System
  • NAVSTAR the GPS incorporates a plurality of satellites which orbit the earth in extremely precise orbits. Based on these precise orbits, GPS satellites can relay their location to any number of receiving units.
  • the GPS system is implemented when a device, specially equipped to receive GPS data, begins scanning radio frequencies for GPS satellite signals. Upon receiving a radio signal from a GPS satellite, the device determines the precise location of that satellite via one of a plurality of different conventional methods.
  • the device will continue scanning, in most instances, for signals until it has acquired at least three different satellite signals (noting that position is not normally, but can be determined, with only two signals using other triangulation techniques).
  • the receiver utilizes the three known positions to determine its own two-dimensional position relative to the satellites. This can be done in a known manner. Additionally, acquiring a fourth satellite signal will allow the receiving device to calculate its three dimensional position by the same geometrical calculation in a known manner.
  • the position and velocity data can be updated in real time on a continuous basis by an unlimited number of users.
  • the present invention is concerned with methods of detecting whether or not a user of the fitness watch or other device is currently on a ski lift (e.g. as opposed to currently being on a ski run).
  • a ski lift e.g. as opposed to currently being on a ski run.
  • the operation of the device, and particularly the display to the user may be controlled such that the user is automatically presented with desired information once a run is completed (i.e. when they are on a ski lift) - for example, the user may be provided with a summary or "scorecard" of the previous run.
  • Figure 1 is an illustrative overview of the state detection that may be implemented on a fitness watch or other device according to embodiments of the present invention.
  • One or more algorithms are used to determine the current state of the user, and particularly to determine whether the user is currently on a ski lift.
  • the algorithm(s) is not limited to use on a fitness watch, and may be implemented on various suitable computing devices as desired.
  • the one or more algorithms process various input data in order to determine or detect a current state of the user.
  • the input data relates to the movement of the user, and is obtained by one or more devices associated with the user.
  • the input data may be recorded by the device itself (i.e. by one or more sensors within the fitness watch or other device) or may be transmitted to the device for processing by one or more remote devices including appropriate sensors or measurement devices.
  • the device that processes the input data might be a mobile phone of the user that receives input data from a fitness tracker worn by the user.
  • Figure 1 thus illustrates various possible current states of the user.
  • Figure 1 schematically shows a state engine of the device, wherein the state engine is changeable between the various states, wherein each state is indicative of a determined current state of the user.
  • the input data processed by the algorithm to determine the current state of the user may include data reflective of the horizontal speed of the user (e.g. taken from GPS measurements), the vertical speed (from measuring changes in altitude as detected, for example, by a pressure sensor) and also altitude or elevation data. It will be appreciated that various other input data may also be used in the determination of the current state of the user, as discussed further below.
  • various other states may also be included, and suitable algorithms provided for detecting such other states.
  • one or more of the states e.g. the intermediate "potential lift” state, may be omitted, such that the algorithm may essentially only make a determination as to whether a user is on a lift or not on a lift.
  • this information may be provided to a processor of the device and/or a software application running on the device.
  • the state determination algorithm(s) may send a state change event to the device in order to control an operation of the device. That is, the operation of the device may be controlled or changed according to the current state of the user.
  • the operation of the device, and the information presented to the user from the user interface or display of the device may be automatically changed or updated depending on the determined current state of the user. For instance, depending on the determined current state of the user, the device may be operated to capture or record certain metrics, or to transmit certain metrics to another device.
  • the device may be operated to trigger an output (of metrics or other data) for presentation to the user.
  • the state change event may be transmitted to a remote device for use thereby e.g. to generate metrics and/or output metrics or other data to a user.
  • a fitness tracker or watch device might transmit a state change event to a mobile device of the user, or even to a server.
  • the device may therefore be arranged to stop capturing any data, and instead display a summary of one or more previous run(s). For instance, when it is determined that the user is on a lift, the device may be set to display to the user an alert showing the statistics from the last run.
  • Figure 3 shows an example of such an alert including the number of the last run, the top speed or best pace of the last run, the descent and the maximum gradient.
  • the information that is displayed may be tailored to include other information as desired. Further information may be accessible to the user by cycling through a set of screens.
  • This alert may be brought up on the user interface or display of the device as soon as it is detected that the user is on a ski lift, i.e. as soon as the state engine is set to the lift state.
  • the alert may be displayed until the user dismisses the alert, or it is detected that the user is no longer on the ski lift i.e. when an appropriate change of state is detected.
  • the last run statistics may be stored in a history so as to be accessible to the user at a future time.
  • An alert of this type may similarly be displayed by a remote device which has received an indication of a change of state to the lift state, or to which appropriate alert data has been transmitted.
  • Figure 4 illustrates another example of data that may be presented to the user.
  • Figure 4 shows the summary, statistics and individual details of each of the recorded runs during a particular session.
  • This information may be displayed by the device, or may be transmitted from the device to another device, e.g. a user's mobile phone, for display.
  • Figure 1 illustrates how the state transitions may be made.
  • Figure 1 illustrates by way of example a situation where it is assumed (or known) that the lift is an uphill lift.
  • the transition from the "not lift" state (state 0) to the “potential lift” state (state 1 ) may be made when it is determined that a user is generally moving uphill.
  • the direction of travel i.e. uphill or downhill
  • GPS elevation measurements in addition to the pressure sensor data may help to correct for pressure sensor failure or errors, e.g.
  • the direction of travel may be a net direction of travel, and may therefore account for there being some descent, e.g. following an initial ascent.
  • the uphill and downhill distances travelled may be determined from the vertical speed data, and the direction of travel determined accordingly based on the overall or net direction of travel.
  • the transition from the "potential lift” state to the "lift” state may be made when it is confirmed that the user is indeed on a ski lift.
  • This determination may generally be made in one of two ways. In a first approach, this determination is made when it is detected that the user has reached a minimum ascent distance at (or above) a minimum vertical speed, or has spent a minimum time travelling uphill at (or above) a minimum vertical speed. In a second approach, the determination may be made by detecting that the user has travelled for a minimum duration at a constant speed. These two approaches may be used in combination. For example, these approaches may be used independently of each other, such that as soon as either condition is satisfied, the state is updated, or may be combined together such that the state is only updated when both conditions are satisfied.
  • Figure 5 shows schematically an algorithm that may be used to determine that the user has spent a minimum time travelling uphill at (or above) a minimum speed.
  • the minimum speed may be a threshold value based on the expected travel speed of the lift (which will typically be higher than a user could otherwise move uphill). It will be appreciated that the Figure 5 approach may also be easily adapted to determine when the user has reached a minimum ascent distance at (or above) the minimum speed as the distance travelled may be determined from the time and speed data.
  • the first step 101 shown in Figure 5 is a determination of the vertical speed from the change in altitude (e.g. in m/s) and a determination of the horizontal speed from GPS data (e.g. in m/s). If the vertical speed is greater than or equal to the threshold minimum vertical speed or if the horizontal speed is greater than or equal to the threshold minimum horizontal speed, a vertical speed counter is incremented (step 102). Else, if the vertical speed is lower than the threshold minimum vertical speed, the vertical speed counter is reset (step 103). These steps are repeated at successive time intervals. Thus, a high value of the vertical speed counter indicates that the user has spent a long time travelling at or above the minimum vertical or horizontal speed. When the vertical speed counter exceeds a certain pre-determined value, this corresponds to the user having spent a minimum time travelling uphill at the minimum vertical speed.
  • Figures 6A and 6B show schematically an algorithm that may be used to determine that the user has travelled for a minimum duration at a constant speed. Ski lifts typically travel at a substantially constant speed, whereas a user on a ski run typically will not. Thus, a determination that the user has travelled for longer than a threshold duration at a constant speed may be used to confirm that the user is on a ski lift.
  • the current speed is determined (step 1 1 1 ), along with the change in speed relative to the previously measured value(s) (step 1 12).
  • a determination is then made as to whether the change in speed falls within a certain threshold range. If the change of speed is within this range, i.e. within +/- a threshold change in speed, a constant speed counter is incremented (step 1 13). Else, if the change of speed exceeds the threshold range/value, the constant speed counter is reset (step 1 14).
  • the constant speed counter may then be used to determine a constant speed state as shown in Figure 6B.
  • a constant speed state is entered when it is determined that the user is moving (i.e. travelling above a certain threshold speed), and wherein the constant speed counter exceeds a threshold count value.
  • the non-constant speed state is entered when it is determined that the user is no longer moving, or wherein the change in speed exceeds the threshold range/value, or wherein the constant speed counter is reset.
  • the speed data used in the determinations described in relation to Figures 6A and 6B may generally reflect either or both of the horizontal and vertical speeds, and may be taken from GPS measurements, from change in altitude data, or a combination of both. It will be appreciated therefore that the approach described in relation to Figures 6A and 6B may be applied to both uphill and downhill lifts, or more complex lift arrangements including both uphill and downhill (and horizontal) segments. In both cases, a constant speed check may be used to detect that the user is on a lift, rather than a run.
  • a user may be on a ski lift whilst not necessarily moving uphill, e.g. when the user is on a downhill or horizontal ski lift, or on a lift that does not stop at the top of the summit.
  • the techniques described herein may allow the detection of such lifts where the user is not necessarily moving continually uphill, or where the user is moving downhill, e.g. using the approach described in relation to Figures 6A and 6B.
  • this state need not be entered on the basis of a user travelling uphill, as shown in Figure 1 , but may be determined in some other way.
  • an initial step of determining the (net) direction of travel of the user may be made, e.g. using the vertical speed data and the relative distances travelled up and downhill, as mentioned above.
  • the approaches may also be extended to cover downhill lifts.
  • a fitness watch or another device worn around the user's wrist may comprise an accelerometer and/or gyroscope for detecting the user's hand movement
  • the watch or wrist mounted device may be arranged to transmit the data to that other device for processing.
  • Minimal hand movement may be indicative of the user being on a ski lift, rather than a ski run.
  • the bearing of the user e.g. taken from compass measurements, or from GPS data
  • the additional checks may preferably be used to determine whether a user is on a downhill lift, where there is otherwise greater potential for confusion.
  • the transition back to the "not lift” state, or into a “potential run” or “run” state may be made e.g. after a determination of the user travelling a minimum descent distance at a non-constant speed, or after a time-out in the "potential lift” state (i.e. where no transition into the "lift” state is made after a predetermined time interval).
  • the approaches described above generally use a combination of horizontal speed, vertical speed and altitude data, as well as optional other checks.
  • the horizontal speed data, and potentially also the vertical speed and altitude data may be obtained from GPS measurements.
  • GPS data In cases where GPS data is not available, the state transitions may be made based solely on changes in the altitude data.
  • the approaches discussed above may be used preferentially, as they allow for a faster detection, and are able to deal with more complex lift arrangements (downhill lifts, shallow lifts, etc.).
  • Figure 7 is an illustrative representation of electronic components of a sports watch 200 according to a preferred embodiment of the present invention, in block component format. It should be noted that the block diagram of the device 200 is not inclusive of all components of the device, but is only representative of many example components.
  • the device 200 includes a processor 202 connected to an input device 212, such as a depressible touchpad (or trackpad), and a display screen 210, such as an LCD display.
  • the device 200 can further include an output device arranged to provide audible information to a user, such as alerts that a certain speed has been reached or a certain distance has been travelled.
  • Figure 7 further illustrates an operative connection between the processor 202 and a GPS antenna/receiver 204.
  • the antenna and receiver are combined schematically for illustration, the antenna and receiver may be separately located components.
  • the antenna may be of any suitable form, but in preferred embodiments is a GPS patch antenna.
  • the device 200 further includes an accelerometer 206, which can be a 3-axis accelerometer arranged to detect accelerations of the user in x, y and z directions.
  • the accelerometer may act as a pedometer for use when/if there is a loss of GPS reception, and/or may act to detect stroke rate when the fitness watch is being used during swimming.
  • the accelerometer is shown to be located within the device, the accelerometer may also be an external sensor worn or carried by the user, and which transmits data to the device 200 via the transmitter/receiver 208.
  • the device 200 further includes a pressure sensor 230 that may be used to determine or detect changes in altitude. Changes in altitude may also be detected using GPS measurements, either alternatively, or preferably additionally, to the pressure sensor 230. Using a combination of pressure sensor
  • measurements and GPS measurements may help to correct for failure of or errors in the pressure sensor measurements, e.g. due to local packets of high/low pressure.
  • the device may also receive data from other sensors, such as a foot pod sensor 222 or a heart rate sensor 226.
  • the foot pod sensor may, for example, be a piezoelectric or micro-electro-mechanical systems (MEMS) accelerometer that is located in or on the sole of the user's shoe.
  • MEMS micro-electro-mechanical systems
  • Each external sensor is provided with a transmitter and receiver, 224 and 228 respectively, which can be used to send or receive data to the device 200 via the transmitter/receiver 208.
  • the processor 202 is operatively coupled to a memory 220.
  • the memory resource 220 may comprise, for example, a volatile memory, such as a Random Access Memory (RAM), and/or a non-volatile memory, for example a digital memory, such as a flash memory.
  • RAM Random Access Memory
  • non-volatile memory for example a digital memory, such as a flash memory.
  • the memory resource 220 may be removable.
  • the memory resource 220 is also operatively coupled to the GPS receiver 204, the accelerometer 206 and the transmitter/receiver 208 for storing data obtained from these sensors and devices.
  • the electronic components shown in Figure 7 are powered by a power source 218 in a conventional manner.
  • the power source 218 may be a rechargeable battery.
  • the device 200 further includes an input/output (I/O) device 216, such as a plurality of electrical contacts or a USB connector.
  • the I/O device 216 is operatively coupled to the processor, and also at least to the memory 220 and power supply 218.
  • the I/O device 216 is used, for example, to: update firmware of processor 220, sensors, etc; transfer data stored on the memory 220 to an external computing resource, such as a personal computer or a remote server; and recharge the power supply 218 of the device 200. Data could, in other embodiments, also be sent or received by the device 200 over the air using any suitable mobile telecommunication means.
  • the watch 200 is depicted as being in communication with a server 400 via a generic communications channel 410 that can be implemented by any number of different arrangements.
  • the server 400 and device 200 can communicate when a connection is established between the server 400 and the watch 200 (noting that such a connection can be a data connection via mobile device, a direct connection via personal computer via the internet, etc.).
  • the server 400 includes, in addition to other components which may not be illustrated, a processor 404 operatively connected to a memory 406 and further operatively connected, via a wired or wireless connection, to a mass data storage device 402.
  • the processor 404 is further operatively connected to transmitter 408 and receiver 409, to transmit and send information to and from device 200 via
  • the signals sent and received may include data, communication, and/or other propagated signals.
  • the functions of transmitter 408 and receiver 409 may be combined into a signal transceiver.
  • the communication channel 410 is not limited to a particular communication technology.
  • the communication channel 410 is not limited to a single communication technology; that is, the channel 410 may include several communication links that use a variety of technology.
  • the communication channel 410 can be adapted to provide a path for electrical, optical, and/or electromagnetic communications, etc.
  • the communication channel 410 includes, but is not limited to, one or a combination of the following: electric circuits, electrical conductors such as wires and coaxial cables, fibre optic cables, converters, radio-frequency (RF) waves, the atmosphere, empty space, etc.
  • the communication channel 410 can include intermediate devices such as routers, repeaters, buffers, transmitters, and receivers, for example.
  • the communication channel 410 includes telephone and computer networks. Furthermore, the communication channel 410 may be capable of accommodating wireless communication such as radio frequency, microwave frequency, infrared communication, etc. Additionally, the communication channel 410 can accommodate satellite communication.
  • the server 400 may be a remote server accessible by the watch 200 via a wireless channel.
  • the server 400 may include a network server located on a local area network (LAN), wide area network (WAN), virtual private network (VPN), etc.
  • LAN local area network
  • WAN wide area network
  • VPN virtual private network
  • the server 400 may include a personal computer such as a desktop or laptop computer, and the communication channel 410 may be a cable connected between the personal computer and the watch 200.
  • a personal computer may be connected between the watch 200 and the server 400 to establish an internet connection between the server 400 and the watch 200.
  • a mobile telephone or other handheld device may establish a wireless connection to the internet, for connecting the watch 200 to the server 400 via the internet.
  • the server 400 is further connected to (or includes) a mass storage device 402.
  • the mass storage device 402 contains a store of at least digital map information. This digital map information can be used, together with data from the device, such as time-stamped location data obtained from the GPS receiver 204 and data indicative of motion of the wearer obtained from the accelerometer 206, foot pod sensor 222, etc., to determine a route travelled by the wearer of the device 200, which can then be viewed by the wearer.
  • the watch 200 is designed to be worn by a runner or other athlete as they undertake a run or other similar type of workout.
  • the various sensors within the watch 200 such as the GPS receiver 204 and the accelerometer 206, collect data associated with this run, such as the distance travelled, current speed, etc., and display this data to the wearer using the display screen 210.
  • a suitable watch module may include a battery and a processor connected to one or more of: the display, an optional input device, a memory, a wireless transceiver, and an input/output device such as electrical contacts.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Navigation (AREA)

Abstract

A method of determining a state of a user during skiing or snowboarding activity involves obtaining data indicative of the movement of the user (e.g. of one or more devices associated with the user) and determining that the user is on a ski lift based on the obtained data when the data indicates that: (i) the user has ascended by a distance and/or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold; and/or (ii) the user has travelled at a constant speed for a period exceeding a predetermined threshold. When a determination is made that the user is on a ski lift, in at least one example, an alert is output to the user including metrics relating to a previous run.

Description

METHODS FOR DETERMINING A STATE OF A USER
DURING FITNESS ACTIVITY Field of the Invention
This invention relates to methods and systems for determining a state of a user during skiing or snowboarding activity based on obtained data indicative of the movement of one or more devices associated with the user. In particular, the present invention is directed to methods and systems for determining when the user is on a ski lift (in a "ski lift" state). The determined state of the user may be used in various manners, e.g. to determine metrics for transmittal to a device and/or to trigger the output of data to the user.
Background of the Invention
Various devices associated with a user may be used during skiing or snowboarding activity to sense data which may be used to determine metrics relating to the skiing or snowboarding activity of the user. For example, data relating to the movement of the device, and hence the user, may be sensed by a mobile device associated with the user, or by a wearable device, such as a fitness watch, associated with the user. The sensed data may be processed to determine metrics relating to the user's skiing or snowboarding activity, which may then be displayed to the user. The metrics may include statistics relating to a previous run performed by the user, such as a length of the run, the maximum speed achieved during the run, etc and/or relating to the overall skiing or snowboarding activity of the user during a particular ski or
snowboarding session including multiple runs, such as the total descent.
References to "skiing or snowboarding activity" of a user herein refer to at least a portion of one or more ski or snowboarding sessions of a user. A ski or snowboarding session will typically include multiple ski or snowboarding runs, separated by periods spent on a ski lift. Thus, "skiing or snowboarding activity" herein refers to the overall session(s) within which there may be active periods of skiing or snowboarding and non- active periods, e.g. travel on a ski lift. When determining data relating to skiing or snowboarding activity, it is important to be able to distinguish between periods in which the user is skiing or snowboarding, and periods spent on a ski lift. This ensures that metrics only relate to time actually spent skiing or snowboarding, and that they are not skewed by the movement of the user when on a ski lift. It also allows metrics to be determined in relation to individual runs. While some systems rely upon a user manually indicating when they are commencing and finishing a ski or snowboarding run, it is desirable to be able to automatically detect when a user is on a ski lift. This may allow a user to ski or snowboard throughout a session, and be presented with relevant data relating to individual runs, or the overall session, without needing to reset their device to identify the start and end of a run, and to ensure that non-skiing or -snowboarding periods are excluded from analysis.
Previous techniques to automatically detect a state of a user during skiing activity to determine when the user is on a ski lift (in a "ski lift state"), have involved consideration of a change in altitude of a device associated with the user. When a change in altitude indicates that the device is moving uphill, it is inferred that the user cannot be on a ski run, and that the device and user are therefore on a ski lift. However, the Applicant has realised that such techniques suffer from certain drawbacks. There may be a delay in determination that the user is on a ski lift, as a significant change in altitude may be required in order to be able to infer with an appropriate level of confidence that the movement is the result of the user being on a ski lift. Furthermore, periods spent on a ski lift may not necessarily be associated with movement uphill. This may be the case where a ski lift includes a downhill section, such as where a lift goes downhill after an initial ascent. Such sections may also be present where a lift extends over a valley, or does not stop at a summit. Similarly, a lift may include a level section. If altitude alone is considered, a ski run may be erroneously detected and/or the end of a previous run not detected when a ski lift enters a downhill section. There may therefore be difficulties in reliably and rapidly identifying that a user is on a ski lift. Prior art techniques based on altitude may accordingly be unable to reliably provide data that relates to individual ski runs and/or that is unskewed by movement associated with periods spent on a ski lift.
It is desired, in at least embodiments of the present invention, to provide an improved method of determining the state of a user during skiing or snowboarding activity of the user.
Summary of the Invention
In accordance with a first aspect of the invention, there is provided a method of determining a state of a user during skiing or snowboarding activity, comprising:
obtaining data indicative of the movement of the user; and
determining that the user is on a ski lift based on the obtained data when the obtained data indicates that: (i) the user has ascended by a distance greater than a predetermined threshold and/or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold; and/or (ii) the user has travelled at a constant speed for a period exceeding a predetermined threshold.
In accordance with the invention, it is determined that the user is on a ski lift based on obtained data indicative of the movement of the user (with respect to time) when one or both of two conditions are satisfied. As discussed in more detail below, the data indicative of the movement of the user with time can be data indicative of the movement of one or more devices associated with the user.
In accordance with the first condition, the user is determined to be on a ski lift when the obtained data indicates that the user has ascended by a distance greater than a predetermined threshold and/or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold. In other words, if it is determined that the user has travelled uphill at a speed exceeding a given threshold over at least a given distance and/or time, it is assumed that the user is on a ski lift, as extended movement uphill at such a rate would not normally be associated with skiing. This may be referred to as the "first condition" herein.
In accordance with the second condition, the user is determined to be on a ski lift when the obtained data indicates that the user has travelled at a constant speed for a period exceeding a predetermined threshold. Travel at a constant speed for an extended period has been found to provide a reliable indication that the user is on a ski lift. Such travel is not normally associated with travel down a ski run. This may be referred to as the "second condition" herein.
The use of the first and second conditions has been found to enable a ski lift to be detected more rapidly, and with greater accuracy, than prior art techniques relying on altitude change alone allow.
The present invention is described with particular reference to skiing activity. However, it will be appreciated that, if not explicitly stated, the invention is equally applicable to snowboarding activity, or indeed other types of snow based activity in which runs are punctuated by periods on a ski lift. Any reference to skiing activity, or skiing, should be understood to refer to skiing or snowboarding activity, or skiing or snowboarding as appropriate, if not explicitly stated.
The present invention extends to a system for carrying out a method in accordance with any of the aspects or embodiments of the invention herein described. Thus, in accordance with a second aspect of the invention, there is provided a system for determining a state of a user during skiing or snowboarding activity, comprising:
means for obtaining data indicative of the movement the user; and
means for determining that the user is on a ski lift based on the obtained data when the obtained data indicates that: (i) the user has ascended by a distance greater than a predetermined threshold and/or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold; and/or (ii) the user has travelled at a constant speed for a period exceeding a predetermined threshold.
As will be appreciated by those skilled in the art, this further aspect of the present invention can and preferably does include any one or more or all of the preferred and optional features of the invention described herein in respect of any of the other aspects of the invention, as appropriate. If not explicitly stated, the system of the present invention herein may comprise means for carrying out any step described in relation to the method of the invention in any of its aspects or embodiments, and vice versa.
The present invention is a computer implemented invention, and any of the steps described in relation to any of the aspects or embodiments of the invention may be carried out under the control of a set of one or more processors. The means for carrying out any of the steps described in relation to the system may be a set of one or more processors. The step of determining when the user is on a ski lift based on the obtained data may be performed by one or more algorithms arranged to detect when the user ascends by a distance greater than a predetermined threshold and/or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold based on the obtained data, and/or when the user travels at a constant speed for a period exceeding a predetermined threshold based on the obtained data. The system may be a mobile device or a wearable device, such as a fitness watch associated with the user.
It will be appreciated that the first condition takes into account a speed of the user. The obtained data indicative of the movement of the one or more devices associated with the user will then include data indicative of a speed of a device associated with the user. Preferably the speed is a vertical speed. The obtained data that is used in determining the state of the user may additionally include the altitude of a device associated with the user. Altitude data may be used in determining the vertical direction of travel, i.e. uphill or downhill. It has been found that by using a condition that takes into account speed in this way, i.e. a rate of change of altitude, rather than merely looking at a change in altitude, (either directly, where the speed is a vertical speed, or indirectly where horizontal speed is considered) a ski lift state may be identified more rapidly, and with greater accuracy. The predetermined thresholds in respect of uphill distance/time travelled and speed may be selected as desired to give an appropriate level of certainty that the user is on a ski lift for a given application. It will be appreciated that different thresholds may be used in respect of uphill distance travelled and time travelled uphill. Where the user travels at a constant speed, the second condition may additionally be met. However, it will be appreciated that the second condition does not necessarily require the constant speed to be in the uphill direction.
The second condition considers whether the user has travelled at a constant speed for a given time. The predetermined threshold in respect of the time that the constant speed is travelled to result in a determination that the user is on a ski lift may be selected as desired to provide a determination with an appropriate level of confidence for a given application. The constant speed considered in the second condition may be in any direction i.e. uphill, downhill, or a combination thereof. A constant speed should be understood as being a substantially constant speed. The constant speed may be defined as a speed which does not vary by more than a prescribed amount. The constant speed considered in the second condition may be a vertical speed or a horizontal speed. The obtained data should then include the vertical speed or the horizontal speed of one or more device associated with the user as appropriate. The obtained data that is used in determining the state of the user may additionally include the altitude of one or more device associated with the user. The altitude data may be used to determine the vertical direction of travel, i.e. uphill or downhill. Travel at a constant speed, in any direction, has been found to be indicative of being on a ski lift. The use of a method which includes a constant speed check in this way is therefore advantageous in being able to detect the user being on a ski lift regardless of the nature of any altitude change associated with the lift. This is in contrast to prior art methods relying upon detecting uphill movement to indicate a ski lift. A ski lift may also be detected more rapidly than when looking at altitude change alone. Where the travel is in an uphill direction, the first condition may additionally be met. However, it will be appreciated that the first condition does not necessarily require the ascent to be at constant speed.
In some sets of embodiments, the constant speed considered in determining whether the second condition is met is in the uphill direction. Thus, the method may comprise the step of determining that the user is on a ski lift when the user travels uphill at a constant speed for a period exceeding a predetermined threshold. In other sets of embodiments, the constant speed considered in determining whether the second condition is met is in the downhill direction.
Preferably, where the obtained data indicates that the user has travelled at a constant speed exceeding a predetermined threshold, one or more additional checks are performed to confirm the determination that the user is on a ski lift. Such checks are performed to ensure that travel at a constant speed on a ski lift can be distinguished from skiing or snowboarding with a desired degree of confidence. Although such checks may be performed regardless of the direction of travel of the user, preferably the one or more additional checks are performed when the user is found to have travelled downhill, as such movement may be more easily confused with downhill skiing or snowboarding.
One additional check comprises obtaining data indicative of the hand and/or arm movement of the user during the (e.g. downhill) movement, and confirming the determination that the user is on a ski lift when the level of hand and/or arm movement is below a predetermined threshold. When a user is moving
(downhill) on a ski lift, the level of hand and/or arm movement would be expected to be lower than when skiing or snowboarding (downhill) on a run. As will be appreciated, the terms "hand movement" and "arm movement" are used to encompass the movement of any one or more portions of the arms and hands of the user, such the wrists, etc. The hand and/or arm movement data is obtained from one or more device associated with the user. Data indicative of the hand and/or arm movement of the user may be obtained from any suitable sensor(s) associated with one or both hands and/or arms of the user. The sensor(s) may include an accelerometer or a gyroscope, and preferably both an accelerometer and a gyroscope. In these embodiments, the one or more devices associated with the user may include a device wearable about the hand or wrist of the user that includes one or more sensors for determining data indicative of the movement of the hand and/or arm of the user. Such a device may be a glove, wristband, fitness watch, etc. This check is preferably performed when the user is found to have travelled downhill at a constant speed meeting the second condition.
Another additional check which may be alternatively or additionally performed comprises obtaining data indicative of a bearing of the user, and using the bearing data to confirm the determination that the user is on a ski lift. The bearing data is obtained from one or more device associated with the user. Such data may be based on compass measurements and/or satellite based, e.g. GPS, positional data. In general, a ski lift will be associated with travel in a relatively straight line. The method may comprise confirming the determination that the user is on a ski lift when the bearing data is indicative of travel substantially in a straight line. An additional check based on bearing data may equally be used to confirm a determination that the user is on a ski lift determined based on the first condition, or the second condition, and is not limited to the case in which the user travels downhill.
The method may comprise generating data indicative of a change of state of the user to a ski lift state once a determination that the user is on a ski lift has been made. The data may be generated once one or both of the first or second conditions is satisfied, i.e. when the user ascends by a distance greater than a predetermined threshold or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold, or when the user travels at a constant speed for a period exceeding a
predetermined threshold, or both. However, it will be appreciated, that, as described above, one or more additional conditions may be required to be satisfied in order to confirm the determination that the user is on a ski lift. In such cases, the state data may be generated only once the determination that the user is on the ski lift has been confirmed by the one or more additional checks performed. The generated change of state data may be used in various manners. Any or all of the steps described below may be performed, to the extent that they are not mutually exclusive.
Data indicative of the change of state may be stored. Alternatively or additionally, data indicative of the change of state may be transmitted to a remote device. For example, the determination of the change of state may be made by a wearable device of the user, e.g. a fitness tracker, and transmitted to a mobile device of the user for use by the device, e.g. for further processing and/or output to the user.
The generated change in state data may be used to generate data indicative of metrics relating to the skiing or snowboarding activity of the user and/or to trigger the output of data to a user. These steps may be performed by a device that generated the change in state data, or by a remote device that has received such data. Preferably the data output to the user comprises metrics relating to the skiing or snowboarding activity of the user.
The data output to the user may comprise an alert indicating that metrics relating to the skiing or snowboarding activity of the user are available and/or including such metrics. For example, the metrics may be displayed to the user together with the alert, or the alert may prompt the user to perform an action to result in the metrics being displayed, e.g. touch a touchscreen, etc. The alert may be accompanied by an alarm. The alert may be displayed to a user until the user dismisses the alert or a change in state of the user is detected indicating that the user is no longer on a ski lift.
Once it is established that the user has moved on to a ski lift, it may be inferred that a previous ski or snowboarding run is complete. The metrics relating to the activity of the user to which the generated or output data relates in the applicable embodiments preferably comprise metrics relating to the previous run. Such metrics may include one or more of: a run distance; a run duration; a run number; a run descent; a maximum gradient on the run; a maximum speed attained during the run; a time during the run at which a maximum gradient was attained; and a time during the run at which a maximum speed was attained. Of course, alternatively or additionally, metrics may relate to the overall ski or snowboarding session of the user. The metrics may be based on the cumulative totals of each run performed during the session. Such metrics may include one or more of: a total descent for all runs during the session; a total duration of all runs during the session; and a total distance for all runs during the session.
The data that is output to a user may be output by the same device that performs the method of determining the ski lift state or which receives data indicative of a generated change in state, when this is transmitted to a remote device. For example, the data may be output via a mobile device or wearable device, such as a fitness watch of the wearer. In other embodiments, generated data indicative of metrics relating to the activity of the user is transmitted to a remote device, where the data may be output to a user. For example, the data may be transmitted to a mobile device of the user for output. The data may then be transmitted from a wearable device, e.g. a fitness watch, for output to a user.
It will be appreciated that it is important to know reliably when a user is on a ski lift in order to be able to generate and output appropriate metrics relating to runs to the user. For example, when the user is in a ski lift, they may be presented with data relating to their previous run to review before starting their next run. Detecting that the user is on a ski lift as quickly as possible enables the end of a previous run to be determined with accuracy, to ensure that metrics relating to the run only relate to movement during the actual run, and are not skewed by movement when on the ski lift. The methods of the present invention, which enable detection of a user being on a ski lift to be achieved in a more timely and reliable manner, may therefore enable more accurate metrics to be determined and quickly provided to a user at relevant times.
Alternatively or additionally, the method may comprise using the generated change of state data to update a state of a state engine indicative of a state of the user. It will be appreciated that this step may be performed by a device remote to that which generated the change of state data, and which has received the data, or may be performed by the same device that generated the change of state data.
The method may comprise using the generated change of state data to update a state of a state engine indicative of the state of the user from a state indicative of a lesser likelihood of being on a ski lift to the ski lift state. The state indicative of a lesser likelihood of the user being on a ski lift may be a state indicative of the user not being on a ski lift (a "not ski lift" state). This may be appropriate where a state engine cycles between two states, a ski lift state, and a not ski lift state. However, it has been found that it may be advantageous for a state engine to transition between at least three states: a "not ski lift" state; a "ski lift" state; and an intermediate "potential ski lift" state. The state indicative of the lesser likelihood of the user being on a ski lift may then be a potential ski lift state. It will be appreciated that where an intermediate potential ski lift state is used, the method of the present invention may be used to confirm an initial determination of a potential ski lift state. By requiring a further level of confirmation, the present invention may provide greater certainty in the determination of the ski lift state, reducing the likelihood of false positives. In some embodiments the method may comprise updating a state of the state engine from a not lift state to a potential lift state when the obtained data is indicative of the user travelling uphill. Thus, in contrast to prior art techniques, a determination that the user is travelling uphill may only provide an initial indication that the user is on a ski lift, which must be further confirmed by determining whether the first and/or second condition described above is met, before the ski lift state can be determined. These provide additional verification that the user is on a ski lift taking into account vertical speed data and/or a constant speed check.
The use of a state engine to reflect the determined states of the user may be helpful in allowing accurate metrics to be determined, and presented to a user at appropriate times. For example, a change in state from to a ski lift state may trigger the generation and output of metrics relating to a previous run to the user. A change in state from a non lift state to a potential lift state, where used, may trigger a determination that a previous run has finished, and a determination of appropriate metrics relating to the previous run. If the ski lift state is then confirmed, this ensures that the metrics do not include the further period after the end of the run, before the lift state was confirmed. If the potential lift state is found to be incorrect, and the state reverts to a non lift state, the previous run may be deemed to still be in progress, and metrics derived including the period spent in the potential lift state.
It will be appreciated that a state engine may include two states, or three states, or a greater number of states. The above embodiments are merely exemplary of some preferred embodiments for transitioning between states of a state engine, and it will be understood that the state engine may include further states, and/or the conditions required to transition between states may be adjusted as required. The number of states used may be selected as desired, depending e.g. upon the way in which the provision of metrics to a user or another device is to be triggered. For example, it is envisaged that potential run and run states might be added. The potential run and potential lift states may be used when it is detected that the user is not moving on a run or lift, or before a run or lift is confirmed. The addition of the potential run and run states may enable metrics to be provided to a user or another device when the user pauses on a run, i.e. when a transition to the run state is detected. This is similar to the way in which metrics may be provided to a user or another device when the user is on a ski lift in the embodiments described herein.
In accordance with any of its embodiments, the method comprises the step of obtaining data indicative of the movement of one or more device associated with the user. The or each device is associated with the user, such that data indicative of the movement of the device is indicative of the movement of the user. The obtained data indicative of the movement of one or more device associated with the user may be any suitable data. In accordance with some preferred embodiments, the method comprises the step of obtaining data indicative of the altitude of a device associated with the user, and at least one of a horizontal speed and a vertical speed of a device associated with the user, and using the obtained data in determining that the device is in a ski lift state. Regardless of which types of data are obtained and used, the movement data may include satellite based positional data. Satellite based positional data may be provided by a GNSS sensor or sensors, such as GPS data, or any other data which may be obtained by one or more GNSS sensor, e.g. GLOSNASS, COMPASS or IRNSS. Such data may be used to provide data indicative of a horizontal speed, e.g. a horizontal GPS speed.
In embodiments in which obtained data indicative of a vertical speed of a device associated with the user (or a vertical speed of the user) is used, the vertical speed data is preferably based on altitude changes determined by pressure measurement. Pressure measurements may be obtained by one or more pressure sensor. The pressure measurement data is indicative of atmospheric pressure. In embodiments using vertical speed data, preferably the one or more devices associated with the user comprise a device including a pressure sensor, e.g. a barometer for providing pressure measurement data.
While it is preferred that the data indicative of a vertical speed of the user (or the device associated with the user) is determined based on pressure measurement, such data may also be obtained using satellite based positional data. As known in the art, satellite based, e.g. GPS, data may be used to provide an estimate as to altitude. In some preferred embodiments, the data indicative of a vertical speed of the user is determined based on altitude changes determined by pressure measurement, and satellite based positional data is used to correct errors in the pressure measurement data. Such errors might arise e.g. where a pressure sensor has failed, or due to pockets of high or low pressure that can affect pressure-based altitude measurements. The satellite based positional data may be GPS elevation data.
In accordance with the invention in any of its embodiments, a vertical direction of movement of the user, i.e. uphill or downhill, may be determined in any suitable manner, e.g. using the determined vertical speed and/or altitude of the user. The direction may be a net direction based on the movement of the user over a period of time. This may ensure that small variations in vertical direction of travel do not skew results. For example, the direction of the vertical speed may be used to determine uphill and downhill distances travelled over a period of time. In other embodiments, the direction of movement may be obtained using altitude data, preferably obtained from pressure measurement, but alternatively obtained from satellite based positional data, e.g. GPS elevation data.
The one or more devices associated with the user to which the obtained data relates may be any suitable device(s) which may provide data indicative of the movement of the device, and hence user, during skiing or snowboarding activity of the user. A device may simply be a sensor arranged to transmit data, or may be a computing device arranged to detect movement. Such a computing device may comprise one or more sensors.
In some embodiments, a single device may be associated with the user, for providing the movement data. Such a device may be a wearable device, such as a fitness watch, or a mobile device. However, in other embodiments, multiple devices may be used. The devices may then include appropriate sensors for providing different types of movement data for use in embodiments of the method described herein. For example, a mobile device may be used together with a wearable device. The wearable device might provide data relating to the movement of a part of the body of the wearer e.g. a hand movement, while the mobile device may provide data relating to the overall movement of the user, e.g. speed and altitude.
In some embodiments, the one or more devices comprise a wearable device. The wearable device may be any suitable device including appropriate sensor(s). In some preferred embodiments the wearable device is a fitness watch. However, it will be appreciated that other types of wearable device may be used, which need not necessarily provide watch functionality. For example, any wearable fitness tracker may be used. A wearable device need not necessarily be associated with the wrist or hand of a user. It is further envisaged that multiple devices may be associated with different parts of the wearer's body. In embodiments in which the method involves using data indicative of the movement of a hand of the user, the one or more devices preferably include a device that is wearable about the wrist, such as a wristband or fitness watch.
Alternatively or additionally, in some embodiments, the one or more devices include a mobile device, such as a mobile phone. Any mobile device may be used that may be associated with the wearer during skiing or snowboarding activity.
The step of obtaining the data indicative of the movement of one or more devices associated with the user may comprise receiving the data. The data may be received from one or more remote device. In other embodiments, the device that processes the data in accordance with the present invention may be the or a device to which the movement data relates. The method may then comprise a state determining subsystem of the device receiving the data from a subsystem or subsystems of the device that generates the data indicative of the movement of the device.
The processing of the obtained movement data in accordance with the invention in any of its aspects or embodiments may be carried out by any suitable computing device or devices. The device(s) may or may not be the same device(s) to which the movement data relates. In some embodiments the method is performed by a device associated with a user, and comprises obtaining data indicative of the movement of the (same) device. This may involve a state determining subsystem receiving the data from a suitable subsystem of the device. Data may or may not additionally be obtained from another device associated with the user, e.g. relating to different aspects of movement. Preferably the device that performs the processing to determine the state of the user is a device associated with the user. However, it is envisaged that such processing could be carried out remote from a user, e.g. by a server, using data received from the one or more devices associated with the user. The determined state may then be transmitted to a device associated with the user, e.g. for output to the user, etc, or might be used to determine metrics for later viewing by the user, e.g. via a user area.
In some exemplary embodiments the method may be performed by a mobile device, e.g. a mobile phone or tablet, using movement data received from one or more wearable devices associated with the user, such as a fitness watch or fitness tracker. The method may be implemented by running an appropriate app on the mobile device. In other embodiments, the method may be performed by a fitness watch or a mobile device e.g. phone to which the movement data relates. Accordingly, in some preferred embodiments the method is performed by a mobile device or a fitness watch associated with the user. When performed by a mobile device, the method may be performed based on movement data relating to the mobile device or a wearable device, such as a fitness watch associated with the user. When performed by a fitness watch, the method may be performed based on movement data relating to the fitness watch.
It is envisaged that some processing of received movement data (whether or not from a remote device) may be required to provide data of the type used in the method e.g. to obtain vertical speed data based on pressure sensor data etc. Where the data relates to a remote device or devices, such processing may be carried out by the remote device prior to transmission of the data, or may be carried out by the device that receives the data in order to obtain the data that is used in the method. Likewise, where the data relates to a device that also performs the processing of the data, the device may be arranged to process the raw positional data to determine the required data. In accordance with any of the embodiments of the invention, the step of obtaining the data indicative of the movement of one or more device associated with the user of a particular form described in embodiments herein, e.g. vertical speed data, may comprise determining such data based on received data (whether received from a remote device or a subsystem of the same device that performs the method). Received data may be in the form of positional data with respect to time, e.g. a plurality of position data samples. Each may be associated with a timestamp. Such data may be satellite based.
It will be appreciated that the methods in accordance with the present invention may be implemented at least partially using software. It will thus be seen that, when viewed from further aspects and in further embodiments, the present invention extends to a computer program product comprising computer readable instructions adapted to carry out any or all of the method described herein when executed on suitable data processing means. The invention also extends to a computer software carrier comprising such software. Such a software carrier could be a physical (or non-transitory) storage medium or could be a signal such as an electronic signal over wires, an optical signal or a radio signal such as to a satellite or the like.
The present invention in accordance with any of its further aspects or embodiments may include any of the features described in reference to other aspects or embodiments of the invention to the extent it is not mutually inconsistent therewith.
Advantages of these embodiments are set out hereafter, and further details and features of each of these embodiments are defined in the accompanying dependent claims and elsewhere in the following detailed description. Brief Description of the Figures
Various aspects of the teachings of the present invention, and arrangements embodying those teachings, will hereafter be described by way of illustrative example with reference to the accompanying drawings, in which:
Figure 1 shows schematically a state engine of a device according to an embodiment of the present invention;
Figure 2 shows schematically another state engine of a device according to a further embodiment of the present invention;
Figure 3 shows an example of an alert that may be provided to a user when it is determined that the user is currently on a ski lift;
Figure 4 shows an example of the data that may be provided to a user;
Figure 5 shows schematically a first approach for determining that a user is currently on a lift;
Figures 6A and 6B show schematically a second approach for determining that a user is currently on a lift;
Figure 7 is a schematic illustration of electronic components of a fitness watch according to a preferred embodiment; and
Figure 8 is a schematic illustration of the manner in which a fitness watch may receive information over a wireless communication channel.
Detailed Description of the Figures
Preferred embodiments of the present invention will now be described with particular reference to a computing device in the form of a fitness or sports watch. It will be appreciated however that the techniques of the present invention are not limited to fitness or sports watches and may generally be implemented on any suitable device, such as a mobile device, or a dedicated fitness tracker worn or carried by a user, or connected or docked in a known manner to a user's clothing or sports equipment. While the embodiments will be described, for ease of reference, with particular reference to a single device implementation, it will also be appreciated that the techniques described herein may be implemented across multiple devices. For instance, different devices including appropriate sensors associated with a user may be used to record or capture movement data which is then transmitted to the fitness or sports watch or other computing device for processing in accordance with the methods of the invention to determine a state of the user. Furthermore, the fitness or sports watch or other device that performs processing of the data to determine a state of the user may be arranged to transmit data indicative of the state, or generated in response to a detected change in state, onto another device, or to an external server. Some examples of such arrangements will be described below.
Particularly, the techniques may be implemented on devices having access to Global Positioning System (GPS) data. In general, GPS is a satellite-radio based navigation system capable of determining continuous position, velocity, time, and in some instances direction information for an unlimited number of users. Formerly known as NAVSTAR, the GPS incorporates a plurality of satellites which orbit the earth in extremely precise orbits. Based on these precise orbits, GPS satellites can relay their location to any number of receiving units. The GPS system is implemented when a device, specially equipped to receive GPS data, begins scanning radio frequencies for GPS satellite signals. Upon receiving a radio signal from a GPS satellite, the device determines the precise location of that satellite via one of a plurality of different conventional methods. The device will continue scanning, in most instances, for signals until it has acquired at least three different satellite signals (noting that position is not normally, but can be determined, with only two signals using other triangulation techniques). Implementing geometric triangulation, the receiver utilizes the three known positions to determine its own two-dimensional position relative to the satellites. This can be done in a known manner. Additionally, acquiring a fourth satellite signal will allow the receiving device to calculate its three dimensional position by the same geometrical calculation in a known manner. The position and velocity data can be updated in real time on a continuous basis by an unlimited number of users.
In general, the present invention is concerned with methods of detecting whether or not a user of the fitness watch or other device is currently on a ski lift (e.g. as opposed to currently being on a ski run). By providing this functionality, the need for the user to continually, manually start/stop the device in order to track individual ski runs is avoided and the user can just leave the device running. Furthermore, by reliably detecting when the user is on a ski lift, it can be ensured that the metrics for the ski runs are calculated using data that is captured only during the ski run, such that the metrics are not skewed e.g. by the lift speed, distance, elevation, etc. Similarly, the operation of the device, and particularly the display to the user, may be controlled such that the user is automatically presented with desired information once a run is completed (i.e. when they are on a ski lift) - for example, the user may be provided with a summary or "scorecard" of the previous run.
Figure 1 is an illustrative overview of the state detection that may be implemented on a fitness watch or other device according to embodiments of the present invention. One or more algorithms are used to determine the current state of the user, and particularly to determine whether the user is currently on a ski lift. The algorithm(s) is not limited to use on a fitness watch, and may be implemented on various suitable computing devices as desired.
The one or more algorithms process various input data in order to determine or detect a current state of the user. The input data relates to the movement of the user, and is obtained by one or more devices associated with the user. The input data may be recorded by the device itself (i.e. by one or more sensors within the fitness watch or other device) or may be transmitted to the device for processing by one or more remote devices including appropriate sensors or measurement devices. For example, the device that processes the input data might be a mobile phone of the user that receives input data from a fitness tracker worn by the user.
The algorithms process the input data to determine the current state of the user, and the state of a state engine of the device is updated accordingly. Figure 1 thus illustrates various possible current states of the user. Alternatively put, Figure 1 schematically shows a state engine of the device, wherein the state engine is changeable between the various states, wherein each state is indicative of a determined current state of the user. In general, the input data processed by the algorithm to determine the current state of the user may include data reflective of the horizontal speed of the user (e.g. taken from GPS measurements), the vertical speed (from measuring changes in altitude as detected, for example, by a pressure sensor) and also altitude or elevation data. It will be appreciated that various other input data may also be used in the determination of the current state of the user, as discussed further below.
In particular, Figure 1 shows three states indicating respectively that the user is not on a lift ("not lift", state = 0), is potentially on a lift ("potential lift", state = 1 ) or is on a lift ("lift", state = 2). Naturally, various other states may also be included, and suitable algorithms provided for detecting such other states. For instance, Figure 2 schematically shows a state engine including the further/alternative states "unknown" (now state = 0), "potential run" (state = 3) and "run" (state = 4). It will also be appreciated that one or more of the states, e.g. the intermediate "potential lift" state, may be omitted, such that the algorithm may essentially only make a determination as to whether a user is on a lift or not on a lift.
Once the current state of the user is determined, e.g. and the state engine updated accordingly, this information may be provided to a processor of the device and/or a software application running on the device. For instance, the state determination algorithm(s) may send a state change event to the device in order to control an operation of the device. That is, the operation of the device may be controlled or changed according to the current state of the user. The operation of the device, and the information presented to the user from the user interface or display of the device, may be automatically changed or updated depending on the determined current state of the user. For instance, depending on the determined current state of the user, the device may be operated to capture or record certain metrics, or to transmit certain metrics to another device. Alternatively/additionally, the device may be operated to trigger an output (of metrics or other data) for presentation to the user. In other embodiments, the state change event may be transmitted to a remote device for use thereby e.g. to generate metrics and/or output metrics or other data to a user. For example, a fitness tracker or watch device might transmit a state change event to a mobile device of the user, or even to a server.
Thus, each state of the device (being reflective of the determined current state of the user) may be associated with a different operating mode. For example, when it is determined that the user is in a "not lift" state (state = 0 in Figure 1 ), or that the user is currently on a run (state = 4 in Figure 2), the device may be arranged to capture metrics associated with the ski run. Typically, the ski run metrics will also be determined in the "potential lift" (state = 1 ) and "potential run" (state = 3 in Figure 2) states, so that this data may be retrieved if it is subsequently confirmed that the user was in fact on a run. On the other hand, when it is determined that the user is in a "lift" state (state = 2), there is no need to capture any data relating to the ski run, and the device may therefore be arranged to stop capturing any data, and instead display a summary of one or more previous run(s). For instance, when it is determined that the user is on a lift, the device may be set to display to the user an alert showing the statistics from the last run. Figure 3 shows an example of such an alert including the number of the last run, the top speed or best pace of the last run, the descent and the maximum gradient. Naturally, the information that is displayed may be tailored to include other information as desired. Further information may be accessible to the user by cycling through a set of screens. This alert may be brought up on the user interface or display of the device as soon as it is detected that the user is on a ski lift, i.e. as soon as the state engine is set to the lift state. The alert may be displayed until the user dismisses the alert, or it is detected that the user is no longer on the ski lift i.e. when an appropriate change of state is detected. Once the alert is dismissed, or no longer displayed, the last run statistics may be stored in a history so as to be accessible to the user at a future time. An alert of this type may similarly be displayed by a remote device which has received an indication of a change of state to the lift state, or to which appropriate alert data has been transmitted.
Figure 4 illustrates another example of data that may be presented to the user. Figure 4 shows the summary, statistics and individual details of each of the recorded runs during a particular session. This information may be displayed by the device, or may be transmitted from the device to another device, e.g. a user's mobile phone, for display. The data may be transmitted periodically, or preferably may be transmitted at the end of each run, i.e. once it is determined that the user is on a ski lift (in state = 2).
Figure 1 illustrates how the state transitions may be made. Figure 1 illustrates by way of example a situation where it is assumed (or known) that the lift is an uphill lift. Thus, as shown in Figure 1 , the transition from the "not lift" state (state 0) to the "potential lift" state (state 1 ) may be made when it is determined that a user is generally moving uphill. The direction of travel (i.e. uphill or downhill) may be determined e.g. by looking at changes in altitude data, which may be provided using pressure sensor measurements taken at different time points, or using GPS elevation data, or a combination of both. Using GPS elevation measurements in addition to the pressure sensor data may help to correct for pressure sensor failure or errors, e.g. due to local pockets of high/low pressure that may affect the pressure sensor measurements. The direction of travel may be a net direction of travel, and may therefore account for there being some descent, e.g. following an initial ascent. For instance, the uphill and downhill distances travelled may be determined from the vertical speed data, and the direction of travel determined accordingly based on the overall or net direction of travel.
The transition from the "potential lift" state to the "lift" state may be made when it is confirmed that the user is indeed on a ski lift. This determination may generally be made in one of two ways. In a first approach, this determination is made when it is detected that the user has reached a minimum ascent distance at (or above) a minimum vertical speed, or has spent a minimum time travelling uphill at (or above) a minimum vertical speed. In a second approach, the determination may be made by detecting that the user has travelled for a minimum duration at a constant speed. These two approaches may be used in combination. For example, these approaches may be used independently of each other, such that as soon as either condition is satisfied, the state is updated, or may be combined together such that the state is only updated when both conditions are satisfied.
Figure 5 shows schematically an algorithm that may be used to determine that the user has spent a minimum time travelling uphill at (or above) a minimum speed. The minimum speed may be a threshold value based on the expected travel speed of the lift (which will typically be higher than a user could otherwise move uphill). It will be appreciated that the Figure 5 approach may also be easily adapted to determine when the user has reached a minimum ascent distance at (or above) the minimum speed as the distance travelled may be determined from the time and speed data.
Previously (e.g. in the transition into the "potential lift" state), or as an initial or further step of the algorithm described generally in relation to Figure 5 (but not shown in Figure 5), a determination may be made that the user is travelling uphill. Accordingly, the algorithm shown in Figure 5 already knows, or comprises an initial or further step of determining, that the user is travelling uphill. The algorithm then goes on to determine whether a user is travelling uphill at or above a minimum threshold speed.
Thus, the first step 101 shown in Figure 5 is a determination of the vertical speed from the change in altitude (e.g. in m/s) and a determination of the horizontal speed from GPS data (e.g. in m/s). If the vertical speed is greater than or equal to the threshold minimum vertical speed or if the horizontal speed is greater than or equal to the threshold minimum horizontal speed, a vertical speed counter is incremented (step 102). Else, if the vertical speed is lower than the threshold minimum vertical speed, the vertical speed counter is reset (step 103). These steps are repeated at successive time intervals. Thus, a high value of the vertical speed counter indicates that the user has spent a long time travelling at or above the minimum vertical or horizontal speed. When the vertical speed counter exceeds a certain pre-determined value, this corresponds to the user having spent a minimum time travelling uphill at the minimum vertical speed.
Figures 6A and 6B show schematically an algorithm that may be used to determine that the user has travelled for a minimum duration at a constant speed. Ski lifts typically travel at a substantially constant speed, whereas a user on a ski run typically will not. Thus, a determination that the user has travelled for longer than a threshold duration at a constant speed may be used to confirm that the user is on a ski lift.
In Figure 6A, the current speed is determined (step 1 1 1 ), along with the change in speed relative to the previously measured value(s) (step 1 12). A determination is then made as to whether the change in speed falls within a certain threshold range. If the change of speed is within this range, i.e. within +/- a threshold change in speed, a constant speed counter is incremented (step 1 13). Else, if the change of speed exceeds the threshold range/value, the constant speed counter is reset (step 1 14). These steps are then repeated at successive time intervals, such that a high value of the constant speed counter indicates that the user has travelled for a long time at a constant speed.
The constant speed counter may then be used to determine a constant speed state as shown in Figure 6B. As shown in Figure 6B, a constant speed state is entered when it is determined that the user is moving (i.e. travelling above a certain threshold speed), and wherein the constant speed counter exceeds a threshold count value. The non-constant speed state is entered when it is determined that the user is no longer moving, or wherein the change in speed exceeds the threshold range/value, or wherein the constant speed counter is reset.
The speed data used in the determinations described in relation to Figures 6A and 6B may generally reflect either or both of the horizontal and vertical speeds, and may be taken from GPS measurements, from change in altitude data, or a combination of both. It will be appreciated therefore that the approach described in relation to Figures 6A and 6B may be applied to both uphill and downhill lifts, or more complex lift arrangements including both uphill and downhill (and horizontal) segments. In both cases, a constant speed check may be used to detect that the user is on a lift, rather than a run.
Indeed, in general, it will be appreciated that a user may be on a ski lift whilst not necessarily moving uphill, e.g. when the user is on a downhill or horizontal ski lift, or on a lift that does not stop at the top of the summit. The techniques described herein may allow the detection of such lifts where the user is not necessarily moving continually uphill, or where the user is moving downhill, e.g. using the approach described in relation to Figures 6A and 6B. Thus, it will be appreciated that where a "potential lift" state is provided, this state need not be entered on the basis of a user travelling uphill, as shown in Figure 1 , but may be determined in some other way.
In any case, an initial step of determining the (net) direction of travel of the user (e.g. uphill or downhill) may be made, e.g. using the vertical speed data and the relative distances travelled up and downhill, as mentioned above. Thus, whilst the example described above relates to the case where the lift is travelling generally uphill, it will be appreciated that the approaches may also be extended to cover downhill lifts.
Various other data may be processed and additional checks made to confirm that the user is on a lift. For example, a fitness watch or another device worn around the user's wrist may comprise an accelerometer and/or gyroscope for detecting the user's hand movement Where processing of the data is carried out by a device remote from such a watch or wrist mounted device, the watch or wrist mounted device may be arranged to transmit the data to that other device for processing. Minimal hand movement may be indicative of the user being on a ski lift, rather than a ski run. As another example, the bearing of the user (e.g. taken from compass measurements, or from GPS data) may help to confirm that the user is on a lift, as lifts generally travel in straight lines. These examples of additional checks apply equally to uphill and downhill lifts. The additional checks may preferably be used to determine whether a user is on a downhill lift, where there is otherwise greater potential for confusion.
A transition from the "lift" state (state = 2) back to the "potential lift" states may be made e.g. when it is determined that a user is moving at a non-constant speed, or particularly, is moving downhill at a non- constant speed. The transition back to the "not lift" state, or into a "potential run" or "run" state may be made e.g. after a determination of the user travelling a minimum descent distance at a non-constant speed, or after a time-out in the "potential lift" state (i.e. where no transition into the "lift" state is made after a predetermined time interval).
The approaches described above generally use a combination of horizontal speed, vertical speed and altitude data, as well as optional other checks. The horizontal speed data, and potentially also the vertical speed and altitude data, may be obtained from GPS measurements. In cases where GPS data is not available, the state transitions may be made based solely on changes in the altitude data. However, once a GPS trace is re-acquired, the approaches discussed above may be used preferentially, as they allow for a faster detection, and are able to deal with more complex lift arrangements (downhill lifts, shallow lifts, etc.).
Figure 7 is an illustrative representation of electronic components of a sports watch 200 according to a preferred embodiment of the present invention, in block component format. It should be noted that the block diagram of the device 200 is not inclusive of all components of the device, but is only representative of many example components.
The device 200 includes a processor 202 connected to an input device 212, such as a depressible touchpad (or trackpad), and a display screen 210, such as an LCD display. The device 200 can further include an output device arranged to provide audible information to a user, such as alerts that a certain speed has been reached or a certain distance has been travelled.
Figure 7 further illustrates an operative connection between the processor 202 and a GPS antenna/receiver 204. Although the antenna and receiver are combined schematically for illustration, the antenna and receiver may be separately located components. The antenna may be of any suitable form, but in preferred embodiments is a GPS patch antenna.
The device 200 further includes an accelerometer 206, which can be a 3-axis accelerometer arranged to detect accelerations of the user in x, y and z directions. The accelerometer may act as a pedometer for use when/if there is a loss of GPS reception, and/or may act to detect stroke rate when the fitness watch is being used during swimming. Although the accelerometer is shown to be located within the device, the accelerometer may also be an external sensor worn or carried by the user, and which transmits data to the device 200 via the transmitter/receiver 208.
The device 200 further includes a pressure sensor 230 that may be used to determine or detect changes in altitude. Changes in altitude may also be detected using GPS measurements, either alternatively, or preferably additionally, to the pressure sensor 230. Using a combination of pressure sensor
measurements and GPS measurements may help to correct for failure of or errors in the pressure sensor measurements, e.g. due to local packets of high/low pressure.
The device may also receive data from other sensors, such as a foot pod sensor 222 or a heart rate sensor 226. The foot pod sensor may, for example, be a piezoelectric or micro-electro-mechanical systems (MEMS) accelerometer that is located in or on the sole of the user's shoe. Each external sensor is provided with a transmitter and receiver, 224 and 228 respectively, which can be used to send or receive data to the device 200 via the transmitter/receiver 208.
The processor 202 is operatively coupled to a memory 220. The memory resource 220 may comprise, for example, a volatile memory, such as a Random Access Memory (RAM), and/or a non-volatile memory, for example a digital memory, such as a flash memory. The memory resource 220 may be removable. As discussed in more detail below, the memory resource 220 is also operatively coupled to the GPS receiver 204, the accelerometer 206 and the transmitter/receiver 208 for storing data obtained from these sensors and devices.
Further, it will be understood by one of ordinary skill in the art that the electronic components shown in Figure 7 are powered by a power source 218 in a conventional manner. The power source 218 may be a rechargeable battery.
The device 200 further includes an input/output (I/O) device 216, such as a plurality of electrical contacts or a USB connector. The I/O device 216 is operatively coupled to the processor, and also at least to the memory 220 and power supply 218. The I/O device 216 is used, for example, to: update firmware of processor 220, sensors, etc; transfer data stored on the memory 220 to an external computing resource, such as a personal computer or a remote server; and recharge the power supply 218 of the device 200. Data could, in other embodiments, also be sent or received by the device 200 over the air using any suitable mobile telecommunication means.
As will be understood by one of ordinary skill in the art, different configurations of the components shown in Figure 7 are considered to be within the scope of the present application. For example, the components shown in Figure 7 may be in communication with one another via wired and/or wireless connections and the like.
In Figure 8 the watch 200 is depicted as being in communication with a server 400 via a generic communications channel 410 that can be implemented by any number of different arrangements. The server 400 and device 200 can communicate when a connection is established between the server 400 and the watch 200 (noting that such a connection can be a data connection via mobile device, a direct connection via personal computer via the internet, etc.).
The server 400 includes, in addition to other components which may not be illustrated, a processor 404 operatively connected to a memory 406 and further operatively connected, via a wired or wireless connection, to a mass data storage device 402. The processor 404 is further operatively connected to transmitter 408 and receiver 409, to transmit and send information to and from device 200 via
communications channel 410. The signals sent and received may include data, communication, and/or other propagated signals. The functions of transmitter 408 and receiver 409 may be combined into a signal transceiver.
The communication channel 410 is not limited to a particular communication technology.
Additionally, the communication channel 410 is not limited to a single communication technology; that is, the channel 410 may include several communication links that use a variety of technology. For example, the communication channel 410 can be adapted to provide a path for electrical, optical, and/or electromagnetic communications, etc. As such, the communication channel 410 includes, but is not limited to, one or a combination of the following: electric circuits, electrical conductors such as wires and coaxial cables, fibre optic cables, converters, radio-frequency (RF) waves, the atmosphere, empty space, etc. Furthermore, the communication channel 410 can include intermediate devices such as routers, repeaters, buffers, transmitters, and receivers, for example.
In one illustrative arrangement, the communication channel 410 includes telephone and computer networks. Furthermore, the communication channel 410 may be capable of accommodating wireless communication such as radio frequency, microwave frequency, infrared communication, etc. Additionally, the communication channel 410 can accommodate satellite communication.
The server 400 may be a remote server accessible by the watch 200 via a wireless channel. The server 400 may include a network server located on a local area network (LAN), wide area network (WAN), virtual private network (VPN), etc.
The server 400 may include a personal computer such as a desktop or laptop computer, and the communication channel 410 may be a cable connected between the personal computer and the watch 200. Alternatively, a personal computer may be connected between the watch 200 and the server 400 to establish an internet connection between the server 400 and the watch 200. Alternatively, a mobile telephone or other handheld device may establish a wireless connection to the internet, for connecting the watch 200 to the server 400 via the internet.
The server 400 is further connected to (or includes) a mass storage device 402. The mass storage device 402 contains a store of at least digital map information. This digital map information can be used, together with data from the device, such as time-stamped location data obtained from the GPS receiver 204 and data indicative of motion of the wearer obtained from the accelerometer 206, foot pod sensor 222, etc., to determine a route travelled by the wearer of the device 200, which can then be viewed by the wearer.
As will be appreciated, the watch 200 is designed to be worn by a runner or other athlete as they undertake a run or other similar type of workout. The various sensors within the watch 200, such as the GPS receiver 204 and the accelerometer 206, collect data associated with this run, such as the distance travelled, current speed, etc., and display this data to the wearer using the display screen 210.
It will be appreciated that whilst various aspects and embodiments of the present invention have heretofore been described, the scope of the present invention is not limited to the particular arrangements set out herein and instead extends to encompass all arrangements, and modifications and alterations thereto, which fall within the scope of the appended claims.
For example, whilst a preferred embodiment described in the foregoing detailed description relates to a watch module that can be removably mounted to a wrist strap, it will be understood that the module could be integrated with a wrist strap. Furthermore, although the watch module has been described as having an input device, this is an optional component. A suitable watch module may include a battery and a processor connected to one or more of: the display, an optional input device, a memory, a wireless transceiver, and an input/output device such as electrical contacts. Lastly, it should be noted that whilst the accompanying claims set out particular combinations of features described herein, the scope of the present invention is not limited to the particular combinations hereafter claimed, but instead extends to encompass any combination of features or embodiments herein disclosed irrespective of whether or not that particular combination has been specially enumerated in the accompanying claims at this time.

Claims

CLAIMS:
1. A method of determining a state of a user during skiing or snowboarding activity, the method comprising:
obtaining data indicative of the movement of the user; and
determining that the user is on a ski lift based on the obtained data when the data indicates that: (i) the user has ascended by a distance greater than a predetermined threshold and/or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold; and/or (ii) the user has travelled at a constant speed for a period exceeding a predetermined threshold.
2. The method of claim 1 , wherein the obtained data indicative of the movement of the user used in said determination comprises data indicative of at least one of a vertical and horizontal speed of a device associated with the user, and data indicative of an altitude of a device associated with the user.
3. The method of claim 1 or 2, comprising determining that the user is on a ski lift based on the received data when the obtained data indicates that the user has ascended by a distance and/or for a time greater than a predetermined threshold at a vertical speed that is greater than a predetermined threshold.
4. The method of any preceding claim, further comprising, when the obtained data indicates that the user has travelled downhill at a constant speed exceeding a predetermined threshold, performing one or more additional checks to confirm the determination that the user is on a ski lift, wherein an additional check is performed which comprises obtaining data indicative of the hand and/or arm movement of the user during the downhill movement, and confirming the determination that the user is on ski lift when the level of hand and/or arm movement is below a predetermined threshold.
5. The method of any preceding claim, comprising performing an additional check to confirm the determination that the user is on a ski lift comprising obtaining data indicative of a bearing of the user, and using the bearing data to confirm the determination that the user is on a ski lift, optionally wherein the method comprises confirming the determination that the user is on a ski lift when the bearing data is indicative of travel in a straight line.
6. The method of any preceding claim, wherein the determination of that the user is on a ski lift is based on data indicative of a vertical speed of a device associated with the user, the vertical speed data being based on altitude changes determined by pressure measurement.
7. The method of claim 6, further comprising using satellite based positional data to correct errors in the pressure measurement data.
8. The method of any preceding claim, further comprising generating data indicative of a change in state of the user once a determination that the user is on a ski lift has been made.
9. The method of claim 8, further comprising using the generated change in state data to update a state of a state engine indicative of the state of the user to a ski lift state.
10. The method of claim 9, wherein the state engine is arranged to transition between at least three states: a "not ski lift" state; a "ski lift" state; and an intermediate "potential ski lift" state, wherein the state of the state engine is updated from the "potential ski lift" state to the "ski lift" state.
1 1. The method of claim 10, wherein the state engine is arranged to transition from the "not ski lift" state to the "potential ski lift" state when the obtained data is indicative of the user travelling uphill.
12. The method of any one of claims 8 to 1 1 , further comprising transmitting data indicative of the change of state to a remote device.
13. The method of any one of claims 8 to 12, further comprising using the data indicative of the generated change in state to generate data indicative of metrics relating to the skiing or snowboarding activity of the user.
14. The method of any one of claim 8 to 13, further comprising using the data indicative of the generated change in state to trigger the output of data to the user, optionally wherein the output data comprises metrics relating to the skiing or snowboarding activity of the user.
15. The method of claim 14, wherein the data output to the user comprises an alert indicating that metrics relating to the skiing or snowboarding activity of the user are available and/or including such metrics.
16. The method of any one of claims 13 to 15, wherein the metrics relate to the previous run performed by the user, optionally wherein the metrics include one or more of: a run distance; a run duration; a run number; a run descent; a maximum gradient on the run; a maximum speed attained during the run; a time during the run at which a maximum gradient was attained; and a time during the run at which a maximum speed was attained.
17. The method of any preceding claim, wherein the method is performed by a mobile device or a wearable device, such as a fitness watch associated with the user.
18. A system for determining a state of a user during skiing or snowboarding activity, comprising:
means for obtaining data indicative of the movement of the user; and
means for determining that the user is on a ski lift based on the obtained data when the obtained data indicates that: (i) the user has ascended by a distance greater than a predetermined threshold and/or for a time greater than a predetermined threshold at a speed that is greater than a predetermined threshold; and/or (ii) the user has travelled at a constant speed for a period exceeding a predetermined threshold.
19. The system of claim 18, wherein the system is a mobile device or a wearable device, such as a fitness watch associated with the user.
20. A computer program product comprising instructions which, when executed by one or more processors of a system, cause the system to perform the method as claimed in any one of claims 1 to 17, optionally stored on a non-transitory computer readable medium.
PCT/EP2017/071996 2016-09-01 2017-09-01 Methods for determining a state of a user during fitness activity WO2018042007A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1614866.0 2016-09-01
GBGB1614866.0A GB201614866D0 (en) 2016-09-01 2016-09-01 Methods for determining a state of a user during fitness activity

Publications (1)

Publication Number Publication Date
WO2018042007A1 true WO2018042007A1 (en) 2018-03-08

Family

ID=57140009

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2017/071996 WO2018042007A1 (en) 2016-09-01 2017-09-01 Methods for determining a state of a user during fitness activity

Country Status (2)

Country Link
GB (1) GB201614866D0 (en)
WO (1) WO2018042007A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6198431B1 (en) * 1998-08-27 2001-03-06 Maptrek Llc Compact GPS tracker and customized mapping system
US20140278220A1 (en) * 2012-06-22 2014-09-18 Fitbit, Inc. Fitness monitoring device with altimeter
US20150256689A1 (en) * 2014-03-05 2015-09-10 Polar Electro Oy Wrist computer wireless communication and event detection
US20160067547A1 (en) * 2014-09-04 2016-03-10 Tagit Labs, Inc. Methods and systems for automatic adverse event detection and alerting

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6198431B1 (en) * 1998-08-27 2001-03-06 Maptrek Llc Compact GPS tracker and customized mapping system
US20140278220A1 (en) * 2012-06-22 2014-09-18 Fitbit, Inc. Fitness monitoring device with altimeter
US20150256689A1 (en) * 2014-03-05 2015-09-10 Polar Electro Oy Wrist computer wireless communication and event detection
US20160067547A1 (en) * 2014-09-04 2016-03-10 Tagit Labs, Inc. Methods and systems for automatic adverse event detection and alerting

Also Published As

Publication number Publication date
GB201614866D0 (en) 2016-10-19

Similar Documents

Publication Publication Date Title
EP2330975B1 (en) Sensor fusion for activity identification
US10321293B2 (en) Methods for communicating sensor data between devices
US20130197857A1 (en) Gps-calibrated pedometer
EP2658443B1 (en) Accelerometer data compression
US10976162B2 (en) Information processing apparatus, information processing method for acquiring precise position in autonomous navigation system
Ahn et al. RescueMe: An indoor mobile augmented-reality evacuation system by personalized pedometry
US20210093918A1 (en) Detecting the end of hiking activities on a wearable device
US10830606B2 (en) System and method for detecting non-meaningful motion
US20140200847A1 (en) Wrist-based speed and distance monitoring
US20190076063A1 (en) Systems and methods of ski activity detection
JP5857397B2 (en) Step information acquisition system and step information acquisition method
US20200158533A1 (en) Step-length calculating device, portable terminal, position-information providing system, step-length calculating device control method, and program
WO2012045484A1 (en) Gps-calibrated pedometer
US10845203B2 (en) Indoor/outdoor detection using a wearable computer
JP6349361B2 (en) Method and system for measuring or predicting hurdle race time
KR102253298B1 (en) Measuring apparatus for golf putting line
WO2018042007A1 (en) Methods for determining a state of a user during fitness activity
US20150124571A1 (en) Measurement information management system, measurement device, measurement information management method, and measurement information management program
US20220095954A1 (en) A foot mounted wearable device and a method to operate the same
CN114111552A (en) Landslide displacement monitoring method and equipment based on GNSS antenna and MEMS
US10967221B2 (en) Device and method for monitoring exercise performance
CN114632317B (en) Fall detection method and device, storage medium and electronic equipment
JP2019053007A (en) Information control device, information display device, information control method, program, and server device
CN115164975A (en) Motion detection method and device and intelligent equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17761085

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17761085

Country of ref document: EP

Kind code of ref document: A1