WO2015177673A1

WO2015177673A1 - System and apparatus for activity classification and activity measurement through tangible interaction

Info

Publication number: WO2015177673A1
Application number: PCT/IB2015/053439
Authority: WO
Inventors: Privender Kaur Saini; Gijs Geleijnse; Aart Tijmen Van Halteren; Marten Jeroen Pijl; Joyca Petra Wilma Lacroix
Original assignee: Koninklijke Philips NV
Current assignee: Koninklijke Philips NV
Priority date: 2014-05-20
Filing date: 2015-05-11
Publication date: 2015-11-26
Anticipated expiration: 2016-11-20

Abstract

An apparatus and a method for using the apparatus including a stretchable layer at least partially surrounding the apparatus, at least one of a pressure sensor configured to detect an amount of pressure applied to the apparatus, a tension sensor configured to detect an amount that the apparatus is stretched, or an accelerometer configured to detect movement of the apparatus, and an interfacing unit configured to receive data corresponding to at least one of the amount of pressure detected by the pressure sensor, the amount that the apparatus is stretched detected by the tension sensor, or movement detected by the accelerometer and configured to deliver the data to a client device.

Description

SYSTEM AND APPARATUS FOR ACTIVITY CLASSIFICATION AND ACTIVITY MEASUREMENT THROUGH TANGIBLE INTERACTION

TECHNICAL FIELD

[0001] The present disclosure relates to the field of promoting a healthier lifestyle to a subject and in particular to a system for promoting a healthy lifestyle utilizing an apparatus that classifies tangible interaction and measures physical activity of a user.

BACKGROUND

[0002] Currently it is widely acknowledged that an increasing number of people live a sedentary lifestyle. This means that a large majority of people do not meet the recommended physical activity level that is required for a healthy lifestyle. As an inactive lifestyle significantly increases the risk for developing a chronic condition, there has been a rise in products and services that promote physical activity and exercise. A special case is the device-service product. A wearable device is used for on-body measurements of physical activity, and a (web) service is used to provide feedback of physical activity and motivate the user to become/stay active.

[0003] Such systems include a web service, an activity monitor and human coaching support. Research has shown that engagement in the program is key to success. Users that enjoy using the activity monitor and the service are more likely to continue using the system as well as benefit more from it.

[0004] Over the years systems continuously improved their proposition by investing in improving the accuracy of the device, in using the proper behavior change strategies, and in adding features to improve the experience. On the accuracy, much research has been done in the area of automatic classification of (common) activities, for example walking, cycling, and running. This research was inspired by the fact that accelerometry is not ideal for activities that either require little to no acceleration (e.g., strength exercises) or acceleration of specific body parts not connected with the activity monitor, e.g. activities like cycling, and strength and flexibility exercises. In fact, certain features have been implemented in existing services to cater to the need of the user to represent their caloric expenditure in a meaningful manner and to improve the accuracy of the measurements. One such feature is activity specification, which allows users to specify a timeframe that corresponds to a specific class of activities, such as physical activities (e.g. flexibility or strength). With respect to improving the experience of the user, elements may be included that are designed to increase engagement and fun using both the device and the service.

[0005] The present disclosure has several benefits including enhancing the experience of the product through making interaction with the device more fun and improving accuracy of the measurements made by the product.

SUMMARY

[0006] The challenges described above are addressed by the present disclosure which includes a fun and tangible manner of proactively classifying and measuring activity through interaction with an activity monitor by stretching, compressing, and shaking it for providing a timely and easy method of classification (increasing accuracy) and at the same time a more fun and engaging point of contact with a client device/activity monitor. [0007] According to an aspect of the present disclosure a method for measuring physical activity is provided. The method includes determining at least one of an amount of pressure applied to an apparatus via a pressure sensor, an amount that the apparatus is stretched via a stretch sensor, or an amount of movement of the apparatus via an accelerometer, delivering data corresponding to at least one of the amount of pressure determined, the amount that the apparatus is stretched determined, or the amount of movement determined to a client device, and calculating calorie expenditure based on the data delivered. At least one of the pressure sensor, the stretch sensor, or the accelerometer may be disposed within a stretchable layer of the apparatus.

[0008] The method may further include determining a first trigger of a start of an activity based on a first preconfigured movement pattern detected by the accelerometer and determining a second trigger of an end of the activity based on a second preconfigured movement pattern detected by the accelerometer. Additionally, or alternatively, the method may further include storing the calorie expenditure calculated between the first trigger and the second trigger. Additionally, or alternatively, the method may further include wirelessly delivering the data corresponding to at least one of the amount of pressure determined, the amount that the apparatus is stretched determined, or the amount of movement determined to the client device. Additionally, or alternatively, the method may further include storing the data corresponding to at least one of the amount of pressure determined, the amount that the apparatus is stretched determined, or the amount of movement determined for coaching a user. Additionally, or alternatively, the method may further include displaying data corresponding to at least one of the amount of pressure determined, the amount that the apparatus is stretched determined, or the amount of movement determined on a display.

[0009] According to another aspect of the present disclosure, an apparatus is provided including a stretchable layer at least partially surrounding the apparatus, at least one of a pressure sensor configured to detect an amount of pressure applied to the apparatus, a stretch sensor configured to detect an amount that the apparatus is stretched, or an accelerometer configured to detect movement of the apparatus, and an interfacing unit configured to receive data corresponding to at least one of the amount of pressure detected by the pressure sensor, the amount that the apparatus is stretched detected by the stretch sensor, or movement detected by the accelerometer and configured to deliver the data to a client device. The interfacing unit may wirelessly transmit the data received to the client device. The stretchable layer may be mounted, or may be mountable, onto the client device.

[0010] In embodiments, at least one of the apparatus or the client device is configured to communicate with a computing device, the computing device configured to store and process the data received for coaching a user. Additionally or alternatively, manipulating the apparatus in a preconfigured pattern/manner causes the apparatus to trigger an activity. Calorie expenditure may be calculated based on the data received. Additionally, a display may be coupled to the stretchable layer.

[0011] According to another aspect of the present disclosure a non-transitory computer readable storage medium is provided, storing a program, which when executed by a computer, causes the computer to a perform any of the methods described herein. BRIEF DESCRIPTION OF THE FIGURES

[0012] The aspects of the present disclosure may be better understood with reference to the following figures. The components in the figures are not necessarily to scale, emphasis instead being placed on the clearly illustrating the principles of the disclosure. Moreover, in the figures, like reference numerals designate corresponding parts throughout the several views.

[0013] In the figures:

[0014] Fig. 1 shows a schematic representation of components of the system of the present disclosure and illustrates the cooperation of these components in accordance with an embodiment of the present disclosure;

[0015] Fig. 2 shows a schematic representation of the components of a computing resource of the system of Fig. 1;

[0016] Fig. 3 shows a pod apparatus of the system of Fig. 1 in accordance with an embodiment of the present disclosure;

[0017] Fig. 4 shows a user operating a pod apparatus of the system of Fig. 1 in accordance with an embodiment of the present disclosure; and

[0018] Fig. 5 shows a user operating a pod apparatus of the system of Fig. 1 in accordance with an embodiment of the present disclosure.

DETAILED DESCRIPTION OF EMBODIMENTS

[0019] The present disclosure describes various embodiments of systems, methods, and devices for calculating calorie/energy expenditure and triggering activity events. [0020] As represented in Fig. 1, shown is a system 100 according to various embodiments including a computing resource 101, an activity monitor or client device 102, a pod apparatus 300, and a network 104 which may be any type of communication layer. The computing resource 101 includes a processor 107 and a memory 108 that stores an application that may implement any of the methods described herein. The computing resource 101 may be a server, computer, or another device providing computing capability. For purposes of convenience, a computing resource is referred to herein in the singular, but it is understood that a plurality of computing resources may be employed in the various arrangements described above instead. Although the methods described herein are described as being carried out by computing resource 101, it is also envisioned that the methods may be carried out by any component of the system 100 such as the pod apparatus 300 and/or the client device 102.

[0021] A client device 102 is representative of a plurality of client devices that may be coupled to the network 104 or otherwise utilized within system 100. In the embodiment illustrated in Fig. 1, the client device 102 is associated with a user. The client device 102 may be configured to communicate with a pod apparatus 300, which will be discussed in further detail below. Additionally, or alternatively, the pod apparatus 300 may be configured to communicate with the computing resource 101 over the network 104 without a client device 102 as an intermediary. Client device 102 may be configured to receive data from a pod apparatus 300, or otherwise transmit data between a pod apparatus 300, client devices 102, and computing resource 101, as will be described in further detail below. [0022] In embodiments, the pod apparatus 300 is coupled to the client device 102. For example, in one embodiment, the pod apparatus is a stretchable layer configured to form around at least a portion of the client device. In some embodiments, the a pod apparatus 300 and/or client device 102 may be included in, or removably attached to, a watch, glasses, headphones, or other device that is worn by a user.

[0023] The network 104 includes, for example, the Internet, intranets, extranets, wired networks, wireless networks, wide area networks (WANs), local area networks (LANs), or other suitable networks, etc., or any combination of two or more such networks.

[0024] Turning now to Fig. 2, shown is a detailed view of the computing resource 101 of Fig. 1. The computing resource 101, client device 102, and/or pod apparatus 300 may each respectively include a processor 107 and a memory 108. In some embodiments, the computing resource 101 and client device 102 may include more than one processor 107 and more than one memory 108. For purposes of convenience, the processor 107 and memory 108 are referred to herein in the singular, but it is understood that a plurality of processors 107 and/or a plurality of memories 108 may be employed by a computing resource 101, a client device 102, or pod apparatus 300.

[0025] Processor 107 is configured to process any of the steps or functions of computing resource 101 and/or system 100, and/or any of the modules, units, or components thereof. The term processor, as used herein, may be any type of controller or processor, and may be embodied as one or more controllers or processors adapted to perform the functionality discussed herein. A memory 108 may include both volatile and/or nonvolatile memory and data storage components. Thus, the memory may include, for example, random access memory (RAM), read-only memory (ROM), hard disk drives, solid-state drives, USB flash drives, memory cards accessed via a memory card reader, floppy disks accessed via an associated floppy disk drive, optical discs accessed via an optical disc drive, magnetic tapes accessed via an appropriate tape drive, and/or other memory components, or a combination of any two or more of these memory components. A memory 108 is a computer readable medium.

[0026] Receiving unit 111 is configured to receive any data transmitted within network 104 such as data transmitted by client device 102 and/or pod apparatus 300.

[0027] Strength and flexibility are notoriously difficult to measure with accelerometry alone. However, for users who work out in a gym, both strength and flexibility are highly important and relevant for daily caloric and/or energy expenditure measurements and calculations. In addition, measuring such activities is also relevant from a health perspective as strength and flexibility training provide health benefits. Although accelerometry is well suited to measure cardio training, accuracy can be improved here as well, when used in conjunction with other data measurements. Certain cardio exercises that don't involve whole body accelerations, like cycling or low- resistance rowing result in inaccurate measurements of caloric expenditure.

[0028] Turning now to Fig. 3, a pod apparatus 300 will be described with particular detail. Pod apparatus 300 includes any or all of an external layer 301, an interfacing unit 303, a pressure sensor 305, a tension sensor 307, an accelerometer 309, and a display 311. In certain embodiments, pod apparatus 300 includes only some of the components described. For example, in one embodiment, pod apparatus 300 does not include a display 311. Additionally, in an embodiment, pod apparatus 300 includes only a pressure sensor 305 and a tension sensor 307 and not an accelerometer 309. For example, in some embodiments, client device 102 may be equipped with an accelerometer and therefore an additional accelerometer 309 within the pod apparatus 300 may not be necessary. Additionally, although illustrated and described as only included a single sensor for each of pressure sensor 305, tension sensor 307, and accelerometer 309, it is envisioned that pod apparatus 300 may include more than one of each sensor.

[0029] External layer 301 may be a flexible, stretchable, compressible, malleable, conformable, or otherwise manipulatable layer. In some embodiments, external layer 301 is a thick highly stretchable rubber coating. At least one of a pressure sensor 305, tension sensor 307, and/or accelerometer 309 is embedded in, or coupled to, external layer 301. Pressure sensor 305 detects the amount of external pressure applied to the pod apparatus 300, tension sensor 307 detects the amount that the pod apparatus 300 is being stretched, and accelerometer 309 may be a tri-axial accelerometer that measures the amount of movement of the pod apparatus 300. Each of these sensors, alone or in combination, may be utilized within system 100 to cue a vast number of activities and measure physical activity of a user for calculating caloric/energy expenditure of the user.

[0030] Pod apparatus 300 may include a mounting mechanism to mount the pod apparatus 300, in particular the external layer 301, to a client device 102.

[0031] Interfacing unit 303 receives signals from any or all of the pressure sensor 305, tension sensor 307, and/or accelerometer 309 and transmits the signals to client device 102 and/or computing resource 101 for storage and processing. In embodiments, interfacing unit 303 includes a storage device for storing the signals received, and/or a processing unit for processing the signals received and converting them into data values. Interfacing unit 303 may wirelessly transmit the data to client device 102 or computing resource 101, or may be coupled to the client device 102 for a hard- wire transmission thereto.

[0032] Display 311 may display the amount of pressure detected by the pressure sensors 305, the amount of tensions measured by the tension sensors 307, and/or the amount of movement measured by the accelerometers 309. Additionally, or alternatively, the display 311 may display the amount of caloric/energy expenditure calculated, and/or desired goals of a user.

[0033] Turning now to Figs. 4 and 5, different uses of the pod apparatus 300 will be described. As described above, pressure sensors 305 measure the amount of pressure applied by the user's hand while gripping the pod apparatus 300 and tension sensors 307 measure the amount that the pod apparatus 300 is being stretched by the user. The measured values are transmitted to the client device 102 via the interfacing unit 303. In turn, client device 102 may store the data or transmit the data to computing resource 101 for processing and/or storage.

[0034] The types of tangible interaction may be intuitive or at the very least, easy to learn. For the indication of strength training or caloric/energy expenditure calculations, the user may take the pod apparatus 300 in the palm of his/her hand such that it allows the pod apparatus 300 to be encapsulated when a fist is formed in the hand. The act and dynamics of the formation of the fist and sustaining the hold for a few seconds should apply pressure such that the pressure sensors 305 get squeezed (or tension sensors 307 get stretched without the pressure sensors 305 being stimulated directly). For the cueing of flexibility training the user may hold the pod apparatus 300 on opposite sides using both hands with thumb and fingers and pulling the pod apparatus 300 in both directions. The pressure of holding the pod apparatus 300 on both sides and the force pulling the pod apparatus 300 apart stimulates the pressure sensors 305 as well as the tension sensors 307.

[0035] Additionally or alternatively, the accelero meter 309 and/or any accelerometers disposed in the client device 102 may be used to assist in the calculation of caloric/energy expenditure and/or may be used to prompt the start and end of cardio training or activities. Particularly, a specific shaking pattern of the pod apparatus 300 and/or client device 102 indicates that the user is about to start doing a particular training activity (i.e., cardio training). Although this specific interaction may use the sensors that actually measure the activity counts that are converted to calorie expenditure, these sensors can serve the additional function of triggering the start of an event or activity.

[0036] Additionally, the termination of each activity class is triggered by repeating the same interaction as for the initialization of the activity class using either the activity monitor 102 and/or the pod apparatus 300. The activity in between the start and end marker enjoys dedicated processing; the calculation of energy expenditure according to an accurate algorithm associated for that particular activity detected.

[0037] The representation of the corrected calorie/energy expenditure as well as the actual labeling of the activity class may be done automatically. The feedback may occur on the client device 102 (and/or the pod apparatus 300) in the form of blinking LEDs to indicate progress and goal achievement of that day. The feedback may also occur on a web interface in the form of a graph with an automatically placed activity tag. The user may edit the timeframe and intensity of the activity class. [0038] To provide a more personalized solution, a proposition could be made to tailor the activities the user would like to trigger rather than a broad class, as well as the type of interaction. For example, the web service could be used to indicate the user's preferences. A number of activities could be offered to choose from, each with a unique accurate algorithm of calculating energy expenditure taking into account the user's body metrics. In addition, a number of interactions with the pod apparatus 300 can be offered such that the user can relate the most fun or personally intuitive interaction with a preferred activity. Such interactions could involve using the stretch/tension sensors 307, pressure sensors 305, and accelerometer sensors 309. A whole range of stretching, squeezing, shaking, bouncing, and a combinations may be implemented and assigned for each pod apparatus 300. These preferences for activities and interactions and associated algorithms may be stored in the client device 102, the pod apparatus 300, and or any other component of system 100.

[0039] While the disclosure has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments. Although, the above-described embodiments have been described as being applicable to a system for promoting a healthy lifestyle in a subject, it is envisioned that any of the above-described embodiments may be implemented in any system and may be used by any individuals not described above, for any purpose other than those described above such as other uses of measuring and registering physical activity.

[0040] Many modifications and other embodiments of the systems, methods, and devices of the present disclosure will come to mind to one skilled in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the embodiments of the present disclosure are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

[0041] Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measured cannot be used to advantage. A computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems. Any reference signs in the claims should not be construed as limiting the scope.

Claims

IN THE CLAIMS:

1. A method for calculating calorie expenditure, comprising:

determining at least one of an amount of pressure applied to an apparatus via a pressure sensor, an amount that the apparatus is stretched via a tension sensor, or an amount of movement of the apparatus via an accelerometer;

delivering data corresponding to at least one of the amount of pressure determined, the amount that the apparatus is stretched determined, or the amount of movement determined to a client device; and

calculating calorie expenditure based on the data delivered.

2. The method according to claim 1, further comprising determining a first trigger of a start of an activity based on a first preconfigured movement pattern detected by the accelerometer.

3. The method according to claim 2, further comprising determining a second trigger of an end of the activity based on a second preconfigured movement pattern detected by the accelerometer.

4. The method according to claim 3, further comprising storing the calorie expenditure calculated between the first trigger and the second trigger.

5. The method according to claim 1, further comprising wirelessly delivering the data corresponding to at least one of the amount of pressure determined, the amount that the apparatus is stretched determined, or the amount of movement determined to the client device.

6. The method according to claim 1, wherein at least one of the pressure sensor, the tension sensor, or the accelerometer is disposed within a stretchable layer.

7. The method according to claim 1, further comprising storing the data corresponding to at least one of the amount of pressure determined, the amount that the apparatus is stretched determined, or the amount of movement determined for coaching a user.

8. The method according to claim 1, further comprising displaying data corresponding to at least one of the amount of pressure determined, the amount that the apparatus is stretched determined, or the amount of movement determined on a display.

9. An apparatus for use with an activity registration system, the apparatus comprising: a stretchable layer at least partially surrounding the apparatus;

at least one of a pressure sensor configured to detect an amount of pressure applied to the apparatus, a tension sensor configured to detect an amount that the apparatus is stretched, or an accelerometer configured to detect movement of the apparatus; and

an interfacing unit configured to receive data corresponding to at least one of the amount of pressure detected by the pressure sensor, the amount that the apparatus is stretched detected by the tension sensor, or movement detected by the accelerometer and configured to deliver the data to a client device.

10. The apparatus according to claim 9, wherein the interfacing unit wirelessly transmits the data received to the client device.

11. The apparatus according to claim 9, wherein the stretchable layer is mounted onto the client device.

12. The apparatus according to claim 9, wherein at least one of the apparatus or the client device is configured to communicate with a computing device, the computing device configured to store and process the data received for coaching a user.

13. The apparatus according to claim 9, wherein manipulating the apparatus in a preconfigured manner causes the apparatus to trigger an activity.

14. The apparatus according to claim 9, wherein calorie expenditure is calculated based on the data received.

15. The apparatus according to claim 9, further comprising a display operably coupled to the stretchable layer, the display configured to display the received data.

16. A non-transitory computer readable storage medium storing a program which, when executed by a computer, causes the computer to perform a method comprising:

calculating calorie expenditure based on the data delivered.

17. The non-transitory computer readable storage medium according to claim 16, wherein the program, when executed by a computer, further causes the computer to determine a first trigger of a start of an activity based on a first preconfigured movement pattern detected by the accelerometer.

18. The non-transitory computer readable storage medium according to claim 16, wherein the program, when executed by a computer, further causes the computer to determine a second trigger of an end of an activity based on a second preconfigured movement pattern detected by the accelerometer

19. The non-transitory computer readable storage medium according to claim 16, wherein the program, when executed by a computer, further causes the computer to wirelessly deliver the data corresponding to at least one of the amount of pressure determined, the amount that the apparatus is stretched determined, or the amount of movement determined to the client device.

20. The non-transitory computer readable storage medium according to claim 16, wherein the program, when executed by a computer, further causes the computer to store the data corresponding to at least one of the amount of pressure determined, the amount that the apparatus is stretched determined, or the amount of movement determined for coaching a user.