EP3500167B1 - Detection of caloric intake due to digestion - Google Patents
Detection of caloric intake due to digestion Download PDFInfo
- Publication number
- EP3500167B1 EP3500167B1 EP17752116.8A EP17752116A EP3500167B1 EP 3500167 B1 EP3500167 B1 EP 3500167B1 EP 17752116 A EP17752116 A EP 17752116A EP 3500167 B1 EP3500167 B1 EP 3500167B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- respiration
- respiration signal
- activity
- subject
- sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 235000019577 caloric intake Nutrition 0.000 title claims description 42
- 238000001514 detection method Methods 0.000 title claims description 24
- 230000029087 digestion Effects 0.000 title claims description 10
- 230000029058 respiratory gaseous exchange Effects 0.000 claims description 152
- 230000000694 effects Effects 0.000 claims description 62
- 238000000034 method Methods 0.000 claims description 34
- 238000004458 analytical method Methods 0.000 claims description 29
- 230000037081 physical activity Effects 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 6
- 230000007423 decrease Effects 0.000 claims description 5
- 238000013186 photoplethysmography Methods 0.000 claims description 5
- 210000000707 wrist Anatomy 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 16
- 230000037406 food intake Effects 0.000 description 16
- 230000007937 eating Effects 0.000 description 13
- 235000012631 food intake Nutrition 0.000 description 13
- 235000013305 food Nutrition 0.000 description 11
- 235000012054 meals Nutrition 0.000 description 10
- 230000000291 postprandial effect Effects 0.000 description 8
- 208000008784 apnea Diseases 0.000 description 7
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 7
- 229910052760 oxygen Inorganic materials 0.000 description 7
- 239000001301 oxygen Substances 0.000 description 7
- 230000009747 swallowing Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 208000002720 Malnutrition Diseases 0.000 description 4
- 238000004140 cleaning Methods 0.000 description 4
- 230000000875 corresponding effect Effects 0.000 description 4
- 230000001419 dependent effect Effects 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 230000003647 oxidation Effects 0.000 description 4
- 238000007254 oxidation reaction Methods 0.000 description 4
- 206010011224 Cough Diseases 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000035622 drinking Effects 0.000 description 3
- 230000037323 metabolic rate Effects 0.000 description 3
- 230000000241 respiratory effect Effects 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 235000000824 malnutrition Nutrition 0.000 description 2
- 230000001071 malnutrition Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 208000015380 nutritional deficiency disease Diseases 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 210000003296 saliva Anatomy 0.000 description 2
- 238000010183 spectrum analysis Methods 0.000 description 2
- 235000000112 undernutrition Nutrition 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 208000019505 Deglutition disease Diseases 0.000 description 1
- 241000167880 Hirundinidae Species 0.000 description 1
- 206010028980 Neoplasm Diseases 0.000 description 1
- 201000002451 Overnutrition Diseases 0.000 description 1
- 210000001015 abdomen Anatomy 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000001174 ascending effect Effects 0.000 description 1
- 235000013361 beverage Nutrition 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 201000011510 cancer Diseases 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001079 digestive effect Effects 0.000 description 1
- 230000020595 eating behavior Effects 0.000 description 1
- 238000002567 electromyography Methods 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 208000000122 hyperventilation Diseases 0.000 description 1
- 230000000870 hyperventilation Effects 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 210000003097 mucus Anatomy 0.000 description 1
- 235000016709 nutrition Nutrition 0.000 description 1
- 230000035764 nutrition Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 235000020823 overnutrition Nutrition 0.000 description 1
- 230000001590 oxidative effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 210000003800 pharynx Anatomy 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 102000004169 proteins and genes Human genes 0.000 description 1
- 108090000623 proteins and genes Proteins 0.000 description 1
- 230000002685 pulmonary effect Effects 0.000 description 1
- 230000036387 respiratory rate Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 235000021055 solid food Nutrition 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000009469 supplementation Effects 0.000 description 1
- 238000012706 support-vector machine Methods 0.000 description 1
- 230000004083 survival effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000009423 ventilation Methods 0.000 description 1
- 230000037221 weight management Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/113—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb occurring during breathing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
- A61B5/0806—Detecting, measuring or recording devices for evaluating the respiratory organs by whole-body plethysmography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
- A61B5/0816—Measuring devices for examining respiratory frequency
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1118—Determining activity level
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4866—Evaluating metabolism
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/683—Means for maintaining contact with the body
- A61B5/6831—Straps, bands or harnesses
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
- A61B5/7207—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts
- A61B5/721—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts using a separate sensor to detect motion or using motion information derived from signals other than the physiological signal to be measured
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
- A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/113—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb occurring during breathing
- A61B5/1135—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb occurring during breathing by monitoring thoracic expansion
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6813—Specially adapted to be attached to a specific body part
- A61B5/6824—Arm or wrist
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
Definitions
- the present invention relates to a device, system and method for detecting caloric intake due to digestion.
- Caloric intake i.e. food/drink intake
- Food intake reporting is also a problem area in the field of elderly care. Additionally, it is relevant for new-born nutrition and some patients categories such as cancer patients, where malnutrition is a primary determinant of low survival.
- malnutrition is a primary determinant of low survival.
- it is at the moment not assessable via an unobtrusive effortless method. Users are asked to indicate when they ingest anything and often to detail what they ingest. This is a cumbersome and time-consuming procedure which suffers of underreporting and poor adherence.
- US 2015/080672 A1 discloses a wearable breathing sensor, such as a piezoelectric chest belt system, for generating a breathing signal that is analyzed by a classifier to identify apnea patterns indicating that the subject has swallowed during breathing. These breathing signals are computer-analyzed to extract inferences regarding the subject's eating and drinking patterns and thereby provide data for monitoring food or beverage intake for remote health monitoring.
- a wearable breathing sensor such as a piezoelectric chest belt system
- DONG BO ET AL "Wearable sensing for liquid intake monitoring via apnea detection in breathing signals” BIOMEDICAL ENGINEERING LETTERS, THE KOREAN SOCIETY OF MEDICAL AND BIOLOGICAL ENGINEERING, KOREA, vol. 4, no. 4, 11 October 2014 (2014-10-11), pages 378-387 , describes a system that works based on the observation that a person's otherwise continuous breathing process is interrupted by a short apnea when a swallow occurs as a part of the intake process and that detects the swallows via recognizing apneas extracted from breathing signal captured by a wearable sensor chest-belt.
- JOHN SMITH ET AL "Coordination of Eating, Drinking and Breathing in Adults", CHEST, vol. 96, no. 3, 1 September 1989 (1989-09-01), pages 578-582 , describes a study of the coordination of breathing and swallowing at rest as well as during eating and drinking. Ventilation was monitored using respiratory inductive plethysmography and swallowing was recorded by submental electromyogram.
- KAREN M. HIIEMAE ET AL "Eating and Breathing: Interactions Between Respiration and Feeding on Solid Food", DYSPHAGIA, vol. 18, no. 3, 1 August 2003 (2003-08-01), pages 169-178 , describes a study to determine how eating, especially bolus formation in the pharynx, affects respiration. Nasal air pressures, masseter electromyography (EMG), and videofluorography (VFG) were examined.
- EMG masseter electromyography
- VFG videofluorography
- a device for detecting caloric intake due to digestion is presented as defined in the independent claim 1.
- a computer program which comprises program code means for causing a computer to perform the steps of the method as claimed in claim 7 when said computer program is carried out on a computer.
- the present invention is based on the idea that more oxygen is needed when the caloric content of foods and/or drinks (i.e. regardless if solid or fluid) is broken down and oxidized to provide energy. Consequently, the living being breathes deeper (leading to increased amplitude) and/or faster (leading to increased frequency / decreased inter-breath intervals), which eventually determines an alteration in respiratory rate variability.
- This idea is exploited by the present invention to detect when caloric intake occurs by evaluating respiration signal features (in the frequency domain), in particular changes of such respiration signal features, which are related to changes in oxidation.
- respiration signal features in the frequency domain
- the commonly used user-dependent subjective food/drink intake self-report is thus replaced by an automatic unobtrusive approach based on respiration signal features, e.g. respiration patterns.
- respiration signal features shall be understood as a statistically or, more generally, a mathematically derived parameter, which describes a typical behavior present in the signal.
- respiration signal features are: the dominant frequency, the amplitude of the signal corresponding to the dominant frequency, mean distance between the breaths, the variance of the distances between the breaths, etc.
- the present invention does not require detecting swallowing events. Additionally, detecting swallowing would be confused by artifacts such as talking, coughing, etc. According to the present invention, these types of artifacts are filtered out. Different from US 2015/080672 A1 , the present invention looks into stable breathing patterns, which are representing how respiration is characterized over a certain period of time. This is an advantage compared to swallowing detection since the latter would always require high quality respiration waves in order to catheterize the morphology of the signal. According to the present invention the high accuracy morphology is not needed, even though it could optionally be used. Known methods look at swallowing and/or apnea events associated with caloric intake.
- respiration signal features are obtained from the respiration signal and an analysis unit is configured to determine one or more of the dominant frequency, the inter-breath interval length and amplitude of the respiration signal as one or more respiration signal features.
- said analysis unit is configured to use one or more feature thresholds for detecting changes of the one or more determined respiration signal features.
- one of more features values may be compared with thresholds to detect changes.
- the features thresholds may be determined in advance, e.g. through measurements or simulations.
- Feature thresholds may be defined in general for all subjects, or may be assigned to groups of subjects (e.g. according to criteria like weight, age, gender, health condition, etc.), or may even defined individually for a monitored subject (e.g. after a training phase of the system).
- said analysis unit is configured to select subsequent time windows, in particular overlapping time windows, of the obtained respiration signal for the analysis by the analysis unit and to detect changes of the one or more determined respiration signal features among selected subsequent time windows. In this way, changes of one or more respiration signal feature from one time window to the next time window are comparable in a better way.
- the device comprises an activity input for obtaining activity data indicating a subject's physical activity and said analysis unit is configured to select time windows for the analysis based on the activity data. Since activity may distort or tamper the respiration signal and the detection of respiration signal features, the activity data will help to select appropriate time windows in which the respiration signal is not distorted or tampered by subject activity (such as walking around or running).
- the analysis unit is thus configured to select time windows in which the activity data indicate no activity or an activity related to caloric food intake or an activity below a predetermined intensity. For instance, if the subject is sitting still or is only slowly moving the upper part of the body while sitting and eating, the activity data will indicate no or only low-level activity so that time windows of the respiration signal during such periods can be used for the analysis, while time windows during which the subject walks around in the room while eating will be excluded from the analysis.
- the analysis unit may also be configured to determine the duration of the time windows based on the intensity and duration of a detected activity.
- the physical activity e.g. through a physical activity classifier
- unreliable elevated respiration values non linkable to caloric intake can be removed.
- intensity and duration of the activity may be used to determine the level of hyperventilation (elevated respiration) and recovery time. Based on this information the duration of the time windows may be selected appropriately.
- respiration waves which may be distorted by coughing or speaking, may be removed.
- the analysis unit may be configured to determine the inter-breath interval length as one respiration signal feature and to detect a post-prandial period if the inter-breath interval length decreases.
- the dominant frequency may be used additionally or alternatively, i.e. said analysis unit may be configured to determine the dominant frequency as one respiration signal feature and to detect a post-prandial period if the dominant frequency increases.
- the respiration sensor comprises a wearable sensor, in particular a respiration belt, a wrist worn sensor, an ECG sensor, or a contact photoplethysmography sensor, or a remote sensor, in particular a remote photoplethysmography sensor or a camera.
- the respiration signal can be acquired by a contact or non-contact (remote) sensor.
- the system may further comprise an activity sensor, in particular an accelerometer or a remote camera, for acquiring activity data indicating a subject's physical activity.
- an activity sensor in particular an accelerometer or a remote camera
- Both the activity sensor and the respiration sensor may be integrated into a common user device worn by the subject.
- the user device may be a smartphone, wrist watch, etc., wherein appropriate sensors are additionally provided or existing sensors (e.g. the inertial sensor as commonly provided in a smartphone) may be used to acquire a respiration signal and/or activity data.
- Fig. 1 shows a schematic diagram of an embodiment of a system 1 and a device 10 for caloric intake detection of a subject 100.
- the system 1 comprises a respiration sensor 20 for detecting a subject's respiration and for generating a respiration signal 21 indicating the subject's respiration.
- the respiration sensor 10 is a wearable sensor that is worn at the subject's body, in this example a respiration belt (e.g. band holding a piezo element as sensor to monitor movements of the chest reflecting the subject's respiration).
- Other usable wearable sensors include a wrist worn sensor, an ECG sensor, or a contact photoplethysmography sensor.
- the system 1 further comprises a device 10 for caloric intake detection based on the generated respiration signal 21.
- the device 10 includes a respiration input 11 for obtaining (i.e. receiving or retrieving the respiration signal 21 indicating the subject's respiration as acquired by the respiration sensor 20.
- a respiration input 11 for obtaining (i.e. receiving or retrieving the respiration signal 21 indicating the subject's respiration as acquired by the respiration sensor 20.
- the respiration sensor 20 may be connected to the device 10 through wires (e.g. directly or via a computer network, such as a LAN) or in a wireless manner, e.g. a communication network (e.g. UMTS, LTE, etc.) or another wireless network (e.g. WiFi, Bluetooth, Zigbee, etc.).
- the respiration input 11 may thus e.g. be a corresponding data interface, such as a Bluetooth interface, a WiFi interface, a wired terminal, etc.
- the device 10 further comprises an analysis unit 12 for analyzing the obtained respiration signal 21 by determining one or more respiration signal features and detecting changes of the one or more determined respiration signal features to detect periods of caloric intake by the subject. This will be explained in more detail below, for instance with reference to Figs. 3 to 5 .
- the analysis unit 12 may e.g. be implemented in hard- and/or software, as one or more programmed processors or computers (e.g. a hospital workstation, a caregiver's PC, etc.) or as an application running on a user device (e.g. a smartphone, laptop, tablet, etc.).
- the device 10 may further comprise an output 13 for issuing a caloric intake information that indicates detected information about the subject's caloric intake, such as the number and periods of intake within a certain time frame (e.g. during a whole day) or eating behaviors (e.g. eating frequency).
- the output 13 may e.g. an output interface for communicating the caloric intake information, to a remote destination, e.g. a nurse's user device, a central supervision monitor, etc., or may be a user interface, like a display and/or loudspeaker, that directly issues (visible and/or audible) the caloric intake information, e.g. as a table or diagram.
- an alarm notice may be issued if it is found that the caloric intake, e.g. of an elderly person or a patient, was much too low over a certain period so that e.g. a caregiver is notified to take care of this situation.
- Fig. 2 shows a schematic diagram of an embodiment of a system 2 and a device 30 according to the present invention.
- the system 2 comprises a remote sensor 22 as respiration sensor, in particular a camera for acquiring video data of the subject 100. From the movements of the chest or belly area extracted from the video data in a commonly known way (e.g. by image processing methods) a respiration signal 23 can be derived that is provided to the respiration input 11 of the device 30.
- the system 2 comprises an activity sensor 40, in this example an accelerometer mounted to the subject's upper body (e.g. by a chest belt) for acquiring activity data 41 indicating a subject's physical activity.
- the activity sensor 40 may be mounted to other body portions, e.g. an arm, a leg, etc., or may be of a different type.
- the video data 23 acquired by the camera 22 may also be used as activity data to detect physical activity of the subject 100.
- the device 30 comprises an activity input 14 for obtaining (i.e. receiving or retrieving) the activity data 41.
- the analysis unit 12 is configured to select time windows for the analysis based on the activity data 41, i.e. to select portion of the respiration signal 21 at which the subject's activity does not or not substantially distort or tamper the respiration signal 21. This improves the accuracy of the caloric intake detection.
- a continuous unobtrusive respiration signal may be used, which can be collected by means of one or more unobtrusive wearable (s) (e.g. of a piezo respiration band, PPG watch) as well as one or more contactless sensor(s) (e.g. vital signs camera) is used here to quantify the oxygen need of a living being which is correlated with the caloric intake of the living being.
- unobtrusive wearable e.g. of a piezo respiration band, PPG watch
- contactless sensor(s) e.g. vital signs camera
- respiration is generally seen as a periodic wave signal.
- Known methods need to identify an interruption of the periodicity, generated for example by an apnea due to ingestion (in the time domain).
- Known methods are limited by the fact that apneas can be generated by several other behaviors.
- the present invention looks instead at the frequency domain, following the principle that caloric intake produced increases oxygen need.
- the consequent increases in O 2 intake is mainly achieved by a combination of changes in respiration frequency (faster), amplitude (greater), and variability in general (variability takes into account both frequency and amplitude changes). It is noted that higher O 2 demand is also induced by exercise, which is the reason why it is preferred to detect these episodes and understand when full recovery has been achieved.
- caloric intake can increase oxidation, because the body has to burn the food/drinks ingested or expend oxygen to build new protein.
- Non-caloric intake does not affect oxidation. In fact, this is a clear advantage over known approaches, which cannot recognize the difference between swallowing saliva, water, etc. from caloric intake by consumption of food and/or drinks.
- Fig. 3 shows a diagram illustrating a running spectral analysis of a respiration signal of a single subject in a pre-prandial and post-prandial phase.
- the diagram shows the power amplitude P over the frequency f at different moments in time.
- P the respiration spectral signal
- the respiration spectral signal can differ from before having consumed a meal (curves 50) to immediately after (curves 51) and again to 3 hours after the meal (curves 52).
- curves 52 were acquired with a piezo respiration band.
- This figure thus clearly proofs that the eating period can be identified.
- the difference in signal amplitude between the peak (in curve 51) and the preceding interval (curve 50) is clearly visible. By comparing these two segments it can be determined that caloric intake happened in the time frame between the time at which the respiration signal represented by curve 50 and the time at which the respiration signal represented by curve 51 have been acquired.
- respiration signal features which detect intake, are dominant frequency and respiration variability, in this case inter-breath intervals.
- a "stable breathing pattern” means respiration that is far enough from significant physical activity moments which would alter the metabolic rate.
- the level of physical activity and the duration of its effect on the metabolic rate and the respiration can e.g. be easily modeled by using a motion sensor (e.g. accelerometer).
- a motion sensor e.g. accelerometer
- the analysis of the respiration signal applied according to the present invention ill not take the input into account.
- the motion is below a certain threshold, given the motion history in terms of bout intensity and duration (which determine the time constant), the analysis will be kept on hold until the time constant determines that the effect of the activity bout over the metabolic rate and respiration is ceased.
- Fig. 4 shows a diagram illustrating the dominant frequency of a respiration signal of a subject in a pre-prandial and post-prandial phase.
- Fig. 4 particularly shows how the dominant frequency increases with digestion. These data are based on 10 subjects who had different meals ranging from 300 kcal to 900 kcal. Results are normalized for pre-meal values.
- the horizontal lines 60, 61, 62 represent the median values of the dominant frequency distributions, the boxes 63, 64 represent the standard deviations and the crosses 65 represent the outliers. As can be seen, the dominant frequency significantly increases after the meal.
- Fig. 5 shows a diagram illustrating the inter-breath interval of a subject in a pre-prandial and post-prandial phase.
- Fig. 5 particularly shows how the inter-breath interval (IBI) decreases with digestion.
- IBI inter-breath interval
- the digestive process starts in the mouth at the time when food and/or drinks are ingested.
- Caloric intake triggers an increase in the oxidative processes, which as a consequence increases oxygen uptake.
- respiration signal features in particular changes of the respiration signal in the frequency domain that are related to an increase in oxidation allowing the conclusion that caloric intake of the subject started by ingesting food and/or drinks. This can particularly be determined from time course variations of respiration signal features in the frequency domain, i.e. by monitoring the respiration signal in the frequency domain over time.
- Fig. 6 shows a schematic diagram of a third embodiment of a system 3 and a device 80 according to the present invention and corresponding signals.
- the respiration input 11 and the activity input 14 are omitted in this diagram, but the device 80 only shows the elements of the analysis unit 12 as provided in this embodiment.
- the activity classifier 81 classifies if the change in the IBI is due to a previously done physical activity, as retrieved from the activity data 41, allowing the exclusion of the subsequent time window of the respiration signal 21 from the analysis process.
- the size of the time window is chosen according to the intensity and duration of the physical activity done.
- the activity classifier 81 allows also selecting segments of the respiration signal 21 when it is stable (e.g. subject is not moving, for instance during sitting activities).
- the raw respiration signal 90 may undergo cleaning processing in a cleaning signal processing unit 82, which may include a filter 83 and a concealing unit 84 for filtering and concealing it to obtain a cleaned respiration signal 91.
- a feature extraction unit 85 one or more respiration signal features 92 are extracted from the cleaned respiration signal 91.
- a classifier 86 is provided for classification into food intake or no food intake in a certain time window.
- respiration signal may be a separate element to conceal respiration signal when this is influenced by physical activity about a certain threshold.
- a simple embodiment for the classifier 86 is a threshold driven detection: when the respiration signal feature is above a certain threshold (absolute or depending from the previous period not influenced by food intake or physical activity) the current analyzed time window is classified as subsequent a food intake event.
- the classifier 86 is implemented using a machine learning technique (e.g. a support vector machine) that can detect the food intake events from more than one respiration signal feature.
- the activity classifier 81 can help to quantify the amount of respiration signal due to the activity and filter/remove it without discharge of part of the recordings.
- Fig. 7 shows a flow chart of a first part of an embodiment of a method according to the present invention
- Fig. 8 shows a flow chart of a second part of an embodiment of a method according to the present invention.
- step S10 a measurement of the respiration signal 21 is made, of which a portion S (e.g. of 3.5 min) is treated in the next steps.
- steps S11 and S12 a short term activity signal 41a and a long term activity signal 41b are measured, which are used to detect in step S13 if an activity took place in the last X minutes and if a vigorous activity took place in the last X+Y minutes. If this is the case, the method proceeds to step S14, in which the method goes to the next portion S of the respiration signal 21, which is obtained in step S10. Otherwise, the method proceeds to step S15.
- step S15 the portion S is segmented into segments S w , e.g. subsequent windows of 10 s with 5 s overlap.
- step S16 it is checked if the segments S w are stable / not flat, e.g. by checking 25% std (S) ⁇ std(S w ) ⁇ 75% std(S) (std meaning the standard deviation).
- step S17 it is checked if the number of stable / not flat segments S w is greater than a predetermined number. If this is the case, the respiration signal features for the portion S are calculated in step S18, which are then stored in a features memory in step S19. The method then proceeds to step S14. If the check in step S17 is negative, the method directly proceeds to step S14.
- step S21 the features at the second time t2 are different from the features at the first time t1 (with a certain margin). If this is not the case, it is assumed in step S22 that there is no food intake between t1 and t2. If this is the case, it is assumed in step S23 that there is food intake between t1 and t2.
- steps S24 and S25 the first and second times t1, t2 are shifted, e.g. by (t2-t1)/2, and the method proceeds with step S20. Further, in both cases, following steps S22 and S23 it is checked in step S26 if there is another equal detection in an adjacent segment S. In the positive case, the adjacent food intake detections are grouped together in step S27, which is then stored in a food intake detections memory in step S28. In the negative case, the food intake detection is directly stored in the food intake detections memory in step S28. This ends the method.
- respiration a physiological signal
- a respiration signal contains a series of features such as dominant frequency and respiration variability derived feature, which are related to the increased oxygen need due to digestion. Respiration data is processed appropriately in order to extract such features.
- the respiration signal may be filtered to remove motion and other artifacts and unreliable parts of it may be concealed by means of an activity classifier.
- the respiration signal is used to see if from the relevant food/drink intake features such as increased in frequency and/or change in respiratory variability, intake is detected.
- the present invention can be used in many fields of application, including weight management programs, undernutrition in patients and undernutrition in elderly people.
- a computer program may be stored/distributed on a suitable non-transitory medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
- a suitable non-transitory medium such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Physiology (AREA)
- Artificial Intelligence (AREA)
- Pulmonology (AREA)
- Signal Processing (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Psychiatry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Obesity (AREA)
- Evolutionary Computation (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Hematology (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Investigating Or Analysing Biological Materials (AREA)
Description
- The present invention relates to a device, system and method for detecting caloric intake due to digestion.
- Caloric intake (i.e. food/drink intake) is a crucial piece of information in any lifestyle coaching service. It can have clinical application, such as malnutrition, overnutrition, as well as sports applications in supplementation or optimal meal timing. Food intake reporting is also a problem area in the field of elderly care. Additionally, it is relevant for new-born nutrition and some patients categories such as cancer patients, where malnutrition is a primary determinant of low survival. However, it is at the moment not assessable via an unobtrusive effortless method. Users are asked to indicate when they ingest anything and often to detail what they ingest. This is a cumbersome and time-consuming procedure which suffers of underreporting and poor adherence.
-
US 2015/080672 A1 discloses a wearable breathing sensor, such as a piezoelectric chest belt system, for generating a breathing signal that is analyzed by a classifier to identify apnea patterns indicating that the subject has swallowed during breathing. These breathing signals are computer-analyzed to extract inferences regarding the subject's eating and drinking patterns and thereby provide data for monitoring food or beverage intake for remote health monitoring. - DONG BO ET AL: "Wearable sensing for liquid intake monitoring via apnea detection in breathing signals", BIOMEDICAL ENGINEERING LETTERS, THE KOREAN SOCIETY OF MEDICAL AND BIOLOGICAL ENGINEERING, KOREA, vol. 4, no. 4, 11 October 2014 (2014-10-11), pages 378-387, describes a system that works based on the observation that a person's otherwise continuous breathing process is interrupted by a short apnea when a swallow occurs as a part of the intake process and that detects the swallows via recognizing apneas extracted from breathing signal captured by a wearable sensor chest-belt.
- JOHN SMITH ET AL: "Coordination of Eating, Drinking and Breathing in Adults", CHEST, vol. 96, no. 3, 1 September 1989 (1989-09-01), pages 578-582, describes a study of the coordination of breathing and swallowing at rest as well as during eating and drinking. Ventilation was monitored using respiratory inductive plethysmography and swallowing was recorded by submental electromyogram.
- KAREN M. HIIEMAE ET AL: "Eating and Breathing: Interactions Between Respiration and Feeding on Solid Food", DYSPHAGIA, vol. 18, no. 3, 1 August 2003 (2003-08-01), pages 169-178, describes a study to determine how eating, especially bolus formation in the pharynx, affects respiration. Nasal air pressures, masseter electromyography (EMG), and videofluorography (VFG) were examined.
- It is an object of the present invention to provide to a device, system and method for a more accurate and unobtrusive caloric intake detection.
- In a first aspect of the present invention a device for detecting caloric intake due to digestion is presented as defined in the independent claim 1.
- In a further aspect of the present invention a system for caloric intake detection is presented comprising
- a respiration sensor for detecting a subject's respiration and for generating a respiration signal indicating the subject's respiration, and
an activity sensor, in particular an accelerometer or a remote camera, for acquiring activity data indicating a subject's physical activity, - a device as defined in any one of claims 1 to 4 for caloric intake detection based on the generated respiration and the acquired activity data.
- In a further aspect of the present invention a method for automatic caloric intake detection as defined in independent claim 7 is presented.
- In yet a further aspect of the present invention, there is provided a computer program which comprises program code means for causing a computer to perform the steps of the method as claimed in claim 7 when said computer program is carried out on a computer.
- Preferred embodiments of the invention are defined in the dependent claims. It shall be understood that the claimed method, system, and computer program have similar and/or identical preferred embodiments as the claimed device, in particular as defined in the dependent claims and as disclosed herein.
- The present invention is based on the idea that more oxygen is needed when the caloric content of foods and/or drinks (i.e. regardless if solid or fluid) is broken down and oxidized to provide energy. Consequently, the living being breathes deeper (leading to increased amplitude) and/or faster (leading to increased frequency / decreased inter-breath intervals), which eventually determines an alteration in respiratory rate variability. This idea is exploited by the present invention to detect when caloric intake occurs by evaluating respiration signal features (in the frequency domain), in particular changes of such respiration signal features, which are related to changes in oxidation. The commonly used user-dependent subjective food/drink intake self-report is thus replaced by an automatic unobtrusive approach based on respiration signal features, e.g. respiration patterns.
- In this context respiration signal features shall be understood as a statistically or, more generally, a mathematically derived parameter, which describes a typical behavior present in the signal. Examples of respiration signal features are: the dominant frequency, the amplitude of the signal corresponding to the dominant frequency, mean distance between the breaths, the variance of the distances between the breaths, etc.
- Contrary to the above-cited
US 2015/080672 A1 , the present invention does not require detecting swallowing events. Additionally, detecting swallowing would be confused by artifacts such as talking, coughing, etc. According to the present invention, these types of artifacts are filtered out. Different fromUS 2015/080672 A1 , the present invention looks into stable breathing patterns, which are representing how respiration is characterized over a certain period of time. This is an advantage compared to swallowing detection since the latter would always require high quality respiration waves in order to catheterize the morphology of the signal. According to the present invention the high accuracy morphology is not needed, even though it could optionally be used. Known methods look at swallowing and/or apnea events associated with caloric intake. The limitation of these methods is the lack of a link with actual energy absorption. For instance, a subject could swallow water, or saliva or mucus, which would then be counted as caloric intake according to such known methods, whereas this would not be counted as caloric intake according to the present invention. - According to the present invention respiration signal features are obtained from the respiration signal and an analysis unit is configured to determine one or more of the dominant frequency, the inter-breath interval length and amplitude of the respiration signal as one or more respiration signal features. These features generally show significant changes when comparing them before, during and after caloric intake and thus lead to a good accuracy of caloric intake detection.
- In another embodiment said analysis unit is configured to use one or more feature thresholds for detecting changes of the one or more determined respiration signal features. Thus, one of more features values may be compared with thresholds to detect changes. The features thresholds may be determined in advance, e.g. through measurements or simulations. Feature thresholds may be defined in general for all subjects, or may be assigned to groups of subjects (e.g. according to criteria like weight, age, gender, health condition, etc.), or may even defined individually for a monitored subject (e.g. after a training phase of the system).
- In a further embodiment said analysis unit is configured to select subsequent time windows, in particular overlapping time windows, of the obtained respiration signal for the analysis by the analysis unit and to detect changes of the one or more determined respiration signal features among selected subsequent time windows. In this way, changes of one or more respiration signal feature from one time window to the next time window are comparable in a better way.
- The device according to the invention comprises an activity input for obtaining activity data indicating a subject's physical activity and said analysis unit is configured to select time windows for the analysis based on the activity data. Since activity may distort or tamper the respiration signal and the detection of respiration signal features, the activity data will help to select appropriate time windows in which the respiration signal is not distorted or tampered by subject activity (such as walking around or running).
- The analysis unit is thus configured to select time windows in which the activity data indicate no activity or an activity related to caloric food intake or an activity below a predetermined intensity. For instance, if the subject is sitting still or is only slowly moving the upper part of the body while sitting and eating, the activity data will indicate no or only low-level activity so that time windows of the respiration signal during such periods can be used for the analysis, while time windows during which the subject walks around in the room while eating will be excluded from the analysis.
- The analysis unit may also be configured to determine the duration of the time windows based on the intensity and duration of a detected activity. By use of the physical activity, e.g. through a physical activity classifier, unreliable elevated respiration values non linkable to caloric intake can be removed. Moreover, intensity and duration of the activity may be used to determine the level of hyperventilation (elevated respiration) and recovery time. Based on this information the duration of the time windows may be selected appropriately. Still further, respiration waves, which may be distorted by coughing or speaking, may be removed.
- The analysis unit may be configured to determine the inter-breath interval length as one respiration signal feature and to detect a post-prandial period if the inter-breath interval length decreases. The dominant frequency may be used additionally or alternatively, i.e. said analysis unit may be configured to determine the dominant frequency as one respiration signal feature and to detect a post-prandial period if the dominant frequency increases.
- Generally, any kind of sensor that is able to provide a respiration signal may be used. Preferably, the respiration sensor comprises a wearable sensor, in particular a respiration belt, a wrist worn sensor, an ECG sensor, or a contact photoplethysmography sensor, or a remote sensor, in particular a remote photoplethysmography sensor or a camera. Thus, the respiration signal can be acquired by a contact or non-contact (remote) sensor.
- The system may further comprise an activity sensor, in particular an accelerometer or a remote camera, for acquiring activity data indicating a subject's physical activity. Both the activity sensor and the respiration sensor may be integrated into a common user device worn by the subject. For instance, the user device may be a smartphone, wrist watch, etc., wherein appropriate sensors are additionally provided or existing sensors (e.g. the inertial sensor as commonly provided in a smartphone) may be used to acquire a respiration signal and/or activity data.
- These and other aspects of the invention will be apparent from and elucidated with reference to the embodiment(s) described hereinafter. In the following drawings
-
Fig. 1 shows a schematic diagram of an embodiment of a system and a device for caloric intake detection. -
Fig. 2 shows a schematic diagram of an embodiment of a system and a device according to the present invention, -
Fig. 3 shows a diagram illustrating a running spectral analysis of a subject in a pre-prandial and post-prandial phase, -
Fig. 4 shows a diagram illustrating the dominant frequency of a respiration signal of a subject in a pre-prandial and post-prandial phase, -
Fig. 5 shows a diagram illustrating the inter-breath interval of a subject in a pre-prandial and post-prandial phase, -
Fig. 6 shows a schematic diagram of another embodiment of a system and a device according to the present invention and corresponding signals, -
Fig. 7 shows a flow chart of a first part of an embodiment of a method according to the present invention, and -
Fig. 8 shows a flow chart of a second part of an embodiment of a method according to the present invention. -
Fig. 1 shows a schematic diagram of an embodiment of a system 1 and adevice 10 for caloric intake detection of a subject 100. - The system 1 comprises a
respiration sensor 20 for detecting a subject's respiration and for generating arespiration signal 21 indicating the subject's respiration. In this embodiment therespiration sensor 10 is a wearable sensor that is worn at the subject's body, in this example a respiration belt (e.g. band holding a piezo element as sensor to monitor movements of the chest reflecting the subject's respiration). Other usable wearable sensors include a wrist worn sensor, an ECG sensor, or a contact photoplethysmography sensor. - The system 1 further comprises a
device 10 for caloric intake detection based on the generatedrespiration signal 21. - The
device 10 includes arespiration input 11 for obtaining (i.e. receiving or retrieving therespiration signal 21 indicating the subject's respiration as acquired by therespiration sensor 20. For the communication of therespiration signal 21 to thedevice 10 generally any possible way of communication may be used. For instance, therespiration sensor 20 may be connected to thedevice 10 through wires (e.g. directly or via a computer network, such as a LAN) or in a wireless manner, e.g. a communication network (e.g. UMTS, LTE, etc.) or another wireless network (e.g. WiFi, Bluetooth, Zigbee, etc.). Therespiration input 11 may thus e.g. be a corresponding data interface, such as a Bluetooth interface, a WiFi interface, a wired terminal, etc. - The
device 10 further comprises ananalysis unit 12 for analyzing the obtainedrespiration signal 21 by determining one or more respiration signal features and detecting changes of the one or more determined respiration signal features to detect periods of caloric intake by the subject. This will be explained in more detail below, for instance with reference toFigs. 3 to 5 . Theanalysis unit 12 may e.g. be implemented in hard- and/or software, as one or more programmed processors or computers (e.g. a hospital workstation, a caregiver's PC, etc.) or as an application running on a user device (e.g. a smartphone, laptop, tablet, etc.). - The
device 10 may further comprise anoutput 13 for issuing a caloric intake information that indicates detected information about the subject's caloric intake, such as the number and periods of intake within a certain time frame (e.g. during a whole day) or eating behaviors (e.g. eating frequency). Theoutput 13 may e.g. an output interface for communicating the caloric intake information, to a remote destination, e.g. a nurse's user device, a central supervision monitor, etc., or may be a user interface, like a display and/or loudspeaker, that directly issues (visible and/or audible) the caloric intake information, e.g. as a table or diagram. In a particular application scenario an alarm notice may be issued if it is found that the caloric intake, e.g. of an elderly person or a patient, was much too low over a certain period so that e.g. a caregiver is notified to take care of this situation. -
Fig. 2 shows a schematic diagram of an embodiment of asystem 2 and adevice 30 according to the present invention. In this embodiment thesystem 2 comprises aremote sensor 22 as respiration sensor, in particular a camera for acquiring video data of the subject 100. From the movements of the chest or belly area extracted from the video data in a commonly known way (e.g. by image processing methods) arespiration signal 23 can be derived that is provided to therespiration input 11 of thedevice 30. - Additionally, the
system 2 comprises anactivity sensor 40, in this example an accelerometer mounted to the subject's upper body (e.g. by a chest belt) for acquiringactivity data 41 indicating a subject's physical activity. In other embodiments, theactivity sensor 40 may be mounted to other body portions, e.g. an arm, a leg, etc., or may be of a different type. For instance thevideo data 23 acquired by thecamera 22 may also be used as activity data to detect physical activity of the subject 100. - The
device 30 comprises anactivity input 14 for obtaining (i.e. receiving or retrieving) theactivity data 41. Generally, the same options exist for implementation of theactivity input 41 and the way of communicating the activity data that have been explained above for therespiration input 11 and therespiration data 21. Theanalysis unit 12 is configured to select time windows for the analysis based on theactivity data 41, i.e. to select portion of therespiration signal 21 at which the subject's activity does not or not substantially distort or tamper therespiration signal 21. This improves the accuracy of the caloric intake detection. - Thus, according to an embodiment of the present invention a continuous unobtrusive respiration signal may be used, which can be collected by means of one or more unobtrusive wearable (s) (e.g. of a piezo respiration band, PPG watch) as well as one or more contactless sensor(s) (e.g. vital signs camera) is used here to quantify the oxygen need of a living being which is correlated with the caloric intake of the living being.
- According to the present invention respiration is generally seen as a periodic wave signal. Known methods need to identify an interruption of the periodicity, generated for example by an apnea due to ingestion (in the time domain). Known methods are limited by the fact that apneas can be generated by several other behaviors. The present invention looks instead at the frequency domain, following the principle that caloric intake produced increases oxygen need. The consequent increases in O2 intake is mainly achieved by a combination of changes in respiration frequency (faster), amplitude (greater), and variability in general (variability takes into account both frequency and amplitude changes). It is noted that higher O2 demand is also induced by exercise, which is the reason why it is preferred to detect these episodes and understand when full recovery has been achieved.
- Thus, only caloric intake can increase oxidation, because the body has to burn the food/drinks ingested or expend oxygen to build new protein. Non-caloric intake does not affect oxidation. In fact, this is a clear advantage over known approaches, which cannot recognize the difference between swallowing saliva, water, etc. from caloric intake by consumption of food and/or drinks.
-
Fig. 3 shows a diagram illustrating a running spectral analysis of a respiration signal of a single subject in a pre-prandial and post-prandial phase. The diagram shows the power amplitude P over the frequency f at different moments in time. It can be appreciated in this diagram how the respiration spectral signal can differ from before having consumed a meal (curves 50) to immediately after (curves 51) and again to 3 hours after the meal (curves 52). These data were acquired with a piezo respiration band. This figure thus clearly proofs that the eating period can be identified. Looking at the y-axis (time) the difference in signal amplitude between the peak (in curve 51) and the preceding interval (curve 50) is clearly visible. By comparing these two segments it can be determined that caloric intake happened in the time frame between the time at which the respiration signal represented bycurve 50 and the time at which the respiration signal represented bycurve 51 have been acquired. - Examples of respiration signal features, which detect intake, are dominant frequency and respiration variability, in this case inter-breath intervals.
- The present invention generally works at rest and preferably looks into stable breathing patterns. In this context, a "stable breathing pattern" means respiration that is far enough from significant physical activity moments which would alter the metabolic rate. The level of physical activity and the duration of its effect on the metabolic rate and the respiration can e.g. be easily modeled by using a motion sensor (e.g. accelerometer). When motion is above a given threshold the analysis of the respiration signal applied according to the present invention ill not take the input into account. When the motion is below a certain threshold, given the motion history in terms of bout intensity and duration (which determine the time constant), the analysis will be kept on hold until the time constant determines that the effect of the activity bout over the metabolic rate and respiration is ceased. How to assess this time constant is generally known, e.g. from Ozyener, F., Rossiter, H. B., Ward, S. A. and Whipp, B. J. (2001), Influence of exercise intensity on the on- and off-transient kinetics of pulmonary oxygen uptake in humans. The Journal of Physiology, 533: 891-902.
-
Fig. 4 shows a diagram illustrating the dominant frequency of a respiration signal of a subject in a pre-prandial and post-prandial phase.Fig. 4 particularly shows how the dominant frequency increases with digestion. These data are based on 10 subjects who had different meals ranging from 300 kcal to 900 kcal. Results are normalized for pre-meal values. Thehorizontal lines boxes crosses 65 represent the outliers. As can be seen, the dominant frequency significantly increases after the meal. -
Fig. 5 shows a diagram illustrating the inter-breath interval of a subject in a pre-prandial and post-prandial phase.Fig. 5 particularly shows how the inter-breath interval (IBI) decreases with digestion. These data are based on the same 10 subjects who had different meals ranging from 300 kcal to 900 kcal. Results are normalized for pre-meal values. Thehorizontal lines boxes cross 75 represents an outlier. As can be seen, the IBI significantly decreases after the meal. - The digestive process starts in the mouth at the time when food and/or drinks are ingested. Caloric intake triggers an increase in the oxidative processes, which as a consequence increases oxygen uptake. According to the present invention it is exploited by analyzing respiration signal features, in particular changes of the respiration signal in the frequency domain that are related to an increase in oxidation allowing the conclusion that caloric intake of the subject started by ingesting food and/or drinks. This can particularly be determined from time course variations of respiration signal features in the frequency domain, i.e. by monitoring the respiration signal in the frequency domain over time.
-
Fig. 6 shows a schematic diagram of a third embodiment of a system 3 and adevice 80 according to the present invention and corresponding signals. Therespiration input 11 and the activity input 14 (as shown inFig. 2 ) are omitted in this diagram, but thedevice 80 only shows the elements of theanalysis unit 12 as provided in this embodiment. - The
activity classifier 81 classifies if the change in the IBI is due to a previously done physical activity, as retrieved from theactivity data 41, allowing the exclusion of the subsequent time window of therespiration signal 21 from the analysis process. The size of the time window is chosen according to the intensity and duration of the physical activity done. Theactivity classifier 81 allows also selecting segments of therespiration signal 21 when it is stable (e.g. subject is not moving, for instance during sitting activities). - The
raw respiration signal 90 may undergo cleaning processing in a cleaningsignal processing unit 82, which may include afilter 83 and a concealingunit 84 for filtering and concealing it to obtain a cleanedrespiration signal 91. In afeature extraction unit 85 one or more respiration signal features 92 are extracted from the cleanedrespiration signal 91. Finally, aclassifier 86 is provided for classification into food intake or no food intake in a certain time window. - The cleaning of the signal will be explained below in more detail with reference to
Fig. 7 . According to this cleaning step stable features will be allocated as follows: - i) It starts from a raw respiration signal x min long, long enough to assess respiration signal features, time, frequency and nonlinear;
- ii) The signal is segmented in segments long enough to contain at least 3 respiration waves, and overlap windows are used to allow removal of eventual noise.
- iii) Each segment is checked for stability (here combined with
step 2 is where things like, talking and coughing are omitted). Stability can be checked for example by looking at the standard deviation of the signal. - iv) When a minimum number of stable data (for example 50% of the total signal) are obtained, features are calculated.
- v) Values of the features calculated are memorized and these steps are repeated in loops.
- There may be a separate element to conceal respiration signal when this is influenced by physical activity about a certain threshold.
- In a subsequent process that will be explained below in more detail with reference to
Fig. 8 the following steps are taken: - i) Features are collected at different times: e.g. time 1 and
time 2. - ii) It is checked if features at time 1 and
time 2 differ. - iii) If they do not differ, it is started over with the comparison between other two data points.
- iv) If they differ, the caloric intake is detected.
- v) If the adjacent times are still the same group, then it is avoided to classify the same intake as different intake.
- A simple embodiment for the
classifier 86 is a threshold driven detection: when the respiration signal feature is above a certain threshold (absolute or depending from the previous period not influenced by food intake or physical activity) the current analyzed time window is classified as subsequent a food intake event. In another embodiment theclassifier 86 is implemented using a machine learning technique (e.g. a support vector machine) that can detect the food intake events from more than one respiration signal feature. - In another embodiment the
activity classifier 81 can help to quantify the amount of respiration signal due to the activity and filter/remove it without discharge of part of the recordings. - The feasibility of the proposed invention during free-living has been examined. Because part of the respiration signal (segments) are optionally concealed when respiration cannot be detected, is influenced by talking, is influenced by exercise, and/or is affected by artefacts, it has been analyzed what would be the minimum amount of time needed to make accurate estimation of caloric intake events, in particular of eating events. In a random and ascending order segments have been removed to appreciate the minimum time needed to detect a difference when there is a difference between phases. 1000 simulations per observation have been run in order to be able to generalize the results and found that 210 seconds is sufficient to detect an eating event. This 210 s includes a good segment before eating and after eating. Since it can be seen that respiration signal features are altered still 3 hours after a meal 3.5 min of clean data is a feasible target.
Time duration [s] left after concealing segments (1000 simulations per subject) that still allows a caloric intake detection Median Dominant Frequency ± standard deviation Subject 1 90 ± 174 Subject 2370 ± 256 Subject 3 580 ± 266 Subject 4 840 ± 273 Subject 5 90 ± 135 Subject 6 40 ± 69 Subject 7 40 ± 70 Subject 8210 ± 180 Subject 9 300 ± 225 Subject 101010 ± 288 Subject 1130 ± 118 Median 210 ± 180 -
Fig. 7 shows a flow chart of a first part of an embodiment of a method according to the present invention, andFig. 8 shows a flow chart of a second part of an embodiment of a method according to the present invention. In step S10 a measurement of therespiration signal 21 is made, of which a portion S (e.g. of 3.5 min) is treated in the next steps. In steps S11 and S12 a short term activity signal 41a and a long term activity signal 41b are measured, which are used to detect in step S13 if an activity took place in the last X minutes and if a vigorous activity took place in the last X+Y minutes. If this is the case, the method proceeds to step S14, in which the method goes to the next portion S of therespiration signal 21, which is obtained in step S10. Otherwise, the method proceeds to step S15. - In step S15 the portion S is segmented into segments Sw, e.g. subsequent windows of 10 s with 5 s overlap. In step S16 it is checked if the segments Sw are stable / not flat, e.g. by checking 25% std (S) < std(Sw) < 75% std(S) (std meaning the standard deviation). Next, in step S17 it is checked if the number of stable / not flat segments Sw is greater than a predetermined number. If this is the case, the respiration signal features for the portion S are calculated in step S18, which are then stored in a features memory in step S19. The method then proceeds to step S14. If the check in step S17 is negative, the method directly proceeds to step S14.
- As shown in
Fig. 8 , starting from the features memory (S19) features are taken at two different times t1, t2 and compared in step S20. In step S21 the features at the second time t2 are different from the features at the first time t1 (with a certain margin). If this is not the case, it is assumed in step S22 that there is no food intake between t1 and t2. If this is the case, it is assumed in step S23 that there is food intake between t1 and t2. - Further, in both cases, in steps S24 and S25 the first and second times t1, t2 are shifted, e.g. by (t2-t1)/2, and the method proceeds with step S20. Further, in both cases, following steps S22 and S23 it is checked in step S26 if there is another equal detection in an adjacent segment S. In the positive case, the adjacent food intake detections are grouped together in step S27, which is then stored in a food intake detections memory in step S28. In the negative case, the food intake detection is directly stored in the food intake detections memory in step S28. This ends the method.
- In summary, automatic detection of food ingestion via an unobtrusive method is provide to address the problem of food/drink intake automatic identification via a physiological signal, i.e. respiration, which can be collected unobtrusively. A respiration signal contains a series of features such as dominant frequency and respiration variability derived feature, which are related to the increased oxygen need due to digestion. Respiration data is processed appropriately in order to extract such features. The respiration signal may be filtered to remove motion and other artifacts and unreliable parts of it may be concealed by means of an activity classifier. When respiratory alterations are induced solely by ingestion and physical activity and/or stress can be excluded through use of the classifier, the respiration signal is used to see if from the relevant food/drink intake features such as increased in frequency and/or change in respiratory variability, intake is detected.
- The present invention can be used in many fields of application, including weight management programs, undernutrition in patients and undernutrition in elderly people.
- While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims.
- In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. A single element or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
- A computer program may be stored/distributed on a suitable non-transitory medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
- Any reference signs in the claims should not be construed as limiting the scope.
Claims (8)
- Device (10, 30, 80) for detecting caloric intak due to digestion, said device comprising:- a respiration input (11) for obtaining a respiration signal indicating the subject's respiration,- an activity input (14) for obtaining activity data indicating a subject's physical activity,- an analysis unit (12) for analyzing the obtained respiration signal byselecting time windows of the obtained respiration signal for the analysis based on the activity data, in which the activity data indicate no activity or an activity related to caloric intake or an activity below a predetermined intensity,determining one or more of dominant frequency, inter-breath interval length and amplitude of the respiration signal as respiration signal features from the obtained respiration signal,detecting one or more changes of the one or more determined respiration signal features over time, anddetecting a period as a period of caloric intake due to digestion by the subject if it has been detected during said period that the dominant frequency increases, the inter-breath interval length decreases and/or the amplitude of the respiration signal increases.
- Device as claimed in claim 1,
wherein said analysis unit (12) is configured to use one or more feature thresholds for detecting changes of the one or more determined respiration signal features. - Device as claimed in claim 1,
wherein said analysis unit (12) is configured to select subsequent time windows, in particular overlapping time windows, of the obtained respiration signal for the analysis by the analysis unit and to detect changes of the one or more determined respiration signal features among selected subsequent time windows. - Device as claimed in claim 1,
wherein said analysis unit (12) is configured to determine the duration of the time windows based on the intensity and duration of a detected activity. - System for caloric intake detection, said system comprising:- a respiration sensor (20, 22) for detecting a subject's respiration and for generating a respiration signal indicating the subject's respiration, and- an activity sensor (40), in particular an accelerometer or a remote camera, for acquiring activity data indicating a subject's physical activity,- a device (10, 30, 80) as defined in any one of claims 1 to 4 for caloric intake detection based on the generated respiration signal and the acquired activity data.
- System as claimed in claim 5,
wherein said respiration sensor (20, 22) comprises a wearable sensor, in particular a respiration belt, a wrist worn sensor, an ECG sensor, or a contact photoplethysmography sensor, or a remote sensor, in particular a remote photoplethysmography sensor or a camera. - Method for use by a computer, processor or device as claimed in any one of claims 1 to 4 for automatic caloric intake detection due to digestion, said method comprising:- obtaining a respiration signal indicating the subject's respiration,- obtaining activity data indicating a subject's physical activity,- analyzing the obtained respiration signal byselecting time windows of the obtained respiration signal for the analysis based on the activity data, in which the activity data indicate no activity or an activity related to caloric intake or an activity below a predetermined intensity,determining one or more of dominant frequency, inter-breath interval length and amplitude of the respiration signal as respiration signal features from the obtained respiration signal,detecting one or more changes of the one or more determined respiration signal features over time, anddetecting a period as a period of caloric intake due to digestion by the subject if it has been detected during said period that the dominant frequency increases, the inter-breath interval length decreases and/or the amplitude of the respiration signal increases.
- Computer program comprising program code means for causing a computer to carry out the steps of the method as claimed in claim 7 when said computer program is carried out on the computer.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP16184732 | 2016-08-18 | ||
PCT/EP2017/070549 WO2018033504A1 (en) | 2016-08-18 | 2017-08-14 | Device, system and method for caloric intake detection |
Publications (3)
Publication Number | Publication Date |
---|---|
EP3500167A1 EP3500167A1 (en) | 2019-06-26 |
EP3500167C0 EP3500167C0 (en) | 2024-06-26 |
EP3500167B1 true EP3500167B1 (en) | 2024-06-26 |
Family
ID=56740915
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17752116.8A Active EP3500167B1 (en) | 2016-08-18 | 2017-08-14 | Detection of caloric intake due to digestion |
Country Status (4)
Country | Link |
---|---|
US (1) | US11832935B2 (en) |
EP (1) | EP3500167B1 (en) |
CN (1) | CN109862828B (en) |
WO (1) | WO2018033504A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2020106318A (en) * | 2018-12-26 | 2020-07-09 | メディカルフォトニクス株式会社 | Absorbed calorie measuring device, absorbed calorie measuring method, and absorbed calorie measuring program |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006033104A1 (en) | 2004-09-22 | 2006-03-30 | Shalon Ventures Research, Llc | Systems and methods for monitoring and modifying behavior |
US8562526B2 (en) * | 2006-06-01 | 2013-10-22 | Resmed Sensor Technologies Limited | Apparatus, system, and method for monitoring physiological signs |
EP2142095A1 (en) * | 2007-05-02 | 2010-01-13 | Earlysense Ltd. | Monitoring, predicting and treating clinical episodes |
US9198621B2 (en) | 2007-06-18 | 2015-12-01 | University of Pittsburgh—of the Commonwealth System of Higher Education | Method, apparatus and system for food intake and physical activity assessment |
US8690769B2 (en) * | 2008-04-21 | 2014-04-08 | Philometron, Inc. | Metabolic energy monitoring system |
FR2940038A1 (en) | 2008-12-22 | 2010-06-25 | Rbi | Patient e.g. elderly person, deglutition monitoring system, has storage memory for storing reference data recorded using plethysmograph, and comparison unit for comparing common breathing amplitude and common breathing airflow with data |
JP5302289B2 (en) * | 2009-12-18 | 2013-10-02 | 韓國電子通信研究院 | Portable calorimeter |
CN102114321B (en) * | 2009-12-31 | 2013-05-01 | 孙大力 | Equipment for deep breath training |
US10327698B2 (en) | 2012-03-15 | 2019-06-25 | Board Of Trustees Of Michigan State University | Food intake monitoring system using apnea detection in breathing signals |
US20160232811A9 (en) * | 2012-06-14 | 2016-08-11 | Robert A. Connor | Eyewear System for Monitoring and Modifying Nutritional Intake |
US20150148632A1 (en) * | 2013-11-26 | 2015-05-28 | David Alan Benaron | Calorie Monitoring Sensor And Method For Cell Phones, Smart Watches, Occupancy Sensors, And Wearables |
WO2016038585A1 (en) | 2014-09-12 | 2016-03-17 | Blacktree Fitness Technologies Inc. | Portable devices and methods for measuring nutritional intake |
-
2017
- 2017-08-14 EP EP17752116.8A patent/EP3500167B1/en active Active
- 2017-08-14 CN CN201780050587.9A patent/CN109862828B/en active Active
- 2017-08-14 WO PCT/EP2017/070549 patent/WO2018033504A1/en unknown
- 2017-08-14 US US16/323,982 patent/US11832935B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
WO2018033504A1 (en) | 2018-02-22 |
EP3500167C0 (en) | 2024-06-26 |
EP3500167A1 (en) | 2019-06-26 |
CN109862828A (en) | 2019-06-07 |
US11832935B2 (en) | 2023-12-05 |
US20190167154A1 (en) | 2019-06-06 |
CN109862828B (en) | 2022-07-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230222887A1 (en) | Machine learning based monitoring system | |
CN111246798B (en) | Automatic detection of respiratory disorders | |
US11510613B2 (en) | Biological condition determining apparatus and biological condition determining method | |
US9336594B2 (en) | Cardiac pulse rate estimation from source video data | |
Wang et al. | Unconstrained video monitoring of breathing behavior and application to diagnosis of sleep apnea | |
JP6149515B2 (en) | Detection method, detection device, and detection program | |
CN109328034B (en) | Determining system and method for determining sleep stage of subject | |
US11547298B2 (en) | Abnormality determination apparatus and non-transitory computer readable medium storing program | |
CN106796622A (en) | Monitoring information provides apparatus and method | |
US20140330132A1 (en) | Physiological characteristic detection based on reflected components of light | |
US20150245787A1 (en) | Real-time video processing for respiratory function analysis | |
EP2844136A1 (en) | Physiological characteristic detection based on reflected components of light | |
CN108882853B (en) | Triggering measurement of physiological parameters in time using visual context | |
Peng et al. | Multimodality sensor system for long-term sleep quality monitoring | |
Grifantini | How's My Sleep?: Personal sleep trackers are gaining in popularity, but their accuracy is still open to debate | |
US10959662B2 (en) | Seizure prediction using cardiovascular features | |
JP2020506770A (en) | Method and system for detecting atrial fibrillation | |
Pouyan et al. | Sleep state classification using pressure sensor mats | |
EP3500167B1 (en) | Detection of caloric intake due to digestion | |
EP4033495A1 (en) | Activity task evaluating system, and activity task evaluating method | |
Islam et al. | Respiratory feature extraction for contactless breathing pattern recognition using a single digital camera | |
US12076161B2 (en) | Unobtrusive symptoms monitoring for allergic asthma patients | |
Datta et al. | Novel statistical post processing to improve blood pressure estimation from smartphone photoplethysmogram | |
AU2020278020A1 (en) | Non-contact identification of sleep and wake periods for elderly care | |
Tamura et al. | Preliminary study of unobtrusive monitoring to increase safety in daily living |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190318 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: KONINKLIJKE PHILIPS N.V. |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20220405 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: VERSUNI HOLDING B.V. |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20240409 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602017082812 Country of ref document: DE |
|
U01 | Request for unitary effect filed |
Effective date: 20240712 |
|
U07 | Unitary effect registered |
Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT SE SI Effective date: 20240725 |
|
U20 | Renewal fee paid [unitary effect] |
Year of fee payment: 8 Effective date: 20240826 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240626 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240927 |