WO2009071128A1 - Dispositif de commande avec un capteur de fréquence cardiaque et un capteur de mouvement - Google Patents

Dispositif de commande avec un capteur de fréquence cardiaque et un capteur de mouvement Download PDF

Info

Publication number
WO2009071128A1
WO2009071128A1 PCT/EP2007/063469 EP2007063469W WO2009071128A1 WO 2009071128 A1 WO2009071128 A1 WO 2009071128A1 EP 2007063469 W EP2007063469 W EP 2007063469W WO 2009071128 A1 WO2009071128 A1 WO 2009071128A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
sensor
heart rate
motion
control device
Prior art date
Application number
PCT/EP2007/063469
Other languages
English (en)
Inventor
Mario El Khoury
Rolf Vetter
Original Assignee
Csem Centre Suisse D'electronique Et De Microtechnique Sa - Recherche Et Developpement
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Csem Centre Suisse D'electronique Et De Microtechnique Sa - Recherche Et Developpement filed Critical Csem Centre Suisse D'electronique Et De Microtechnique Sa - Recherche Et Developpement
Priority to PCT/EP2007/063469 priority Critical patent/WO2009071128A1/fr
Priority to EP07847938A priority patent/EP2217338A1/fr
Publication of WO2009071128A1 publication Critical patent/WO2009071128A1/fr

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02438—Detecting, measuring or recording pulse rate or heart rate with portable devices, e.g. worn by the patient
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1118—Determining activity level
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6897—Computer input devices, e.g. mice or keyboards
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
    • A61B5/7207—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts
    • A61B5/721—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts using a separate sensor to detect motion or using motion information derived from signals other than the physiological signal to be measured
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0087—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25—Output arrangements for video game devices
    • A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6895—Sport equipment
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6896—Toys
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0087—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
    • A63B2024/0093—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load the load of the exercise apparatus being controlled by performance parameters, e.g. distance or speed
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0087—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
    • A63B2024/0096—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load using performance related parameters for controlling electronic or video games or avatars
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/40—Acceleration
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00—Measuring of physical parameters relating to sporting activity
    • A63B2220/80—Special sensors, transducers or devices therefor
    • A63B2220/803—Motion sensors
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00—Measuring physiological parameters of the user
    • A63B2230/04—Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations
    • A63B2230/06—Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations heartbeat rate only
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0686—Timers, rhythm indicators or pacing apparatus using electric or electronic means
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/90—Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
    • A63F13/92—Video game devices specially adapted to be hand-held while playing
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2250/00—Miscellaneous game characteristics
    • A63F2250/26—Miscellaneous game characteristics the game being influenced by physiological parameters
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1012—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/105—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals using inertial sensors, e.g. accelerometers, gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1068—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted to detect the point of contact of the player on a surface, e.g. floor mat, touch pad

Definitions

  • Control device with a heart rate sensor and a motion sensor
  • the present invention concerns a control device such as a handheld controller or footboard comprising a heart rate sensor and a motion sensor, able to provide a heart rate signal corrected for the user's motion artifacts and a motion signal to control an electronic game or fitness activity process.
  • a control device such as a handheld controller or footboard comprising a heart rate sensor and a motion sensor, able to provide a heart rate signal corrected for the user's motion artifacts and a motion signal to control an electronic game or fitness activity process.
  • An interactive game apparatus comprising a heart rate measurement device worn by the user and which pulse signal is transmitted to the game apparatus as a parameter for effecting an interactive game between user and game machine is known.
  • EP1275420 discloses an interactive game apparatus using the heart rate signal measured by a heart rate detection means worn by the user to interact with the game parameter such as the game time period and speed.
  • the level of difficulty of an electronic game is adjusted in response to a signal that measures the galvanic skin resistance between two points on the player's skin.
  • an electrocardiogram (ECG) sensor is attached to a player's body and produces a heart rate signal used to adjust the play of a video game, either independently or in conjunction with other game controls such as control signals from a joystick.
  • ECG electrocardiogram
  • WO2007053146 claims a method and portable device for generating a heart rate signal corrected for the user's motion contribution where the device comprises a pressure or piezoelectric sensor or a force transducer for measuring the heart rate and an accelerometer or a pressure sensor to detect the user's motion.
  • a watch-like device for monitoring a user's heart rate comprises two electrodes placed along the surface of a wrist strap, in contact with the user's skin, in order to measure changes in an electrocardiogram (ECG) signal.
  • ECG electrocardiogram
  • the device further comprises an accelerator for determining an acceleration of the user's arm and compensate for the arm movement in the heart rate signal.
  • the compensated ECG signal may be used as a parameter in computer games.
  • the accelerator signal itself, however, is not used as a game parameter.
  • An object of the invention is therefore to propose a new system and method which overcomes at least some limitations of the prior art. According to the invention, these objectives are achieved by means of a system and method comprising the features of the independent claims, preferred embodiments being indicated in the dependent claims and in the description.
  • a control device comprising a heart rate sensor for delivering a sensor signal; a signal processing device for correcting artifacts due to user's motion in said sensor signal; and a motion sensor delivering a motion reference signal.
  • the motion sensor is characterized by having a main function for providing a motion reference signal used to control a system such as an electronic game or fitness activity process and an auxiliary function where the motion reference signal is used in a signal processing device to determine from the sensor signal, a heart rate signal corrected for movement artifacts.
  • control device is a handheld controller and the heart rate signal and motion reference signal are used in combination to control an electronic game level of difficulty, speed, duration, complexity, etc.
  • control device is used for a fitness activity where the motion reference signal is used to determine the user's movement amplitude and frequency while the heart rate signal controls for example, the exercise duration and intensity.
  • the control device can be a footboard.
  • Fig. 1 shows a schematic view of the system
  • Fig.2 represents a possible setting of the control device. Detailed Description of possible embodiments of the Invention
  • FIG. 1 illustrates schematically one embodiment of the invention where a system contains a control device 1 comprising a housing 2, a heart rate sensor 3, a motion sensor 4 and a signal processing device 5.
  • the system also comprises a transfer device 6 for transferring the signals produced by the motion sensor 4 and the heart rate sensor 3 to an external console 7.
  • the control device 1 is, for example, a handheld controller which may contain operating buttons and keys for interacting with the entertainment activity process.
  • Such handheld controller can be held in one hand as, for example, the Wii remote controller or the Nunchuk, produced by Nintendo or possibly held in both hands such as, for example, the Nintendo N64 controller.
  • the heart rate sensor 3 is preferably based on an electro-optic technique, such as photoplethysmography (PPG) described in documents US7018338 and US717560.
  • PPG photoplethysmography
  • the heart pulse wave caused by the periodic pulsations of arterial blood volume is measured by the changing optical absorption of radiant energy.
  • the PPG based heart rate sensor 3 comprises an emitter, preferably an infrared light emitting device (LED), and a receiver, preferably a photodiode, for detecting the intensity of the radiant energy after propagation through the user's skin.
  • LED infrared light emitting device
  • the heart rate sensor 3 is placed on a security armband 8 which is part of the control device.
  • the emitter 9 and the receiver 10 can be placed along the security armband 8, on the side which is in contact with the user's skin.
  • the receiver 10 comprises a pair light detectors 11 disposed on each side of the emitter 9, formed by one light source, at a determined distance from the light source of the emitter 9, for example, about 10 mm.
  • Other possible arrangements of the emitter and receiver can comprise one or several light sources and light detectors respectively.
  • the spatial arrangement of the light detectors should be selected in a way to provide sufficient spatial diversity in order to remove artifacts due to tissue inhomogeneities.
  • the security armband 8 of Fig. 2 further comprises a signal acquisition module 12, into which the sensor signal is transferred, comprising, for example, an analog to digital (A/D) converter and signal filtering and shaping means.
  • the acquired signal outputted from the acquisition module 12 is transferred to the control device 1, more particularly to the signal processing device 5 through a cable 13.
  • the security armband 8 can be powered by a battery (not shown) contained in the control device 1.
  • the cable 13 can be connected to the control device 1 through a USB connector or any other type of connector.
  • the acquisition module 12 can be placed in the control device 1 or, alternatively, the functionalities of the acquisition module 12 can be performed by the signal processing device 5 located within the control device 1.
  • the sensor or acquired signal, outputted from the heart rate sensor 3 or from the acquisition module 12 respectively, is transferred to the signal processing device 5 in a wireless fashion.
  • the security armband 8 is powered with a battery contained in the security armband 8.
  • the emitter 9 and the receiver 10 are disposed on the housing 2 of the control device 1 in the parts where the user's hands are placed.
  • the heart rate sensor 3 is based on an ECG technique using at least two electric potential electrodes.
  • one electrode can be placed on the security armband 8 worn on one user's wrist and the other electrode can be disposed on another strap (not shown) worn, for example, on the other user's wrist, both electrodes being in contact with the user's skin.
  • both electrodes can be placed on the security armband 8, in a similar fashion to the apparatus described in WO2007/072239. Both electrodes can also be placed on a chest belt.
  • the electrodes can be located on the housing of the handheld controller, preferably, on areas of the housing 2 that are grabbed by the right and left hands respectively.
  • Flexible electrodes for example such as described in US20060142654, can also be integrated into the security armband and/or the strap tissue or into a garment fabric.
  • the electrodes can be connected to a comparator (not shown) for determining a difference value between the measured electric potentials at the different electrode locations.
  • the heart rate sensor 3 may comprise a signal acquisition module 12 outputting an acquired signal that is transferred to the signal processing device 5 through a cable 13 or wirelessly.
  • the heart rate sensor 3 can be based on an impedance cardiography (ICG) technique or a combination of at least two of the electro-optic technique, ECG or ICG techniques.
  • ICG impedance cardiography
  • the heart rate sensor 3 is placed on a chest belt and the sensor signal outputted by the heart rate sensor 3 is transferred wirelessly to a wristwatch, similarly to some of the heart monitoring systems proposed by Polar Electro Oy.
  • the wristwatch may comprise a visual display for displaying a heart rate and a motion sensor 4 for evaluating the user's position, speed, etc.
  • the motion sensor 4 may alternatively be placed in the user's shoes.
  • the motion sensor 4 is preferably a MEMS-based three dimensional accelerometer composed of three accelerometers disposed along three orthogonal measurement axis and providing three dimensional acceleration data representative of the acceleration to which the device is subjected.
  • the accelerometer may be of the type manufactured by the company Colibrys S. A. under reference MS 6100. It will however be appreciated that other types of accelerometers or motion detecting devices can be used provided they deliver a reliable measure of motion.
  • the motion sensor 4 could be a gyro-sensor of any suitable technology incorporating a one or two dimensional accelerometer, or a rotating or vibrating element.
  • the main function of the motion sensor 4 is to control a process in the system, here, for example, an electronic game or a fitness activity.
  • the motion sensor 4 is a three dimensional accelerometer it will detect acceleration signals along the three orthogonal measurement axis. These acceleration signals can be processed in the signal processing device 5 in order to generate a reliable motion reference signal representative of the movement, position and/or attitude of the control device and/or the user.
  • the linear acceleration output of the motion sensor 4 can be used to infer tilt of the object relative to the gravity vector by correlating tilt angles with detected linear acceleration.
  • the motion sensor 4 may include an embedded signal processor (not shown) or other type of dedicated processors for performing any desired processing of the acceleration signals output from the accelerometers therein prior to outputting signals to the signal processing device 5.
  • an embedded signal processor not shown
  • other type of dedicated processors for performing any desired processing of the acceleration signals output from the accelerometers therein prior to outputting signals to the signal processing device 5.
  • the signal processing device 5 is preferably housed within the control device 1 and can be an adequately programmed digital signal processor or DSP or a general purpose microcontroller that also controls the control device 1 .
  • an external signal processing unit 5 can be an external signal processing unit 14 located, for example, within the console 7, and linked to the control device 1 by means of a direct or wireless connection.
  • the acquired signal outputted from the acquisition module 12 is affected by movement artifacts which may prevent the direct extraction of heart rate information from this acquired signal.
  • the acquired signal is then further processed to correct it for movement artifacts.
  • a signal enhancement method exploiting the information contained in the motion reference signal is used. The method assumes that under rhythmical movements, artifacts on the acquired signal appear as harmonics of the movement frequency. The method comprises the steps below.
  • the fundamental movement frequency is extracted from the motion reference signal through one of the following technique: zero-crossing, parametric or non-parametric spectral estimation, autocorrelation, recurrence plots.
  • the fundamental movement frequency extracted in the first step is used to enhance the acquired signal.
  • a multiple notch filter can be employed to attenuate harmonics of movement contributions in the acquired signal.
  • non- parametric enhancement can be used where the movement contribution is cancelled, for example, by putting high resolution restricted discrete Fourier transform estimations at zero from nearest lower minimum to nearest upper minimum at each harmonic of movement frequency.
  • heart rate signals are extracted from the enhanced signal using a zero-crossing, parametric or non-parametric spectral estimation, autocorrelation or recurrence plot method.
  • the reliability of the heart rate signals is assessed in order to merge and/or discard heart rate signals based on a reliability indicator and provide a reliable heart rate signal corrected for motion artifacts.
  • the user's fundamental movement frequency may become synchronized with the user's heart rate. This may happen, for example, when the frequency of the steps of a jogger approaches its heart rate.
  • the fundamental movement frequency of the motion reference signal overlaps completely the heart rate component of the sensor signal and the extracted fundamental movement frequency can be used instead of the enhanced signal to estimate the user's heart rate signal.
  • the user's heart rate signal can be again estimated using the enhanced signal as in the method described above.
  • the processing method described above is performed completely in the signal processing device 5.
  • the heart rate signal is transferred to the console 7 through a wireless transfer device 6 such as Bluetooth, 802.11 UWB (ultra wide band), infrared, and the like, or through a wired connection.
  • the transfer device 6 or the wired connection can also be used to transfer the motion reference signal determined from the motion sensor 4.
  • One advantage of processing the acquired signal completely on the signal processing device 5 is that a simple signal, such as a pulse/min value, is transmitted between the control device 1 and console 7.
  • the processing of the acquired signal is completely or partially performed by the external signal processing unit 14 located within the console 7.
  • This embodiment has the advantage of offering more calculation power since a more powerful processor may be used in the console 7.
  • a more complex signal is transmitted between the control device 1 and console 7 with a transfer rate possibly slower than when a simple signal is transferred.
  • a computer program product configured to be operable on the signal processing device 5 or the external signal processing unit 14 located within the console 7, in order to carry out the processing of the acquired signal to correct the acquired signal for motion artifacts.
  • the processing is performed according to the method described above when the program is executed by said signal processing device 5 or said external signal processing unit 14.
  • the software product can be downloaded in a memory 15 associated with the signal processing device 5 or associated with the external signal processing unit 14.
  • the downloading operation can be performed using a storage reader device (not shown), such as a CD or DVD reader, etc., integrated on the console 7, or an removable storage reader device (not shown), such as an external CD or DVD reader, a USB memory key or a flash memory, connected to the console 7 or the control device 1 through a USB connector or any other type of connector.
  • a storage reader device such as a CD or DVD reader, etc.
  • an removable storage reader device such as an external CD or DVD reader, a USB memory key or a flash memory, connected to the console 7 or the control device 1 through a USB connector or any other type of connector.
  • the downloading operation can also be performed in a wireless fashion.
  • the control device 1 may further comprise an output device 16 for outputting an indication of the detected pulse rate in the form of an optical, audible signal, or other sensorial signal.
  • Such means could be a LED, a display, a buzzer, a vibrating device or any other suitable device adapted for transmitting information representative of the pulse rate measurement to the user.
  • the output device 16 may also comprise alarm means for generating an alarm when the heart rate signal reaches a determined threshold, which could be either a low or high threshold or both.
  • the motion reference signal and heart rate signal can be used in combination with an electronic game or fitness activity process.
  • a motion reference signal representative of the position and/or attitude of the controller device 1 can be used as a pointer able to interact with an object or a region on a screen of the game console 7.
  • the heart rate signal can then be used as a supplementary parameter, for example, indicating the level of excitement of the user or the level of difficulty of the activity.
  • the speed and/or duration of the activity, the complexity of the activity tasks, the type and/or number of obstacles or challenges, etc. can be adjusted in response to the heart pulse signal.
  • the motion reference signal can also be used to translate the user's movements, such as the number of steps, jumps, jogging, biking or any other movements, in a parameter in an activity involving physical exercising.
  • the user would be invited to produce a series of jumps or any other movements until his heart rate reaches a given level.
  • the motion sensor 4 would then be used to count the number of jumps, or movements, and deliver a motion signal used to obtain heart rate signal free from motion artifacts.
  • the heart rate signal and the motion reference signal can be used as parameters in a fitness activity in order to obtain optimal benefit of the fitness activity, for example, allowing the user to define his objectives such as losing weight or improving fitness.
  • requirements in movement amplitude and frequency would be adjusted in a way to ensure the user's heart rate to stay in the range of, say, 60% to 75% of his maximal heart rate during the whole fitness activity period.
  • requirements in movement amplitude and frequency would be adjusted to cause the user's heart rate to fall in different level ranges for different activity periods such as, for example :
  • the change from an activity period to another can be triggered by a combination of the motion reference signal and the user's heart rate signal.
  • These signals can be transferred through the transfer device 6 to the console 7 where, for example, the console screen would produce visual effects representative of the fitness activity level.
  • the control device 1 can be a handheld device or a portable device fixed on the user's body (waist, arm, leg, etc.).
  • the handheld or portable control device 1 can be replaced by a footboard such as, for example, a running belt or the Wii balance board produced by Nintendo.
  • the motion sensor 6 located within the running belt or footboard should be able to respond adequately to the impulsions produced by the user's feet, for example, by using a pressure sensor.
  • the motion sensor 6 could be placed in a wrist strap connected through a wire or in a wireless fashion to the footboard or, eventually, to the console. It is understood that the present invention is not limited to the exemplary embodiments described above and other examples of implementations are also possible within the scope of the patent claims.
  • control device 1 can be a steering wheel with the heart sensor 3 installed on areas of the steering wheel that is grabbed by the right hand and/or left hand, such as described in EP1749477.
  • the motion sensor 4, placed within the steering wheel would then sense the rotational and lateral movements of the steering wheel.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Public Health (AREA)
  • Physics & Mathematics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Cardiology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Physiology (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)

Abstract

L'invention porte sur un système qui comporte un capteur de fréquence cardiaque (3) pour émettre un signal de capteur ; un dispositif de traitement de signal (5) pour corriger des artéfacts dus au mouvement de l'utilisateur dans ledit signal de capteur ; et un capteur de mouvement (4) émettant un signal de référence de mouvement, le capteur de mouvement (4) étant caractérisé par le fait qu'il possède une fonction principale de commande d'un procédé dans ledit système et une fonction auxiliaire de commande dudit dispositif de traitement de signal (5).
PCT/EP2007/063469 2007-12-06 2007-12-06 Dispositif de commande avec un capteur de fréquence cardiaque et un capteur de mouvement WO2009071128A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/EP2007/063469 WO2009071128A1 (fr) 2007-12-06 2007-12-06 Dispositif de commande avec un capteur de fréquence cardiaque et un capteur de mouvement
EP07847938A EP2217338A1 (fr) 2007-12-06 2007-12-06 Dispositif de commande avec un capteur de fréquence cardiaque et un capteur de mouvement

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2007/063469 WO2009071128A1 (fr) 2007-12-06 2007-12-06 Dispositif de commande avec un capteur de fréquence cardiaque et un capteur de mouvement

Publications (1)

Publication Number Publication Date
WO2009071128A1 true WO2009071128A1 (fr) 2009-06-11

Family

ID=39708727

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2007/063469 WO2009071128A1 (fr) 2007-12-06 2007-12-06 Dispositif de commande avec un capteur de fréquence cardiaque et un capteur de mouvement

Country Status (2)

Country Link
EP (1) EP2217338A1 (fr)
WO (1) WO2009071128A1 (fr)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100262012A1 (en) * 2009-04-14 2010-10-14 Feng Wu Method for a medical diagnostic ultrasound system to save power and the medical diagnostic ultrasound system
WO2012152305A1 (fr) * 2011-05-06 2012-11-15 Sony Ericsson Mobile Communications Ab Dispositif sans fil de détection et d'utilisation d'un signal cardiaque
US8332544B1 (en) 2010-03-17 2012-12-11 Mattel, Inc. Systems, methods, and devices for assisting play
WO2013166446A1 (fr) * 2012-05-03 2013-11-07 Physio-Control, Inc. Mécanisme de filtrage permettant d'éliminer des artéfacts de compression thoracique d'un signal d'entrée, procédé d'utilisation correspondant et dispositif de compression thoracique mécanique
JP2014140470A (ja) * 2013-01-23 2014-08-07 Kyocera Corp 携帯電子機器、診断方法、および診断プログラム
US8903498B2 (en) 2012-03-27 2014-12-02 Physio-Control, Inc. System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery
US8942796B2 (en) * 2012-08-17 2015-01-27 Fujitsu Limited Exercise determination method, and electronic device
US9538931B2 (en) 2012-03-27 2017-01-10 Physio-Control, Inc. Reducing electrocardiogram artifacts during and post CPR
US9545211B2 (en) 2012-03-27 2017-01-17 Physio-Control, Inc. System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery
US9826938B2 (en) 2014-10-29 2017-11-28 Microsoft Technology Licensing, Llc Motion compensation for optical heart rate sensors
US10542925B2 (en) 2012-02-28 2020-01-28 Koninklijke Philips N.V. Device and method for monitoring vital signs
CN113995389A (zh) * 2020-07-28 2022-02-01 华为技术有限公司 一种获得心率的方法及电子设备
US11998340B2 (en) 2020-10-01 2024-06-04 Physio-Control, Inc. System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US717560A (en) 1902-04-02 1903-01-06 Henry C Emrich Closure for storing and dispensing vessels.
US5001632A (en) * 1989-12-22 1991-03-19 Hall Tipping Justin Video game difficulty level adjuster dependent upon player's aerobic activity level during exercise
EP0674927A1 (fr) 1994-03-31 1995-10-04 AT&T Corp. Jeu électronique utilisant des signaux biologiques
EP0890338A1 (fr) 1996-01-31 1999-01-13 Federal Patent Corporation Appareil de jeu vidéo
WO2002102469A1 (fr) * 2001-06-14 2002-12-27 Exertris Limited Appareil d'exercice
EP1275420A1 (fr) 2001-07-09 2003-01-15 Huang-Tung Chang Appareil de jeu interactif en utilisant des paramètres relatifs à l'utilisateur de l'appareil d'exercice
US7018338B2 (en) 2001-09-28 2006-03-28 Csem Centre Suisse D'electronique Et De Microtechnique Sa Method and device for pulse rate detection
US20060142654A1 (en) 2004-12-28 2006-06-29 Polar Electro Oy Sensor system, garment and heart rate monitor
WO2007053146A1 (fr) 2005-11-03 2007-05-10 Georgia State University Research Foundation Inc. Procedes, systemes et dispositif permettant de mesurer la frequence du pouls
WO2007072239A2 (fr) 2005-12-19 2007-06-28 Koninklijke Philips Electronics N.V. Appareil destiné à surveiller la fréquence cardiaque et/ou une variation de fréquence cardiaque d'une personne, et montre-bracelet comprenant cet appareil
US20070219059A1 (en) * 2006-03-17 2007-09-20 Schwartz Mark H Method and system for continuous monitoring and training of exercise

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL120507A (en) * 1997-03-24 2001-06-14 Keytron Electronics & Technolo Exercise monitoring system
US20070142715A1 (en) * 2005-12-20 2007-06-21 Triage Wireless, Inc. Chest strap for measuring vital signs

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US717560A (en) 1902-04-02 1903-01-06 Henry C Emrich Closure for storing and dispensing vessels.
US5001632A (en) * 1989-12-22 1991-03-19 Hall Tipping Justin Video game difficulty level adjuster dependent upon player's aerobic activity level during exercise
EP0674927A1 (fr) 1994-03-31 1995-10-04 AT&T Corp. Jeu électronique utilisant des signaux biologiques
EP0890338A1 (fr) 1996-01-31 1999-01-13 Federal Patent Corporation Appareil de jeu vidéo
WO2002102469A1 (fr) * 2001-06-14 2002-12-27 Exertris Limited Appareil d'exercice
EP1275420A1 (fr) 2001-07-09 2003-01-15 Huang-Tung Chang Appareil de jeu interactif en utilisant des paramètres relatifs à l'utilisateur de l'appareil d'exercice
US7018338B2 (en) 2001-09-28 2006-03-28 Csem Centre Suisse D'electronique Et De Microtechnique Sa Method and device for pulse rate detection
US20060142654A1 (en) 2004-12-28 2006-06-29 Polar Electro Oy Sensor system, garment and heart rate monitor
WO2007053146A1 (fr) 2005-11-03 2007-05-10 Georgia State University Research Foundation Inc. Procedes, systemes et dispositif permettant de mesurer la frequence du pouls
WO2007072239A2 (fr) 2005-12-19 2007-06-28 Koninklijke Philips Electronics N.V. Appareil destiné à surveiller la fréquence cardiaque et/ou une variation de fréquence cardiaque d'une personne, et montre-bracelet comprenant cet appareil
US20070219059A1 (en) * 2006-03-17 2007-09-20 Schwartz Mark H Method and system for continuous monitoring and training of exercise

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2217338A1 *

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100262012A1 (en) * 2009-04-14 2010-10-14 Feng Wu Method for a medical diagnostic ultrasound system to save power and the medical diagnostic ultrasound system
US8332544B1 (en) 2010-03-17 2012-12-11 Mattel, Inc. Systems, methods, and devices for assisting play
WO2012152305A1 (fr) * 2011-05-06 2012-11-15 Sony Ericsson Mobile Communications Ab Dispositif sans fil de détection et d'utilisation d'un signal cardiaque
US10542925B2 (en) 2012-02-28 2020-01-28 Koninklijke Philips N.V. Device and method for monitoring vital signs
US8903498B2 (en) 2012-03-27 2014-12-02 Physio-Control, Inc. System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery
US9283400B2 (en) 2012-03-27 2016-03-15 Physio-Control, Inc. System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery
US11096616B2 (en) 2012-03-27 2021-08-24 Physio-Control, Inc. Reducing electrocardiogram artifacts during and post CPR
US9538931B2 (en) 2012-03-27 2017-01-10 Physio-Control, Inc. Reducing electrocardiogram artifacts during and post CPR
US9545211B2 (en) 2012-03-27 2017-01-17 Physio-Control, Inc. System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery
US9801561B2 (en) 2012-03-27 2017-10-31 Physio-Control, Inc. System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery
US10905344B2 (en) 2012-03-27 2021-02-02 Physio-Control, Inc. System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery
US10499824B2 (en) 2012-03-27 2019-12-10 Physio-Control, Inc. Reducing electrocardiogram artifacts during and post CPR
WO2013166446A1 (fr) * 2012-05-03 2013-11-07 Physio-Control, Inc. Mécanisme de filtrage permettant d'éliminer des artéfacts de compression thoracique d'un signal d'entrée, procédé d'utilisation correspondant et dispositif de compression thoracique mécanique
US9084545B2 (en) 2012-05-03 2015-07-21 Physio-Control, Inc. Filter mechanism for removing ECG artifact from mechanical chest compressions
US8942796B2 (en) * 2012-08-17 2015-01-27 Fujitsu Limited Exercise determination method, and electronic device
EP2949267A4 (fr) * 2013-01-23 2016-10-05 Kyocera Corp Dispositif électronique portable, procédé de diagnostic, et programme de diagnostic
JP2014140470A (ja) * 2013-01-23 2014-08-07 Kyocera Corp 携帯電子機器、診断方法、および診断プログラム
US9826938B2 (en) 2014-10-29 2017-11-28 Microsoft Technology Licensing, Llc Motion compensation for optical heart rate sensors
CN113995389A (zh) * 2020-07-28 2022-02-01 华为技术有限公司 一种获得心率的方法及电子设备
WO2022022469A1 (fr) * 2020-07-28 2022-02-03 华为技术有限公司 Procédé d'acquisition de fréquence cardiaque et dispositif électronique
CN113995389B (zh) * 2020-07-28 2023-06-02 华为技术有限公司 一种获得心率的方法及电子设备
US11998340B2 (en) 2020-10-01 2024-06-04 Physio-Control, Inc. System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery

Also Published As

Publication number Publication date
EP2217338A1 (fr) 2010-08-18

Similar Documents

Publication Publication Date Title
EP2217338A1 (fr) Dispositif de commande avec un capteur de fréquence cardiaque et un capteur de mouvement
EP2229880A1 (fr) Unité de surveillance intégrée dans un bandeau utilisant un accéléromètre
RU2428106C2 (ru) Контрольное устройство для контроля частоты сердечных сокращений и/или вариации частоты сердечных сокращений пользователя; наручные часы, содержащие такое контрольное устройство
US10220254B1 (en) Multi-sensor body movement analysis
US10758778B1 (en) Stride change detection and correction
JP5504810B2 (ja) 歩行姿勢判定装置、制御プログラム、および制御方法
EP2755551B1 (fr) Dispositif et procédé pour estimer la fréquence cardiaque d'une personne en mouvement
JP5849092B2 (ja) ストライドの生体力学的パラメータを分析するための、加速度計を実装する一体型携帯装置及び方法
JP4936479B2 (ja) 情報処理プログラム、情報処理装置、情報処理システム、および情報処理方法
ES2309455T3 (es) Dispositivo, procedimiento y programa de ordenador para determinar el nivel de actividad fisica de un ser humano.
JP2015058096A (ja) 運動支援装置及び運動支援方法、運動支援プログラム
JP2010005033A (ja) 歩行動作分析装置
EP0866949A4 (fr) Systeme et procede de mesure du mouvement
JP5742520B2 (ja) 生体情報処理装置及び生体情報処理方法
JP2003024287A (ja) 身体状態の監視装置
WO2015189687A1 (fr) Dispositif intégré pour calculer la fréquence cardiaque et l'activité corporelle avec précision
JP6158324B2 (ja) 血管異常検知装置
WO2017221248A1 (fr) Dispositif portable pour la surveillance de l'activité
US20060122521A1 (en) Electronic wristwatch-type exercise signal detecting apparatus
JP2018007979A (ja) 運動支援装置及び運動支援方法、運動支援プログラム
JP6164515B2 (ja) 移動状態測定装置、移動状態測定方法、移動状態測定プログラム
JP2013017614A (ja) 疲労判定装置
JP6970645B2 (ja) 脈拍検出方法、および、脈拍検出システム
WO2016088307A1 (fr) Dispositif d'analyse d'informations biologiques, système d'analyse d'informations biologiques, et procédé d'analyse d'informations biologiques
JP6773149B2 (ja) 脈波解析装置及び脈波解析方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07847938

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2007847938

Country of ref document: EP