EP2217338A1 - Steuervorrichtung mit einem herzfrequenzsensor und einem bewegungssensor - Google Patents
Steuervorrichtung mit einem herzfrequenzsensor und einem bewegungssensorInfo
- Publication number
- EP2217338A1 EP2217338A1 EP07847938A EP07847938A EP2217338A1 EP 2217338 A1 EP2217338 A1 EP 2217338A1 EP 07847938 A EP07847938 A EP 07847938A EP 07847938 A EP07847938 A EP 07847938A EP 2217338 A1 EP2217338 A1 EP 2217338A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- sensor
- heart rate
- motion
- control device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02438—Detecting, measuring or recording pulse rate or heart rate with portable devices, e.g. worn by the patient
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1118—Determining activity level
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6897—Computer input devices, e.g. mice or keyboards
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
- A61B5/7207—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts
- A61B5/721—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts using a separate sensor to detect motion or using motion information derived from signals other than the physiological signal to be measured
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0087—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
- A61B2562/02—Details of sensors specially adapted for in-vivo measurements
- A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6895—Sport equipment
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6896—Toys
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0087—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
- A63B2024/0093—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load the load of the exercise apparatus being controlled by performance parameters, e.g. distance or speed
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0087—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
- A63B2024/0096—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load using performance related parameters for controlling electronic or video games or avatars
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/40—Acceleration
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/80—Special sensors, transducers or devices therefor
- A63B2220/803—Motion sensors
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2230/00—Measuring physiological parameters of the user
- A63B2230/04—Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations
- A63B2230/06—Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations heartbeat rate only
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0686—Timers, rhythm indicators or pacing apparatus using electric or electronic means
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/90—Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
- A63F13/92—Video game devices specially adapted to be hand-held while playing
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2250/00—Miscellaneous game characteristics
- A63F2250/26—Miscellaneous game characteristics the game being influenced by physiological parameters
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1012—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/105—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals using inertial sensors, e.g. accelerometers, gyroscopes
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1068—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted to detect the point of contact of the player on a surface, e.g. floor mat, touch pad
Definitions
- Control device with a heart rate sensor and a motion sensor
- the present invention concerns a control device such as a handheld controller or footboard comprising a heart rate sensor and a motion sensor, able to provide a heart rate signal corrected for the user's motion artifacts and a motion signal to control an electronic game or fitness activity process.
- a control device such as a handheld controller or footboard comprising a heart rate sensor and a motion sensor, able to provide a heart rate signal corrected for the user's motion artifacts and a motion signal to control an electronic game or fitness activity process.
- An interactive game apparatus comprising a heart rate measurement device worn by the user and which pulse signal is transmitted to the game apparatus as a parameter for effecting an interactive game between user and game machine is known.
- EP1275420 discloses an interactive game apparatus using the heart rate signal measured by a heart rate detection means worn by the user to interact with the game parameter such as the game time period and speed.
- the level of difficulty of an electronic game is adjusted in response to a signal that measures the galvanic skin resistance between two points on the player's skin.
- an electrocardiogram (ECG) sensor is attached to a player's body and produces a heart rate signal used to adjust the play of a video game, either independently or in conjunction with other game controls such as control signals from a joystick.
- ECG electrocardiogram
- WO2007053146 claims a method and portable device for generating a heart rate signal corrected for the user's motion contribution where the device comprises a pressure or piezoelectric sensor or a force transducer for measuring the heart rate and an accelerometer or a pressure sensor to detect the user's motion.
- a watch-like device for monitoring a user's heart rate comprises two electrodes placed along the surface of a wrist strap, in contact with the user's skin, in order to measure changes in an electrocardiogram (ECG) signal.
- ECG electrocardiogram
- the device further comprises an accelerator for determining an acceleration of the user's arm and compensate for the arm movement in the heart rate signal.
- the compensated ECG signal may be used as a parameter in computer games.
- the accelerator signal itself, however, is not used as a game parameter.
- An object of the invention is therefore to propose a new system and method which overcomes at least some limitations of the prior art. According to the invention, these objectives are achieved by means of a system and method comprising the features of the independent claims, preferred embodiments being indicated in the dependent claims and in the description.
- a control device comprising a heart rate sensor for delivering a sensor signal; a signal processing device for correcting artifacts due to user's motion in said sensor signal; and a motion sensor delivering a motion reference signal.
- the motion sensor is characterized by having a main function for providing a motion reference signal used to control a system such as an electronic game or fitness activity process and an auxiliary function where the motion reference signal is used in a signal processing device to determine from the sensor signal, a heart rate signal corrected for movement artifacts.
- control device is a handheld controller and the heart rate signal and motion reference signal are used in combination to control an electronic game level of difficulty, speed, duration, complexity, etc.
- control device is used for a fitness activity where the motion reference signal is used to determine the user's movement amplitude and frequency while the heart rate signal controls for example, the exercise duration and intensity.
- the control device can be a footboard.
- Fig. 1 shows a schematic view of the system
- Fig.2 represents a possible setting of the control device. Detailed Description of possible embodiments of the Invention
- FIG. 1 illustrates schematically one embodiment of the invention where a system contains a control device 1 comprising a housing 2, a heart rate sensor 3, a motion sensor 4 and a signal processing device 5.
- the system also comprises a transfer device 6 for transferring the signals produced by the motion sensor 4 and the heart rate sensor 3 to an external console 7.
- the control device 1 is, for example, a handheld controller which may contain operating buttons and keys for interacting with the entertainment activity process.
- Such handheld controller can be held in one hand as, for example, the Wii remote controller or the Nunchuk, produced by Nintendo or possibly held in both hands such as, for example, the Nintendo N64 controller.
- the heart rate sensor 3 is preferably based on an electro-optic technique, such as photoplethysmography (PPG) described in documents US7018338 and US717560.
- PPG photoplethysmography
- the heart pulse wave caused by the periodic pulsations of arterial blood volume is measured by the changing optical absorption of radiant energy.
- the PPG based heart rate sensor 3 comprises an emitter, preferably an infrared light emitting device (LED), and a receiver, preferably a photodiode, for detecting the intensity of the radiant energy after propagation through the user's skin.
- LED infrared light emitting device
- the heart rate sensor 3 is placed on a security armband 8 which is part of the control device.
- the emitter 9 and the receiver 10 can be placed along the security armband 8, on the side which is in contact with the user's skin.
- the receiver 10 comprises a pair light detectors 11 disposed on each side of the emitter 9, formed by one light source, at a determined distance from the light source of the emitter 9, for example, about 10 mm.
- Other possible arrangements of the emitter and receiver can comprise one or several light sources and light detectors respectively.
- the spatial arrangement of the light detectors should be selected in a way to provide sufficient spatial diversity in order to remove artifacts due to tissue inhomogeneities.
- the security armband 8 of Fig. 2 further comprises a signal acquisition module 12, into which the sensor signal is transferred, comprising, for example, an analog to digital (A/D) converter and signal filtering and shaping means.
- the acquired signal outputted from the acquisition module 12 is transferred to the control device 1, more particularly to the signal processing device 5 through a cable 13.
- the security armband 8 can be powered by a battery (not shown) contained in the control device 1.
- the cable 13 can be connected to the control device 1 through a USB connector or any other type of connector.
- the acquisition module 12 can be placed in the control device 1 or, alternatively, the functionalities of the acquisition module 12 can be performed by the signal processing device 5 located within the control device 1.
- the sensor or acquired signal, outputted from the heart rate sensor 3 or from the acquisition module 12 respectively, is transferred to the signal processing device 5 in a wireless fashion.
- the security armband 8 is powered with a battery contained in the security armband 8.
- the emitter 9 and the receiver 10 are disposed on the housing 2 of the control device 1 in the parts where the user's hands are placed.
- the heart rate sensor 3 is based on an ECG technique using at least two electric potential electrodes.
- one electrode can be placed on the security armband 8 worn on one user's wrist and the other electrode can be disposed on another strap (not shown) worn, for example, on the other user's wrist, both electrodes being in contact with the user's skin.
- both electrodes can be placed on the security armband 8, in a similar fashion to the apparatus described in WO2007/072239. Both electrodes can also be placed on a chest belt.
- the electrodes can be located on the housing of the handheld controller, preferably, on areas of the housing 2 that are grabbed by the right and left hands respectively.
- Flexible electrodes for example such as described in US20060142654, can also be integrated into the security armband and/or the strap tissue or into a garment fabric.
- the electrodes can be connected to a comparator (not shown) for determining a difference value between the measured electric potentials at the different electrode locations.
- the heart rate sensor 3 may comprise a signal acquisition module 12 outputting an acquired signal that is transferred to the signal processing device 5 through a cable 13 or wirelessly.
- the heart rate sensor 3 can be based on an impedance cardiography (ICG) technique or a combination of at least two of the electro-optic technique, ECG or ICG techniques.
- ICG impedance cardiography
- the heart rate sensor 3 is placed on a chest belt and the sensor signal outputted by the heart rate sensor 3 is transferred wirelessly to a wristwatch, similarly to some of the heart monitoring systems proposed by Polar Electro Oy.
- the wristwatch may comprise a visual display for displaying a heart rate and a motion sensor 4 for evaluating the user's position, speed, etc.
- the motion sensor 4 may alternatively be placed in the user's shoes.
- the motion sensor 4 is preferably a MEMS-based three dimensional accelerometer composed of three accelerometers disposed along three orthogonal measurement axis and providing three dimensional acceleration data representative of the acceleration to which the device is subjected.
- the accelerometer may be of the type manufactured by the company Colibrys S. A. under reference MS 6100. It will however be appreciated that other types of accelerometers or motion detecting devices can be used provided they deliver a reliable measure of motion.
- the motion sensor 4 could be a gyro-sensor of any suitable technology incorporating a one or two dimensional accelerometer, or a rotating or vibrating element.
- the main function of the motion sensor 4 is to control a process in the system, here, for example, an electronic game or a fitness activity.
- the motion sensor 4 is a three dimensional accelerometer it will detect acceleration signals along the three orthogonal measurement axis. These acceleration signals can be processed in the signal processing device 5 in order to generate a reliable motion reference signal representative of the movement, position and/or attitude of the control device and/or the user.
- the linear acceleration output of the motion sensor 4 can be used to infer tilt of the object relative to the gravity vector by correlating tilt angles with detected linear acceleration.
- the motion sensor 4 may include an embedded signal processor (not shown) or other type of dedicated processors for performing any desired processing of the acceleration signals output from the accelerometers therein prior to outputting signals to the signal processing device 5.
- an embedded signal processor not shown
- other type of dedicated processors for performing any desired processing of the acceleration signals output from the accelerometers therein prior to outputting signals to the signal processing device 5.
- the signal processing device 5 is preferably housed within the control device 1 and can be an adequately programmed digital signal processor or DSP or a general purpose microcontroller that also controls the control device 1 .
- an external signal processing unit 5 can be an external signal processing unit 14 located, for example, within the console 7, and linked to the control device 1 by means of a direct or wireless connection.
- the acquired signal outputted from the acquisition module 12 is affected by movement artifacts which may prevent the direct extraction of heart rate information from this acquired signal.
- the acquired signal is then further processed to correct it for movement artifacts.
- a signal enhancement method exploiting the information contained in the motion reference signal is used. The method assumes that under rhythmical movements, artifacts on the acquired signal appear as harmonics of the movement frequency. The method comprises the steps below.
- the fundamental movement frequency is extracted from the motion reference signal through one of the following technique: zero-crossing, parametric or non-parametric spectral estimation, autocorrelation, recurrence plots.
- the fundamental movement frequency extracted in the first step is used to enhance the acquired signal.
- a multiple notch filter can be employed to attenuate harmonics of movement contributions in the acquired signal.
- non- parametric enhancement can be used where the movement contribution is cancelled, for example, by putting high resolution restricted discrete Fourier transform estimations at zero from nearest lower minimum to nearest upper minimum at each harmonic of movement frequency.
- heart rate signals are extracted from the enhanced signal using a zero-crossing, parametric or non-parametric spectral estimation, autocorrelation or recurrence plot method.
- the reliability of the heart rate signals is assessed in order to merge and/or discard heart rate signals based on a reliability indicator and provide a reliable heart rate signal corrected for motion artifacts.
- the user's fundamental movement frequency may become synchronized with the user's heart rate. This may happen, for example, when the frequency of the steps of a jogger approaches its heart rate.
- the fundamental movement frequency of the motion reference signal overlaps completely the heart rate component of the sensor signal and the extracted fundamental movement frequency can be used instead of the enhanced signal to estimate the user's heart rate signal.
- the user's heart rate signal can be again estimated using the enhanced signal as in the method described above.
- the processing method described above is performed completely in the signal processing device 5.
- the heart rate signal is transferred to the console 7 through a wireless transfer device 6 such as Bluetooth, 802.11 UWB (ultra wide band), infrared, and the like, or through a wired connection.
- the transfer device 6 or the wired connection can also be used to transfer the motion reference signal determined from the motion sensor 4.
- One advantage of processing the acquired signal completely on the signal processing device 5 is that a simple signal, such as a pulse/min value, is transmitted between the control device 1 and console 7.
- the processing of the acquired signal is completely or partially performed by the external signal processing unit 14 located within the console 7.
- This embodiment has the advantage of offering more calculation power since a more powerful processor may be used in the console 7.
- a more complex signal is transmitted between the control device 1 and console 7 with a transfer rate possibly slower than when a simple signal is transferred.
- a computer program product configured to be operable on the signal processing device 5 or the external signal processing unit 14 located within the console 7, in order to carry out the processing of the acquired signal to correct the acquired signal for motion artifacts.
- the processing is performed according to the method described above when the program is executed by said signal processing device 5 or said external signal processing unit 14.
- the software product can be downloaded in a memory 15 associated with the signal processing device 5 or associated with the external signal processing unit 14.
- the downloading operation can be performed using a storage reader device (not shown), such as a CD or DVD reader, etc., integrated on the console 7, or an removable storage reader device (not shown), such as an external CD or DVD reader, a USB memory key or a flash memory, connected to the console 7 or the control device 1 through a USB connector or any other type of connector.
- a storage reader device such as a CD or DVD reader, etc.
- an removable storage reader device such as an external CD or DVD reader, a USB memory key or a flash memory, connected to the console 7 or the control device 1 through a USB connector or any other type of connector.
- the downloading operation can also be performed in a wireless fashion.
- the control device 1 may further comprise an output device 16 for outputting an indication of the detected pulse rate in the form of an optical, audible signal, or other sensorial signal.
- Such means could be a LED, a display, a buzzer, a vibrating device or any other suitable device adapted for transmitting information representative of the pulse rate measurement to the user.
- the output device 16 may also comprise alarm means for generating an alarm when the heart rate signal reaches a determined threshold, which could be either a low or high threshold or both.
- the motion reference signal and heart rate signal can be used in combination with an electronic game or fitness activity process.
- a motion reference signal representative of the position and/or attitude of the controller device 1 can be used as a pointer able to interact with an object or a region on a screen of the game console 7.
- the heart rate signal can then be used as a supplementary parameter, for example, indicating the level of excitement of the user or the level of difficulty of the activity.
- the speed and/or duration of the activity, the complexity of the activity tasks, the type and/or number of obstacles or challenges, etc. can be adjusted in response to the heart pulse signal.
- the motion reference signal can also be used to translate the user's movements, such as the number of steps, jumps, jogging, biking or any other movements, in a parameter in an activity involving physical exercising.
- the user would be invited to produce a series of jumps or any other movements until his heart rate reaches a given level.
- the motion sensor 4 would then be used to count the number of jumps, or movements, and deliver a motion signal used to obtain heart rate signal free from motion artifacts.
- the heart rate signal and the motion reference signal can be used as parameters in a fitness activity in order to obtain optimal benefit of the fitness activity, for example, allowing the user to define his objectives such as losing weight or improving fitness.
- requirements in movement amplitude and frequency would be adjusted in a way to ensure the user's heart rate to stay in the range of, say, 60% to 75% of his maximal heart rate during the whole fitness activity period.
- requirements in movement amplitude and frequency would be adjusted to cause the user's heart rate to fall in different level ranges for different activity periods such as, for example :
- the change from an activity period to another can be triggered by a combination of the motion reference signal and the user's heart rate signal.
- These signals can be transferred through the transfer device 6 to the console 7 where, for example, the console screen would produce visual effects representative of the fitness activity level.
- the control device 1 can be a handheld device or a portable device fixed on the user's body (waist, arm, leg, etc.).
- the handheld or portable control device 1 can be replaced by a footboard such as, for example, a running belt or the Wii balance board produced by Nintendo.
- the motion sensor 6 located within the running belt or footboard should be able to respond adequately to the impulsions produced by the user's feet, for example, by using a pressure sensor.
- the motion sensor 6 could be placed in a wrist strap connected through a wire or in a wireless fashion to the footboard or, eventually, to the console. It is understood that the present invention is not limited to the exemplary embodiments described above and other examples of implementations are also possible within the scope of the patent claims.
- control device 1 can be a steering wheel with the heart sensor 3 installed on areas of the steering wheel that is grabbed by the right hand and/or left hand, such as described in EP1749477.
- the motion sensor 4, placed within the steering wheel would then sense the rotational and lateral movements of the steering wheel.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Biophysics (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Public Health (AREA)
- Physics & Mathematics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Medical Informatics (AREA)
- Cardiology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Physiology (AREA)
- Physical Education & Sports Medicine (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/EP2007/063469 WO2009071128A1 (en) | 2007-12-06 | 2007-12-06 | Control device with a heart rate sensor and a motion sensor |
Publications (1)
Publication Number | Publication Date |
---|---|
EP2217338A1 true EP2217338A1 (de) | 2010-08-18 |
Family
ID=39708727
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP07847938A Withdrawn EP2217338A1 (de) | 2007-12-06 | 2007-12-06 | Steuervorrichtung mit einem herzfrequenzsensor und einem bewegungssensor |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP2217338A1 (de) |
WO (1) | WO2009071128A1 (de) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101862204A (zh) * | 2009-04-14 | 2010-10-20 | Ge医疗系统环球技术有限公司 | 使超声医疗诊断系统省电的方法及超声医疗诊断系统 |
US8332544B1 (en) | 2010-03-17 | 2012-12-11 | Mattel, Inc. | Systems, methods, and devices for assisting play |
WO2012152305A1 (en) * | 2011-05-06 | 2012-11-15 | Sony Ericsson Mobile Communications Ab | Wireless device for detecting and utilizing a cardiac signal |
US10542925B2 (en) | 2012-02-28 | 2020-01-28 | Koninklijke Philips N.V. | Device and method for monitoring vital signs |
US9538931B2 (en) | 2012-03-27 | 2017-01-10 | Physio-Control, Inc. | Reducing electrocardiogram artifacts during and post CPR |
US8903498B2 (en) | 2012-03-27 | 2014-12-02 | Physio-Control, Inc. | System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery |
US9545211B2 (en) | 2012-03-27 | 2017-01-17 | Physio-Control, Inc. | System and method for electrocardiogram analysis and optimization of cardiopulmonary resuscitation and therapy delivery |
US9084545B2 (en) | 2012-05-03 | 2015-07-21 | Physio-Control, Inc. | Filter mechanism for removing ECG artifact from mechanical chest compressions |
JP6064431B2 (ja) * | 2012-08-17 | 2017-01-25 | 富士通株式会社 | 運動判定プログラム、携帯電子機器、運動判定方法及び情報処理装置 |
JP6177533B2 (ja) * | 2013-01-23 | 2017-08-09 | 京セラ株式会社 | 携帯電子機器、携帯電子機器の作動方法、および診断プログラム |
US9826938B2 (en) | 2014-10-29 | 2017-11-28 | Microsoft Technology Licensing, Llc | Motion compensation for optical heart rate sensors |
CN113995389B (zh) * | 2020-07-28 | 2023-06-02 | 华为技术有限公司 | 一种获得心率的方法及电子设备 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6132337A (en) * | 1997-03-24 | 2000-10-17 | Keytron Electronics & Technologies Ltd. | Exercise monitoring system |
US20030065269A1 (en) * | 2001-09-28 | 2003-04-03 | Csem Centre Suisse D'electronique Et De Microtechnique Sa | Method and device for pulse rate detection |
WO2007053146A1 (en) * | 2005-11-03 | 2007-05-10 | Georgia State University Research Foundation Inc. | Methods, systems and apparatus for measuring a pulse rate |
US20070142715A1 (en) * | 2005-12-20 | 2007-06-21 | Triage Wireless, Inc. | Chest strap for measuring vital signs |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US717560A (en) | 1902-04-02 | 1903-01-06 | Henry C Emrich | Closure for storing and dispensing vessels. |
US5001632A (en) * | 1989-12-22 | 1991-03-19 | Hall Tipping Justin | Video game difficulty level adjuster dependent upon player's aerobic activity level during exercise |
CA2141144A1 (en) | 1994-03-31 | 1995-10-01 | Joseph Desimone | Electronic game utilizing bio-signals |
US5672107A (en) | 1996-01-31 | 1997-09-30 | Federal Patent Corporation | Integral video game and cardio-waveform display |
JP2004528953A (ja) * | 2001-06-14 | 2004-09-24 | エキサトリス リミテッド | エクササイズ装置 |
US20030022140A1 (en) | 2001-07-09 | 2003-01-30 | Huang-Tung Chang | Interactive game apparatus by utilizing parameters related to exerciser user |
FI20045503A (fi) | 2004-12-28 | 2006-06-29 | Polar Electro Oy | Anturijärjestelmä, asuste ja sykemittari |
JP2009519737A (ja) | 2005-12-19 | 2009-05-21 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 人の心拍数及び/又は心拍数変動を監視する装置並びに同じ機能を含むリストウォッチ |
US20070219059A1 (en) * | 2006-03-17 | 2007-09-20 | Schwartz Mark H | Method and system for continuous monitoring and training of exercise |
-
2007
- 2007-12-06 EP EP07847938A patent/EP2217338A1/de not_active Withdrawn
- 2007-12-06 WO PCT/EP2007/063469 patent/WO2009071128A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6132337A (en) * | 1997-03-24 | 2000-10-17 | Keytron Electronics & Technologies Ltd. | Exercise monitoring system |
US20030065269A1 (en) * | 2001-09-28 | 2003-04-03 | Csem Centre Suisse D'electronique Et De Microtechnique Sa | Method and device for pulse rate detection |
WO2007053146A1 (en) * | 2005-11-03 | 2007-05-10 | Georgia State University Research Foundation Inc. | Methods, systems and apparatus for measuring a pulse rate |
US20070142715A1 (en) * | 2005-12-20 | 2007-06-21 | Triage Wireless, Inc. | Chest strap for measuring vital signs |
Non-Patent Citations (1)
Title |
---|
See also references of WO2009071128A1 * |
Also Published As
Publication number | Publication date |
---|---|
WO2009071128A1 (en) | 2009-06-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2009071128A1 (en) | Control device with a heart rate sensor and a motion sensor | |
EP2229880A1 (de) | Stirnbandintegrierte Überwachungseinheit mit einem Beschleunigungsmesser | |
RU2428106C2 (ru) | Контрольное устройство для контроля частоты сердечных сокращений и/или вариации частоты сердечных сокращений пользователя; наручные часы, содержащие такое контрольное устройство | |
US10220254B1 (en) | Multi-sensor body movement analysis | |
US10758778B1 (en) | Stride change detection and correction | |
JP5504810B2 (ja) | 歩行姿勢判定装置、制御プログラム、および制御方法 | |
US9770176B2 (en) | Device and method for estimating the heart rate during motion | |
JP5849092B2 (ja) | ストライドの生体力学的パラメータを分析するための、加速度計を実装する一体型携帯装置及び方法 | |
ES2309455T3 (es) | Dispositivo, procedimiento y programa de ordenador para determinar el nivel de actividad fisica de un ser humano. | |
JP2015058096A (ja) | 運動支援装置及び運動支援方法、運動支援プログラム | |
JP2010005033A (ja) | 歩行動作分析装置 | |
EP0866949A4 (de) | Vorrichtung und verfahren zur bewegungsmessung | |
JP2004298606A (ja) | 脈拍計、脈拍計の制御方法、腕時計型情報機器、制御プログラム、記録媒体、血管模擬センサおよび生体情報計測装置 | |
JP5742520B2 (ja) | 生体情報処理装置及び生体情報処理方法 | |
JP2003024287A (ja) | 身体状態の監視装置 | |
JP6158324B2 (ja) | 血管異常検知装置 | |
JP2018007979A (ja) | 運動支援装置及び運動支援方法、運動支援プログラム | |
US20060122521A1 (en) | Electronic wristwatch-type exercise signal detecting apparatus | |
JP6164515B2 (ja) | 移動状態測定装置、移動状態測定方法、移動状態測定プログラム | |
JP2013017614A (ja) | 疲労判定装置 | |
JP6970645B2 (ja) | 脈拍検出方法、および、脈拍検出システム | |
WO2016088307A1 (ja) | 生体情報解析装置、生体情報解析システム及び生体情報解析方法 | |
JP2022080503A (ja) | 装着可能な多機能生体情報検出装置 | |
JP6773149B2 (ja) | 脈波解析装置及び脈波解析方法 | |
CN219782545U (zh) | 一种可穿戴设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20100609 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK RS |
|
17Q | First examination report despatched |
Effective date: 20110209 |
|
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20180703 |