Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/0002—Inspection of images, e.g. flaw detection
  • G06T7/0012—Biomedical image inspection
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
  • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
  • A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
  • A61B5/021—Measuring pressure in heart or blood vessels
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
  • A61B5/021—Measuring pressure in heart or blood vessels
  • A61B5/02108—Measuring pressure in heart or blood vessels from analysis of pulse wave characteristics
  • A61B5/02125—Measuring pressure in heart or blood vessels from analysis of pulse wave characteristics of pulse wave propagation time
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/0002—Inspection of images, e.g. flaw detection
  • G06T7/0012—Biomedical image inspection
  • G06T7/0014—Biomedical image inspection using an image reference approach
  • G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/20—Analysis of motion
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/70—Multimodal biometrics, e.g. combining information from different biometric modalities
• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H30/00—ICT specially adapted for the handling or processing of medical images
  • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
  • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
  • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• • G—PHYSICS
  • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
  • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
  • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
  • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
  • G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
  • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
  • A61B2562/0204—Acoustic sensors
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
  • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
  • A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
  • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
  • A61B5/6898—Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2200/00—Indexing scheme for image data processing or generation, in general
  • G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/10—Image acquisition modality
  • G06T2207/10004—Still image; Photographic image
  • G06T2207/10012—Stereo images
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/10—Image acquisition modality
  • G06T2207/10024—Color image
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/20—Special algorithmic details
  • G06T2207/20021—Dividing image into blocks, subimages or windows
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/30—Subject of image; Context of image processing
  • G06T2207/30004—Biomedical image processing
  • G06T2207/30076—Plethysmography
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/30—Subject of image; Context of image processing
  • G06T2207/30004—Biomedical image processing
  • G06T2207/30088—Skin; Dermal

Definitions

• the invention relates to a method for determining vital parameters of a human body by means of a device, in particular a smart device. Furthermore, the invention relates to a device for determining vital parameters of a human body, a method for authenticating a person, and a method for detecting a reaction of a person.
• vital parameters such as pulse, blood pressure, respiratory rate, oxygen saturation, pulse wave variability and blood sugar
• these were only used for a so-called patient curve, for example in a hospital or in competitive sports. This served to monitor the patient before or after treatment to accurately document their health status and record improvement or deterioration.
• vital signs are used to document the athlete's performance and determine the success of the workout. Vital signs are used to determine if the athlete's training or diet needs to be changed.
• vital signs have become interesting and important for home diagnosis and recreational sports. For example, patients are no longer necessarily hospitalized in a hospital, but often only treated on an outpatient basis, with home-based aftercare.
• a patient must record his own pulse after treatment.
• a device which has a chest strap with sensors and a recording device.
• the chest belt sensors pick up the beats directly on the patient's chest.
• the data is then transmitted to the recording device.
• the recorder may store the data for a long-term cardiogram over several hours to days.
• the data is then read out and evaluated, for example, by medical personnel.
• the device is, however, uncomfortable for the patient to wear, since the chest belt, for example, for the long-term cardiogram must be worn without interruption. This limits the mobility of the patient and is also a hindrance to the daily laundry. Furthermore, the patient must also constantly carry the recording device with him.
• a blood pressure cuff e.g. must be worn by a patient for 24 hours
• the blood pressure cuff e.g. is pressurized every 15 minutes.
• a vital parameter commonly measured at home is blood sugar.
• Diabetics often rely on their blood sugar before and after each meal.
• the patient can decide whether self-medication with insulin is necessary.
• a device which comprises a needle, measuring strips and an evaluation unit.
• the patient pricks the needle into a fingertip to remove a drop of blood.
• the blood is then transferred by means of the measuring strip to the evaluation unit and the blood sugar is determined.
• This is on the one hand awkward and on the other hand also painful for the patient.
• chest straps are often used with sensors that transmit the signals, for example, to a sports watch or an audio device for evaluation.
• the chest strap is, in particular in order not to slip during training, attached with a high pressure on the chest of the athlete.
• the chest strap restricts the freedom of movement of the athlete and is uncomfortable due to the high contact pressure.
• the pulse wave transit time is a cardiovascular reading. This describes the time it takes for a pulse wave to travel a certain distance in the vascular system of the body.
• the most common embodiment is the measurement of the pulse wave transit time from the heart to a finger. In particular, a measurement at at least two measuring points is always necessary.
• the beginning of the pulse wave ie the time of cardiac contraction, can be determined by means of an electrocardiogram (ECG).
• ECG electrocardiogram
• R-wave the so-called R-wave or R-wave
• the signal can be detected photoplethysmographically by means of a pulse oximeter. Studies have shown that, at least over short periods, the pulse wave transit time can be used for blood pressure determination. However, a reference measurement may still be necessary for this.
• the determination of the pulse wave transit time and vital parameters thereof is known, for example, from the publications DE 96 02 010, EP 0 859 569, DE 10 2008 042 1 15 and DE 2007/000406.
• the object of the present invention is to provide a method and a device which enable a simple and cost-effective determination of vital parameters.
• the invention achieves the object by a method according to claim 1, an apparatus according to claim 18 and further by methods according to claim 27 and claim 28.
• the invention relates to a method comprising the following steps:
• Evaluation of the image data comprising a determination of a pulse wave transit time
• the recording of the sequence of image data by means of a device in particular a smart device, with at least one optical recording unit and a computing unit (also referred to as a data processing unit) is performed.
• the device may be, for example, a mobile telephone, also called a smartphone.
• Smartphones are known to be compact computers with common architecture consisting of CPU, RAM, ROM and data bus, with integrated video capture hardware (digital camera), video and I / O and communication interfaces.
• Other exemplary devices include clocks, glasses, or the like provided with a computing unit other clothing, also called smart clothing. These devices or devices are usually carried by a user for other purposes, for example, to make phone calls or retrieve information on the Internet.
• the method can be advantageously carried out with an already existing device.
• a further advantage results from the fact that, in contrast to the prior art, only one measuring location, namely a single, limited area of the skin of the human body, is necessary. In principle, any part of the skin can be used. However, it is advantageous to use a well-perfused site, since the image data thus have more informative value and a more favorable signal-to-noise ratio.
• the sequence of individual image data can be a video sequence or pure individual images in a temporal sequence.
• a video sequence contains more information that can be evaluated, thereby improving the result of the determination of the vital parameters, in particular, the accuracy is increased.
• Single images are easier to store, which is particularly advantageous in the case of a limited storage space, for example in a main memory of the arithmetic unit.
• individual images also increase the speed for determining the vital parameters since less information must be evaluated.
• the pulse wave transit time is determined from the image data by evaluating it. This can be done, for example, by recognizing the pulse wave passing through the area of the skin and an associated temporal measurement of the pulse wave velocity. In this case, for example, in an interval from an R-wave to a next R-wave, also called RR interval, can be measured.
• the vital parameters can then be determined from the pulse wave transit time thus determined.
• the pulse wave transit time and the pulse wave velocity provide information about the vessel situation. Rigid vessels with impaired vasomotor function lead to different transit times and speeds of the pulse wave. About the duration and the speed of the pulse wave can thus draw conclusions about the condition the vessel wall are hit.
• the image data of the area of the skin of the human body need not necessarily be detected directly by the optical pickup unit. It is also possible to record a pictorial representation, for example a television picture, of the area of the skin in order to carry out the vital parameter determination according to the invention.
• a pictorial representation for example a television picture
• vital parameters of a person reproduced on a television monitor can be determined.
• the method are the blood pressure measurement in the monitoring of persons, the blood pressure measurement on the skin, the blood pressure measurement and monitoring in the sleep laboratory, the blood pressure measurement in the performance diagnostics, the blood pressure measurement as a continuous measurement, for example, over several hours or days, controlling blood delivery speeds or uptake, blood purification such as dialysis, platelets, plasma.
• Blood pressure is considered one of the medical standards in the assessment of the cardiovascular situation at rest and under physical stress. The physiological limits at rest and under stress are extensively described and laid down in guidelines. However, a continuous determination of the blood pressure is currently not possible under stress, because the blood pressure can only be determined at certain times by means of a blood pressure cuff. Only through the invention, a continuous measurement is possible.
• the blood pressure is determined according to the invention from the speed of the pulse wave / the pulse wave transit time, a low transit time from the heart to the finger stands for a high blood pressure, since the vessels are set close.
• a calibration is carried out at rest and under load. Thereafter, the blood pressure can be measured continuously.
• the method according to the invention can be used in all groups of people; by non-invasive measurement, anyone can carry out the measurement without risk. Blood pressure determination over a long period of time will not only be beneficial in healthy athletes, but also in healthy athletes Risk groups eg heart patients and pregnant women possible. Users are given the opportunity to detect blood pressure peaks and situations that lead to an increase. As a result, users can avoid situations and learn to better control their blood pressure through lifestyle changes.
• the determination of the pulse wave transit time comprises the following steps:
• the subdivision of the image data in tiles can be done with variable accuracy. This depends, for example, on the size of the area of the skin from which the image data is taken. For a large area, tile splitting may be less detailed. A small area uses a variety of tiles. For example, the image data per frame are subdivided into 100 by 100 tiles, allowing distances on the skin to be determined precisely to determine the pulse wave transit time. For each tile of a frame, the color, brightness, and / or volume are determined. This gives the sequence of image data the sequence of color, brightness, and / or volume of each tile. The individual images are compared with one another in a next step in order to be able to determine a change in color, brightness and / or volume.
• a change profile ie a temporal sequence of changes is created.
• the pulse wave and its passage through the area of the skin can be determined.
• the pulse travel time is determined.
• assumptions may be made about the size of the area of the skin and about the pulse wave velocity.
• each tile is e.g. Covering 100-10,000 or more pixels causes an averaging of the color and brightness values and thus a reduction of the image noise.
• the tiles may also partially overlap each other.
• a rectangular grid of tiles has been found to be particularly practical, other arrangements of the tiles (e.g., concentric circular or spiral) are conceivable in principle.
• the tiles may be square, rectangular, circular, polygonal or otherwise geometrically shaped.
• At least one biometric feature is recognized in the image data, with the positions of the tiles being equal in relation to the at least one biometric feature in the sequence of image data.
• biometric Features eg, the detection of the position of eyes / mouth / nose / ears
• the detection of biometric Features is common practice. Reliable algorithms which are well suited for the use according to the invention exist for this purpose. Also suitable is the detection of brighter and darker zones in the tissue, which appear in the sequence of images at the recurring same coordinates.
• the lighter and darker zones change their brightness and color during the incoming pulse wave. Relative to each other, however, these zones are firmly placed in the fabric and can thus serve as a reference for the alignment of the tiles. In this way, according to the invention, an area of the skin determined for the evaluation is tracked during a movement of the body part relative to the receiving shaft.
• Tiling is also important in order to achieve the required temporal resolution in the analysis of the pulse wave.
• Common video hardware eg in smartphones, provides a frame rate of 20-50 frames per second, which corresponds to a time resolution of 50-20 ms. This is usually not enough for the purpose of determining vital parameters.
• the effective temporal resolution can be increased beyond the resolution dictated by the video hardware, since the pulse wave will be at different times (ie, with different phase ) goes through the positions of the different tiles.
• the changes in the color, brightness and / or volume values recorded at the different tiling positions can be combined according to the invention in order to determine the change profile and thus the pulse wave with a temporal resolution which is considerably higher than the frame rate of the video hardware. For example, if the area passing through the pulse wave in 100 ms in the direction of the pulse wave is divided into 100 tiles, an effective temporal resolution of up to 1 ms results. This is sufficient for a temporally very precise analysis of the pulse wave transit time and associated vital parameters (RR interval, pulse variability, etc.).
• a combined temporal / spatial evaluation of image values takes place, one for diagnostic purposes to enable sufficiently temporally resolved analysis of the pulse wave with the simplest video hardware (eg a smartphone).
• the recording unit records stereo image data. This can be done for example by the use of a second lens of a camera. These stereo image data then enable a three-dimensional modeling of the area of the skin and a determination of the volume of, for example, the tiles. The accuracy in determining the R-wave of the continuous pulse wave can thus be significantly increased.
• a particularly advantageous embodiment of the invention provides that, to record the sequence of the individual image data, the area of the skin is exposed by means of a lighting unit, in particular in a specific spectral range. Thus, the illumination of the area of the skin can be improved if, for example, the ambient light is insufficient to record image data of sufficiently high quality.
• the skin can be exposed to light in a specific spectral range, such as infrared or ultraviolet, to better absorb changes in the color or brightness of the skin.
• the spectral range can be adapted to the vital parameters to be determined. For example, to determine blood glucose, light in the active spectral range of glucose may be used, thereby increasing the accuracy of the measurement.
• the sequence of the individual image data is recorded at a distance from the area of the skin by means of the recording unit.
• the determination of the vital parameters can also be performed from a distance.
• the vital parameter can also be determined without the person being in direct contact with the device.
• the sequence of the individual image data is in direct contact with the area of the skin by means of the recording unit added. This ensures that the sequence of image data is always captured exactly by the same area.
• the sequence of the individual image data is taken into contact with the area of the skin via a pressure medium medium by means of the recording unit.
• the pressure medium medium can ensure a fixed distance between the skin and the receiving unit, on the other hand, the pressure fluid medium can exert pressure on the skin.
• the pressure on the skin influences the blood flow and thus an improvement in the accuracy of the measurement can be brought about.
• the printing medium medium can be designed to be transparent, in particular, so as not to influence the recording of the image data.
• the pressure medium medium can be arranged in an annular manner around the receiving unit, in particular around a lens of the receiving unit. In this embodiment, the pressure medium medium can exert pressure on the skin and does not hinder the recording of the image data.
• movement data of the human body are recorded by means of at least one acceleration sensor.
• the movement data allow, for example, a reconstruction of the physical stress of the person, which is taken into account in the evaluation of the image data and in the determination of the pulse wave transit time.
• the acceleration sensor can also be provided in the device.
• sound data is recorded by means of a microphone and assigned to the sequence of the individual image data. From the sound data, additional information for determining the vital parameters can be obtained. Thus, the sound of the passing pulse wave can be taken into account to determine the pulse.
• the recorded image data, acceleration data and sound data are provided with a time stamp and stored on a memory unit of the device for a long-term evaluation together with the time stamp. So that can a long-term evaluation of vital signs can be performed.
• the stored image data, acceleration data and sound data can then be read and evaluated by medical personnel, for example after several hours or days.
• the information can be transmitted, for example, via a data connection of the device to a central location.
• the blood pressure and / or the pulse can be determined.
• the pulse i. the heart rate indicates how often the heart contracts in one minute.
• heart rate is the most common factor for assessing performance.
• the heart rate limit values are described in the different age groups. However, the individual differences are very strong, as the heart rate is influenced by many factors. In addition to age, this includes the state of training, the current state of health and the influence of numerous medications. A continuous heart rate measurement therefore brings with it the opportunity to investigate numerous health issues closer. Heart rate is a key parameter in exercise control and performance diagnostics.
• oxygen saturation of the blood of the human body can be determined.
• Oxygen saturation indicates what percentage of total hemoglobin in the blood is oxygenated. Among other things, it allows statements about the effectiveness of oxygen transport, that is primarily about respiration.
• the oxygen saturation is determined photometrically according to the invention on the basis of the recorded image data in a manner known per se.
• cardiac output HMV or cardiac output (CO) is the volume of blood that is pumped from the heart to the aorta ascendens into the bloodstream in one minute The cardiac output is therefore a measure of the pumping function of the heart and thus a parameter that is very meaningful especially in the cardiac area.
• cardiac output abbreviated to CO
• the pulse wave variability can be determined. Pulse wave variability results in heart rate variability.
• the distances are defined by the chamber contraction of the heart.
• the chamber contraction In the ECG, the chamber contraction is called the R-wave, so this is also called the RR interval.
• This RR interval also changes spontaneously in rest, ie the intervals between the heart contractions differ.
• the heart action is started via a clock.
• the center of excitation in the heart is called sinus node. This is controlled by the autonomic nervous system and is therefore not subject to the voluntary influence, but the activity of the sympathetic. Physical as well as psychological stress is associated with an increase in sympathetic activity, which leads to an increase in the heart rate.
• the parasympathetic nervous system the antagonist of the sympathetic nervous system, reduces the heart rate.
• Heart rate variability has its origin in the vegetative nerve center, the measured values allow to draw conclusions about diseases of the organ system. Heart rate variability is probably even more meaningful than heart rate to detect physiological or pathological changes in the cardiovascular system at an early stage. Changes at rest and after exercise can be observed and evaluated. The following parameters may be of interest:
• rMSSD the root of the mean of the squared differences continuous RR interval.
• the optical recording unit can be fixedly mounted in the motor vehicle or at the workplace, for example, to generate a warning signal as soon as the driver or the machine operator recognizes tiredness or otherwise endangering the safety of the driver or the machine operator on the basis of the specific vital parameter (s).
• a warning signal is generated when one or more of the determined vital parameters exceeds or falls below a predetermined limit.
• the blood sugar can also be determined.
• an ear or a finger is recorded for the blood sugar measurement.
• the following can be used for the measurement: absorption, ie the absorption of energy by the glucose molecules in and under the skin from irradiated infrared light, which leads to characteristic signals in the absorption spectrum.
• scattering can be measured. Inhaled light is scattered, and the type of scattering can be used to determine the glucose content.
• polarization can be used become. Polarized light has a plane of vibration that is rotated by glucose (optical activity), resulting in the change in the angle of glucose content.
• Another method is the percutaneous measurement with the aid of a broadband laser in the mid-infrared range.
• the absorption of the laser light is measured by the glucose molecules in the blood, in particular the absorption maximum of glucose in the wavelength range of 925 nm or above can be used for this purpose.
• Other approaches include the measurement of blood sugar levels by fluorescent nanoparticles and the determination of the sugar content in the tear fluid.
• the determination of vital parameters includes the determination of a respiratory rate.
• the detected pulse wave according to the invention is superimposed by an oscillation with respect to the pulse of lower frequency, namely the respiratory rate. This superimposed oscillation can be evaluated according to the invention to determine the respiratory rate. If further parameters are included, an analysis of the respiratory volume based on the recorded image data is possible in principle.
• the invention makes it possible to implement application programs (eg so-called "apps" for smartphones, the integrated video hardware of the smartphone being used as an optical recording unit) for so-called biofeedback, whereby at least one of the continuously measured vital parameters is visualized in a suitable manner in real time and the
• the user preferably receives an optical or audible feedback indicating whether and to what extent the vital sign (s) in question are within a setpoint range or are brought into the setpoint range by the user control, for example Biofeedback
• the user control for example Biofeedback
• a control of both parameters is made possible by the biofeedback training, the user the context of Atm and heart rate recognize and learn to regulate heart rate via breathing.
• biofeedback can be used to regulate heart rate variability.
• the healthy heart is characterized in the relaxed state by a high heart rate variability. That is, the higher the state of relaxation, the higher the variability of the heart rate.
• the visual representation of the currently measured heart rate variability makes the user's own degree of relaxation visible. When carrying out relaxation processes, the user therefore has direct feedback about the effectiveness of his relaxation technique.
• the recording of the image data can be carried out in particular in the area of the face, the forehead, a hand, a finger, a palm, an ankle or the groin of the human body.
• the invention further relates to a device, in particular a smart device, for determining vital parameters of a human body comprising at least:
• an optical pickup unit adapted to receive a sequence of individual image data of a single restricted area of the skin of the human body; and - a computing unit, adapted for evaluating the image data, comprising a determination of a pulse wave transit time and arranged for determining vital parameters of the human body from the image data.
• the invention further relates to a method for authenticating a person by means of a device, in particular a smart device, with at least one optical recording unit, a computing unit and a memory unit, comprising the following steps: - recording a sequence of individual image data of a region of the skin of the human body, in particular a face, by means of the optical recording unit;
• profiles can be used which reflect the characteristic blood flow for each person. This can be done, for example, for a face.
• measurements of the vital parameters are carried out in advance by a group of persons and corresponding profiles are created. If a person of this group approaches the device for authentication, this can be positively identified. For a person who does not belong to this group, no authentication is issued accordingly.
• the authentication according to the invention is carried out by brighter and darker zones in the tissue, which appear brighter or darker at the recurring same coordinates due to the passing pulse wave. These differences in color or brightness result from the pulse waves in the arterial blood vessels.
• the evaluation can provide data on the vital condition of the person to be checked. Lifeless bodies, such as prints or copies intended to manipulate the inspection, are recognized.
• the evaluation itself can be made with each pixel in the image. Light and dark zones change their brightness and color during the incoming pulse wave. Relative to each other, these zones are firmly placed in the tissue. Only changes in blood oxygen levels will cause brightness and color changes during the RR interval in the tissue. After an interval, the brightness and color differences return to the initial state. This remains until the next pulse wave like that.
• An area of the skin determined for the evaluation is tracked during a movement of the body part. With each image obtained, from the video and or the individual image, the evaluation is then carried out based on the maximum brightness values compared to the predecessor images.
• the invention thus also relates to the authentication (or identification) of humans, e.g. for securing movable and immovable goods.
• Differentiated access controls are made possible by the evaluation of the images according to the invention.
• a complex authentication with smart cards or transponders is therefore superfluous. Only images of areas of the body, such as the face or hand, are required for authentication. For example, with a 60 fps ("frames per second") camera in a smartphone, the measurement takes about 2 to 3 seconds to manipulate, and it can not be manipulated with inanimate objects by checking a pulse wave.
• the invention also relates to a method for detecting a reaction of a person by means of a device, in particular a smart device, comprising at least one optical recording unit, a computing unit and a memory unit comprising the following steps: recording a sequence of individual image data of a region of the skin of the human body, in particular a face, by means of the optical recording unit;
• the reaction patterns describe in particular reactions of the blood flow to external influences.
• the reaction to a false statement of the person can be recognized.
• the reaction patterns are stored in advance, for example, as a significant increase in the pulse on a false statement of the person.
• a determination of the vital parameters can be determined in a comparison of the reaction patterns, if the person has made a false statement, for example.
• the invention thus makes it possible overall, simply and cost-effectively, to determine vital parameters for different applications.
• This makes the vital signs easily accessible and can be used as the basis for a variety of applications.
• the invention may provide personal vital signs for the field of telemedicine and medical applications, games, sports and leisure facilities, online games, control of equipment, machinery, equipment, and vehicles.
• Fig. 1 is a schematic representation
• Fig. 2 is a schematic representation
• FIG. 3 is a schematic representation of a
• Fig. 1 shows a schematic representation of method steps comprising a recording of a sequence of individual image data 20 of a single limited area of the skin 30 of the human body by means of an optical pickup unit 1 1; evaluating the image data including determining a pulse travel time; and the determination of vital parameters of the human body from the image data by means of a computing unit 12.
• the image data is thereby recorded only by a region of the skin 30.
• This may be, for example, the face, parts of the face, such as the forehead, a hand, parts of a hand, such as fingers, fingertip, palm, an ankle, or the groin of a human body.
• every area of the skin can be used, but with a high blood flow, the measuring accuracy of the vital parameter is increased.
• the image data is subsequently evaluated and a pulse transit time is determined. This can be done only a few days after the recording, for example, in a long-term measurement of a vital parameter.
• the image data is temporarily stored in a memory unit 13 until the evaluation of the image data is carried out.
• the pulse wave transit time is taken as a basis and evaluated according to known methods.
• Fig. 2 shows a preferred embodiment for determining the pulse transit time.
• each individual image 20 is divided into a multiplicity of tiles 21, ie, a grid of tiles 21 results.
• the color, the brightness and / or the volume are determined.
• the volume is preferably determined from stereo image data.
• a 3D camera with two camera lenses preferably in the smartphone, can capture images at a clearly defined distance at the same time.
• the evaluation of the 3D camera follows the same principle as with only one camera. However, the accuracy is many times higher, as more images are available for evaluation. Also, the defined distance from each other for an image analysis of advantage. Smartphones with two separate cameras allow the extraction of more accurate data from the pulse wave from the image data.
• a sequence of the color, brightness, or volume of each tile 21 is then compared with each other to detect a change in color, brightness and / or volume in the sequence of image data.
• a change profile that is to say a temporal sequence of the changes, is then created.
• the image analysis can be used to determine the distance traveled by the pulse wave within a certain time. From this change profile then the pulse travel time is determined. This can be based on assumptions about the size of the area of the skin.
• all captured images are divided into tiles 21 as previously described.
• the recorded pictures contain noise, among other things due to movement during recording.
• 10 images per second, with a pulse of 60 beats per minute results in a tiling of 100 x 100 tiles 21 10,000 tiles per original image.
• the source image shows a time excerpt of about 100 ms (10 frames per second).
• the tiling of 100 x 100 divides the entire image, which shows a 100 ms section, into 100 linear parts. This corresponds to an effective (at a pulse of 60) temporal resolution of 1 ms.
• a meaningful evaluation of the profile of the pulse wave in the determination of the pulse wave transit time is possible.
• the pulse wave transit time and the RR interval are determined.
• the provided images of the smartphone are tiled, as explained above, and then defined as images with values for color, brightness and / or volume.
• the changes in these values, generated by the pulsating waves of the oxygen-rich blood, can now be determined from the image.
• the color change produces differences in the values in the images of the recorded sequence, which can be evaluated in the further calculation as differences, for example in percent, in length, in width, in height, or in color and brightness definitions. From the pulse wave transit time, e.g. the blood pressure can be calculated.
• FIG. 3 shows a device 10 comprising a recording unit 11 for recording a sequence of individual image data of a single, restricted area of the skin 30 of a human body and a computer 12 for evaluating the image data comprising a determination of a pulse wave transit time and for determining vital parameters of the human body from the image data.
• the device 10 also has a memory unit 13, which can store image data for later evaluation.
• a lighting unit 14 for exposing the area of the skin 30 is provided.
• Light 34 of illumination unit 14 may in particular have a specific spectral range.
• the device also has a microphone 15 for recording audio data in the illustrated embodiment.
• the area of the skin 30 is further provided with an acceleration eosensor 16 for receiving motion data.
• the data may also provide relevant evidence in the detection of criminal offenses. Also one more efficient help and detection during rescue operations of injured persons is possible. High resolution surveillance cameras detect and authenticate individuals.
• Movement and vital data also provide information about the person's energy consumption in real time.
• a search mode (e.g., in a visualized fractal) is useful throughout the medical field.
• an evaluation of a personal energy balance as well as their calculation on an upcoming and possible performance request, be performed.
• the blood pressure and the pulse measurement, breathing and oxygen saturation, with the help of pulse wave transit time measurement and the RR interval, especially in the outdoor area an improvement.
• the measurement takes place, for example, with a smartphone or an external camera. If there are any problems and special system presetting, the smartphone can automatically request help or offer suggestions for training control.
• the data recording in the water due to size and low energy consumption is possible.
• the non-contact measurement also creates in the movement of the user, the measurement of vital data in the water, using video and or individual image analysis.
• An evaluation of the user's level of performance becomes visible through the evaluation of the vital data from the image analysis, through the pulse wave variability. Pulse wave variability decreases with age. At the same time, the pulse wave variability decreases or stagnates even in the case of severe physical or mental stress on the organism.
• anaerobic threshold For training control, the individual anaerobic threshold (IAS) is often used today as the basis for defining training areas. A threshold determination via the heart rate variability is made possible by the invention in a simple manner.
• the performance in the anaerobic area is subject to a complex control process in the holistic view of humans. However, it is also a sign of exhaustion and can be detected in stored lactate.
• the heart rate variability threshold described by Berbalk and Neumann is approximately 2.4mmol lactate and 10% below the IAS performance.
• Control of household appliances and energy management in the home so for example, a coffee after waking up or stand up the user can turn on.
• Control of the heating, ventilation or electronic systems in the house are based on the vital data and the pre-set processes.
• Control of firearms for example.
• This can be used, for example, by biathletes who shoot between the pulse waves within 200 - 300 ms.

Landscapes

• Health & Medical Sciences (AREA)
• Engineering & Computer Science (AREA)
• Life Sciences & Earth Sciences (AREA)
• General Health & Medical Sciences (AREA)
• Medical Informatics (AREA)
• Physics & Mathematics (AREA)
• Biomedical Technology (AREA)
• Public Health (AREA)
• Cardiology (AREA)
• Biophysics (AREA)
• Veterinary Medicine (AREA)
• Pathology (AREA)
• Heart & Thoracic Surgery (AREA)
• Molecular Biology (AREA)
• Surgery (AREA)
• Animal Behavior & Ethology (AREA)
• Physiology (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
• Radiology & Medical Imaging (AREA)
• Primary Health Care (AREA)
• Epidemiology (AREA)
• Quality & Reliability (AREA)
• Vascular Medicine (AREA)
• Multimedia (AREA)
• Business, Economics & Management (AREA)
• General Business, Economics & Management (AREA)
• Pulmonology (AREA)
• Signal Processing (AREA)
• Human Computer Interaction (AREA)
• Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
• Measuring And Recording Apparatus For Diagnosis (AREA)
• Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
• Investigating Or Analysing Materials By Optical Means (AREA)
• Investigating Or Analysing Biological Materials (AREA)

Priority Applications (9)

Applications Claiming Priority (8)

Related Child Applications (2)

Publications (1)

Family

ID=49725096

Family Applications (1)

Country Status (9)

Cited By (6)

Families Citing this family (37)

Citations (8)

Family Cites Families (28)

• 2013
  • 2013-11-08 WO PCT/EP2013/073362 patent/WO2014072461A1/de not_active Ceased
  • 2013-11-08 RU RU2018118973A patent/RU2018118973A/ru not_active Application Discontinuation
  • 2013-11-08 BR BR112015010677A patent/BR112015010677A2/pt not_active IP Right Cessation
  • 2013-11-08 CA CA2891194A patent/CA2891194A1/en not_active Abandoned
  • 2013-11-08 KR KR1020157015355A patent/KR20150095661A/ko not_active Ceased
  • 2013-11-08 JP JP2015541151A patent/JP2016501048A/ja active Pending
  • 2013-11-08 CN CN201380069939.7A patent/CN105338890B/zh not_active Expired - Fee Related
  • 2013-11-08 US US14/441,917 patent/US9892505B2/en active Active
  • 2013-11-08 EP EP13801993.0A patent/EP2916724A1/de not_active Ceased
  • 2013-11-08 RU RU2015122420A patent/RU2656559C2/ru active
• 2018
  • 2018-01-02 US US15/859,862 patent/US20180122073A1/en not_active Abandoned

Patent Citations (8)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events