CN103815890A - Method for detecting heart rate by utilizing intelligent mobile phone camera - Google Patents

Method for detecting heart rate by utilizing intelligent mobile phone camera Download PDF

Info

Publication number
CN103815890A
CN103815890A CN201410083138.2A CN201410083138A CN103815890A CN 103815890 A CN103815890 A CN 103815890A CN 201410083138 A CN201410083138 A CN 201410083138A CN 103815890 A CN103815890 A CN 103815890A
Authority
CN
China
Prior art keywords
waveform
heart rate
photographic head
mobile phone
smart mobile
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410083138.2A
Other languages
Chinese (zh)
Inventor
夏勇
刘冠达
王宽全
伯彭波
张盛平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin Institute of Technology
Original Assignee
Harbin Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin Institute of Technology filed Critical Harbin Institute of Technology
Priority to CN201410083138.2A priority Critical patent/CN103815890A/en
Publication of CN103815890A publication Critical patent/CN103815890A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

The invention provides a method for detecting the heart rate by utilizing an intelligent mobile phone camera. The method comprises the steps that 1, a user covers the camera with a finger, and the camera continuously acquires images; 2, gray information in each frame of image is extracted, the gray information of every frame of image is accumulated for serving as the overall gray value of every frame of image, and the overall gray values of the continuous image form a blood gray change waveform; 3, preprocessing, baseline drift removing and smooth denoising are carried out on the waveform; 4, peak values of the waveform are extracted, and the number of frames between every two adjacent peak values is determined for calculating the real-time heart rate; 5, the extracted waveform signal is zoomed for simulating a dynamic electrocardiogram. The method does not need the aid of any other medical equipment, and only the finger covers the camera, and the electrocardio waveform can be simulated, so that the real-time heart rate can be calculated.

Description

A kind of method of utilizing smart mobile phone photographic head to detect heart rate
Technical field
The present invention relates to a kind of detection method of heart rate, relate in particular to and a kind ofly utilize camera collection, catch small blood grey scale change and carry out analog electrocardiogram figure and measure the method for heart rate.
Background technology
Along with scientific and technological development, there is being much convenient for people to the product of life, health.On market, have a lot of portable Cardiotachometers, people, by these equipment, just can know the heart rate of oneself whenever and wherever possible, look at that whether the cardiac rhythm of oneself is normal.But the user group of these products has the people of HDH often, and although the equipment that is of portable form still may bring the problems such as uncomfortable of wearing to patient.
And universal along with smart mobile phone, we can utilize the computing capability of smart mobile phone and integrated several functions module to develop the product of healthy class as much as possible.On market, just lack this other armarium that do not utilize now, only utilize mobile phone to allow user measure the rhythm of the heart, observe the product of cardiac rhythm.
Summary of the invention
The object of the invention is to be to provide a kind of method of utilizing smart mobile phone photographic head to detect heart rate, the method, without by other any Medical Equipmentes, only need cover finger on photographic head, will simulate ecg wave form, measures real-time heart rate.
The object of the invention is to be achieved through the following technical solutions:
(1) user covers finger on photographic head, and photographic head carries out continuous acquisition to image;
(2) extract the half-tone information in each two field picture, the half-tone information of each two field picture is added up, as each two field picture overall gray value, the overall gray value of consecutive image forms the waveform of blood grey scale change;
(3) waveform is carried out to pretreatment, remove baseline drift, smoothing denoising;
(4) each peak value of extraction waveform, determines the frame number between each adjacent peak value, calculates real-time heart rate;
(5) waveshape signal extracting is carried out to convergent-divergent, simulate ambulatory electrocardiogram.
Each heart beating all can make the oxygen content in blood increase, and after health consumes, the oxygen content of blood can reduce again, so blood color is because the variation of oxygen content can produce periodically-varied.In blood, oxygen content increases, and blood color is cerise, and after health consumes the oxygen in blood, blood becomes kermesinus.But this variation is to be with the naked eye difficult to observe out.The present invention proposes a kind of photographic head that utilizes smart mobile phone and detect anywhere or anytime own a kind of method of heart rate in real time, and simulate ambulatory electrocardiogram and be used for observing changes in heart rate.The method is by covering finger on mobile phone camera, by gathering consecutive image, the blood catching on finger changes with the periodic small light and shade of heartbeat, this light and shade is changed and shown with waveform, be used for simulating ambulatory electrocardiogram, observation cardiac rhythm changes, and calculates the peak-to-peak interval of adjacent wave and calculate real-time heart rate.
This method tool has the following advantages:
(1) need not just can be more accurate by other Medical Equipmentes measure heart rate, by the slight change of blood color, simulate Electrocardiographic roughly tendency, be convenient to observe cardiac rhythm and change.
(2) meet real-time, portability.
Accompanying drawing explanation
Fig. 1 is crest testing result figure.
The specific embodiment
Below technical scheme of the present invention is further described, but is not limited to this, every technical solution of the present invention is modified or is equal to replacement, and do not depart from the spirit and scope of technical solution of the present invention, all should be encompassed in protection scope of the present invention.
The method of utilizing the photographic head of smart mobile phone to detect heart rate provided by the invention, comprises the following steps:
1, image acquisition: user covers finger on photographic head, photographic head continuous acquisition image.
2, data acquisition: extract the half-tone information in each two field picture, the each grey scale pixel value in each two field picture is cumulative, and its value represents the overall gray value of this two field picture, as a frame signal, continuous signal forms the waveform of blood grey scale change.
The present invention realizes under Android system, and the primary image storage format of Android system photographic head is YUV420SP.Wherein Y representation in components monochrome information, UV represents color information.So we only need the value of the Y component of each two field picture to add up, and obtain the overall gray value of a two field picture, as a frame signal.
3, waveform pretreatment: waveshape signal is removed to baseline drift, smoothing denoising processing.
Because human body respiration or the mobile light and shade variation meeting causing of finger impact waveshape signal, need to remove baseline drift processing.In order to guarantee high efficiency and real-time, we adopt median filtering method to go baseline drift to signal here.Its principle is exactly, drift value using the intermediate value of the data of certain some regular length the last period as this point, deducts the drift value of changing the time with this signal value, obtain this point and remove the signal value after drift value, whole segment signal is all done to such processing according to this, obtain removing the waveform after drift value.
The waveform of removing after drift value adopts the template of 1:2:1 to carry out smoothing denoising to waveform.Be multiplied by 2 by current demand signal value numerical value, add the value of a previous and rear signal adjacent with current demand signal, result divided by 4 as the signal value after this smothing filtering.The object of smoothing denoising be for after waveform processing process in, exclude noise on crest detect impact.
4, waveform processing: the crest location in detection waveform, calculates current heart rate according to the peak-to-peak interval of each adjacent wave.
Pretreated signal is carried out to the detection of crest, the crest ratio of pretreated waveform is more outstanding, so we adopt threshold method to detect crest.The steps include: that (1) get the maximum Max of set time the last period of current point; (2) take Max/2 as threshold value, waveform is cut apart, as shown in Figure 1; (3) waveform after cutting apart, the waveform of only considering to be greater than this threshold value of Max/2 is the waveform above gray area in figure.Get the maximum in each discrete waveform, be crest value.
Detect after crest, calculate the peak-to-peak interval of adjacent wave, the i.e. peak-to-peak frame number of ripple.With the meansigma methods avg of adjacent several peak separations before current demand signal, and the frame number f of known photographic head collection image per second, just can calculate current heart rate r=60*f/avg.
5, waveform is carried out to suitable scaling, the ambulatory electrocardiogram simulating can observe heart whether have allorhythmia.

Claims (6)

1. utilize smart mobile phone photographic head to detect a method for heart rate, it is characterized in that described method step is as follows:
User covers finger on photographic head, and photographic head carries out continuous acquisition to image;
Extract the half-tone information in each two field picture, the half-tone information of each two field picture is added up, as each two field picture overall gray value, the overall gray value of consecutive image forms the waveform of blood grey scale change;
Waveform is carried out to pretreatment, remove baseline drift, smoothing denoising;
Extract each peak value of waveform, determine the frame number between each adjacent peak value, calculate real-time heart rate;
The waveshape signal extracting is carried out to convergent-divergent, simulate ambulatory electrocardiogram.
2. a kind of method of utilizing smart mobile phone photographic head to detect heart rate according to claim 1, is characterized in that in described step (3), adopts median filtering method to go baseline drift to signal.
3. a kind of method of utilizing smart mobile phone photographic head to detect heart rate according to claim 1, is characterized in that in described step (3), adopts the template of 1:2:1 to carry out smoothing denoising to waveform.
4. a kind of method of utilizing smart mobile phone photographic head to detect heart rate according to claim 1, is characterized in that in described step (4), adopts threshold method to extract crest.
5. a kind of method of utilizing smart mobile phone photographic head to detect heart rate according to claim 4, is characterized in that the method that adopts threshold method to extract crest is as follows: (1) gets the maximum Max of set time the last period of current point; (2) take Max/2 as threshold value, waveform is cut apart; (3) waveform after cutting apart, the waveform of only considering to be greater than this threshold value of Max/2 is the waveform above gray area in figure.
6. a kind of method of utilizing smart mobile phone photographic head to detect heart rate according to claim 1, it is characterized in that in described step (4), heart rate r=60*f/avg in real time, wherein, avg: the meansigma methods avg of adjacent several peak separations before current demand signal, f: the frame number of photographic head collection image per second.
CN201410083138.2A 2014-03-08 2014-03-08 Method for detecting heart rate by utilizing intelligent mobile phone camera Pending CN103815890A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410083138.2A CN103815890A (en) 2014-03-08 2014-03-08 Method for detecting heart rate by utilizing intelligent mobile phone camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410083138.2A CN103815890A (en) 2014-03-08 2014-03-08 Method for detecting heart rate by utilizing intelligent mobile phone camera

Publications (1)

Publication Number Publication Date
CN103815890A true CN103815890A (en) 2014-05-28

Family

ID=50751398

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410083138.2A Pending CN103815890A (en) 2014-03-08 2014-03-08 Method for detecting heart rate by utilizing intelligent mobile phone camera

Country Status (1)

Country Link
CN (1) CN103815890A (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105030217A (en) * 2015-06-09 2015-11-11 吉林大学 Portable motion monitoring and detecting equipment and motion monitoring and detecting method
CN105266772A (en) * 2014-06-20 2016-01-27 赵海 Measuring method for physiological parameter
CN105615862A (en) * 2015-12-21 2016-06-01 珠海格力电器股份有限公司 Method and device for detecting heart rate
CN105740627A (en) * 2016-01-29 2016-07-06 深圳市奋达科技股份有限公司 Heart rate calculating method and device
CN105877730A (en) * 2016-03-21 2016-08-24 联想(北京)有限公司 Heart rate detecting method and device and electronic equipment
CN106073745A (en) * 2016-06-15 2016-11-09 西北工业大学 Heart rate detection method based on smart mobile phone
CN106373111A (en) * 2016-08-30 2017-02-01 苏州品诺维新医疗科技有限公司 Heart rate detection device and method for obtaining heart rate variation waveform
CN106377269A (en) * 2016-08-03 2017-02-08 广东技术师范学院 College student health physical fitness detection method based on intelligent mobile phone
CN106446582A (en) * 2016-10-18 2017-02-22 江西博瑞彤芸科技有限公司 Image processing method
CN106504235A (en) * 2016-10-18 2017-03-15 北京博瑞彤芸文化传播股份有限公司 Rhythm of the heart method based on image procossing
CN106651967A (en) * 2016-10-18 2017-05-10 北京博瑞彤芸文化传播股份有限公司 Blood viscosity monitoring method based on image processing
CN107595271A (en) * 2017-07-27 2018-01-19 康美健康云服务有限公司 Method for measuring heart rate, electronic equipment, storage medium and system based on mobile phone
CN108937905A (en) * 2018-08-06 2018-12-07 合肥工业大学 A kind of contactless heart rate detection method based on signal fitting
CN111214218A (en) * 2020-01-13 2020-06-02 京东方科技集团股份有限公司 Detection equipment for multiple physiological parameters
CN111466902A (en) * 2020-01-06 2020-07-31 南开大学 Method for measuring zebra fish heart rate by using fluorescence signal difference
CN113975126A (en) * 2021-11-03 2022-01-28 上海清宁熙健康科技有限公司 Heartbeat monitoring structure for electric vibration health-care chair
CN114305373A (en) * 2021-12-31 2022-04-12 佳禾智能科技股份有限公司 Exercise heart rate monitoring earphone

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100249619A1 (en) * 2009-03-30 2010-09-30 Fujitsu Limited Physical fitness level determining apparatus, method and mobile terminal apparatus
CN102488508A (en) * 2011-12-29 2012-06-13 哈尔滨工业大学 Heart rate measuring method based on image capture
CN103054569A (en) * 2012-12-20 2013-04-24 Tcl集团股份有限公司 Method, device and handhold device for measuring human body heart rate based on visible image
CN103271734A (en) * 2012-12-10 2013-09-04 中国人民解放军第一五二中心医院 Heart rate measuring method based on low-end imaging device
CN103505196A (en) * 2013-09-02 2014-01-15 展讯通信(上海)有限公司 Method and device for measuring human body pulse and mobile terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100249619A1 (en) * 2009-03-30 2010-09-30 Fujitsu Limited Physical fitness level determining apparatus, method and mobile terminal apparatus
CN102488508A (en) * 2011-12-29 2012-06-13 哈尔滨工业大学 Heart rate measuring method based on image capture
CN103271734A (en) * 2012-12-10 2013-09-04 中国人民解放军第一五二中心医院 Heart rate measuring method based on low-end imaging device
CN103054569A (en) * 2012-12-20 2013-04-24 Tcl集团股份有限公司 Method, device and handhold device for measuring human body heart rate based on visible image
CN103505196A (en) * 2013-09-02 2014-01-15 展讯通信(上海)有限公司 Method and device for measuring human body pulse and mobile terminal

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105266772A (en) * 2014-06-20 2016-01-27 赵海 Measuring method for physiological parameter
CN105266772B (en) * 2014-06-20 2018-07-27 赵海 A kind of measurement method of physiological parameter
CN105030217A (en) * 2015-06-09 2015-11-11 吉林大学 Portable motion monitoring and detecting equipment and motion monitoring and detecting method
CN105615862A (en) * 2015-12-21 2016-06-01 珠海格力电器股份有限公司 Method and device for detecting heart rate
CN105740627A (en) * 2016-01-29 2016-07-06 深圳市奋达科技股份有限公司 Heart rate calculating method and device
CN105740627B (en) * 2016-01-29 2019-02-26 深圳市奋达科技股份有限公司 A kind of rate calculation method and device
CN105877730A (en) * 2016-03-21 2016-08-24 联想(北京)有限公司 Heart rate detecting method and device and electronic equipment
CN106073745A (en) * 2016-06-15 2016-11-09 西北工业大学 Heart rate detection method based on smart mobile phone
CN106377269A (en) * 2016-08-03 2017-02-08 广东技术师范学院 College student health physical fitness detection method based on intelligent mobile phone
CN106373111A (en) * 2016-08-30 2017-02-01 苏州品诺维新医疗科技有限公司 Heart rate detection device and method for obtaining heart rate variation waveform
CN106651967A (en) * 2016-10-18 2017-05-10 北京博瑞彤芸文化传播股份有限公司 Blood viscosity monitoring method based on image processing
CN106504235A (en) * 2016-10-18 2017-03-15 北京博瑞彤芸文化传播股份有限公司 Rhythm of the heart method based on image procossing
CN106446582A (en) * 2016-10-18 2017-02-22 江西博瑞彤芸科技有限公司 Image processing method
CN106504235B (en) * 2016-10-18 2019-05-10 北京博瑞彤芸文化传播股份有限公司 Rhythm of the heart method based on image procossing
CN106651967B (en) * 2016-10-18 2019-11-05 北京博瑞彤芸文化传播股份有限公司 Blood viscosity monitoring method based on image procossing
CN107595271A (en) * 2017-07-27 2018-01-19 康美健康云服务有限公司 Method for measuring heart rate, electronic equipment, storage medium and system based on mobile phone
CN108937905A (en) * 2018-08-06 2018-12-07 合肥工业大学 A kind of contactless heart rate detection method based on signal fitting
CN111466902A (en) * 2020-01-06 2020-07-31 南开大学 Method for measuring zebra fish heart rate by using fluorescence signal difference
CN111466902B (en) * 2020-01-06 2022-07-29 南开大学 Method for measuring zebra fish heart rate by using fluorescence signal difference
CN111214218A (en) * 2020-01-13 2020-06-02 京东方科技集团股份有限公司 Detection equipment for multiple physiological parameters
CN111214218B (en) * 2020-01-13 2024-02-09 京东方科技集团股份有限公司 Multi-physiological parameter detection equipment
CN113975126A (en) * 2021-11-03 2022-01-28 上海清宁熙健康科技有限公司 Heartbeat monitoring structure for electric vibration health-care chair
CN114305373A (en) * 2021-12-31 2022-04-12 佳禾智能科技股份有限公司 Exercise heart rate monitoring earphone

Similar Documents

Publication Publication Date Title
CN103815890A (en) Method for detecting heart rate by utilizing intelligent mobile phone camera
Tasli et al. Remote PPG based vital sign measurement using adaptive facial regions
Iozzia et al. Relationships between heart-rate variability and pulse-rate variability obtained from video-PPG signal using ZCA
CN105678780B (en) A kind of video heart rate detection method for removing ambient light change interference
CN109247923B (en) Non-contact type pulse real-time estimation method and device based on video
Casado et al. Face2PPG: An unsupervised pipeline for blood volume pulse extraction from faces
CN105266772A (en) Measuring method for physiological parameter
CN106073729A (en) The acquisition method of photoplethysmographic signal
CA2882080A1 (en) Real-time physiological characteristic detection based on reflected components of light
DE112015005804T5 (en) Breath condition estimator, portable device, body wearable device, program, medium, breath state estimation method, and breath condition estimator
CN104545950A (en) Non-contact type lie detection method and lie detection system thereof
CN104808776A (en) Device and method for detecting continuous attaching of head-wearing intelligent device on human body
CN114298089A (en) Multi-mode strength training assisting method and system
Karthick et al. Analysis of vital signs using remote photoplethysmography (RPPG)
Hassan et al. Optimal source selection for image photoplethysmography
Qiao et al. Revise: Remote vital signs measurement using smartphone camera
CN106096544B (en) Non-contact blink and heart rate joint detection system and method based on second-order blind identification
CN110660486A (en) Doctor health monitoring system based on wearable device
Wiede et al. Signal fusion based on intensity and motion variations for remote heart rate determination
US20200155008A1 (en) Biological information detecting apparatus and biological information detecting method
CN114929101A (en) System and method for physiological measurement based on optical data
CN211962969U (en) Body-building real-time monitoring system
JP2015039487A (en) Visual line analysis system and method using physiological index
Ling et al. An Efficient Method for Identifying Lower Limb Behavior Intentions Based on Surface Electromyography.
Beatson et al. Calculating a vagal tone index using webcam photoplethysmography

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20140528