CN104257349A - Mirror and method for monitoring health of user through integration of image processing and heart rate characteristics - Google Patents
Mirror and method for monitoring health of user through integration of image processing and heart rate characteristics Download PDFInfo
- Publication number
- CN104257349A CN104257349A CN201410467553.8A CN201410467553A CN104257349A CN 104257349 A CN104257349 A CN 104257349A CN 201410467553 A CN201410467553 A CN 201410467553A CN 104257349 A CN104257349 A CN 104257349A
- Authority
- CN
- China
- Prior art keywords
- user
- module
- data
- mirror
- heart rate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
- A61B5/0022—Monitoring a patient using a global network, e.g. telephone networks, internet
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
- A61B5/0079—Devices for viewing the surface of the body, e.g. camera, magnifying lens using mirrors, i.e. for self-examination
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02405—Determining heart rate variability
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/7445—Display arrangements, e.g. multiple display units
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2576/00—Medical imaging apparatus involving image processing or analysis
- A61B2576/02—Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part
- A61B2576/023—Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part for the heart
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Surgery (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Physics & Mathematics (AREA)
- Molecular Biology (AREA)
- Pathology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Cardiology (AREA)
- Physiology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The invention discloses a mirror and a method for monitoring the health of a user through integration of image processing and heart rate characteristics. The network technology is adopted, collected user health data can be timely transmitted to a cloud server to be stored, and accordingly the problem that the user cannot track the self-health-state in the long term is successfully solved and the user can timely adhere to the self-health-state when using equipment. According to the mirror and the method for monitoring the health of the user through the integration of the image processing and the heart rate characteristics, the continuous monitoring can be achieved, the problems can be found and adjusted timely, the use is convenient, the speed is high, the real-time effect is achieved, the cost is low, the application range is wide, and the like.
Description
?
Technical field
The present invention relates to a kind of monitoring system, particularly a kind of have mirror and the method that image procossing merges heart rate feature monitoring user healthy functions.
Background technology
Publication date is 2012-06-20, publication number is that the Chinese invention patent of 102499664A discloses a kind of non-contact vital sign detection method based on video image, first by fixing frame frequency continuous acquisition video image, automatic detection ROI region, vital sign parameter signals is isolated from the multichannel signal that described ROI region marks off, the frequency inverted extracting vital sign parameter signals is described vital sign, obtains check result.
But, see above approach application to this family of mirror ordinary articles does not also have with the design of Real-Time Monitoring user health states.
Summary of the invention
In order to overcome the deficiencies in the prior art, the invention provides a kind of Web TV based on the contactless health monitoring systems of heart rate variability and method.
The technical solution adopted for the present invention to solve the technical problems is:
There is the mirror that image procossing merges heart rate feature monitoring user healthy functions, it is characterized in that: comprise mirror, be arranged at the facial image acquisition identification module in mirror, display module, CPU module, communication module, infrared induction module, warning module, described facial image acquisition identification module, infrared induction module, communication module, display module and warning module are all connected with described CPU module, described facial image acquisition identification module is for gathering the face-image of user and changing into face-image sequence data, described CPU module carries out the Treatment Analysis of data, described communication module comprises Network Interface Unit, one or more of blue-tooth device and short message sending device, and by this Network Interface Unit, CPU module is connected with cloud server and hospital database system communication, the data of system log (SYSLOG) transfer to cloud server and to be stored in hospital system in personal electric health account, user can utilize blue-tooth device by system log data synchronous transfer on the equipment such as mobile phone, flat board, to realize transmitting without near radio off the net, described short message sending device is used for sending the expressive features information after CPU module Treatment Analysis and heart rate characteristic information data to mobile phone terminal, infrared induction module is for responding to human body, and wake the resting state of described facial image acquisition module up, described display module is for outputting to display module by the real time information data of the user received and contrast findings data, and described warning module is used for User Alarms.
Described facial image acquisition module comprises camera, and this camera embeds the top centre of mirror case, and described face-image sequence data is gathered by camera.
Described display module have employed OLED transparent display screen.
Described infrared induction module installation is on mirror case.
Described warning module comprises at least one of auditory tone cues device, LED lamplight prompting apparatus.
There is the method that image procossing merges heart rate feature monitoring user healthy functions, it is characterized in that: be made up of following steps:
Step one: when there being people using TV, detected by infrared induction module, infrared induction module is by information feed back to CPU module, and CPU module activates this health monitoring systems and enters duty;
Step 2: gather the face-image of user by the facial image acquisition identification module being arranged on the top of mirror case and change into face-image sequence data, and by CPU, this face-image sequence data being processed;
Step 3: CPU module processes the user face-image sequence data collected, and obtains the expressive features information of user;
Step 4: the face-image sequence data of CPU module to user is further analyzed and obtains user heart rate characteristic information within a period of time;
Step 5: expressive features information and heart rate characteristic information are carried out information fusion comparison by CPU module, in order to real-time physiological situation and the health status of monitoring user,
Step 6: CPU module is invoke user information from the data base of cloud server, inquiring about this user is old user or new user, and makes corresponding answer; Be confirmed to be old user as replied, the real time information data obtained in step 5 is kept in the data base of cloud server data base relative users by CPU module; Be confirmed to be new user as replied, CPU module sets up this customer data base, and is kept at by the real time information data obtained in this step 5 in the data base of the newly-built user of cloud server data base;
Step 7: CPU module exports data to display module, and the real-time physiological situation obtained by user and state of health data are shown on display module, the Health & Fitness Tip drawn according to information by physiological situation and the CPU module of data display translation user;
Step 8: the value of the health status information after merging exceedes history average, then point out early warning by warning module to user, and EMERGENCY PHONE terminal unit when being registered to user by short message sending device sends information early warning.
Step 2 specifically comprises following; Collected the face-image of user by camera after, facial image acquisition identification module is existing converts face-image to face-image sequence data, and sends the face-image sequence data of this user to CPU module.
The invention has the beneficial effects as follows: the detection system and the method that the invention discloses a kind of non-contact vital sign based on video image, the present invention adopts network technology, in real time the user health data collected can reportedly be delivered to cloud server to preserve, successfully solving user cannot the problem of long-term follow own health status, makes user also adhere to the health status of self in real time when the equipment of use.
The present invention can realize continuous monitoring; And can Timeliness coverage problem regulating, have easily and fast, in real time, low cost and the advantage such as applied widely.
Accompanying drawing explanation
Below in conjunction with drawings and Examples, the present invention is further described.
Fig. 1 is the three-dimensional view of mirror.
Fig. 2 is theory diagram of the present invention.
Detailed description of the invention
With reference to Fig. 1, Fig. 2, the invention discloses a kind of mirror and the method with image procossing fusion heart rate feature monitoring user healthy functions,
In one preferably example, when described infrared induction module does not detect that someone uses mirror 1, described health monitoring systems is in resting state, when having detected that people is using mirror 1, described facial image acquisition module just enters duty, facial image acquisition module comprises a camera 2, camera 2 gathers face-image, facial image acquisition module converts face-image to face-image sequence data, and send the face-image sequence data of the user collected to CPU module, pass user back in the data base of described CPU module distally server and go confirmation, the user face-image sequence data collected is carried out Treatment Analysis by CPU module, obtain expressive features information and the heart rate characteristic information of user,
Simultaneously, pass user back in the data base of CPU module distally server and go confirmation, the process of validation of information is specially: CPU module is invoke user information from the data base of cloud server, and inquiring about this user is old user or new user, and makes corresponding answer; Be confirmed to be old user as replied, the real time information data of above-mentioned acquisition is kept in the data base of cloud server data base relative users by CPU module; Be confirmed to be new user as replied, CPU module sets up this customer data base, and is kept at by the real time information data of above-mentioned acquisition in the data base of the newly-built user of cloud server data base; Then this real time data and user's historical data are carried out confidence fusion ratio pair, in order to the health status of monitoring user, and control corresponding reaction unit according to the conclusion drawn, by display module for the real time information data of the user received and contrast findings data are outputted to display module, display module is an OLED transparent display screen 3.
Wherein, CPU module workflow is as follows:
When infrared induction module has detected that people is using mirror 1, infrared induction module signals to CPU module, CPU module controls facial image capture module and enters duty, send the face-image sequence data collecting user to CPU module, facial image information in the data base of CPU module and cloud server is compared, and reads the historical data of user.Now CPU module proceeds as follows real time data:
The real time information data of analyzing and processing is kept in the data base of cloud server data base relative users;
Fusion ratio is carried out comparatively by the historical data meansigma methods in expressive features information and heart rate characteristic information and cloud server data base for the user obtained in real time, when the health status information after merging exceedes history average, then point out early warning by warning module to user, and EMERGENCY PHONE terminal unit when being registered to user by information transmitting apparatus sends information early warning.
Above to a kind of mirror 1 and method with image procossing fusion heart rate feature monitoring user healthy functions that the embodiment of the present invention provides, be described in detail, apply specific case herein to set forth principle of the present invention and embodiment, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping; Meanwhile, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (7)
1. there is the mirror that image procossing merges heart rate feature monitoring user healthy functions, it is characterized in that: comprise mirror, be arranged at the facial image acquisition identification module in mirror, display module, CPU module, communication module, infrared induction module, warning module, described facial image acquisition identification module, infrared induction module, communication module, display module and warning module are all connected with described CPU module, described facial image acquisition identification module is for gathering the face-image of user and changing into face-image sequence data, described CPU module carries out the Treatment Analysis of data, described communication module comprises Network Interface Unit, one or more of blue-tooth device and short message sending device, and by this Network Interface Unit, CPU module is connected with cloud server and hospital database system communication, the data of system log (SYSLOG) transfer to cloud server and to be stored in hospital system in personal electric health account, user can utilize blue-tooth device by system log data synchronous transfer on the equipment such as mobile phone, flat board, to realize transmitting without near radio off the net, described short message sending device is used for sending the expressive features information after CPU module Treatment Analysis and heart rate characteristic information data to mobile phone terminal, infrared induction module is for responding to human body, and wake the resting state of described facial image acquisition module up, described display module is for outputting to display module by the real time information data of the user received and contrast findings data, and described warning module is used for User Alarms.
2. according to claim 1 have the mirror that image procossing merges heart rate feature monitoring user healthy functions, it is characterized in that: described facial image acquisition module comprises camera, and this camera embeds the top centre of mirror case, described face-image is gathered by camera.
3. according to claim 1 have the mirror that image procossing merges heart rate feature monitoring user healthy functions, it is characterized in that: described display module have employed OLED transparent display screen.
4. according to claim 1 have the mirror that image procossing merges heart rate feature monitoring user healthy functions, it is characterized in that: described infrared induction module installation is on mirror case.
5. according to claim 1 have the mirror that image procossing merges heart rate feature monitoring user healthy functions, it is characterized in that: described warning module comprises at least one of auditory tone cues device, LED lamplight prompting apparatus.
6. realize that there is method that image procossing merges the mirror of heart rate feature monitoring user healthy functions as claimed in claim 1, it is characterized in that: be made up of following steps:
Step one: when there being people using TV, detected by infrared induction module, infrared induction module is by information feed back to CPU module, and CPU module activates this health monitoring systems and enters duty;
Step 2: gather the face-image of user by the facial image acquisition identification module being arranged on the top of mirror case and change into face-image sequence data, and by CPU, this face-image sequence data being processed;
Step 3: CPU module processes the user face-image sequence data collected, and obtains the expressive features information of user;
Step 4: the face-image sequence data of CPU module to user is further analyzed and obtains user heart rate characteristic information within a period of time;
Step 5: expressive features information and heart rate characteristic information are carried out information fusion comparison by CPU module, in order to real-time physiological situation and the health status of monitoring user,
Step 6: CPU module is invoke user information from the data base of cloud server, inquiring about this user is old user or new user, and makes corresponding answer; Be confirmed to be old user as replied, the real time information data obtained in step 5 is kept in the data base of cloud server data base relative users by CPU module; Be confirmed to be new user as replied, CPU module sets up this customer data base, and is kept at by the real time information data obtained in this step 5 in the data base of the newly-built user of cloud server data base;
Step 7: CPU module exports data to display module, and the real-time physiological situation obtained by user and state of health data are shown on display module, the Health & Fitness Tip drawn according to information by physiological situation and the CPU module of data display translation user;
Step 8: the value of the health status information after merging exceedes history average, then point out early warning by warning module to user, and EMERGENCY PHONE terminal unit when being registered to user by short message sending device sends information early warning.
7. according to claim 6 have the method that image procossing merges the mirror of heart rate feature monitoring user healthy functions, it is characterized in that: step 2 specifically comprises following; Collected the face-image of user by camera after, facial image acquisition identification module is existing converts face-image to face-image sequence data, and sends the face-image sequence data of this user to CPU module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410467553.8A CN104257349A (en) | 2014-09-15 | 2014-09-15 | Mirror and method for monitoring health of user through integration of image processing and heart rate characteristics |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410467553.8A CN104257349A (en) | 2014-09-15 | 2014-09-15 | Mirror and method for monitoring health of user through integration of image processing and heart rate characteristics |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104257349A true CN104257349A (en) | 2015-01-07 |
Family
ID=52149023
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410467553.8A Pending CN104257349A (en) | 2014-09-15 | 2014-09-15 | Mirror and method for monitoring health of user through integration of image processing and heart rate characteristics |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104257349A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107862676A (en) * | 2017-09-26 | 2018-03-30 | 深圳市赛亿科技开发有限公司 | A kind of health of heart detection mirror and its detection method |
| CN108245176A (en) * | 2017-12-07 | 2018-07-06 | 江苏大学 | Based on the interactive contactless psychology detection therapeutic device of Internet of Things, system and method |
| CN110833400A (en) * | 2019-12-02 | 2020-02-25 | 清华大学 | Health information monitoring method and system |
| US10755415B2 (en) | 2018-04-27 | 2020-08-25 | International Business Machines Corporation | Detecting and monitoring a user's photographs for health issues |
| CN113749490A (en) * | 2021-10-21 | 2021-12-07 | 深圳豪威显示科技有限公司 | Intelligent fitness mirror |
-
2014
- 2014-09-15 CN CN201410467553.8A patent/CN104257349A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107862676A (en) * | 2017-09-26 | 2018-03-30 | 深圳市赛亿科技开发有限公司 | A kind of health of heart detection mirror and its detection method |
| CN108245176A (en) * | 2017-12-07 | 2018-07-06 | 江苏大学 | Based on the interactive contactless psychology detection therapeutic device of Internet of Things, system and method |
| US10755415B2 (en) | 2018-04-27 | 2020-08-25 | International Business Machines Corporation | Detecting and monitoring a user's photographs for health issues |
| US10755414B2 (en) | 2018-04-27 | 2020-08-25 | International Business Machines Corporation | Detecting and monitoring a user's photographs for health issues |
| CN110833400A (en) * | 2019-12-02 | 2020-02-25 | 清华大学 | Health information monitoring method and system |
| CN113749490A (en) * | 2021-10-21 | 2021-12-07 | 深圳豪威显示科技有限公司 | Intelligent fitness mirror |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104270504A (en) | Non-contact health monitoring mobile phone based on Internet and method | |
| US10388016B2 (en) | Seizure detection | |
| CN104257349A (en) | Mirror and method for monitoring health of user through integration of image processing and heart rate characteristics | |
| CN105116859B (en) | A kind of intelligent domestic system realized using unmanned vehicle and method | |
| US10061389B2 (en) | Gesture recognition system and gesture recognition method | |
| CN203630821U (en) | Old man caring system based on Internet-of-things | |
| CN102764131A (en) | System and method for remotely monitoring and taking care of life of elders | |
| CN105171752A (en) | Robot system and method thereof | |
| CN104284486A (en) | Intelligent lighting device and system and intelligent lighting control method | |
| CN105096527A (en) | Monitoring and alerting method and system based on child's sleep state | |
| WO2015133195A1 (en) | Information processing device, information processing method, and program | |
| CN106214436A (en) | A kind of intelligent blind guiding system based on mobile phone terminal and blind-guiding method thereof | |
| CN105282490A (en) | Novel empty nester smart home interaction system and method | |
| WO2014028671A3 (en) | Real-time physiological characteristic detection based on reflected components of light | |
| CN103919531A (en) | Health monitoring device and children learning equipment provided with same | |
| CN205212970U (en) | Mother and infant nurses robot system | |
| CN202751383U (en) | Long-distance monitoring caring system for life of old people | |
| CN203480551U (en) | Hospital clinic information system based on the internet of things | |
| CN104257373A (en) | Cloud technology based human health intelligent monitoring device and method | |
| CN104270658A (en) | Television based on heart-rate-variability non-contact health monitoring system and method for using television | |
| CN103876746A (en) | Method and device for determining alarm according to recognized motion state information | |
| CN203287910U (en) | Search system based on face recognition | |
| CN104257365A (en) | Non-contact health monitoring device and method for notebook computer operator | |
| CN204839487U (en) | Healthy data on -line monitoring system | |
| CN105046611A (en) | Nursing home management system based on radio frequency identification technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150107 |