LU502466B1 - Medical warning system based on face images and emotion recognition - Google Patents

Medical warning system based on face images and emotion recognition Download PDF

Info

Publication number
LU502466B1
LU502466B1 LU502466A LU502466A LU502466B1 LU 502466 B1 LU502466 B1 LU 502466B1 LU 502466 A LU502466 A LU 502466A LU 502466 A LU502466 A LU 502466A LU 502466 B1 LU502466 B1 LU 502466B1
Authority
LU
Luxembourg
Prior art keywords
module
emotion
body gesture
sample
communicated
Prior art date
Application number
LU502466A
Other languages
French (fr)
Inventor
Guchen Shi
Dongyu Zhu
Xugang Shi
Original Assignee
Joyware Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Joyware Electronics Co Ltd filed Critical Joyware Electronics Co Ltd
Priority to LU502466A priority Critical patent/LU502466B1/en
Application granted granted Critical
Publication of LU502466B1 publication Critical patent/LU502466B1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1121—Determining geometric values, e.g. centre of rotation or angular range of movement
    • A61B5/1122—Determining geometric values, e.g. centre of rotation or angular range of movement of movement trajectories
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
    • A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using image analysis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/117—Identification of persons
    • A61B5/1171—Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • A61B5/1176—Recognition of faces
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/7465—Arrangements for interactive communication between patient and care services, e.g. by using a telephone network
    • A61B5/747—Arrangements for interactive communication between patient and care services, e.g. by using a telephone network in case of emergency, i.e. alerting emergency services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Psychiatry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Social Psychology (AREA)
  • Educational Technology (AREA)
  • Physiology (AREA)
  • Child & Adolescent Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Theoretical Computer Science (AREA)
  • Hospice & Palliative Care (AREA)
  • Multimedia (AREA)
  • Psychology (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Dentistry (AREA)
  • Critical Care (AREA)
  • Radiology & Medical Imaging (AREA)
  • Emergency Medicine (AREA)
  • Geometry (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Emergency Management (AREA)
  • Business, Economics & Management (AREA)
  • Nursing (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

The present invention disclosed a medical warning system based on a face image and emotion recognition, including a monitoring device, a controller, a community service platform, a medical service platform, and a remote control platform. The monitoring device includes a sample emotion collecting module, a sample emotion training module, a face image collecting module, an emotion feature extraction module, an emotion signal conversion module, an emotion processing module, a sample body gesture collecting module, a body gesture collecting module, a body gesture feature extraction module, a body gesture signal conversion module, a body gesture storage module, a body gesture processing module, and a comprehensive analysis module. The controller is connected to the monitoring device, the community service platform, and the remote control platform, respectively. In the present invention, a physical state of a user is automatically monitored by the technical solution of recognizing a face and an emotion via the monitoring device. The user is automatically warned in the event of a sudden disease that cannot be called for a 120 first aid, so that the user can receive timely treatment, thereby improving medical safety of the user.

Description

MEDICAL WARNING SYSTEM BASED ON FACE IMAGES AND EMOTION 0502466
RECOGNITION
TECHNICAL FIELD The invention belongs to the medical field, and relates to a medical warning system based on a face image and emotion recognition.
BACKGROUND ART In daily life, people may encounter a sudden disease and cannot call a 120 first aid, especially for the elderly. If a child is not at home when an accident occurs, the accident may aggravate the disease or cause an irreparable tragedy. At present, a plurality of families mount a monitor so that the child can observe a situation at home at any time, but cannot observe the situation all the time. In addition, the monitor is a passive monitoring device and cannot realize automatic warning. The present invention effectively solves this problem.
SUMMARY OF THE INVENTION In order to overcome deficiencies in the prior art, the present invention provides a medical warning system based on a face image and emotion recognition. In order to achieve the forgoing objective, the present invention adopts the following technical solutions: a medical warning system based on a face image and emotion recognition includes a monitoring device, a controller, a community service platform, a medical service platform, and a remote control platform. The monitoring device includes a sample emotion collecting module, a sample emotion training module, a face image collecting module, an emotion feature extraction module, an emotion signal conversion module, an emotion processing module, a sample body gesture collecting module, a body gesture collecting module, a body gesture feature extraction module, a body gesture signal conversion module, a body gesture storage module, a body gesture processing module, and a comprehensive analysis module. The controller is connected to the monitoring device, the community service platform, and the remote control platform, respectively. The medical service platform is communicated with or electrically connected to the community service platform. Further, the face image collecting module is communicated with or electrically connected to the emotion feature extraction module. The emotion feature extraction module is communicated with or electrically connected to the emotion signal conversion module. The emotion signal conversion module is communicated with or electrically connected to the sample emotion collecting module. The sample emotion collecting module is communicated with or electrically connected 792466 the sample emotion training module. The emotion processing module is communicated with or electrically connected to the sample emotion training module. To sum up, the present invention has the following beneficial effects: 1) In the present invention, a physical state of a user is automatically monitored by the technical solution of recognizing a face and an emotion via the monitoring device. The user is automatically warned in the event of a sudden disease that cannot be called for a 120 first aid, so that the user can receive timely treatment, thereby improving medical safety of the user.
2) In the present invention, a received image transmitted by the face image collecting module as well as identity information and medical information of the user are transmitted to the community service platform and the remote control platform when a warning action is conducted. The controller transmits abnormal information of a patient to a customer terminal of a corresponding family member to issue a warning, so that the abnormal information of the patient can be notified to the corresponding family member at the first time. A property management center and a community hospital can cooperate with the patient to take preliminary treatment measures in a timely manner, so that the user can receive timely treatment, thereby improving the medical safety of the user. .
BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic diagram of a system of the present invention.
DETAILED DESCRIPTION OF THE EMBODIMENTS As shown in FIG. 1, a medical warning system based on a face image and emotion recognition includes a monitoring device, a controller, a community service platform, and a remote control platform, wherein the monitoring device comprises a sample emotion collecting module, a sample emotion training module, a face image collecting module, an emotion feature extraction module, an emotion signal conversion module, an emotion processing module, a sample body gesture collecting module, a body gesture collecting module, a body gesture feature extraction module, a body gesture signal conversion module, a body gesture storage module, a body gesture processing module, and a comprehensive analysis module. The controller is connected to the monitoring device, the community service platform, and the remote control platform, respectively. The face image collecting module is communicated with or electrically connected to the emotion feature extraction module. The emotion feature extraction module is communicated with or electrically connected to the emotion signal conversion module.
The emotion signal conversion 66 module is communicated with or electrically connected to the sample emotion collecting module.
The sample emotion collecting module is communicated with or electrically connected to the sample emotion training module.
The emotion processing module is communicated with or electrically connected to the sample emotion training module.
The sample emotion collecting module extracts a fragment of an emotion electrical signal of a person in each emotion category via a set extraction rule, so as to form a sample electrical signal of a plurality of emotion categories.
The sample emotion training module receives a sample electrical signal of the sample emotion collecting module.
The sample emotion training module uses the plurality of sample electrical signals as input values of a neural network and performs training, and establishes the trained neural network to obtain an emotion recognition model.
The face image collecting module collects a plurality of sets of images.
The face image collecting module is provided as a camera.
The emotion feature extraction module receives a face part in an image collected by the image collecting module, and extracts an emotion feature on the face part of at least two images.
An emotion feature of the person includes an eye feature, a nose feature, a mouth feature, and an ear feature.
The emotion signal conversion module receives the emotion feature of the person extracted by the emotion feature extraction module to convert the signal to form the emotion electrical signal of the person.
The sample emotion training module receives the emotion electrical signal of the person output by the sample emotion collecting module.
The emotion electrical signal of the person is input into the emotion recognition model to obtain an output result of the emotion recognition model, and recognize and output an emotion category of the person according to the output result.
The emotion processing module is built-in with a normal emotion category and an abnormal emotion category.
The normal emotion category includes a positive emotion such as pleasure, happiness, and excitement.
The abnormal emotion category includes a negative emotion such as pain.
Generally, an recognized emotion of a face of a sudden disease is pain.
The sample body gesture collecting module is communicated with or electrically connected to with the body gesture storage module.
The body gesture collecting module is communicated with or electrically connected to the body gesture storage module.
The face image collecting module is communicated with or electrically connected to the body gesture collecting module.
The body gesture feature extraction module is communicated with or electrically connected to the 56947466 gesture collecting module. The body gesture feature extraction module is communicated with or electrically connected to the body gesture collecting module. The body gesture feature extraction module is communicated with or electrically connected to the body gesture signal conversion module. The body gesture signal conversion module is communicated with or electrically connected to the body gesture storage module.
The sample body gesture collecting module extracts a fragment of a body gesture electrical signal in each gesture category via the set extraction rule to form a sample gesture electrical signal of a plurality of body gesture categories. The body gesture storage module receives the sample gesture electrical signal and forms the plurality of body gesture electrical signals, which can specifically include standing, sitting, lying and falling gestures. The body gesture collecting module receives an image collected by the face image collecting module and adjusts the image adaptively. The body gesture feature extraction module receives the adjusted image output by the body gesture collecting module and extracts at least two images to perform a body gesture feature. The body gesture signal conversion module receives the body gesture feature and converts a signal to form a body gesture feature electrical signal. The body gesture storage module receives the body gesture feature electrical signal and compares the body gesture feature electrical signal with the sample gesture electrical signal to output a real-time gesture category of the user.
The body gesture processing module is built-in with a normal gesture category and an abnormal gesture category. The normal gesture category includes a conventional gesture such as standing and sitting gestures, and the abnormal gesture category includes an unconventional gesture such as falling, curling, and twitching gestures.
The comprehensive analysis module is communicated with or electrically connected to the body gesture processing module and the emotion processing module. The comprehensive analysis module receives the normal emotion category or the abnormal emotion category output by the emotion processing module and receives the normal gesture category or the abnormal gesture category output by the body gesture processing module and analyzes whether a problem is provided with a health state of the user. If both of the emotion category and the gesture category are normal, a monitoring action continues, and a signal of executing the monitoring action is output. If one of the emotion category and the gesture category is normal, a family member is alerted to a phenomenon and remotely controls the phenomenon. If both of the emotion category and Te 00 gesture category are abnormal, a signal of executing a warning action is output. The controller is communicated with or electrically connected to the comprehensive analysis module. The face image collecting module is communicated with or electrically connected to the 5 controller. The controller is built-in with identity information and medical information of the user. The identity information includes a name, an age, an address, an emergency contact, a family doctor (if any), etc. The medical information includes a medical history, an allergy history and other information for timely processing. The controller receives the signal of executing the warning action output by the comprehensive analysis module and executes the warning action.
The controller is communicated with or electrically connected to the community service platform, the medical service platform and the remote control platform, respectively. The medical service platform is communicated with or electrically connected to the community service platform.
The controller performs the warning action including receiving the image transmitted by the face image collecting module. The controller transmits the image, the identity information and the medical information of the user to the community service platform, the medical service platform, and the remote control platform. The community service platform includes a community hospital and a property management center. The remote control platform includes a client terminal. The controller sends an abnormal information of a patient to the client terminal of the corresponding family member for warning, so that the abnormal information of the patient can be notified to the corresponding family member at the first time, so as to realize functions of real-time monitoring and timely warning of the patient, and enable the patient to receive timely treatment, thereby improving the medical safety of the user. The property management center cooperates with the community hospital to take preliminary treatment measures for the patient in time. If it is determined that the community hospital is unable to provide follow-up treatment, the community hospital contacts the medical service platform to send the patient to the medical service platform for follow-up treatment.

Claims (2)

  1. Claims LU502466 I. A medical warning system based on a face image and emotion recognition, comprising a monitoring device, a controller, a community service platform, a medical service platform, and a remote control platform, wherein the monitoring device comprises a sample emotion collecting module, a sample emotion training module, a face image collecting module, an emotion feature extraction module, an emotion signal conversion module, an emotion processing module, a sample body gesture collecting module, a body gesture collecting module, a body gesture feature extraction module, a body gesture signal conversion module, a body gesture storage module, a body gesture processing module, and a comprehensive analysis module, the controller is communicated with or electrically connected to the monitoring device, the community service platform, and the remote control platform, respectively, and the medical service platform is communicated with or electrically connected to the community service platform.
  2. 2. The medical warning system based on the face image and the emotion recognition according to claim 1, wherein the face image collecting module is communicated with or electrically connected to the emotion feature extraction module, the emotion feature extraction module is communicated with or electrically connected to the emotion signal conversion module, the emotion signal conversion module is communicated with or electrically connected to the sample emotion collecting module, the sample emotion collecting module is communicated with or electrically connected to the sample emotion training module, and the emotion processing module is communicated with or electrically connected to the sample emotion training module.
LU502466A 2022-07-06 2022-07-06 Medical warning system based on face images and emotion recognition LU502466B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
LU502466A LU502466B1 (en) 2022-07-06 2022-07-06 Medical warning system based on face images and emotion recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
LU502466A LU502466B1 (en) 2022-07-06 2022-07-06 Medical warning system based on face images and emotion recognition

Publications (1)

Publication Number Publication Date
LU502466B1 true LU502466B1 (en) 2023-01-06

Family

ID=84817622

Family Applications (1)

Application Number Title Priority Date Filing Date
LU502466A LU502466B1 (en) 2022-07-06 2022-07-06 Medical warning system based on face images and emotion recognition

Country Status (1)

Country Link
LU (1) LU502466B1 (en)

Similar Documents

Publication Publication Date Title
CN105460713A (en) Wireless elevator passenger safety management system
CN108320814A (en) A kind of old man family remote monitoring system based on wearable wisdom clothing
CN110327051A (en) A kind of intelligent guarding system in the nursing type home for destitute based on cloud platform
EP2515760A1 (en) Affective well-being supervision system and method
CN111035366A (en) Home-based aged-care intelligent service system based on Internet of things
CN116978510A (en) Nursing grading evaluation system for home cerebral apoplexy patient
CN112386238A (en) Household medical health management system
CN108010579A (en) Health monitoring system
CN109727653A (en) A kind of community intelligent health monitoring system
LU502466B1 (en) Medical warning system based on face images and emotion recognition
CN113869179A (en) Multi-mode feature attention fused home-based and aged-care intelligent monitoring method and system
CN113971869A (en) Method and device for monitoring home safety of old people
CN206251136U (en) A kind of intelligent sound monitor system
CN220820814U (en) Medical warning system based on face image and emotion recognition
CN117038027A (en) Nurse station information management system
CN116312952A (en) Chest compression feedback method, device, readable storage medium and program product
KR20100048768A (en) System and method for home healthcare management
CN114998834A (en) Medical warning system based on face image and emotion recognition
KR20210006200A (en) Silver Healthcare System using AMI Networks
CN110166645A (en) A kind of call service system based on electro-ocular signal control
US20220005338A1 (en) Personal safety assurance system and safety monitoring method
CN115733850A (en) Wireless transparent transmission module for intelligent old-age care and working method
CN221551289U (en) Distress call device and electronic equipment
CN112826484A (en) Emergency high-safety medical monitoring equipment
CN111265377A (en) Old nursing bed with automatic alarm mechanism

Legal Events

Date Code Title Description
FG Patent granted

Effective date: 20230106