CN114795125A - Middle and old aged physical examination system and device based on multi-modal physiological signal processing - Google Patents
Middle and old aged physical examination system and device based on multi-modal physiological signal processing Download PDFInfo
- Publication number
- CN114795125A CN114795125A CN202210479930.4A CN202210479930A CN114795125A CN 114795125 A CN114795125 A CN 114795125A CN 202210479930 A CN202210479930 A CN 202210479930A CN 114795125 A CN114795125 A CN 114795125A
- Authority
- CN
- China
- Prior art keywords
- physical examination
- signal
- examinee
- blood oxygen
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0062—Arrangements for scanning
- A61B5/0064—Body surface scanning
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
- A61B5/14551—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
- A61B5/14551—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
- A61B5/14552—Details of sensors specially adapted therefor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
- A61B5/14551—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
- A61B5/14553—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases specially adapted for cerebral tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/40—Detecting, measuring or recording for evaluating the nervous system
- A61B5/4076—Diagnosing or monitoring particular conditions of the nervous system
- A61B5/4088—Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4854—Diagnosis based on concepts of traditional oriental medicine
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/7405—Details of notification to user or communication with user or patient ; user input means using sound
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/743—Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/7465—Arrangements for interactive communication between patient and care services, e.g. by using a telephone network
Abstract
The invention discloses a middle-aged and elderly physical examination system based on multi-modal physiological signal processing, which comprises a signal acquisition unit, a data analysis processing unit, a brain screening unit, a cognitive evaluation unit and a human-computer interaction unit, wherein the signal acquisition unit is used for acquiring a plurality of physiological signals; the invention discloses a middle-aged and elderly physical examination device based on multi-modal physiological signal processing, which comprises a movable physical examination table, a movable shooting bracket, a color image collector, an infrared temperature imaging collector, a human-computer interaction device and processing equipment, wherein the movable physical examination table is arranged on the middle-aged and elderly physical examination table; the invention has the advantages that the infrared thermal imaging technology is adopted to diagnose diseases, no radiation is generated to human bodies, the machine and the operation cost are low, the cause of the diseases can be discovered before the organic lesions of the human bodies occur, and the conditioning reference is provided for examinees in the reversible stage of the diseases. And adopt infrared brain blood oxygen collection device to gather and analysis brain blood oxygen, easy operation has just reduced the contact between operator and the examinee, accords with epidemic situation requirement.
Description
Technical Field
The invention relates to the field of detection and processing of neural and physiological signals, in particular to a middle-aged and elderly physical examination system and device based on multi-modal physiological signal processing.
Background
At present, the aging degree of China is more and more serious, and the health problems of the middle-aged and old people are closely related to everyone and cannot be ignored. Common diseases of the middle-aged and the elderly, such as neck, shoulder, waist and leg pain, cognitive impairment, psychological diseases, cerebral apoplexy and the like, wherein organic lesions of the neck, shoulder, waist and leg can be checked and determined by imaging technologies such as X-ray or nuclear magnetic resonance and the like. However, according to the current medical state of China, X-ray or nuclear magnetic resonance cannot be used as a routine physical examination item, and both the X-ray or nuclear magnetic resonance can cause radiation to doctors and examinees to damage the bodies; the cost and the operation cost of the machine are high, and the machine cannot be popularized; most of these imaging techniques only detect irreversible damage that has been diseased, but not disease before organic lesions develop. Therefore, a disease detection means which is low in cost, non-radiative to human body, capable of discovering before organic lesions occur, analyzing disease causes and providing conditioning reference for subjects is needed.
Regarding cognitive disorder and psychological diseases of middle-aged and elderly people, diagnosis is usually determined by means of psychology scales and cognitive scales at present, which requires that an answerer concentrates on and communicates with an operator for a long time, and for the elderly, the answerer is difficult to concentrate on for a long time, so that a good diagnosis effect is achieved. Therefore, there is also a need for a simpler detection method, which can reduce the contact between the operator and the subject and meet the epidemic situation.
Disclosure of Invention
The invention aims to provide a middle-aged and elderly physical examination system based on multi-modal physiological signal processing, and the invention also aims to provide a middle-aged and elderly physical examination device based on multi-modal physiological signal processing.
The middle-aged and elderly physical examination system based on multi-modal physiological signal processing comprises a signal acquisition unit, a data analysis processing unit, a brain screening unit, a cognitive evaluation unit and a human-computer interaction unit;
the signal acquisition unit is used for acquiring data of the movable physical examination table, the color image collector and the infrared temperature imaging collector which are arranged on the movable shooting support;
the data analysis processing unit is used for obtaining the complexion diagnosis result of the examined person and the health condition analysis result of neck, shoulder, waist, leg and superficial organs according to the complexion signal and the body surface temperature field signal;
the brain screening unit is used for combining the brain blood oxygen signal and the infrared temperature signal and analyzing the possibility that the examinee suffers from stroke and brain insufficiency;
the cognitive evaluation unit is used for carrying out brain function network analysis processing on the blood oxygen signal and analyzing the possibility of suffering from cognitive disorder and psychological diseases of an examinee;
the human-computer interaction unit comprises audio and video playing and is used for guiding the participation of the examinees.
The key concept of the technical scheme is as follows: can discover the disease cause before the occurrence of the organic lesion of the human body, analyze the disease cause and provide conditioning reference for a detected person in the reversible stage of the disease.
Further, portable physical examination platform is including being furnished with brain blood oxygen signal acquisition device's helmet, battery, wireless data transmission device and automatic navigation way-finding device, can arrive the default position according to predetermineeing the route and predetermineeing the detection order automatically to the gesture is in order to make things convenient for the signal acquisition automatically.
Furthermore, the movable shooting support is used for fixing, moving and adjusting the color image collector, the infrared temperature imaging collector, the height and the angle of the color image collector and the infrared temperature imaging collector.
Further, signal acquisition device can gather brain blood oxygen signal, resting state blood oxygen signal, face color signal, body surface temperature field signal, infrared temperature signal.
Furthermore, the complexion diagnosis refers to traversing a typical complexion map, comparing the typical complexion map with the complexion signals, classifying through histogram similarity comparison, and predicting the traditional Chinese medicine constitution information of the examined person and common diseases corresponding to the complexion signals.
Furthermore, the health condition analysis of the neck, shoulder, waist, leg and superficial organs refers to traversing typical body surface temperature field signals, comparing the histogram similarity, and analyzing the health conditions of the neck, shoulder, waist, leg and superficial organs by combining the diagnosis characteristics of the body surface temperature field.
Further, the brain screening unit analysis process comprises preliminary screening and further analysis; the further analysis refers to the steps of carrying out voice and limb interaction with the examinee through the man-machine interaction unit, collecting the brain blood oxygen signal and the infrared temperature signal, and analyzing the possibility that the examinee suffers from stroke and brain function insufficiency again.
Further, the cognitive disorder and the psychological disease refer to cognitive disorder and psychological disease which are easily reflected on abnormal blood oxygen signals, including depression and Alzheimer's disease.
Further, the cognitive assessment unit further comprises analysis of thyroid function in combination with infrared temperature signals; performing voice and limb interaction with a detected person through the human-computer interaction unit, and further screening the cognitive disorder and the psychological disease; calculating a cognitive scale score by integrating the answer condition of the cognitive scale and the comparison between the answer condition and the resting state blood oxygen signal during interaction; assessing the relationship of cognitive impairment to thyroid function using image similarity contrast; and outputting the cognitive disorder evaluation result.
The middle-aged and elderly physical examination device based on multi-modal physiological signal processing comprises a movable physical examination table, a movable shooting support, a color image collector, an infrared temperature imaging collector, a human-computer interaction device and processing equipment; the mobile physical examination table comprises a helmet provided with a brain blood oxygen signal acquisition device, a battery, a wireless data transmission device and an automatic navigation and path finding device, is used for acquiring brain blood oxygen signals and resting state blood oxygen signals of an examinee, can automatically reach preset positions according to a preset path and a preset detection sequence, automatically adjusts the posture to facilitate signal acquisition, and uploads the acquired signals to the processing equipment through the wireless data transmission device;
the movable shooting support is used for fixing, moving and adjusting the color image collector, the infrared temperature imaging collector and the heights and angles of the color image collector and the infrared temperature imaging collector, and collecting a face color signal, a body surface temperature field signal and an infrared temperature signal;
the human-computer interaction device is arranged on the movable physical examination table and is used for guiding the participation of the examinees through audio and video playing;
the processing equipment is used for analyzing, screening and evaluating the physical condition of a subject;
wherein, wireless data transmission is adopted among the mobile physical examination platform, the color image collector, the infrared temperature imaging collector, the man-machine interaction device and the processing equipment.
The invention has the advantages that the infrared thermal imaging technology is adopted to diagnose the diseases, no radiation is generated to the human body, the machine and the operation cost are low, the cause of the diseases can be discovered before the organic lesions of the human body occur, and the conditioning reference is provided for the examinees in the reversible stage of the diseases. And adopt infrared brain blood oxygen collection system to gather and the analysis brain blood oxygen, easy operation has just reduced the contact between operator and the examinee, accords with epidemic situation requirement.
Drawings
FIG. 1 is a block diagram of the system of the present invention.
Figures 2.1, 2.2 are front and side views of the electrically powered wheelchair according to the invention.
Fig. 3.1 and 3.2 are a schematic view and an enlarged view of part a of the mobile camera support according to the invention.
Fig. 4 is a preparatory flow to the practice of the invention.
Fig. 5 is a face color detection flow of the implementation process of the present invention.
Fig. 6 is a flow chart of cerebral blood oxygen detection in accordance with an embodiment of the present invention.
Fig. 7 is a cognitive impairment detection process implemented in accordance with the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely below, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
As shown in fig. 1, the middle-aged and elderly physical examination system based on multi-modal physiological signal processing comprises a signal acquisition unit, a data analysis processing unit, a brain screening unit, a cognitive evaluation unit and a human-computer interaction unit;
the signal acquisition unit is used for acquiring data of the movable physical examination table and the color image collector and the infrared temperature imaging collector which are arranged on the movable shooting bracket; the data comprises a cerebral blood oxygen signal, a resting state blood oxygen signal, a face color signal, a body surface temperature field signal, an infrared temperature signal and the like.
As shown in fig. 2.1, 2.2, 3.1 and 3.2, the movable physical examination table is an electric wheelchair 1, and is provided with a helmet 1.1 integrated with a cerebral blood oxygen signal acquisition device, so that cerebral blood oxygen signals can be acquired when a subject uses the wheelchair. Meanwhile, the wheelchair is also provided with a battery and a wireless data transmission device 1.2 which are used for supplying power to the wheelchair and synchronously transmitting the acquired data of the examinee to the signal acquisition unit; the automatic navigation and path finding device 1.3 is used for automatically reaching a preset position according to a preset path and a preset detection sequence, automatically adjusting the posture to match the angle adjustment of the camera, and conveniently acquiring signals, namely automatically finding a movable shooting support 2 (shown in figures 3.1 and 3.2) for fixing a color camera and an infrared temperature imaging camera to acquire the face color and the infrared signals. Meanwhile, the chair back of the electric wheelchair 1 is provided with a window, so that the part of the back of the examinee, which can collect infrared temperature field information, can be exposed to the maximum extent while the examinee can safely take the chair, the infrared temperature field signals can be conveniently collected, and the height can be adjusted according to the individual difference of different examinees.
The color camera is used for collecting face color signals, the color camera is firstly fixed on the movable shooting support 2, the movable shooting support 2 is lifted, the camera is convenient to observe, the head and face positions are automatically locked, then the camera descends to the optimal position to shoot pictures, and the face color signal collection is completed.
The infrared temperature imaging camera is used for collecting body surface temperature field signals, the examinee takes off clothes in a consulting room, a system operator wears the helmet 1.1 on the examinee, the electric wheelchair 1 automatically seeks a way and remotely controls fine adjustment through the system operator, the examined part of the examinee is exposed under the infrared camera, the infrared temperature imaging principle is utilized, the examinee receives infrared temperature collection in a resting state, and data are synchronously transmitted to the signal collecting unit;
moreover, the color camera and the infrared temperature imaging camera can synchronously transmit the attitude information of the collected examinee to the signal collecting unit while collecting the face color signal and the body surface temperature field signal, and the attitude of the examinee is guided through the human-computer interaction unit after system operation so as to achieve the optimal information collecting state.
The data analysis processing unit is used for processing the complexion signals and the temperature field signals by traversing typical complexion maps of different parts and comparing the complexion signals according to the complexion signals and the body surface temperature field signals and adopting a histogram similarity comparison mode, diagnosing and analyzing neck, shoulder, waist and leg and superficial organs with the highest diagnosis accuracy by combining the characteristics of body surface temperature field diagnosis, obtaining the traditional Chinese medicine constitution information of the current examinee, common diseases corresponding to the current complexion, and the health condition analysis results of the neck, shoulder, waist and leg and superficial organs, and writing a traditional Chinese medicine conditioning method corresponding to the results into a report and outputting the results together;
the brain screening unit is used for analyzing the possibility that the examinee suffers from cerebral apoplexy and cerebral insufficiency by combining the cerebral blood oxygen signal and the infrared temperature signal, and the brain screening unit is used for initial examination. The suspected patient or the appointed examinee that the system operator set up in the preliminary examination carries out further task attitude analysis, namely carry out pronunciation and limbs with the examinee and interact with the panel computer that installs in the wheelchair the place ahead, accomplish specific limbs action by the examinee, if let the examinee lift both arms or both legs to the same height, and keep a period of time etc. gather cerebral blood oxygen signal and infrared imaging signal, judge that the examinee has the possibility of cerebral apoplexy and brain function insufficiency.
The cognitive evaluation unit is used for carrying out brain function network analysis processing on the resting state blood oxygen signal and analyzing the possibility that the examinee suffers from cognitive disorder, Alzheimer disease and the like which are easy to be reflected on brain blood oxygen and the possibility of suffering from psychological diseases. In addition, thyroid hypofunction is a cause of cognitive impairment and psychological diseases, and cognitive impairment and psychological diseases caused by thyroid hypofunction are reversible and easy to cure. Therefore, for the examinee suspected of cognitive impairment and psychological diseases, whether the examinee is caused by hypothyroidism or not is analyzed by combining infrared temperature imaging, and the thyroid function condition of the examinee is judged. Then, performing task state analysis on the suspected case or a designated subject set by an operator, namely performing voice and limb interaction with the subject by using a tablet computer arranged in front of a wheelchair, completing the response of a cognitive scale by the subject, recalculating the score of the cognitive scale of the subject by integrating the answer condition of the cognitive scale of the subject and the comparison result of task state and resting state electroencephalogram data, and evaluating the relationship between cognitive disorder and thyroid function by using image similarity contrast; and outputting the cognitive disorder evaluation result.
As shown in fig. 2.1 and 2.2, the human-computer interaction unit 3 is installed on the electric wheelchair 1, and is used for audio-video playing to guide the participation of the examinee. After the examinee sits on the wheelchair 1, the human-computer interaction unit 3 can automatically adjust the volume of the voice prompt to a range which is enough for the examinee to hear clearly; in the acquisition link of the cerebral blood oxygen signals, the examinee can be kept in a resting state through voice prompt; in the face color signal acquisition link, the examinee can be prompted to sit upright through voice, and the face color signal acquisition is received by the alignment camera. In a body surface temperature field signal acquisition link, the posture of the examinee can be adjusted through voice prompt so as to accurately acquire signals. Meanwhile, when brain screening and cognitive assessment are carried out, the human-computer interaction unit broadcasts voice and limb interaction content, an operation method and cautions to the examinee by using voice, the human-computer interaction unit collects voice information of the examinee, and the color camera collects limb actions of the examinee.
As shown in fig. 2.1, 2.2, 3.1 and 3.2, the middle-aged and elderly physical examination device based on multi-modal physiological signal processing comprises a mobile physical examination table, namely an electric wheelchair 1, a mobile shooting support 2, a color image collector, an infrared temperature imaging collector, a human-computer interaction device 3 and processing equipment;
the electric wheelchair 1 is provided with a helmet 1.1 integrated with a cerebral blood oxygen signal acquisition device, and can acquire cerebral blood oxygen signals when a detected person uses the electric wheelchair. Meanwhile, the wheelchair is also provided with a battery and a wireless data transmission device 1.2 which are used for supplying power to the wheelchair and synchronously transmitting the acquired data of the examinee to the processing equipment; the automatic navigation and path finding device 1.3 is used for automatically reaching a preset position according to a preset path and a preset detection sequence, automatically adjusting the posture to match the angle adjustment of a camera, and conveniently acquiring signals, namely automatically finding a movable shooting support 2 for fixing a color camera and an infrared temperature imaging camera to acquire face colors and infrared signals. Meanwhile, the chair back of the electric wheelchair 1 is provided with a window, so that the part of the back of the examinee, which can collect infrared temperature field information, can be exposed to the maximum extent while the examinee can safely take the chair, the infrared temperature field signals can be conveniently collected, and the height can be adjusted according to the individual difference of different examinees.
The mobile shooting bracket 2 is provided with a color camera mounting position 2.1 and an infrared temperature imaging camera mounting position 2.2, and can be used for mounting a color camera and an infrared temperature imaging camera at the same time; and can automatically cooperate with the electric wheelchair 1 to adjust the up-and-down position and the pitching angle according to the difference of the examined parts and the individual difference of the examined person, so as to better collect information.
The human-computer interaction device 3 is arranged on the electric wheelchair 1 and can guide the cooperation detection of the examinee through audio and video playing;
the processing equipment is used for analyzing, screening and evaluating the physical condition of a subject;
wherein, the electric wheelchair 1, the color image collector, the infrared temperature imaging collector, the man-machine interaction device 3 and the processing equipment adopt wireless data transmission.
The specific implementation process of the invention is as follows:
as shown in fig. 4, after the physical examination is started, the system operator inputs basic information of the examinee and adjusts the volume of the human-computer interaction unit so that the examinee can easily hear the information. The examinee takes off the clothes of the whole body and sits on the electric wheelchair 1, the system operator assists in adjusting the height of the chair back of the electric wheelchair 1, and wears the blood oxygen acquisition helmet for the examinee according to the individual difference of the examinee, adjusts the acquisition parameters, keeps the acquisition helmet to be capable of contacting with the scalp, and fixes the helmet.
As shown in fig. 5, the electric wheelchair 1 is started, the electric wheelchair 1 enters the automatic route searching mode, and the electric wheelchair travels to the front of the movable shooting support 2 for collecting the facial image and the infrared temperature field according to the predetermined route. By the cooperation of portable shooting support 2 and electronic wheelchair 1, use the color camera to carry out gesture recognition to the person being examined and look for facial position and automatic control support removes person being examined facial the place ahead, combine human-computer interaction system's voice prompt, remind the person being examined just to shoot the camera, or by system operator's remote control fine setting wheelchair angle or camera height, reach the best and shoot the requirement, lock person being examined face and diagnose and shoot. Then the color camera is lifted to the top end of the movable shooting support 2, and the elevation angle is adopted to face the examinee, so that the posture of the examinee is recorded in real time. Then, with the rotation of the electric wheelchair and the movement of the bracket, the infrared camera is used for photographing key parts of neck, shoulder, waist and legs, superficial internal organs and the like of the examinee, and the system operator can also finely adjust and confirm the position during photographing.
After the signal acquisition unit acquires the face color signal and the body surface temperature field signal, the data analysis processing unit processes the face color signal and the temperature field signal by traversing typical face color maps of different parts and comparing the face color signal with the face color signal in a histogram similarity comparison mode, diagnoses and analyzes neck, shoulder, waist and leg and superficial organs with the highest diagnosis accuracy by combining the characteristics of body surface temperature field diagnosis to obtain the traditional Chinese medicine constitution information of the current examinee, common diseases corresponding to the current face color, and the health condition analysis results of the neck, shoulder, waist and leg and superficial organs, and writes the traditional Chinese medicine conditioning method corresponding to the results into a report and outputs the results together.
The subject was then allowed to rest for 5 minutes and analyzed for the likelihood of the subject having cognitive impairment, psychological disease and stroke.
As shown in fig. 6, the cerebral blood oxygen test was started. Through the man-machine interaction unit, the voice prompts the examinee to start detection, and prompts the examinee to keep a relaxed posture. The brain blood oxygen data is collected through the helmet 1.1, and the posture action of the testee is detected through the color camera. After the data acquisition unit acquires corresponding data, the brain screening unit eliminates interference information and analyzes resting state blood oxygen content. The suspected patient in the preliminary examination or the appointed examinee who sets up of system operator further use the panel computer of installing in the wheelchair the place ahead to carry out pronunciation and limbs with the examinee and interact, accomplish specific limbs action by the examinee, if let the examinee lift both arms or both legs to same height to keep for a period of time etc. gather cerebral blood oxygen signal and infrared imaging signal, judge the possibility that the examinee has cerebral apoplexy and brain insufficiency.
As shown in fig. 7, if the brain screening unit performs brain function network analysis processing on the resting state blood oxygen signal, it is found that the possibility that the examinee has cognitive impairment and psychological disease which are easily reflected on the brain blood oxygen such as depression and alzheimer's disease is affected. Whether the thyroid function of the examinee is reduced or not is analyzed by the cognitive evaluation unit in combination with infrared temperature imaging; the panel computer arranged in front of the wheelchair is used for interacting with the examinee through voice and limbs, and the examinee completes the cognitive scale. After the cognition evaluation unit acquires the relevant information, the cognition impairment condition of the testee is jointly judged by combining the cognition scale answer condition, the resting state electroencephalogram data, the comparison result of the electroencephalogram data when voice and limb interact and the thyroid function condition. After the diagnosis is completed, the helmet is removed from the system operator for the subject, and a detection report is generated and can be viewed and output by the operator.
Claims (10)
1. The utility model provides a middle-aged and old physical examination system based on multi-modal physiological signal processing which characterized in that: the brain screening device comprises a signal acquisition unit, a data analysis and processing unit, a brain screening unit, a cognitive evaluation unit and a man-machine interaction unit;
the signal acquisition unit is used for acquiring data of the movable physical examination table, the color image collector and the infrared temperature imaging collector which are arranged on the movable shooting support;
the data analysis processing unit is used for obtaining the complexion diagnosis result of the examined person and the health condition analysis result of neck, shoulder, waist, leg and superficial organs according to the complexion signal and the body surface temperature field signal;
the brain screening unit is used for combining the brain blood oxygen signal and the infrared temperature signal and analyzing the possibility that the examinee suffers from cerebral apoplexy and cerebral insufficiency;
the cognitive evaluation unit is used for carrying out brain function network analysis processing on the blood oxygen signal and analyzing the possibility of suffering from cognitive disorder and psychological diseases of an examinee;
the human-computer interaction unit comprises audio and video playing and is used for guiding the participation of the examinees.
2. The system for physical examination of middle aged and elderly people based on multi-modal physiological signal processing according to claim 1, wherein: the mobile physical examination table comprises a helmet, a battery, a wireless data transmission device and an automatic navigation path searching device, wherein the helmet, the battery, the wireless data transmission device and the automatic navigation path searching device are provided with a brain blood oxygen signal acquisition device, and can automatically reach a preset position according to a preset path and a preset detection sequence and automatically adjust the posture so as to conveniently acquire signals.
3. The system for physical examination of middle aged and old people based on multi-modal physiological signal processing according to claim 1 or 2, wherein: the movable shooting support is used for fixing, moving and adjusting the color image collector, the infrared temperature imaging collector and the height and angle of the color image collector and the infrared temperature imaging collector.
4. The system for physical examination of middle aged and old people based on multi-modal physiological signal processing according to claim 1 or 2, wherein: the signal acquisition device can acquire the cerebral blood oxygen signal, the resting state blood oxygen signal, the face color signal, the body surface temperature field signal and the infrared temperature signal of the examinee.
5. The system for physical examination of middle aged and old people based on multi-modal physiological signal processing according to claim 1 or 2, wherein: the complexion diagnosis of the examinee refers to traversing a typical complexion map, comparing the typical complexion map with the complexion signals, classifying through histogram similarity comparison, and predicting the traditional Chinese medicine constitution information of the examinee and common diseases corresponding to the complexion signals.
6. The system for physical examination of middle aged and old people based on multi-modal physiological signal processing according to claim 1 or 2, wherein: the health condition analysis of the neck, shoulder, waist, leg and superficial organs refers to traversing typical body surface temperature field signals, comparing the histogram similarity, and analyzing the health condition of the neck, shoulder, waist, leg and superficial organs by combining the diagnosis characteristics of the body surface temperature field.
7. The system for physical examination of middle aged and old people based on multi-modal physiological signal processing according to claim 1 or 2, wherein: the brain screening unit analysis process comprises primary screening and further analysis; the further analysis refers to the steps of carrying out voice and limb interaction with the examinee through the man-machine interaction unit, collecting the brain blood oxygen signal and the infrared temperature signal, and analyzing the possibility that the examinee suffers from stroke and brain function insufficiency again.
8. The system for physical examination of middle aged and old people based on multi-modal physiological signal processing according to claim 1 or 2, wherein: the cognitive disorder and the psychological disease refer to cognitive disorder and psychological disease which are easily reflected on abnormal blood oxygen signals, and comprise depression and Alzheimer's disease.
9. The system for physical examination of middle aged and old people based on multi-modal physiological signal processing according to claim 1 or 2, wherein: the cognitive evaluation unit further comprises a thyroid function analysis unit which analyzes thyroid function in combination with the infrared temperature signal; performing voice and limb interaction with a detected person through the human-computer interaction unit, and further screening the cognitive disorder and the psychological disease; calculating a cognitive scale score by integrating the answer condition of the cognitive scale and the comparison between the answer condition and the resting state blood oxygen signal during interaction; assessing the relationship of cognitive impairment to thyroid function using image similarity contrast; and outputting the cognitive disorder evaluation result.
10. The utility model provides a middle-aged and old physical examination device based on multi-modal physiological signal processing which characterized in that: the system comprises a movable physical examination table, a movable shooting support, a color image collector, an infrared temperature imaging collector, a human-computer interaction device and processing equipment; the mobile physical examination table comprises a helmet provided with a brain blood oxygen signal acquisition device, a battery, a wireless data transmission device and an automatic navigation and path finding device, is used for acquiring brain blood oxygen signals and resting state blood oxygen signals of an examinee, can automatically reach preset positions according to a preset path and a preset detection sequence, automatically adjusts the posture to facilitate signal acquisition, and uploads the acquired signals to the processing equipment through the wireless data transmission device;
the movable shooting support is used for fixing, moving and adjusting the color image collector, the infrared temperature imaging collector and the heights and angles of the color image collector and the infrared temperature imaging collector, and collecting a face color signal, a body surface temperature field signal and an infrared temperature signal;
the human-computer interaction device is arranged on the movable physical examination table and is used for guiding the participation of the examinees through audio and video playing;
the processing equipment is used for analyzing, screening and evaluating the physical condition of a subject;
the mobile physical examination table, the color image collector, the infrared temperature imaging collector, the man-machine interaction device and the processing equipment are in wireless data transmission.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210479930.4A CN114795125A (en) | 2022-05-05 | 2022-05-05 | Middle and old aged physical examination system and device based on multi-modal physiological signal processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210479930.4A CN114795125A (en) | 2022-05-05 | 2022-05-05 | Middle and old aged physical examination system and device based on multi-modal physiological signal processing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114795125A true CN114795125A (en) | 2022-07-29 |
Family
ID=82512308
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210479930.4A Pending CN114795125A (en) | 2022-05-05 | 2022-05-05 | Middle and old aged physical examination system and device based on multi-modal physiological signal processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114795125A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116211253A (en) * | 2023-02-27 | 2023-06-06 | 国家康复辅具研究中心 | System and method for checking experimental paradigm of cognitive disorder of old people |
-
2022
- 2022-05-05 CN CN202210479930.4A patent/CN114795125A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116211253A (en) * | 2023-02-27 | 2023-06-06 | 国家康复辅具研究中心 | System and method for checking experimental paradigm of cognitive disorder of old people |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Li et al. | The obf database: A large face video database for remote physiological signal measurement and atrial fibrillation detection | |
| US20090216092A1 (en) | System for analyzing eye responses to accurately detect deception | |
| US20040082862A1 (en) | Examination and imaging of brain cognitive functions | |
| CN111326253A (en) | Method for evaluating multi-modal emotional cognitive ability of patients with autism spectrum disorder | |
| CN109615633A (en) | Crohn disease assistant diagnosis system and method under a kind of colonoscopy based on deep learning | |
| CN109411084A (en) | A kind of intestinal tuberculosis assistant diagnosis system and method based on deep learning | |
| AU2017263802B8 (en) | A user interface for navigating through physiological data | |
| CN109447987A (en) | Ulcerative colitis assistant diagnosis system and method under colonoscopy based on deep learning | |
| CN112232256B (en) | Contactless sports and body measurement data acquisition system | |
| CN111248890A (en) | Non-contact newborn heart rate monitoring method and system based on facial video | |
| US20180279935A1 (en) | Method and system for detecting frequency domain cardiac information by using pupillary response | |
| CN112294282A (en) | Self-calibration method of emotion detection device based on RPPG | |
| CN104739366B (en) | A kind of portable binocular pupil detector | |
| CN114795125A (en) | Middle and old aged physical examination system and device based on multi-modal physiological signal processing | |
| CN109700423B (en) | Intelligent vision detection method and device capable of automatically sensing distance | |
| US20230096006A1 (en) | Methods and systems for automated clinical workflows | |
| CN107997760B (en) | Relevance evaluation method for human body physiological and psychological measurement data | |
| US10631727B2 (en) | Method and system for detecting time domain cardiac parameters by using pupillary response | |
| RU184210U1 (en) | AUTOMATED DEVICE FOR MONITORING AND EVALUATING THE STATE OF THE MONITORED SUBJECT | |
| CN116407096A (en) | Vital sign detection device, system and data processing method | |
| CN111700598B (en) | Pulse feeling device | |
| CN110148110B (en) | Spontaneous intelligent diagnosis system for eye shake | |
| FR3123795A1 (en) | Help system to provide diagnostic information | |
| WO2020209401A1 (en) | Eye imaging apparatus | |
| JP2003520622A (en) | Method and apparatus for high resolution dynamic digital infrared imaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |