CN113539486A - Health state identification system based on traditional Chinese medicine facial and tongue manifestation dynamic change - Google Patents
Health state identification system based on traditional Chinese medicine facial and tongue manifestation dynamic change Download PDFInfo
- Publication number
- CN113539486A CN113539486A CN202111077108.7A CN202111077108A CN113539486A CN 113539486 A CN113539486 A CN 113539486A CN 202111077108 A CN202111077108 A CN 202111077108A CN 113539486 A CN113539486 A CN 113539486A
- Authority
- CN
- China
- Prior art keywords
- facial
- information
- user
- data
- chinese medicine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000001815 facial effect Effects 0.000 title claims abstract description 64
- 239000003814 drug Substances 0.000 title claims abstract description 54
- 230000036541 health Effects 0.000 title claims abstract description 39
- 230000008859 change Effects 0.000 title claims abstract description 18
- 238000012545 processing Methods 0.000 claims abstract description 33
- 208000024891 symptom Diseases 0.000 claims description 66
- 238000000034 method Methods 0.000 claims description 31
- 238000004458 analytical method Methods 0.000 claims description 29
- 208000011580 syndromic disease Diseases 0.000 claims description 28
- 230000003862 health status Effects 0.000 claims description 17
- 208000017667 Chronic Disease Diseases 0.000 claims description 15
- 230000008569 process Effects 0.000 claims description 13
- 210000002569 neuron Anatomy 0.000 claims description 12
- 238000004364 calculation method Methods 0.000 claims description 11
- 230000006870 function Effects 0.000 claims description 11
- 238000007781 pre-processing Methods 0.000 claims description 10
- 238000003062 neural network model Methods 0.000 claims description 9
- 238000010606 normalization Methods 0.000 claims description 9
- 239000000126 substance Substances 0.000 claims description 9
- 238000011835 investigation Methods 0.000 claims description 7
- 238000013528 artificial neural network Methods 0.000 claims description 6
- 238000012546 transfer Methods 0.000 claims description 6
- 238000012216 screening Methods 0.000 claims description 5
- 208000027407 head symptom Diseases 0.000 claims description 4
- 206010060891 General symptom Diseases 0.000 claims description 3
- 238000004140 cleaning Methods 0.000 claims description 3
- 230000005284 excitation Effects 0.000 claims description 3
- 239000002932 luster Substances 0.000 claims description 3
- 238000012800 visualization Methods 0.000 claims description 3
- 238000012935 Averaging Methods 0.000 claims description 2
- 239000011248 coating agent Substances 0.000 claims 2
- 238000000576 coating method Methods 0.000 claims 2
- 201000010099 disease Diseases 0.000 abstract description 29
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 abstract description 29
- 230000008901 benefit Effects 0.000 abstract description 4
- 230000007774 longterm Effects 0.000 abstract description 3
- 238000010219 correlation analysis Methods 0.000 description 16
- 238000003745 diagnosis Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 8
- 208000006545 Chronic Obstructive Pulmonary Disease Diseases 0.000 description 6
- 238000007689 inspection Methods 0.000 description 6
- 238000011161 development Methods 0.000 description 4
- 230000018109 developmental process Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000003449 preventive effect Effects 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 206010062717 Increased upper airway secretion Diseases 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 3
- 230000001684 chronic effect Effects 0.000 description 3
- 210000004072 lung Anatomy 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 208000026435 phlegm Diseases 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 208000006820 Arthralgia Diseases 0.000 description 2
- 206010011224 Cough Diseases 0.000 description 2
- 208000008454 Hyperhidrosis Diseases 0.000 description 2
- 206010028748 Nasal obstruction Diseases 0.000 description 2
- 206010041235 Snoring Diseases 0.000 description 2
- 206010060926 abdominal symptom Diseases 0.000 description 2
- 238000012098 association analyses Methods 0.000 description 2
- 238000003759 clinical diagnosis Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000002405 diagnostic procedure Methods 0.000 description 2
- 230000004069 differentiation Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000037315 hyperhidrosis Effects 0.000 description 2
- 230000003340 mental effect Effects 0.000 description 2
- 230000036285 pathological change Effects 0.000 description 2
- 231100000915 pathological change Toxicity 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 238000012163 sequencing technique Methods 0.000 description 2
- 230000009885 systemic effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 208000020084 Bone disease Diseases 0.000 description 1
- 206010007558 Cardiac failure chronic Diseases 0.000 description 1
- 206010061819 Disease recurrence Diseases 0.000 description 1
- 206010015137 Eructation Diseases 0.000 description 1
- 208000031361 Hiccup Diseases 0.000 description 1
- 206010020751 Hypersensitivity Diseases 0.000 description 1
- 206010020772 Hypertension Diseases 0.000 description 1
- 206010024264 Lethargy Diseases 0.000 description 1
- 206010061876 Obstruction Diseases 0.000 description 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 208000032140 Sleepiness Diseases 0.000 description 1
- 206010041349 Somnolence Diseases 0.000 description 1
- 206010041956 Stasis syndrome Diseases 0.000 description 1
- 206010047700 Vomiting Diseases 0.000 description 1
- 206010048232 Yawning Diseases 0.000 description 1
- 208000031971 Yin Deficiency Diseases 0.000 description 1
- 210000001015 abdomen Anatomy 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000001467 acupuncture Methods 0.000 description 1
- 208000026935 allergic disease Diseases 0.000 description 1
- 230000007815 allergy Effects 0.000 description 1
- 208000027687 belching Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 208000005634 blind loop syndrome Diseases 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 208000020832 chronic kidney disease Diseases 0.000 description 1
- 208000035850 clinical syndrome Diseases 0.000 description 1
- 208000010877 cognitive disease Diseases 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000013872 defecation Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 206010012601 diabetes mellitus Diseases 0.000 description 1
- 230000037213 diet Effects 0.000 description 1
- 235000005911 diet Nutrition 0.000 description 1
- 230000001079 digestive effect Effects 0.000 description 1
- 210000002249 digestive system Anatomy 0.000 description 1
- 208000010643 digestive system disease Diseases 0.000 description 1
- 230000006806 disease prevention Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 230000002124 endocrine Effects 0.000 description 1
- 210000000750 endocrine system Anatomy 0.000 description 1
- 208000030172 endocrine system disease Diseases 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 206010016256 fatigue Diseases 0.000 description 1
- 208000026278 immune system disease Diseases 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 230000008376 long-term health Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 208000030159 metabolic disease Diseases 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 208000005264 motor neuron disease Diseases 0.000 description 1
- 210000000214 mouth Anatomy 0.000 description 1
- 230000008035 nerve activity Effects 0.000 description 1
- 210000000653 nervous system Anatomy 0.000 description 1
- 230000001575 pathological effect Effects 0.000 description 1
- 230000002685 pulmonary effect Effects 0.000 description 1
- 238000004451 qualitative analysis Methods 0.000 description 1
- 238000004445 quantitative analysis Methods 0.000 description 1
- 230000003014 reinforcing effect Effects 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
- 210000002345 respiratory system Anatomy 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 230000037321 sleepiness Effects 0.000 description 1
- 206010041232 sneezing Diseases 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000002485 urinary effect Effects 0.000 description 1
- 208000037911 visceral disease Diseases 0.000 description 1
- 230000008673 vomiting Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/36—Creation of semantic tools, e.g. ontology or thesauri
- G06F16/367—Ontology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/048—Activation functions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
- G10L25/66—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for extracting parameters related to health condition
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Biomedical Technology (AREA)
- Medical Informatics (AREA)
- Epidemiology (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Computing Systems (AREA)
- Molecular Biology (AREA)
- Primary Health Care (AREA)
- Evolutionary Computation (AREA)
- Biophysics (AREA)
- Artificial Intelligence (AREA)
- Databases & Information Systems (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Animal Behavior & Ethology (AREA)
- Pathology (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The invention relates to the field of health management, in particular to a health state identification system based on the dynamic change of the facial and tongue manifestations of traditional Chinese medicine. The system comprises a facial-lingual image acquisition module, an information input module and a server, wherein the server comprises a user management unit, a medical record management unit and a data processing unit. The invention analyzes the input inquiry information, the acquired facial and tongue picture information and the sound information based on the relevance among long-term sample data, visually displays the result of dynamically acquired data, also provides a dynamic data source of individual health state for constructing a knowledge graph, can effectively diagnose diseases and health states of human bodies, and has the advantages of convenient popularization, convenient use, novel form and accurate result.
Description
Technical Field
The invention relates to the field of health management, in particular to a health state identification system based on the dynamic change of the facial and tongue manifestations of traditional Chinese medicine.
Background
The traditional Chinese medicine has obvious advantages in the aspect of 'treating the disease before illness'. The Chinese medicine ' preventive treatment ' is originally derived from the notes of Huangdi's internal classic: the "the former is treating the disease before the disease is treated, but not treating the disease, this is also called. The four main points of the disease prevention and treatment are as follows: preventing before illness, treating emergent illness, preventing illness, and treating after illness. The first is that the disease is prevented in the bud, and the body is in a healthy state; when the two diseases are still in a sprouting state or will not occur, effective measures are taken; after the disease occurs, the transmission of the disease needs to be prevented, and the disease needs to be diagnosed and treated in time; and the four fingers prevent disease recurrence. The TCM distinguishes the syndromes by differentiation and refers to the inspection, smelling, inquiring and consulting of the four diagnostic methods to deduce the cause, location and nature of disease.
With the development of computer technology, in the aspect of facial and tongue diagnosis, a plurality of health management systems for preventive treatment and corresponding intelligent medical systems are available at present, user images are collected through the intelligent medical systems, and corresponding symptom information and the like are obtained by analyzing the characteristics of facial shapes, complexion, lip colors, tongue fur, tongue shapes and the like on the images according to an intelligent mirror.
In recent years, the objective research results of the facial diagnosis and tongue diagnosis are remarkable, but the objective research results have many defects. The key problem is that the information of the face and tongue is closely related to the individual difference, and the observation function in clinical diagnosis cannot be really played only from the perspective of unifying the objective standards of the face diagnosis and the tongue diagnosis. The current research of the scholars at home and abroad on inspection standardization does not combine the external environmental characteristics and individual differences of patients at that time, and does not carry out deep analysis on the dynamic process of occurrence, development and change of diseases. And a health state identification system based on dynamic thinking of traditional Chinese medicine, convenient use and accurate result and suitable for chronic diseases does not exist.
Disclosure of Invention
The invention aims to overcome the defects that no health state identification system based on the dynamic thinking of the traditional Chinese medicine, convenient use and accurate result is suitable for chronic diseases exists in the prior art, and provides a health state identification system based on the dynamic change of the facial and tongue manifestations of the traditional Chinese medicine.
In order to achieve the above purpose, the invention provides the following technical scheme:
a health state identification system based on traditional Chinese medicine facial and tongue manifestation dynamic change comprises a facial and tongue manifestation acquisition module, an information input module and a server, wherein the server comprises a user management unit, a medical record management unit and a data processing unit;
the facial and tongue image acquisition module is used for acquiring facial and tongue image data of a user and uploading the facial and tongue image data to the medical record management unit;
the information input module is used for inputting symptom survey information of the user and personal information of the user, uploading the symptom survey information to the medical record management unit, and uploading the personal information to the user management unit;
the user management unit is used for adding, deleting, modifying and managing account information of the user, wherein the account information comprises the personal information;
the medical record management unit is used for storing and managing medical record information of the user, and the medical record information comprises the facial-lingual image data and the symptom investigation information which are acquired in a plurality of time periods;
and the data processing unit is used for carrying out comprehensive analysis on the medical record information and outputting the health state of the user. The invention analyzes the input inquiry information, the acquired facial and tongue picture information and the sound information based on the relevance among long-term sample data, visually displays the result of dynamically acquired data, also provides a dynamic data source of individual health state for constructing a knowledge graph, can effectively diagnose diseases and health states of human bodies, and has the advantages of convenient popularization, convenient use, novel form and accurate result.
As a preferred aspect of the present invention, the data processing unit executes the following flow:
s01: acquiring medical record information of a user to be identified;
s02: preprocessing the medical record information through a neural network to obtain analysis data;
s03: performing relevance analysis on the analysis data and each chronic disease traditional Chinese medicine syndrome by adopting a grey relevance analysis method, and outputting the relevance between the user and each traditional Chinese medicine syndrome;
s04: and outputting the health state of the user according to the correlation degree. The invention takes the facial image and tongue image information closely related to individuals as the basis, combines the inquiry and other related information, and analyzes the association rule of the facial image state and the tongue image state and the symptoms by dynamically monitoring the facial image, the tongue image and other symptom information at different periods; the scale method-based dynamic and objective acquisition of chronic disease information can be realized; meanwhile, grey correlation analysis is adopted, quantitative health state information can be subjected to correlation degree calculation and correlation degree sequencing to explore inspection key influence factors, a health state identification system based on the dynamic change rule of the facial image and the tongue image of the traditional Chinese medicine is realized, and scientific and effective data support and guidance are provided for the inspection and preventive treatment of diseases of the traditional Chinese medicine.
As a preferable embodiment of the present invention, the step S02 includes the following steps:
s021: performing image enhancement processing on the facial-lingual image data in the medical record information, and performing classification, screening, marking, cleaning, completion and discretization processing on the symptom investigation information in the medical record information; and generating a symptom data table after normalization processing;
s022: and importing the symptom data table into a neural network model for processing, and generating analysis data.
As a preferred embodiment of the present invention, the symptom data table includes the complexion, lip color, luster, tongue color, tongue quality, tongue color and/or tongue quality of the user in the facial-tongue image data, and the symptom information of the general symptoms, the head symptoms, the otorhinolaryngological symptoms, the thoraco-abdominal symptoms, the limb symptoms and/or the stool and stool traits of the user in the symptom survey information.
As a preferred scheme of the present invention, the neural network model includes an input layer, a hidden layer, and an output layer;
the number of the neurons of the input layer is the same as that of the variables;
the hidden layer adopts hyperbolic tangent transfer function, and the output of the hidden layer
The calculation formula of (2) is as follows:
wherein the content of the first and second substances,
in order to be a function of the excitation,
for the weights of the input layer to the hidden layer,
for the biasing of the input layer to the hidden layer,
is the serial number of the input layer neuron,
to imply the sequence number of the layer neurons,
the number of the hidden layer units;
the output layer adopts a linear transfer function, and the output of the output layer
The calculation formula of (A) is as follows:
wherein the content of the first and second substances,
the weight of the hidden layer to the output layer,
for the biasing of the hidden layer to the output layer,
is the serial number of the neuron in the output layer,
the number of nodes of the output layer;
the initialization and update formula of the weight and the bias is as follows:
wherein the content of the first and second substances,
in order to be able to output the result as desired,
to learn the rate.
As a preferable embodiment of the present invention, the step S03 includes the following steps:
s031: converting the analytical data into a comparison sequence
And the Chinese medicine syndrome types of various chronic diseases are recorded into the reference sequence
In (1),
，
，
to compare the feature numbers in the sequences,
the time sequence number of the acquisition;
s032: using averaging method to compare the sequences
Preprocessing is carried out, and the calculation formula is as follows:
s033: calculating the comparison sequence according to
The correlation coefficient of each parameter in the reference sequence with the corresponding parameter in the reference sequence:
wherein
In order to be able to determine the resolution factor,
；
s034: determining the comparison sequence according to
With each feature
Degree of association of
：
S035: associating the degree of relation
In descending order.
As a preferred scheme of the present invention, the facial-lingual image acquisition module is provided with a microphone sensor for acquiring voice data of the user and inputting the voice data into the data processing unit for analysis. The invention enlarges the range of analyzing data by collecting and analyzing the voice data, and effectively improves the accuracy and reliability of the identification result of the invention.
As a preferred embodiment of the present invention, the system includes the following execution flows:
s11: the user inputs a corresponding account password in the information input module to log in; if the user does not register the account, an account registration process is carried out; the account registration process comprises personal information input and password setting;
s12: acquiring facial and lingual image data through the facial and lingual image acquisition module, and uploading the facial and lingual image data to the medical record management unit after the acquisition is finished;
s13: voice data are collected through the microphone sensor, and the voice data are uploaded to the medical record management unit after the collection is finished;
s14: filling in symptom survey information through the information input module, and uploading the symptom survey information to the medical record management unit after the acquisition is finished;
s15: and the data processing unit is used for carrying out comprehensive analysis on the medical record information and outputting the health state of the user.
As a preferred embodiment of the present invention, the execution process collects data according to the frequency of 1 week and 1 time, and stores the data in the medical record management unit according to the time tag.
The invention collects data according to the frequency of 1 week and 1 time, provides a dynamic data source of individual health state for constructing the knowledge graph, and also ensures that the output result is more accurate and reliable.
As a preferred embodiment of the present invention, the system further includes a result visualization module for displaying the health status of the user and displaying a corresponding health prompt.
Compared with the prior art, the invention has the beneficial effects that:
1. the invention analyzes the input inquiry information, the acquired facial and tongue picture information and the sound information based on the relevance among long-term sample data, visually displays the result of dynamically acquired data, also provides a dynamic data source of individual health state for constructing a knowledge graph, can effectively diagnose diseases and health states of human bodies, and has the advantages of convenient popularization, convenient use, novel form and accurate result.
2. The invention takes the facial image and tongue image information closely related to individuals as the basis, combines the inquiry and other related information, and analyzes the association rule of the facial image state and the tongue image state and the symptoms by dynamically monitoring the facial image, the tongue image and other symptom information at different periods; the scale method-based dynamic and objective acquisition of chronic disease information can be realized; meanwhile, grey correlation analysis is adopted, quantitative health state information can be subjected to correlation degree calculation and correlation degree sequencing to explore inspection key influence factors, a health state identification system based on the dynamic change rule of the facial image and the tongue image of the traditional Chinese medicine is realized, and scientific and effective data support and guidance are provided for the inspection and preventive treatment of diseases of the traditional Chinese medicine.
3. The invention enlarges the range of analyzing data by collecting and analyzing the voice data, and effectively improves the accuracy and reliability of the identification result of the invention.
4. The invention collects data according to the frequency of 1 week and 1 time, provides a dynamic data source of individual health state for constructing the knowledge graph, and also ensures that the output result is more accurate and reliable.
Drawings
Fig. 1 is a schematic structural diagram of a health status identification system based on dynamic changes of facial and tongue manifestations in traditional Chinese medicine according to embodiment 1 of the present invention;
fig. 2 is a schematic structural diagram of a neural network model for syndrome identification in a health status identification system based on dynamic changes of facial and lingual manifestations in traditional Chinese medicine according to embodiment 1 of the present invention;
fig. 3 is a schematic diagram of the identification workflow of the health status identification system based on the dynamic change of the facial and tongue manifestations of traditional Chinese medicine according to embodiment 1 of the present invention;
fig. 4 is a flowchart illustrating a work flow of the data processing unit in the health status identification system based on the dynamic change of the facial and tongue manifestations in traditional Chinese medicine according to embodiment 1 of the present invention;
fig. 5 is a schematic diagram of tongue picture segmentation in a health status identification system based on dynamic changes of facial and tongue images in traditional Chinese medicine according to embodiment 1 of the present invention.
Detailed Description
The present invention will be described in further detail with reference to test examples and specific embodiments. It should be understood that the scope of the above-described subject matter is not limited to the following examples, and any techniques implemented based on the disclosure of the present invention are within the scope of the present invention.
Example 1
As shown in fig. 1, a health status identification system based on the dynamic changes of the facial and lingual manifestations of traditional Chinese medicine comprises a facial and lingual manifestation acquisition module, an information entry module and a server (the server can adopt a cloud server), wherein the server comprises a user management unit, a medical record management unit and a data processing unit;
the facial and tongue image acquisition module is used for acquiring facial and tongue image data of a user and uploading the facial and tongue image data to the medical record management unit; wherein, the following requirements are required to be met during facial image acquisition: (1) exposing the complete face, wherein the front face of the face is completely positioned in the collecting mask; (2) makeup is preferably not required to avoid affecting the collection of the face color information and lip color information. The tongue picture is collected by meeting the following requirements: (1) exposing the complete oral cavity, and completely extending the front surface of the tongue; (2) it is desirable not to eat food that can affect the tongue color. And after the acquisition is finished, clicking a submit button on the information input module to upload the facial and tongue picture data to a medical record management unit of the server.
Meanwhile, the facial and tongue image acquisition module further comprises a microphone sensor, sound information is acquired through the digital silicon crystal microphone sensor, and the data measurement module analyzes the sound information to judge whether pathological change sound exists. Lesion sounds are changes in the voice and language that reflect a disease. Listening to the pathological changes mainly distinguishes abnormal sounds of the user, such as speech sounds, snores, coughs, sneezes, yawns, and tairs. The language identification mainly analyzes whether the expression and response ability of the user language are abnormal or not, whether the word is clear or not, and the like. The pathological sounds include speech sound, speech, respiration, cough, vomiting, hiccup, belching, sighing, snore, sneezing, bowel sound and water vibration sound. In the audio data processing process, an audio file in a wav format is imported into Praat voice analysis software, and resonance frequencies of a sound cavity when a user vocalizes, namely a First Formant (First Formant, F1), a Second Formant (Second Formant, F2), a Third Formant (Third Formant, F3) and a Fourth Formant (Fourth Formant, F4) are extracted, and four indexes reflecting voice characteristics are counted. The preprocessing of the voice signal can precisely select the starting endpoint and the ending endpoint aiming at a section of sound waveform, so that the effective part of the voice signal is accurately intercepted, unnecessary noise can be removed through good preprocessing, and meanwhile, the consistency of the intercepted voice information can be ensured.
The information input module is used for inputting symptom survey information of the user and personal information of the user, uploading the symptom survey information to the medical record management unit, and uploading the personal information to the user management unit; the symptom investigation information gives possible symptoms in the form of 50-60 selection questions, the user is filled in faithfully according to the severity, the problems are formulated according to common slow-disease traditional Chinese medicine diagnosis and treatment guidelines and a second edition 'traditional Chinese medicine symptom differential diagnostics' compiled by Yaoying teachers, and the symptoms cover the aspects of general symptoms, head symptoms, chest and abdomen symptoms, limb symptoms, defecation and the like.
The user management unit is used for adding, deleting, modifying and managing account information of the user, wherein the account information comprises the personal information; the user needs to register with the valid telephone number and set the corresponding password, and login is performed with the telephone number and the password registered during registration. The personal information includes two categories of personal basic information and personal lifestyle information. The personal basic information includes the contents of name, age, sex, contact telephone, resident address, occupation, academic calendar, allergy history and the like. The personal life habit information comprises the contents of disease state, special period type, diet sleeping habit, exercise habit, emotional state, family atmosphere, etc., the condition of going on business overtime, height, weight, etc. And the personal information can be selected and modified according to the actual situation after logging in.
The medical record management unit is used for storing and managing medical record information of the user, and the medical record information comprises the facial-lingual image data and the symptom investigation information which are acquired in a plurality of time periods;
and the data processing unit is used for carrying out comprehensive analysis on the medical record information and outputting the health state of the user. As shown in fig. 2, the data processing unit constructs a neural network model for syndrome identification through a deep learning technique, that is, a syndrome identification model using "tongue image after classification + other four diagnostic information of traditional Chinese medicine" as an input vector and "syndrome classification" as an output label is trained in a data-driven manner and obtained (for example, for Chronic Obstructive Pulmonary Disease (COPD), the traditional Chinese medicine syndrome types are classified into 10 types, namely, a lung syndrome due to wind-cold attack, an internal cold syndrome due to external cold, a lung syndrome due to phlegm-heat accumulation, a lung syndrome due to turbid phlegm, a mental trick syndrome due to phlegm, a lung-qi deficiency, a lung-spleen qi deficiency, a lung-kidney qi-yin deficiency and a concurrent blood stasis syndrome, and the identification and classification of different traditional Chinese medicine syndrome types are performed through a neural network algorithm). And the grey correlation analysis method is adopted to complete the correlation analysis of the tongue and face image and the chronic disease symptoms, and the personalized data and the common data are analyzed differently through the transverse and longitudinal bidirectional comparison. In the personal transverse data, when the appearance frequency of the facial-tongue picture is higher than a first preset value (for example, 70%), the constant facial color, the tongue color, the fur color and other symptom information are considered to be normal color or normal state expression, and when the appearance frequency of the facial-tongue picture is lower than a second preset value (for example, 30%), the facial-tongue picture is considered to be guest color or abnormal state expression, and health warning needs to be given according to the disease traditional Chinese medicine guidelines. And the grey correlation analysis method is adopted to process the longitudinal data of different crowds to complete the correlation analysis of the tongue and face image and the traditional Chinese medicine syndrome type of the chronic disease. The system identification workflow is shown in fig. 3.
As shown in fig. 4, the data processing unit executes the following flow:
s01: acquiring medical record information of a user to be identified;
s02: preprocessing the medical record information through a neural network to obtain analysis data;
s021: after the medical record information is preprocessed, normalizing to generate a symptom data table; the preprocessing of the facial-lingual image data comprises processing based on traditional morphology, image enhancement processing based on horizontal turning translation and the like, and the sample capacity is enhanced; the preprocessing of the symptom investigation information comprises the steps of classifying, screening, marking, cleaning, completing and discretizing an original sample, and removing data with incomplete content and errors. The normalization processing of the input vector is mainly standardized aiming at the four diagnostic methods of the traditional Chinese medicine, and the tongue picture symptom in the original sample is normalized by referring to the national standard of the people's republic of China, namely the basic theoretical terms of the traditional Chinese medicine, and combining the second version of the Chinese medicine symptom differential diagnostics, which is mainly compiled by the salmonel teacher. The normalization processing of the output label is mainly normalized aiming at tongue manifestation syndrome classification, and is based on the industry standard ZY/T001.1.94 Chinese medicine syndrome diagnosis and curative effect standard. The symptom data table includes complexion, lip color, luster, tongue color, tongue quality, fur color and/or fur quality of the user in the facial-tongue image data, and symptom information of systemic symptoms, head symptoms, otorhinolaryngological symptoms, thoracico-abdominal symptoms, limb symptoms and/or stool traits of the user in the symptom survey information.
S022: importing the symptom data table into a neural network model for processing, and generating analysis data (the neural network model is obtained by training history labeled samples, and the history labeled samples are randomly grouped into an 80% training set and a 20% testing set); as shown in fig. 5, for the tongue segmentation scheme of the present invention, Batch Normalization (Batch Normalization) is performed between the convolutional neural network and the ReLU function, so that it is easier and more stable to train the deep network model. If the actual samples used are not distributed the same as the training samples, i.e. covariance shifts occur, the model is typically retrained. In a neural network, especially a deep neural network, covariance shift can cause the prediction effect of the model to be poor, and the sum of hidden layers of a retrained model generates shift and change. And Batch Normalization (Batch Normalization) reduces the coupling among the weights of all layers, and performs Normalization processing on the mean value and the variance of the output of each hidden layer, so that all layers are more independent, the self-training learning effect is realized, the model becomes more robust, and the robustness is stronger.
Wherein the neural network model comprises an input layer, a hidden layer and an output layer;
the number of the neurons of the input layer is the same as that of the variables;
the hidden layer adopts hyperbolic tangent transfer function, and the output of the hidden layer
The calculation formula of (2) is as follows:
wherein the content of the first and second substances,
in order to be a function of the excitation,
for the weights of the input layer to the hidden layer,
for the biasing of the input layer to the hidden layer,
is the serial number of the input layer neuron,
to imply the sequence number of the layer neurons,
the number of the hidden layer units;
the output layer adopts a linear transfer function, and the output of the output layer
The calculation formula of (A) is as follows:
wherein the content of the first and second substances,
the weight of the hidden layer to the output layer,
for the biasing of the hidden layer to the output layer,
is the serial number of the neuron in the output layer,
is an outputThe number of nodes of a layer;
the initialization and update formula of the weight and the bias is as follows:
wherein the content of the first and second substances,
in order to be able to output the result as desired,
to learn the rate.
S03: performing relevance analysis on the analysis data (10 items of data are selected for analysis) and the traditional Chinese medicine syndrome type of a certain chronic disease by adopting a grey relevance analysis method, and outputting the relevance between the user and each traditional Chinese medicine syndrome type; the grey correlation analysis method is a quantitative comparison analysis method for measuring the correlation degree between factors according to the similarity or dissimilarity degree between the factors in the system. The grey correlation analysis is performed by first specifying the reference sequence. The analysis algorithm of the dynamic change rule of the tongue and face image based on the grey correlation analysis comprises the following steps:
s031: converting the analytical data into a comparison sequence
And the Chinese medicine syndrome type of a certain chronic disease is recorded into a reference sequence
(e.g. 10 categories of traditional Chinese medicine syndrome types of chronic obstructive pulmonary disease),
，
，
to compare the numbers of different symptoms in the sequence,
the time sequence number of the acquisition; the specific association analysis content is shown in table 1.
TABLE 1 correlation analysis of tongue manifestation characteristics and COPD Chinese medicine syndrome type numerical content
S032: because the data in the factor columns in the system may be different in dimension, it is inconvenient to compare or it is difficult to obtain correct conclusion in comparison. Therefore, in the gray level correlation analysis, data is generally subjected to non-dimensionalization. The invention adopts an equalization method, namely preprocessing the ratio of the statistic value of each sequence to the average value of the whole sequence, wherein the calculation formula is as follows:
S033: calculating the comparison sequence according to
The correlation coefficient of each parameter in the reference sequence with the corresponding parameter in the reference sequence:
wherein
In order to be able to determine the resolution factor,
；
the smaller, the greater the resolution, generally
The value range of (2) is (0, 1), and the value of the application is 0.5.
S034: since the correlation coefficient is the degree of correlation value between the comparison series and the reference series at each time (i.e., each point in the curve), the number is more than one, and the information is too scattered to facilitate the overall comparison. It is therefore necessary to concentrate the correlation coefficient at each time (i.e. each point in the curve) to one value, i.e. to average it, as a quantitative representation of the degree of correlation between the comparison series and the reference series, the degree of correlation
The formula is as follows:
s035: associating the degree of relation
In descending order.
S04: and outputting the health state of the user according to the correlation degree.
The grey correlation analysis is a method for judging the correlation degree between factors according to the similarity degree of the geometric shapes of the factor change curves. The method completes comparison of geometrical relations of relevant statistical data of time series in the system through quantitative analysis of development situation of the dynamic process, and obtains grey correlation degree between the reference series and each comparison series. The greater the degree of association of the comparison series with the reference series, the closer the direction and rate of development to the reference series, the more closely the relationship to the reference series. The gray correlation analysis method requires that the sample capacity can be as small as 4, is also applicable to irregular data, and does not cause the situation that the quantitative result does not accord with the qualitative analysis result. The basic idea is to perform dimensionless processing on the original observed number of the evaluation indexes, calculate the association coefficient and the association degree and sort the indexes to be evaluated according to the association degree.
Example 2
The present embodiment is different from embodiment 1 in that, in step S031, a gray correlation analysis method is used to perform correlation analysis on the analysis data (about 10 items) and other typical symptoms of a chronic disease (e.g., typical symptoms of COPD include sleepiness, hyperhidrosis, nasal obstruction, arthralgia, and the like, and about 40 kinds of symptoms), and output the degree of correlation between the user and each typical symptom, and the steps specifically include:
s031: converting the analytical data into a comparison sequence
And recording other symptoms typical of a certain chronic disease (such as typical symptoms of COPD including lethargy, hyperhidrosis, nasal obstruction, arthralgia, etc., about 40 items) into a reference sequence
In (1),
，
，
to compare the different symptom numbers in the sequences,
the time sequence number of the acquisition; the specific association analysis content is shown in table 2.
TABLE 2 analysis of numerical content of tongue manifestation characteristics in association with other typical symptoms of COPD
Example 3
The difference between this embodiment and embodiment 1 is that the system further includes a result visualization module, which is configured to show the health status of the user and display a corresponding health prompt. The module can also construct a related data knowledge base through the steps of entity extraction, attribute identification, relation extraction, knowledge evaluation and the like, and continuously updates the knowledge base in the implementation process. And visualizing the correlation analysis result in the form of a geometric graph, a star group graph and the like.
Example 4
The present embodiment is an execution flow of the system described in embodiment 1 or embodiment 2:
s11: the user inputs a corresponding account password in the information input module to log in; if the user does not register the account, an account registration process is carried out; the account registration process comprises personal information input and password setting;
s12: acquiring facial and lingual image data through the facial and lingual image acquisition module, and uploading the facial and lingual image data to the medical record management unit after the acquisition is finished;
s13: voice data are collected through the microphone sensor, and the voice data are uploaded to the medical record management unit after the collection is finished;
s14: filling in symptom survey information through the information input module, and uploading the symptom survey information to the medical record management unit after the acquisition is finished;
s15: and the data processing unit is used for carrying out comprehensive analysis on the medical record information and outputting the health state of the user.
And the execution flow acquires data according to the frequency of 1 week and 1 time, and stores the data in the medical record management unit according to the time label. And the present system can be applied to the following cases:
(1) the device is used for conventional prompt detection equipment of families and various medical institutions. Can be used as detection equipment for families, hospitals at all levels, community medical institutions and village and town clinics.
(2) Provides quantitative basis for the clinical syndrome differentiation of the traditional Chinese medicine. The facial and tongue picture, the audio data and the inquiry information are collected to be used as a quantitative basis for selecting acupuncture channels and points and reinforcing and reducing methods, and the relevance between the facial and tongue picture information and the traditional Chinese medicine syndrome type is provided to assist accurate clinical diagnosis.
(3) Provides disease change early warning for common chronic patients. For chronic patients, the state of illness is controlled for a long time, the change of the facial image and the tongue image is earlier than the deterioration of the disease, and long-term health monitoring is helpful for the patients to master the state of illness in advance and to seek medical treatment in time.
(4) Early disease is suggested. The method has accurate prompt and judgment on various diseases susceptible to diseases such as nervous system, digestive system, endocrine system, circulatory system, urinary system, excretory system, respiratory system, motor system and the like. Especially has certain prospective prompting or warning effect on common chronic diseases such as hypertension, diabetes, chronic heart failure, chronic pulmonary obstruction, chronic renal insufficiency, cognitive dysfunction and the like.
(5) And evaluating and observing the curative effect of the disease. The clinical treatment effect including the application effect of the medicine and the health care product is objectively evaluated, and the dynamic process of disease regression data change can be tracked and observed.
(6) Defining the sub-health of the human body. Accurate quantitative data is provided for sub-health states of human body, such as mental activity, psychological activity, vegetative nerve activity, fatigue syndrome and the like, and prompt judgment is made.
(7) And (4) detecting the whole body. Can be used for screening the health of people or screening certain systemic diseases. It can be used for treating physical, nervous, circulatory, digestive and metabolic diseases, immune, endocrine, bone, motor system and visceral diseases. Can also be used as reference index for psychological disease diagnosis.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (10)
1. A health state identification system based on traditional Chinese medicine facial and tongue manifestation dynamic change is characterized by comprising a facial and tongue manifestation acquisition module, an information input module and a server, wherein the server comprises a user management unit, a medical record management unit and a data processing unit;
the facial and tongue image acquisition module is used for acquiring facial and tongue image data of a user and uploading the facial and tongue image data to the medical record management unit;
the information input module is used for inputting symptom survey information of the user and personal information of the user, uploading the symptom survey information to the medical record management unit, and uploading the personal information to the user management unit;
the user management unit is used for adding, deleting, modifying and managing account information of the user, wherein the account information comprises the personal information;
the medical record management unit is used for storing and managing medical record information of the user, and the medical record information comprises the facial-lingual image data and the symptom investigation information which are acquired in a plurality of time periods;
and the data processing unit is used for carrying out comprehensive analysis on the medical record information and outputting the health state of the user.
2. The system for identifying health status based on dynamic changes of facial and lingual manifestations in traditional Chinese medicine according to claim 1, wherein said data processing unit executes the following procedures:
s01: acquiring medical record information of a user to be identified;
s02: preprocessing the medical record information through a neural network to obtain analysis data;
s03: performing relevance analysis on the analysis data and each chronic disease traditional Chinese medicine syndrome by adopting a grey relevance analysis method, and outputting the relevance between the user and each traditional Chinese medicine syndrome;
s04: and outputting the health state of the user according to the correlation degree.
3. The system for identifying health status based on dynamic changes of facial and lingual manifestations in traditional Chinese medicine, as claimed in claim 2, wherein said step S02 comprises the following steps:
s021: performing image enhancement processing on the facial-lingual image data in the medical record information, and performing classification, screening, marking, cleaning, completion and discretization processing on the symptom investigation information in the medical record information; and generating a symptom data table after normalization processing;
s022: and importing the symptom data table into a neural network model for processing, and generating analysis data.
4. The system for identifying health status based on dynamic changes of facial-lingual symptoms of traditional Chinese medicine according to claim 3, wherein the symptom data table comprises the facial color, lip color, luster, tongue color, tongue quality, tongue coating color and/or tongue coating quality of the user in the facial-lingual image data, and the symptom information of the general symptoms, head symptoms, otorhinolaryngological symptoms, thoracoabdominal symptoms, limb symptoms and/or stool traits of the user in the symptom survey information.
5. The system of claim 3, wherein the neural network model comprises an input layer, a hidden layer and an output layer;
the number of the neurons of the input layer is the same as that of the variables;
the hidden layer adopts hyperbolic tangent transfer function, and the output of the hidden layer
The calculation formula of (2) is as follows:
wherein the content of the first and second substances,
in order to be a function of the excitation,
for the weights of the input layer to the hidden layer,
for the biasing of the input layer to the hidden layer,
is the serial number of the input layer neuron,
to imply the sequence number of the layer neurons,
the number of the hidden layer units;
the output layer adopts a linear transfer function, and the output of the output layer
The calculation formula of (A) is as follows:
wherein the content of the first and second substances,
the weight of the hidden layer to the output layer,
for the biasing of the hidden layer to the output layer,
is the serial number of the neuron in the output layer,
the number of nodes of the output layer;
the initialization and update formula of the weight and the bias is as follows:
wherein the content of the first and second substances,
in order to be able to output the result as desired,
to learn the rate.
6. The system for identifying health status based on dynamic changes of facial and lingual manifestations in traditional Chinese medicine, as claimed in claim 2, wherein said step S03 comprises the following steps:
s031: converting the analytical data into a comparison sequence
And the Chinese medicine syndrome types of various chronic diseases are recorded into the reference sequence
In (1),
，
，
to compare the feature numbers in the sequences,
the time sequence number of the acquisition;
s032: using averaging method to compare the sequences
Preprocessing is carried out, and the calculation formula is as follows:
s033: calculating the comparison sequence according to
The correlation coefficient of each parameter in the reference sequence with the corresponding parameter in the reference sequence:
wherein
In order to be able to determine the resolution factor,
；
s034: determining the comparison sequence according to
With each feature
Degree of association of
：
S035: associating the degree of relation
In descending order.
7. The system for identifying health status based on the dynamic changes of facial and lingual manifestations of traditional Chinese medicine, as claimed in claim 1, wherein said facial and lingual manifestations collecting module is provided with a microphone sensor for collecting the voice data of the user and inputting the voice data into said data processing unit for analysis.
8. The system for identifying health status based on dynamic changes of facial and tongue manifestations in traditional Chinese medicine, according to claim 7, comprising the following steps:
s11: the user inputs a corresponding account password in the information input module to log in; if the user does not register the account, an account registration process is carried out; the account registration process comprises personal information input and password setting;
s12: acquiring facial and lingual image data through the facial and lingual image acquisition module, and uploading the facial and lingual image data to the medical record management unit after the acquisition is finished;
s13: voice data are collected through the microphone sensor, and the voice data are uploaded to the medical record management unit after the collection is finished;
s14: filling in symptom survey information through the information input module, and uploading the symptom survey information to the medical record management unit after the acquisition is finished;
s15: and the data processing unit is used for carrying out comprehensive analysis on the medical record information and outputting the health state of the user.
9. The system for identifying health status based on the dynamic changes of facial and lingual manifestations in traditional Chinese medicine, as claimed in claim 8, wherein said execution procedure collects data according to 1 week 1 times frequency and stores the data into said case history management unit according to time tags.
10. The system for identifying health status based on dynamic changes of facial and lingual manifestations in traditional Chinese medicine according to claim 1, further comprising a result visualization module for displaying the health status of the user and displaying a corresponding health prompt.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111077108.7A CN113539486A (en) | 2021-09-15 | 2021-09-15 | Health state identification system based on traditional Chinese medicine facial and tongue manifestation dynamic change |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111077108.7A CN113539486A (en) | 2021-09-15 | 2021-09-15 | Health state identification system based on traditional Chinese medicine facial and tongue manifestation dynamic change |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113539486A true CN113539486A (en) | 2021-10-22 |
Family
ID=78092625
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111077108.7A Pending CN113539486A (en) | 2021-09-15 | 2021-09-15 | Health state identification system based on traditional Chinese medicine facial and tongue manifestation dynamic change |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113539486A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115206523A (en) * | 2022-08-10 | 2022-10-18 | 重庆乾坤济实业集团有限公司 | Health management evaluation system and method thereof |
| CN116784804A (en) * | 2023-07-19 | 2023-09-22 | 湖南云医链生物科技有限公司 | No-disease analysis and evaluation system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106295139A (en) * | 2016-07-29 | 2017-01-04 | 姹ゅ钩 | A kind of tongue body autodiagnosis health cloud service system based on degree of depth convolutional neural networks |
| CN106446533A (en) * | 2016-09-12 | 2017-02-22 | 北京和信康科技有限公司 | Processing system of human body health data and method thereof |
| CN107330889A (en) * | 2017-07-11 | 2017-11-07 | 北京工业大学 | A kind of traditional Chinese medical science tongue color coating colour automatic analysis method based on convolutional neural networks |
| CN110299193A (en) * | 2019-06-27 | 2019-10-01 | 合肥云诊信息科技有限公司 | Chinese medicine health cloud service method based on artificial intelligence lingual diagnosis |
| CN110432864A (en) * | 2019-07-19 | 2019-11-12 | 成都中医药大学 | A kind of tcm constitution dynamic change discrimination method and system |
-
2021
- 2021-09-15 CN CN202111077108.7A patent/CN113539486A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106295139A (en) * | 2016-07-29 | 2017-01-04 | 姹ゅ钩 | A kind of tongue body autodiagnosis health cloud service system based on degree of depth convolutional neural networks |
| CN106446533A (en) * | 2016-09-12 | 2017-02-22 | 北京和信康科技有限公司 | Processing system of human body health data and method thereof |
| CN107330889A (en) * | 2017-07-11 | 2017-11-07 | 北京工业大学 | A kind of traditional Chinese medical science tongue color coating colour automatic analysis method based on convolutional neural networks |
| CN110299193A (en) * | 2019-06-27 | 2019-10-01 | 合肥云诊信息科技有限公司 | Chinese medicine health cloud service method based on artificial intelligence lingual diagnosis |
| CN110432864A (en) * | 2019-07-19 | 2019-11-12 | 成都中医药大学 | A kind of tcm constitution dynamic change discrimination method and system |
Non-Patent Citations (3)
| Title |
|---|
| 周霞等: "灰色关联分析在医学中的应用", 《辽宁中医杂志》 * |
| 宋海贝等: "基于 AI 的中医舌象面象辅助诊疗系统构建", 《时珍国医国药》 * |
| 章浩伟等: "基于灰色关联分析的中医肝炎肝硬化诊断方法", 《计算机工程与应用》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115206523A (en) * | 2022-08-10 | 2022-10-18 | 重庆乾坤济实业集团有限公司 | Health management evaluation system and method thereof |
| CN116784804A (en) * | 2023-07-19 | 2023-09-22 | 湖南云医链生物科技有限公司 | No-disease analysis and evaluation system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102630580B1 (en) | Cough sound analysis method using disease signature for respiratory disease diagnosis | |
| Tracy et al. | Investigating voice as a biomarker: deep phenotyping methods for early detection of Parkinson's disease | |
| CN106725532B (en) | Depression automatic evaluation system and method based on phonetic feature and machine learning | |
| CN103458777B (en) | For the method and apparatus swallowing damage check | |
| Roy et al. | Evidence-based clinical voice assessment: a systematic review | |
| Niu et al. | Detection of sputum by interpreting the time-frequency distribution of respiratory sound signal using image processing techniques | |
| CN112166475A (en) | Respiratory system based sound management of respiratory conditions | |
| KR102091832B1 (en) | Portable In Vitro Diagnostic Kit Analyzer Using Multimedia Information | |
| CN113539486A (en) | Health state identification system based on traditional Chinese medicine facial and tongue manifestation dynamic change | |
| CN108597621B (en) | Health state monitoring device, system and method based on traditional Chinese medicine theory | |
| CN115714022B (en) | Neonatal jaundice health management system based on artificial intelligence | |
| CN114334123A (en) | Cognition assessment system suitable for mild cognitive impairment rapid detection | |
| Coyle et al. | High-resolution cervical auscultation and data science: new tools to address an old problem | |
| CN109346164A (en) | A kind of automatic acquisition equipment and method of tcm clinical practice case | |
| CN113658697B (en) | Psychological assessment system based on video fixation difference | |
| Anand et al. | A comprehensive survey on the biomedical signal processing methods for the detection of COVID-19 | |
| CN115337000B (en) | Machine learning method for evaluating brain aging caused by diseases based on brain structure images | |
| CN116484290A (en) | Depression recognition model construction method based on Stacking integration | |
| CN113729708B (en) | Lie judgment method based on eye movement technology | |
| CN115497621A (en) | Old person cognitive status evaluation system | |
| Muralikrishna | Efficient Detection of Parkinson Disease Using Multiple Machine Learning Techniques | |
| Wang | Research on a New AI Diagnostic Model with Strong Universality Based on Multilayer Perceptron Neural Networks | |
| CN117789987B (en) | Method and system for constructing endocrinology rehabilitation evaluation model | |
| Dong et al. | Data-driven based four examinations in TCM: a survey | |
| De et al. | Alz-sense: A novel non-invasive pre-clinical testing to differentiate dementia from mci |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211022 |