TWM579360U - Consultation system for detecting facial expression - Google Patents

Abstract

The present invention relates to a medical examination system for detecting facial expressions, comprising: an operation processing unit that outputs a picture for asking questions for an evaluation question; a display unit for playing the picture; and a photography unit for shooting a facial expression change a picture, the operation processing unit compares a standard and abnormal facial expression feature value according to the facial expression change screen, and outputs an evaluation result; a facial expression model library provides the standard and the abnormal facial expression The eigenvalues are evaluated by a neural-like calculus prediction to obtain the evaluation result. It is used by the assistant doctor to judge whether the patient has mental or psychological diseases.

Description

Questioning system for detecting facial expressions

This creative department is concerned with a facial expression change by photographing and comparing the patient's response to the evaluation question, in order to assist the doctor in judging whether the patient has mental or psychological diseases.

According to the current situation, patients with anxiety, depression, mental or psychological diseases, mainly rely on the doctor's professional and experience, through questions to patients, and comprehensive assessment data of patients, to determine whether patients suffer from The above mental or psychological diseases. However, because it is based on the doctor's subjective determination, it is easy to cause errors in human judgment, and delay the patient's condition.

Therefore, there is a patent case "Psychological and Behavioral Status Assessment and Diagnosis Method and System" published by the Republic of China on November 21, 2007, which discloses a virtual reality scene presentation device for use by subjects. And controlling, by a processing device, the virtual reality scene presenting device to display a plurality of consecutive task events, and a responding device receives the subject's reaction to each of the task events and transmits the same to a recording device to correspond to each The task event generates a record information and provides the processing device to determine the next task event according to the record information corresponding to the previous task event; and the processing device calculates at least one test score based on the record information, and the at least A test score is compared with at least one normative diagnostic model established in advance to obtain a relative position on each of the normative diagnostic models as a basis for diagnosing the psychological and behavioral state of the subject.

The pre-existing patent system is used as a supplementary judgment in the doctor's consultation through the scoring mechanism. However, due to the evaluation of the score, it is still not intuitive enough to directly grasp the physiological state changes of the patient during the current assessment, so there is still Its shortcomings.

Thus, in view of the fact that the auxiliary consultation system currently used has the above disadvantages. Therefore, the present invention provides a diagnosis system for detecting facial expressions, comprising: an operation processing unit that outputs a picture for asking questions for an evaluation question; and a display unit that connects the signal to the operation processing unit for providing Playing the picture; a photographing unit is connected to the operation processing unit for photographing a facial expression change screen, and transmitting the facial expression change screen to the operation processing unit, wherein the operation processing unit is The facial expression change screen is compared with a standard and abnormal facial expression feature value, and outputs an evaluation result; a facial expression model library is connected to the operation processing unit, and the facial expression model library is provided The standard and the abnormal facial expression feature values are subjected to a neurological calculus prediction evaluation to obtain the evaluation result.

The above picture includes a screen that directly accepts a question from a professional doctor.

The above picture contains a screen for a virtual doctor to ask questions.

The above facial expression change screen includes a screen when a patient answers the evaluation question.

The above evaluation results include determining whether the patient's symptoms are consistent with an anxiety, depression, mental or psychological disease.

The above criteria and abnormal facial expression feature values include image characteristics of a patient who has an anxiety disorder, depression, mental or mental illness, and a facial expression change when answering the assessment question.

The above criteria and abnormal facial expression feature values include physiological changes in facial expressions such as frowning, shaking, blinking, sweating, pupil dilation, stunned eyes, muttering, sputum, flushing, or facial muscles. .

The arithmetic processing unit determines the calculation result and the virtual doctor's medical examination result by the fuzzy theory to obtain the evaluation result.

The photographing unit is disposed on the display unit.

The computing processing unit is a remote server, a remote computer, a notebook computer, a tablet computer or a smart phone. The display unit is a touch-type desktop screen and the notebook computer. One of the screens, one of the screens of the tablet, or one of the screens of the smart phone has the following advantages:

1. It can compare the facial expression changes with the standard and abnormal facial expression characteristics according to the patient's answer, so as to evaluate whether the patient's symptoms meet the anxiety, depression, mental or psychological aspects. The disease can be used as a reference for doctors.

2. Further, the patient can be used as a test or preventive screening before the onset of the disease, so that the energy can be detected early, and then the treatment can be early, and the disease can be prevented from being delayed, and the disease can be prevented due to irregular attacks. The problem of law and order.

3. Directly taking the physiological changes of the negative expression of the patient's face, and comparing with the image features of the facial expression of the patient with the same symptoms, as a reference for disease judgment, is intuitive And convenience, and can reduce the error of people on the subjective assessment.

Referring to the first and second figures, the present embodiment includes an arithmetic processing unit (1), a display unit (2), a photographing unit (3), and a facial expression model library (4), wherein:

The arithmetic processing unit (1) can be a remote server, a remote computer, a notebook computer, a tablet computer or a smart phone. The arithmetic processing unit (1) is capable of directly asking a professional doctor to make a question, thereby outputting an image (A) of the professional doctor, and the professional doctor according to a pre-designed evaluation question for a patient (B) A screen for asking questions. Alternatively, the arithmetic processing unit (1) pre-built the evaluation question and then outputs a picture of the question to the evaluation question by outputting the image (A) of a virtual doctor. The arithmetic processing unit (1) of the present embodiment is described by the remote server, and the image (A) of the virtual doctor is outputted to evaluate the patient (B) for the evaluation problem. Judge.

The display unit (2) is connected to the arithmetic processing unit (1) for playing the image (A) of the professional doctor or the virtual doctor, and the image (A) contains a question screen for the evaluation question. The display unit (2) can be a touch-type desktop screen, a notebook screen, a tablet screen or a smart phone screen. The display unit (2) is touch-sensitive for interaction with the professional doctor or the virtual doctor.

The photographing unit (3) is disposed on the display unit (2) for photographing the face expression change screen (C) when the patient (B) answers the evaluation question. The photographing unit (3) is connected to the arithmetic processing unit (1) for transmitting the facial expression change screen (C) of the patient (B) to the arithmetic processing unit (1) for The operation processing unit (1) compares a standard and abnormal facial expression feature value according to the facial expression change screen (C) to evaluate whether the symptom of the patient (B) is in compliance with an anxiety disorder or depression. Diseases, mental or psychological, and output an assessment for reference as a doctor's consultation, or as a preventive screening to provide early detection and early treatment to avoid delays.  The facial expression model library (4) is connected to the operation processing unit (1), and the standard and abnormal facial expression feature values are provided for the arithmetic processing unit (1) to perform calculation and determination. The facial expression model library (4) can store image characteristics of a patient who has an anxiety disorder, depression, mental or psychological disease, and an expression change on the face when answering the question. Standard and abnormal facial expression feature values, and can be input, modified or deleted at any time for the arithmetic processing unit (1) to recalculate and establish image features. The standard or abnormal facial expression feature value includes a facial frown, shaking his head, blinking, sweating, pupil dilation, stunned, muttered, sly, flushed or facial muscles when the patient hears the assessment problem. Physiological changes in negative expressions such as jitter. The arithmetic processing unit (1) predicts and evaluates the face expression change picture (C) of the patient (B) through the neural network calculus theory, and the standard and the abnormal facial expression feature value, thereby generating the evaluation result. And output the evaluation results.  

In use, as shown in the second and third figures, the patient (B) is located at a proper position in front of the display unit (2), and the face of the patient (B) is located in the photographing unit (3) ) within the shooting range. After the operation processing unit (1) is started, the operation processing unit (1) outputs the image (A) of the virtual doctor and plays on the display unit (2), and the image of the virtual doctor (A) And will ask questions about the patient (B) one by one for the pre-designed assessment question. At this time, the patient (B) can select an answer on the touch-sensitive display unit (2) after hearing the evaluation question to make an answer. The patient (B) in the process of answering, according to the evaluation question designed, the physiological changes of the negative expression of the face, such as frowning, shaking his head, blinking, sweating, pupil dilation, eye stagnation, muttering Changes in negative expressions such as self-speaking, sputum, flushing of the face or shaking of facial muscles. Then, the photographing unit (3) takes the change of all the facial expressions of the patient (B) during the answering process, and takes the facial expression change screen (C), and transmits the facial expression change screen (C). Going to the operation processing unit (1), the operation processing unit (1) retrieves the standard and abnormal facial expression feature values stored in the facial expression model library (4) for the operation processing unit ( 1) Take the image feature with the facial expression change screen (C), perform facial expression prediction evaluation to obtain a calculation result, and then combine with the result of the consultation of the form requested by the virtual doctor, and use the fuzzy theory to estimate the result. The patient (B) is suffering from different diseases such as anxiety, depression, mental or psychological, and outputs it as a result of the evaluation, which can be used as a reference for doctors to consult. Furthermore, this creation can also be used as a test or preventive screening before the onset of illness, so that early detection can be performed, and early treatment can avoid delaying the disease and prevent the occurrence of irregular attacks. The issue of social security. In view of the above description of the embodiments, the above-described embodiments are merely a preferred embodiment of the present invention, and the implementation of the present invention is not limited thereto. The scope, that is, the simple equivalent changes and modifications made in accordance with the scope of the patent application and the content of the creation of the creation, are within the scope of this creation.

(1) ‧‧‧Operation Processing Unit  (2)‧‧‧Display unit  (3) ‧‧‧Photographic unit  (4) ‧‧‧Face expression model library  (A) ‧ ‧ images  (B) ‧ ‧ patients  (C) ‧ ‧ facial expression change screen  

[First figure] is a schematic diagram of the configuration of the present embodiment.

[Second figure] is a schematic diagram of the use of the present embodiment.

[Third Figure] is a flow chart of the operation of the present embodiment.

Claims (10)

A consultation system for detecting facial expressions, comprising:  An arithmetic processing unit that outputs a picture for asking an evaluation question;  a display unit, the signal is connected to the operation processing unit for playing the picture;  a photographing unit connected to the arithmetic processing unit for photographing a facial expression change screen, and transmitting the facial expression change screen to the arithmetic processing unit, the arithmetic processing unit changing according to the facial expression The screen is compared with a standard and abnormal facial expression feature value, and an evaluation result is output;  A face expression model library is connected to the operation processing unit, and the facial expression model library provides the standard and the facial expression eigenvalues for the neurological calculation prediction evaluation to obtain the evaluation result.   The invention system for detecting facial expressions as described in claim 1 of the patent application, wherein the screen comprises a screen for directly accepting a question by a professional doctor. The invention system for detecting facial expressions according to the first aspect of the patent application, wherein the screen comprises a screen for a virtual doctor to ask questions. The invention system for detecting facial expressions according to claim 1, wherein the facial expression change screen includes a picture of a patient answering the evaluation question. The medical examination system for detecting facial expressions as described in claim 4, wherein the evaluation result comprises determining whether the symptom of the patient conforms to an anxiety, depression, mental or psychological disease. The medical examination system for detecting facial expressions as described in claim 1, wherein the standard and abnormal facial expression feature values include patients who are indeed suffering from anxiety, depression, mental or mental illness. The image features of the face that produce facial expression changes when answering the assessment question. The system for detecting facial expressions according to item 6 of the patent application scope, wherein the standard and abnormal facial expression feature values include facial frowning, shaking head, blinking, sweating, pupil dilation, and eye stagnation. Physiological changes in the negative expressions of whispering, whispering, flushing or facial muscles. The medical examination system for detecting a facial expression according to the first aspect of the patent application, wherein the arithmetic processing unit determines the calculation result and the virtual doctor's consultation result by a fuzzy theory to determine the evaluation result. The invention system for detecting a facial expression according to the first aspect of the patent application, wherein the photographing unit is disposed on the display unit. The invention relates to a consultation system for detecting a facial expression according to the first aspect of the patent application, wherein the operation processing unit is a remote server, a remote computer, a notebook computer, a tablet computer or a smart type. In the mobile phone, the display unit is a touch-type desktop screen, a screen of the notebook computer, a screen of the tablet computer or a screen of the smart phone.