CN112168141A - Information processing method, device, equipment and storage medium for remote inquiry - Google Patents
Information processing method, device, equipment and storage medium for remote inquiry Download PDFInfo
- Publication number
- CN112168141A CN112168141A CN202010066097.1A CN202010066097A CN112168141A CN 112168141 A CN112168141 A CN 112168141A CN 202010066097 A CN202010066097 A CN 202010066097A CN 112168141 A CN112168141 A CN 112168141A
- Authority
- CN
- China
- Prior art keywords
- diagnosis result
- vital sign
- sign information
- user
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 49
- 238000003672 processing method Methods 0.000 title claims abstract description 34
- 238000003745 diagnosis Methods 0.000 claims abstract description 171
- 230000001815 facial effect Effects 0.000 claims description 35
- 210000000056 organ Anatomy 0.000 claims description 14
- 238000000034 method Methods 0.000 claims description 13
- 230000008859 change Effects 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 5
- 230000002194 synthesizing effect Effects 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims description 3
- 230000000875 corresponding effect Effects 0.000 description 33
- 230000006870 function Effects 0.000 description 7
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 206010023126 Jaundice Diseases 0.000 description 5
- 201000010099 disease Diseases 0.000 description 5
- 230000014509 gene expression Effects 0.000 description 5
- 230000036528 appetite Effects 0.000 description 4
- 235000019789 appetite Nutrition 0.000 description 4
- 230000036760 body temperature Effects 0.000 description 4
- 235000007183 paleface Nutrition 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 210000004709 eyebrow Anatomy 0.000 description 3
- 230000008921 facial expression Effects 0.000 description 3
- 230000008447 perception Effects 0.000 description 3
- 208000024891 symptom Diseases 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 230000006866 deterioration Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 208000002173 dizziness Diseases 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000035790 physiological processes and functions Effects 0.000 description 2
- 230000033764 rhythmic process Effects 0.000 description 2
- 210000000697 sensory organ Anatomy 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 208000017667 Chronic Disease Diseases 0.000 description 1
- 206010033557 Palpitations Diseases 0.000 description 1
- 208000013738 Sleep Initiation and Maintenance disease Diseases 0.000 description 1
- 206010048245 Yellow skin Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000000265 homogenisation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 206010022437 insomnia Diseases 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002980 postoperative effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000011895 specific detection Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
- A61B5/0024—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system for multiple sensor units attached to the patient, e.g. using a body or personal area network
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0062—Arrangements for scanning
- A61B5/0064—Body surface scanning
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4803—Speech analysis specially adapted for diagnostic purposes
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Veterinary Medicine (AREA)
- Surgery (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Computer Networks & Wireless Communication (AREA)
- Cardiology (AREA)
- Physiology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Pulmonology (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The information processing method comprises the steps of receiving a video call connection instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image, and extracting first vital sign information in the face image; acquiring second vital sign information detected by a user through the portable wearable sensing equipment; and comparing the first vital sign information and the second vital sign information with the reference vital sign information in the background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user. According to the technical scheme, the vital sign information of the user can be perceived visually or in a touch manner, and the accuracy of remote inquiry is improved.
Description
Technical Field
The present application relates to the field of medical information processing technologies, and in particular, to an information processing method, apparatus, device, and storage medium for remote inquiry.
Background
The medical follow-up refers to a method for the hospital to regularly know the disease condition change of the patient and guide the patient to recover by means of communication or other means with the patient who has been in a visit at the hospital. On one hand, the doctor can conveniently track and observe postoperative patients, special disease groups, chronic diseases and the like for a long time through follow-up visits, so that the doctor can know the state of an illness of the patients in time and give suggestions, and the treatment is arranged in time for the patients with relapse and deterioration of the state of the illness.
In actual operation, sometimes a patient does not cooperate with follow-up visits of medical staff, does not answer or reply to a telephone or a short message of the medical staff, or replies inaccurately to the actual condition of the patient, so that the medical staff cannot timely and accurately master the change of the patient's condition.
Disclosure of Invention
The object of the present application is to solve at least one of the above-mentioned technical drawbacks, in particular the problem of inaccurate patient condition.
In a first aspect, an embodiment of the present application provides an information processing method for remote inquiry, which is applied to a remote inquiry client, and includes the following steps:
receiving a video call connection instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image, and extracting first vital sign information in the face image;
acquiring second vital sign information detected by the user through a portable wearable sensing device;
and comparing the first vital sign information and the second vital sign information with reference vital sign information in a background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user.
In an embodiment, the step of comparing the first vital sign information and the second vital sign information with reference vital sign information in a background database respectively to obtain a preliminary diagnosis result includes:
comparing the first vital sign information with corresponding first reference vital sign information in a background database to obtain a first diagnosis result; comparing the second vital sign information with corresponding second reference vital sign information in the background database to obtain a second diagnosis result;
and combining the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
In one embodiment, the information processing method for remote inquiry further includes:
acquiring third sign information of a life object input by a user in advance;
and comparing the third vital sign information with third reference vital sign information corresponding to the background database to obtain a third diagnosis result, and combining the third diagnosis result with the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
In one embodiment, the information processing method for remote inquiry further includes:
acquiring voice information of a user in a video call process, and extracting fourth vital sign information of the user from the voice information;
and comparing the fourth vital sign information with fourth reference vital sign information corresponding to the background database to obtain a fourth diagnosis result, and combining the fourth diagnosis result with the first diagnosis result, the second diagnosis result and the third diagnosis result to obtain a preliminary diagnosis result.
In one embodiment, the information processing method for remote inquiry further comprises: acquiring historical second body information detected by the user through the portable wearable sensing equipment, and determining the change trend of the second body information of the user according to the historical second body information;
the step of combining the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result comprises:
and obtaining the preliminary diagnosis result by combining the first diagnosis result, the second diagnosis result and the variation trend of the second sign information.
In an embodiment, the first vital sign information includes a facial color and a micro-expression; the second vital sign includes pulse information, heart rate information, and body temperature information.
In an embodiment, the step of extracting the first vital sign information in the face image further includes:
acquiring facial color and five-sense organ characteristics corresponding to third vital sign data according to a matching relation between the third vital sign data and the facial color and five-sense organ characteristics which are pre-configured;
and synthesizing the facial color five-sense organ characteristics to the face image.
In one embodiment, the step of sending the preliminary diagnosis result to the user comprises:
displaying the preliminary diagnosis result;
receiving an external instruction to correct the preliminary diagnosis result;
and sending the corrected preliminary diagnosis result to the user.
In a second aspect, an embodiment of the present application provides an information processing apparatus for remote inquiry, which is applied to a remote inquiry client, and includes:
the first acquisition module is used for receiving a video call connection instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image and extracting first vital sign information in the face image;
the second acquisition module is used for acquiring second vital sign information detected by the user through the portable wearable sensing equipment;
and the result generation module is used for respectively comparing the first vital sign information and the second vital sign information with reference vital sign information in a background database to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user.
In a third aspect, an embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the steps of the information processing method for remote inquiry according to any embodiment of the first aspect when executing the program.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the steps of the information processing method for remote interrogation according to any one of the embodiments of the first aspect.
According to the information processing method, the device, the equipment and the storage medium for remote inquiry, a camera is opened by receiving a video call connection instruction of a user, a face image of the user is detected in a video acquisition area, the face image is recognized, and first vital sign information in the face image is extracted; acquiring second vital sign information detected by a user through the portable wearable sensing equipment; and comparing the first vital sign information and the second vital sign information with the reference vital sign information in the background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user so as to realize visual or tactile perception of the vital sign information of the user and improve the diagnosis accuracy of remote inquiry.
Meanwhile, the third vital sign information input by the user, the fourth vital sign information obtained by processing according to the voice information of the user, the change trend of the second vital sign information and other aspects can be comprehensively analyzed, so that the remote inquiry achieves the effect of 'looking for, smelling and asking for' and the diagnosis accuracy of the remote inquiry is improved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow chart of an information processing method for remote interrogation according to an embodiment;
fig. 2 is a schematic structural diagram of an information processing apparatus for remote inquiry according to an embodiment.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Fig. 1 is a flowchart of an information processing method for remote inquiry according to an embodiment, where the information processing method for remote inquiry can be executed on a computer device, such as a client, and further, in this embodiment, the information processing method for remote inquiry is applied to a remote inquiry client, and optionally, the remote inquiry client can be installed on a terminal device, such as a mobile phone and a tablet computer.
Specifically, as shown in fig. 1, the information processing method for remote inquiry may include the following steps:
s110, receiving a video call connection instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image, and extracting first vital sign information in the face image.
Medical staff initiates a video call through a client installed in a medical monitoring center, a remote inquiry client where a patient user is located receives the video call, and the user clicks a corresponding key on a corresponding interface of the remote inquiry client to make a video call connection instruction. And the remote inquiry client receives the video call connection instruction and opens the camera. In an embodiment, the camera may be a camera in the remote inquiry client, or may be a camera carried on the terminal device.
The position of the camera is adjusted so that the face of the user is presented in the video capture area of the camera. The method comprises the steps of detecting a face image of a user through a video acquisition area, identifying information in the face image, and extracting first vital sign information in the face image, wherein the first vital sign information can be micro-expressions, facial colors and the like of the face.
Because the user is in different physiological states, the parameters corresponding to the first vital sign information are different, for example, the user is easily tired in a physical uncomfortable physiological state, the micro expression is in a selected tired state, and specifically, the micro expression of the patient can be detected through the following steps to judge whether the patient is in a tired state: firstly, acquiring facial expression images of a patient user to obtain the facial expression images of the patient user; secondly, preprocessing the image, converting the facial expression image into a gray level image, and carrying out histogram equalization on the gray level image; positioning a face region, positioning an eye region, a mouth region and an eyebrow region of a person, segmenting and extracting an image of the face region, and performing size homogenization on the segmented and extracted image; extracting the textural features of the eye region, the textural features of the mouth region and the textural features of the eyebrow region of the patient user; carrying out feature fusion on the texture features of the eye region, the texture features of the mouth region and the texture features of the eyebrow region to obtain face texture features; and classifying the current facial texture features of the patient user according to the facial texture features of the fatigue state micro expressions in the facial texture micro expression library so as to identify the micro expressions of the patient user and judge whether to enter the fatigue state.
As another example, the user's condition may also be detected by facial complexion. For example, when a patient user suffers from jaundice, the complexion is yellow, and as jaundice is gradually cured, the complexion changes from yellow to normal complexion. Specifically, the facial complexion of the patient can be detected to judge the cure degree of the disease through the following steps: the method comprises the steps of firstly, acquiring face information images of patient users, obtaining face images of the patient users, obtaining color values of face pixel points of the patient users, extracting colors to be yellow regions according to the color values, and judging the recovery degree of jaundice diseases of the patient users according to the depth and the area of the colors in the yellow regions.
And S120, obtaining second vital sign information detected by the user through the portable wearable sensing equipment.
Optionally, the portable wearable sensing device can be a terminal device which is small in size and convenient for a user to carry and is an intelligent watch, an intelligent bracelet, an intelligent ring and a film-shaped sensor, and can be used for detecting second vital sign information of the user, such as pulse information, heart rate information, heart rhythm information and body temperature information.
In an embodiment, a remote interrogation client is communicatively coupled with a portable wearable sensing device. The portable wearable sensing equipment detects second vital sign information of the user periodically or in real time and sends the second vital sign information to the remote inquiry client. And the remote inquiry client receives the second vital sign information sent by the portable wearable sensing equipment and carries out subsequent processing on the second vital sign information.
S130, comparing the first vital sign information and the second vital sign information with reference vital sign information in a background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user.
In traditional Chinese medicine, the physical condition of a patient is known in many ways such as by looking at, hearing, making a request and the like, so as to improve the diagnosis result. In an embodiment, the first vital sign information is visually perceived vital sign information obtained through a video image, which is equivalent to information obtained by "looking". The second vital sign information is the tactile vital sign information obtained through physical, chemical or biological means, and is equivalent to the information obtained through cutting. The reference vital sign information may be the vital sign information of the user under normal conditions, and is stored in the background database. Optionally, the reference vital sign information corresponding to users with different diseases, different sexes, and different ages is different. Of course, in the embodiment, since the physical states of the users are different, the reference vital sign information may be determined after acquiring and processing the vital sign information in the normal state according to the actual situation of the user.
Further, comparing the first vital sign information with corresponding first reference vital sign information in the background database to obtain a first diagnosis result, namely a diagnosis result on the 'hope' aspect; and comparing the second vital sign information with corresponding second reference vital sign information in the background database to obtain a second diagnosis result, namely the diagnosis result on the aspect of 'cutting'. In this embodiment, a preliminary diagnosis result is obtained by combining a "hope" first diagnosis result obtained through video information and a "cut" second diagnosis result obtained through the portable wearable sensing device, where the preliminary diagnosis result includes a "improvement" or "deterioration" diagnosis state, and may further include a specific detection parameter value. The preliminary diagnosis result obtained by the remote inquiry client can be presented to the client in a display mode on a corresponding interface of the remote inquiry client, and can also be sent to a medical monitoring center of a relevant hospital in a network communication mode.
According to the information processing method for remote inquiry, a video call connection instruction of a user is received, a camera is opened, a face image of the user is detected in a video acquisition area, the face image is recognized, and first vital sign information in the face image is extracted; acquiring second vital sign information detected by a user through the portable wearable sensing equipment; and comparing the first vital sign information and the second vital sign information with the reference vital sign information in the background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user so as to realize visual or tactile perception of the vital sign information of the user and improve the accuracy of remote inquiry.
In an embodiment, the information processing method for remote inquiry may further include the following steps:
s201, third life sign information input by the user in advance is obtained.
The third vital sign information can be vital sign information which is displayed on a display interface of the remote inquiry client and needs to be filled by the patient user, such as whether the patient is dizzy or not, whether the patient is palpitation or not, insomnia and dreaminess or the like.
S202, comparing the third vital sign information with third reference vital sign information corresponding to the background database to obtain a third diagnosis result, and combining the third diagnosis result with the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
After the remote inquiry client acquires the third vital sign information, comparing the third vital sign information with a corresponding third reference vital sign credit in the background database, wherein if the third vital sign information filled by the user is as follows: if no dizziness, bad appetite, etc., comparing the third vital sign information with the third reference vital sign information to obtain a third diagnosis result: poor appetite. And meanwhile, the third diagnosis result is combined with the first diagnosis result and the second diagnosis result to comprehensively judge to obtain a preliminary diagnosis result. If the first diagnosis result is pale face, the second diagnosis result is: the pulse is normal, and the third diagnosis result is that: if the appetite is poor, the preliminary diagnosis result can be: the condition is slightly improved, but more rest is needed, and the patient can go to a hospital for further treatment if necessary.
In an embodiment, before the step of extracting the first vital sign information in the face image in S110, the method further includes:
s100, according to a matching relation between pre-configured third vital sign data and facial color five-sense organ characteristics, acquiring facial color five-sense organ characteristics corresponding to the third vital sign data, and synthesizing the facial color five-sense organ characteristics into the face image.
The corresponding relation between the third vital sign data and the facial color and five-sense organ characteristics is pre-configured, and the corresponding relation between the third vital sign data and the facial color and five-sense organ characteristics is stored in a database.
When the user inputs third vital sign data through the remote inquiry client, facial color and facial features corresponding to the third vital sign data input by the user are determined according to the corresponding relation between the third vital sign data and the facial color and facial features stored in the database, and the facial color and facial features are synthesized into a face image so as to improve the face image acquired by the camera. For example, a user of a patient may have jaundice, and one of the symptoms of jaundice is yellow complexion, and the facial features include relatively yellow skin, because the current camera typically causes the face to be whitened or the like or the picture to be distorted by adjusting the shooting parameters. The embodiment improves the face image by combining corresponding facial color and facial features into the acquired face image according to the third vital sign data input by the patient user.
The remote inquiry client side obtains third vital sign data input by a patient, judges possible diseases of the patient, obtains corresponding symptoms, extracts facial color five sense organs characteristics corresponding to the symptoms, and adds the facial color five sense organs characteristics to the facial image in each frame of video picture in the video transmission process of the facial image collected by the camera, so that transmission errors and distortions of transmission equipment such as the camera and the like are reduced, and the accuracy of remote inquiry is improved.
In an embodiment, the information processing method for remote inquiry may further include the following steps:
s301, acquiring voice information of the user in the video call process, and extracting fourth vital sign information of the user from the voice information.
The patient user can input voice information in the video call process, the voice information can be the voice information sent by the patient user at will, and the voice information can also be the voice information which enables the patient user to pronounce according to the appointed sentence. And performing voice processing on the voice information, and obtaining fourth vital sign information according to voice characteristics such as timbre and audio obtained after the voice processing, wherein the fourth vital sign information includes whether the voice is hoarse or not.
S302, comparing the fourth vital sign information with fourth reference vital sign information corresponding to the background database to obtain a fourth diagnosis result, and combining the fourth diagnosis result with the first diagnosis result, the second diagnosis result and the third diagnosis result to obtain a preliminary diagnosis result.
After the remote inquiry client acquires the fourth vital sign information, comparing the fourth vital sign information with a corresponding fourth reference vital sign message in the background database, if the fourth vital sign information is that the sound is low, sandy and dumb, and the like, and the fourth reference vital sign information of the patient user stored in the background database is that the sound is clear, comparing the fourth vital sign information with the fourth reference vital sign information to obtain a third diagnosis result: the sound is sandy. And meanwhile, the fourth diagnosis result is combined with the first diagnosis result, the second diagnosis result and the third diagnosis result to comprehensively judge to obtain a preliminary diagnosis result. If the first diagnosis result is pale face, the second diagnosis result is: the pulse is normal, and the third diagnosis result is that: poor appetite; fourth diagnosis results: if the sound is sandy, the result of the preliminary diagnosis can be: the condition is slightly improved, but more rest is needed, and the patient can go to a hospital for further treatment if necessary.
In one embodiment, the information processing method for remote inquiry further comprises:
s401, obtaining historical second body information detected by the user through the portable wearable sensing device, and determining the change trend of the second body information of the user according to the historical second body information.
In an embodiment, the second body condition information of the patient user's pulse, heart rate, heart rhythm, body temperature, or the like in the history over the preset time period may be detected by a portable wearable sensing device with a sensing function, such as a smart watch, a smart band, or a film-like pressure sensor, to obtain the trend of the second body condition information of the patient user over the preset time period. In an embodiment, the preset time period may be within a set time period before the video call is performed, and if the video call time is 11 am, the preset time period is 6 am to 11 am.
S402, combining the first diagnosis result, the second diagnosis result and the change trend of the second sign information to obtain the preliminary diagnosis result.
Since the variation trend of the second sign information can reflect the variation condition of the physical condition of the patient user, in an embodiment, the variation trend of the second sign information is obtained, and the preliminary diagnosis result is obtained by combining the first diagnosis result and the second diagnosis result. For example, the first diagnostic result is pale face, and the second diagnostic result is: the pulse is normal; the second sign information is kept stable within the preset time period, which indicates that the condition of the patient user is improved and the condition is optimistic. If the first diagnosis result is pale face, the second diagnosis result is: the pulse is normal; the second sign information has a large change in the preset time period, which indicates that the first diagnostic result and the second diagnostic result look optimistic, the actual situation may be unstable, and the patient user may need to be re-detected again or multiple times, so as to improve the accuracy of the preliminary diagnostic result and avoid detection errors caused by unstable situations.
In one embodiment, the step of sending the preliminary diagnosis result to the user in the information processing method for remote inquiry comprises:
s501, displaying the preliminary diagnosis result.
And S502, receiving an external instruction to correct the preliminary diagnosis result.
And S503, sending the corrected preliminary diagnosis result to the user.
Specifically, the remote inquiry client performs data processing on the obtained physical sign information to obtain a preliminary diagnosis result, and the preliminary diagnosis result is displayed to medical staff firstly. And the medical staff checks the preliminary diagnosis result and further judges whether the preliminary diagnosis result is correct or not by combining the first vital sign information, the second vital sign information, the third vital sign information or the fourth vital sign information which are possibly acquired by the remote inquiry client. If the preliminary diagnosis result needs to be corrected, corresponding actions can be performed to correct the preliminary diagnosis result. For example, the remote inquiry client determines that the condition of the patient user is optimistic according to the acquired vital sign information of the patient user, however, medical staff further refers to various vital sign information, and if the patient user needs to go to a hospital for examination, the remote inquiry client can perform an external action, so that the remote inquiry client receives an external instruction made by the user to correct the preliminary diagnosis result, corrects the automatically generated preliminary diagnosis result which is slightly improved in state but needs more rest into a state which requires to go to the hospital for examination, and sends the corrected preliminary diagnosis result to the user. According to the information processing method for remote inquiry, the preliminary diagnosis result which is automatically generated is determined and corrected by displaying the preliminary diagnosis result on the medical staff, so that the accuracy of diagnosis of remote inquiry is improved.
The following describes in detail a related embodiment of the information processing apparatus for remote inquiry.
Fig. 2 is a schematic structural diagram of an information processing apparatus for remote inquiry according to an embodiment, which is applicable to an information processing device for remote inquiry, such as a remote inquiry client. Specifically, as shown in fig. 2, the information processing apparatus for remote inquiry may include a first obtaining module 110, a second obtaining module 120, and a result generating module 130. :
the first obtaining module 110 is configured to receive a video call connection instruction from a user, turn on a camera, detect a face image of the user in a video acquisition area, identify the face image, and extract first vital sign information in the face image;
a second obtaining module 120, configured to obtain second vital sign information detected by the user through the portable wearable sensing device;
a result generating module 130, configured to compare the first vital sign information and the second vital sign information with reference vital sign information in a background database, respectively, to obtain a preliminary diagnosis result, and send the preliminary diagnosis result to the user.
The information processing device for remote inquiry provided by the embodiment receives a video call connection instruction of a user through the first acquisition module, opens the camera, detects a face image of the user in the video acquisition area, identifies the face image, and extracts first vital sign information in the face image; the second acquisition module acquires second vital sign information detected by the user through the portable wearable sensing equipment; the result generation module compares the first vital sign information and the second vital sign information with the reference vital sign information in the background database respectively to obtain a preliminary diagnosis result, and sends the preliminary diagnosis result to the user, so that the visual or tactile perception of the vital sign information of the user is realized, and the accuracy of remote inquiry is improved.
In one embodiment, the result generation module 130 includes:
the first diagnosis unit is used for comparing the first vital sign information with corresponding first reference vital sign information in the background database to obtain a first diagnosis result;
the second diagnosis unit is used for comparing the second vital sign information with corresponding second reference vital sign information in the background database to obtain a second diagnosis result;
and the result diagnosis unit is used for combining the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
In one embodiment, the information processing apparatus for remote inquiry further includes: a third diagnostic module for performing a third diagnostic function,
the third diagnosis module is used for acquiring third sign information of a life sign input by a user in advance; and comparing the third vital sign information with third reference vital sign information corresponding to the background database to obtain a third diagnosis result, and combining the third diagnosis result with the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
In one embodiment, the information processing apparatus for remote inquiry further includes: a fourth diagnostic module for performing a diagnostic function,
the fourth diagnosis module is used for acquiring voice information of the user in the video call process and extracting fourth vital sign information of the user from the voice information; and comparing the fourth vital sign information with fourth reference vital sign information corresponding to the background database to obtain a fourth diagnosis result, and combining the fourth diagnosis result with the first diagnosis result, the second diagnosis result and the third diagnosis result to obtain a preliminary diagnosis result.
In one embodiment, the information processing apparatus for remote inquiry further includes: a variation trend acquisition module;
the change trend acquisition module is used for acquiring historical second body information detected by the user through the portable wearable sensing equipment and determining the change trend of the second body information of the user according to the historical second body information;
the result generating module 130 is further configured to combine the first diagnosis result, the second diagnosis result, and the variation trend of the second sign information to obtain the preliminary diagnosis result.
In one embodiment, the information processing apparatus for remote inquiry further comprises a synthesis module;
the synthesis module is used for acquiring facial color and five-sense organ characteristics corresponding to third vital sign data according to a matching relation between the third vital sign data and the facial color and five-sense organ characteristics which are preset; and synthesizing the facial color five-sense organ characteristics to the face image.
In an embodiment, the first vital sign information includes a facial color and a micro-expression; the second vital sign includes pulse information, heart rate information, and body temperature information.
In an embodiment, the result generation module 130 is further configured to: displaying the preliminary diagnosis result; receiving an external instruction to correct the preliminary diagnosis result; and sending the corrected preliminary diagnosis result to the user.
When the information processing device for remote inquiry performs the information processing method for remote inquiry provided by any embodiment, the information processing device for remote inquiry has corresponding functions and beneficial effects.
The embodiment of the present application further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the program, the information processing method for remote inquiry in any of the above embodiments is implemented.
Optionally, the computer device may be a mobile terminal, a tablet computer, a server, or the like. When the computer equipment provided by the invention executes the information processing method for remote inquiry provided by any embodiment, the computer equipment has corresponding functions and beneficial effects.
Embodiments of the present application also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform an information processing method for remote inquiry, including:
receiving a video call connection instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image, and extracting first vital sign information in the face image;
acquiring second vital sign information detected by the user through a portable wearable sensing device;
and comparing the first vital sign information and the second vital sign information with reference vital sign information in a background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user.
Of course, the storage medium provided by the embodiment of the present invention contains computer-executable instructions, and the computer-executable instructions are not limited to the operations of the information processing method for remote inquiry as described above, and may also perform related operations in the information processing method for remote inquiry provided by any embodiment of the present invention, and have corresponding functions and advantages.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the information processing method for remote inquiry according to any embodiment of the present invention.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.
Claims (10)
1. An information processing method for remote inquiry is characterized by being applied to a remote inquiry client and comprising the following steps:
receiving a video call connection instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, and extracting first vital sign information in the face image;
acquiring second vital sign information detected by the user through a portable wearable sensing device;
and comparing the first vital sign information and the second vital sign information with reference vital sign information in a background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user.
2. The method of claim 1, wherein the step of comparing the first vital sign information and the second vital sign information with reference vital sign information in a background database to obtain a preliminary diagnosis result comprises:
comparing the first vital sign information with corresponding first reference vital sign information in a background database to obtain a first diagnosis result; comparing the second vital sign information with corresponding second reference vital sign information in the background database to obtain a second diagnosis result;
and combining the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
3. The information processing method for remote inquiry according to claim 1 or 2, further comprising:
acquiring third sign information of a life object input by a user in advance;
and comparing the third vital sign information with third reference vital sign information corresponding to the background database to obtain a third diagnosis result, and combining the third diagnosis result with the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
4. The method of claim 3, further comprising:
acquiring voice information of a user in a video call process, and extracting fourth vital sign information of the user from the voice information;
and comparing the fourth vital sign information with fourth reference vital sign information corresponding to the background database to obtain a fourth diagnosis result, and combining the fourth diagnosis result with the first diagnosis result, the second diagnosis result and the third diagnosis result to obtain a preliminary diagnosis result.
5. The information processing method for remote inquiry according to claim 2, further comprising: acquiring historical second body information detected by the user through the portable wearable sensing equipment, and determining the change trend of the second body information of the user according to the historical second body information;
the step of combining the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result comprises:
and obtaining the preliminary diagnosis result by combining the first diagnosis result, the second diagnosis result and the variation trend of the second sign information.
6. The method according to any one of claims 3, wherein the step of extracting the first vital sign information from the face image further comprises:
acquiring facial color and five-sense organ characteristics corresponding to third vital sign data according to a matching relation between the third vital sign data and the facial color and five-sense organ characteristics which are pre-configured;
and synthesizing the facial color five-sense organ characteristics to the face image.
7. The method of claim 4, wherein the step of sending the preliminary diagnosis result to the user comprises:
displaying the preliminary diagnosis result;
receiving an external instruction to correct the preliminary diagnosis result;
and sending the corrected preliminary diagnosis result to the user.
8. An information processing device for remote inquiry, which is applied to a remote inquiry client, comprises:
the first acquisition module is used for receiving a video call connection instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image and extracting first vital sign information in the face image;
the second acquisition module is used for acquiring second vital sign information detected by the user through the portable wearable sensing equipment;
and the result generation module is used for respectively comparing the first vital sign information and the second vital sign information with reference vital sign information in a background database to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the information processing method for remote interrogation according to any one of claims 1 to 7 when executing the program.
10. A storage medium containing computer-executable instructions for performing the steps of the information processing method for remote interrogation according to any one of claims 1 to 7 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010066097.1A CN112168141B (en) | 2020-01-20 | 2020-01-20 | Information processing method, device, equipment and storage medium for remote inquiry |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010066097.1A CN112168141B (en) | 2020-01-20 | 2020-01-20 | Information processing method, device, equipment and storage medium for remote inquiry |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112168141A true CN112168141A (en) | 2021-01-05 |
| CN112168141B CN112168141B (en) | 2024-03-22 |
Family
ID=73919006
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010066097.1A Active CN112168141B (en) | 2020-01-20 | 2020-01-20 | Information processing method, device, equipment and storage medium for remote inquiry |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112168141B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113707301A (en) * | 2021-08-30 | 2021-11-26 | 康键信息技术（深圳）有限公司 | Remote inquiry method, device, equipment and medium based on artificial intelligence |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004008573A (en) * | 2002-06-07 | 2004-01-15 | Seiko Instruments Inc | Remote medical checkup apparatus, diagnostic method therefor and remote medical checkup program |
| KR20040012155A (en) * | 2002-08-01 | 2004-02-11 | (주) 굿커뮤니케이션 | Chinese medical service method for remote medical examination and prescription through network and system thereof |
| CN103258137A (en) * | 2013-05-28 | 2013-08-21 | 美合实业（苏州）有限公司 | Long-distance inquiring method |
| CN104398244A (en) * | 2014-10-20 | 2015-03-11 | 西北工业大学 | Tele medicine real time monitoring and positioning system based on Internet of things |
| CN105877709A (en) * | 2016-04-07 | 2016-08-24 | 新绎健康科技有限公司 | Health condition data acquisition device, health condition data acquisition analysis system and method |
| CN107242857A (en) * | 2017-06-12 | 2017-10-13 | 南开大学 | The intelligent traditional Chinese medical science based on deep learning integrates diagnosis and therapy system |
| CN107736875A (en) * | 2017-09-30 | 2018-02-27 | 深圳市易特科信息技术有限公司 | Chinese medicinal interrogation equipment and Chinese medicinal interrogation data processing equipment |
-
2020
- 2020-01-20 CN CN202010066097.1A patent/CN112168141B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004008573A (en) * | 2002-06-07 | 2004-01-15 | Seiko Instruments Inc | Remote medical checkup apparatus, diagnostic method therefor and remote medical checkup program |
| KR20040012155A (en) * | 2002-08-01 | 2004-02-11 | (주) 굿커뮤니케이션 | Chinese medical service method for remote medical examination and prescription through network and system thereof |
| CN103258137A (en) * | 2013-05-28 | 2013-08-21 | 美合实业（苏州）有限公司 | Long-distance inquiring method |
| CN104398244A (en) * | 2014-10-20 | 2015-03-11 | 西北工业大学 | Tele medicine real time monitoring and positioning system based on Internet of things |
| CN105877709A (en) * | 2016-04-07 | 2016-08-24 | 新绎健康科技有限公司 | Health condition data acquisition device, health condition data acquisition analysis system and method |
| CN107242857A (en) * | 2017-06-12 | 2017-10-13 | 南开大学 | The intelligent traditional Chinese medical science based on deep learning integrates diagnosis and therapy system |
| CN107736875A (en) * | 2017-09-30 | 2018-02-27 | 深圳市易特科信息技术有限公司 | Chinese medicinal interrogation equipment and Chinese medicinal interrogation data processing equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113707301A (en) * | 2021-08-30 | 2021-11-26 | 康键信息技术（深圳）有限公司 | Remote inquiry method, device, equipment and medium based on artificial intelligence |
| WO2023029510A1 (en) * | 2021-08-30 | 2023-03-09 | 康键信息技术（深圳）有限公司 | Remote diagnostic inquiry method and apparatus based on artificial intelligence, and device and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112168141B (en) | 2024-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10970841B2 (en) | Processing fundus images using machine learning models | |
| RU2613580C2 (en) | Method and system for helping patient | |
| US11699529B2 (en) | Systems and methods for diagnosing a stroke condition | |
| CN111225612A (en) | Neural obstacle identification and monitoring system based on machine learning | |
| WO2021057423A1 (en) | Image processing method, image processing apparatus, and storage medium | |
| JP2018195164A (en) | Analysis device, analysis program, and analysis method | |
| CN109585001A (en) | A kind of data analysing method, device, electronic equipment and storage medium | |
| CN111881838A (en) | Dyskinesia assessment video analysis method and equipment with privacy protection function | |
| CN115101191A (en) | Parkinson disease diagnosis system | |
| CN112168141B (en) | Information processing method, device, equipment and storage medium for remote inquiry | |
| US20100150405A1 (en) | System and method for diagnosis of human behavior based on external body markers | |
| CN116665281B (en) | Key emotion extraction method based on doctor-patient interaction | |
| CN117557850A (en) | Consciousness disturbance assessment method and device based on multi-mode brain data fusion | |
| CN110459299B (en) | Retina fundus color photograph image screening method | |
| Logan et al. | From individual features to full faces: Combining aspects of face information | |
| KR100915922B1 (en) | Methods and System for Extracting Facial Features and Verifying Sasang Constitution through Image Recognition | |
| JP7327987B2 (en) | Medical diagnosis support system, medical diagnosis support device, medical diagnosis support method and program | |
| CN112107332A (en) | Method, equipment and system for processing medical ultrasonic image | |
| TW202122040A (en) | Method for analyzing and estimating face muscle status | |
| JP7257682B2 (en) | LEARNING DEVICE, LEARNING METHOD AND LEARNING DEVICE PROGRAM, AND INFORMATION OUTPUT DEVICE, INFORMATION OUTPUT METHOD AND INFORMATION OUTPUT PROGRAM | |
| CN113553460B (en) | Image retrieval method and device, electronic device and storage medium | |
| CN116509419B (en) | Electroencephalogram information processing method and system | |
| WO2022270584A1 (en) | Information processing system, information processing method, and program | |
| Fernández et al. | A methodology for the analysis of spontaneous reactions in automated hearing assessment | |
| KR20180133081A (en) | System and method for health examination using ear and medical examination by interview |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |