CN112168141B - Information processing method, device, equipment and storage medium for remote inquiry - Google Patents
Information processing method, device, equipment and storage medium for remote inquiry Download PDFInfo
- Publication number
- CN112168141B CN112168141B CN202010066097.1A CN202010066097A CN112168141B CN 112168141 B CN112168141 B CN 112168141B CN 202010066097 A CN202010066097 A CN 202010066097A CN 112168141 B CN112168141 B CN 112168141B
- Authority
- CN
- China
- Prior art keywords
- vital sign
- sign information
- diagnosis result
- user
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 49
- 238000003672 processing method Methods 0.000 title abstract description 29
- 238000003745 diagnosis Methods 0.000 claims abstract description 166
- 230000001815 facial effect Effects 0.000 claims description 37
- 230000008859 change Effects 0.000 claims description 16
- 230000006870 function Effects 0.000 claims description 7
- 238000000034 method Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 5
- 230000002194 synthesizing effect Effects 0.000 claims description 4
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 238000004590 computer program Methods 0.000 claims description 3
- 238000003786 synthesis reaction Methods 0.000 claims description 3
- 230000008447 perception Effects 0.000 abstract description 4
- 230000000007 visual effect Effects 0.000 abstract description 4
- 230000000875 corresponding effect Effects 0.000 description 33
- 206010023126 Jaundice Diseases 0.000 description 5
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000036760 body temperature Effects 0.000 description 4
- 201000010099 disease Diseases 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 235000007183 paleface Nutrition 0.000 description 4
- 230000036528 appetite Effects 0.000 description 3
- 235000019789 appetite Nutrition 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 210000004709 eyebrow Anatomy 0.000 description 3
- 230000008921 facial expression Effects 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 208000024891 symptom Diseases 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000035790 physiological processes and functions Effects 0.000 description 2
- 230000033764 rhythmic process Effects 0.000 description 2
- 208000017667 Chronic Disease Diseases 0.000 description 1
- 206010033557 Palpitations Diseases 0.000 description 1
- 208000013738 Sleep Initiation and Maintenance disease Diseases 0.000 description 1
- 206010048245 Yellow skin Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 208000002173 dizziness Diseases 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000000265 homogenisation Methods 0.000 description 1
- 206010022437 insomnia Diseases 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002980 postoperative effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
- A61B5/0024—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system for multiple sensor units attached to the patient, e.g. using a body or personal area network
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0062—Arrangements for scanning
- A61B5/0064—Body surface scanning
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4803—Speech analysis specially adapted for diagnostic purposes
Abstract
The information processing method comprises the steps of receiving a video call instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image, and extracting first vital sign information in the face image; acquiring second vital sign information detected by a user through the portable wearable sensing device; and comparing the first vital sign information and the second vital sign information with the reference vital sign information in the background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user. According to the technical scheme, the visual or tactile perception of vital sign information of the user is realized, and the accuracy of remote inquiry is improved.
Description
Technical Field
The present application relates to the technical field of medical information processing, and in particular, to an information processing method, apparatus, device and storage medium for remote inquiry.
Background
Medical follow-up refers to an observation method by which a hospital can regularly know the change of the condition of a patient and guide the rehabilitation of the patient by communicating or other modes to the patient who has been at the hospital. On the one hand, the follow-up visit can facilitate doctors to carry out long-term tracking observation on postoperative patients, special disease groups, chronic diseases and the like, so that the doctors can know the change of the illness state of the patients in time and give advice, and the patients with recurrent and worsened illness state can be treated in time.
In actual operation, the patient sometimes does not cooperate with follow-up visit of medical staff, does not answer or reply the telephone or short message of the medical staff, or replies inaccurately to the actual condition of the patient, so that the medical staff can not timely and accurately grasp the change of the illness state of the patient.
Disclosure of Invention
The purpose of the present application is to solve at least one of the above technical drawbacks, in particular the problem of inaccurate condition of the patient obtained.
In a first aspect, an embodiment of the present application provides an information processing method for remote inquiry, which is applied to a remote inquiry client, and includes the following steps:
receiving a video call instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image, and extracting first vital sign information in the face image;
acquiring second vital sign information detected by the user through the portable wearable sensing device;
and comparing the first vital sign information and the second vital sign information with the reference vital sign information in a background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user.
In an embodiment, the step of comparing the first vital sign information and the second vital sign information with reference vital sign information in a background database, respectively, to obtain a preliminary diagnosis result includes:
comparing the first vital sign information with corresponding first reference vital sign information in a background database to obtain a first diagnosis result; comparing the second vital sign information with corresponding second reference vital sign information in a background database to obtain a second diagnosis result;
and combining the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
In an embodiment, the information processing method of remote inquiry further includes:
acquiring third vital sign information input by a user in advance;
comparing the third vital sign information with corresponding third reference vital sign information in a background database to obtain a third diagnosis result, and combining the third diagnosis result with the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
In an embodiment, the information processing method of remote inquiry further includes:
acquiring voice information of a user in the video call process, and extracting fourth vital sign information of the user from the voice information;
comparing the fourth vital sign information with the corresponding fourth reference vital sign information in the background database to obtain a fourth diagnosis result, and combining the fourth diagnosis result with the first diagnosis result, the second diagnosis result and the third diagnosis result to obtain a preliminary diagnosis result.
In an embodiment, the information processing method of remote inquiry further includes: acquiring historical second sign information detected by the user through the portable wearable sensing equipment, and determining the change trend of the second sign information of the user according to the historical second sign information;
the step of combining the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result comprises the following steps:
and combining the first diagnosis result, the second diagnosis result and the change trend of the second sign information to obtain the preliminary diagnosis result.
In an embodiment, the first vital sign information includes facial color and micro-expressions; the second vital sign includes pulse information, heart rate information, and body temperature information.
In an embodiment, the step of extracting the first vital sign information in the face image further includes:
acquiring facial features corresponding to third vital sign data according to a matching relation between the third vital sign data and facial features;
and synthesizing the facial features to the facial image.
In one embodiment, the step of sending the preliminary diagnostic result to the user comprises:
displaying the preliminary diagnosis result;
receiving an external instruction to correct the preliminary diagnosis result;
and sending the corrected preliminary diagnosis result to the user.
In a second aspect, an embodiment of the present application provides an information processing apparatus for remote inquiry, which is applied to a remote inquiry client, including:
the first acquisition module is used for receiving a video call instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image and extracting first vital sign information in the face image;
a second acquisition module for acquiring second vital sign information detected by the user through the portable wearable sensing device;
and the result generation module is used for comparing the first vital sign information and the second vital sign information with the reference vital sign information in the background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user.
In a third aspect, embodiments of the present application provide a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the information processing method for remote interrogation according to any embodiment of the first aspect when the program is executed.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer executable instructions for performing the steps of the information processing method of remote interrogation as defined in any of the embodiments of the first aspect when executed by a computer processor.
The information processing method, the device, the equipment and the storage medium for remote inquiry provided by the embodiment are used for receiving a video call instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image and extracting first vital sign information in the face image; acquiring second vital sign information detected by a user through the portable wearable sensing device; and comparing the first vital sign information and the second vital sign information with the reference vital sign information in the background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user so as to realize visual or tactile perception of the vital sign information of the user and improve the diagnosis accuracy of remote inquiry.
Meanwhile, the third vital sign information input by the user, the fourth vital sign information obtained through processing according to the voice information of the user, the change trend of the second vital sign information and other aspects can be comprehensively analyzed, so that the effect of looking into asking and cutting is achieved in the remote inquiry, and the diagnosis accuracy of the remote inquiry is improved.
Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a flow chart of an information processing method of remote inquiry provided by an embodiment;
fig. 2 is a schematic structural diagram of an information processing apparatus for remote inquiry according to an embodiment.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of illustrating the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless expressly stated otherwise, as understood by those skilled in the art. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It will be understood by those skilled in the art that all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs unless defined otherwise. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Fig. 1 is a flowchart of an information processing method of a remote inquiry provided in an embodiment, where the information processing method of the remote inquiry may be implemented in a computer device, such as a client, further, in this embodiment, the information processing method of the remote inquiry is applied to a remote inquiry client, and optionally, the remote inquiry client may be installed in a terminal device, such as a mobile phone and a tablet computer.
Specifically, as shown in fig. 1, the information processing method of the remote inquiry may include the following steps:
s110, receiving a video call instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image, and extracting first vital sign information in the face image.
A medical staff initiates a video call through a client installed in a medical monitoring center, a remote inquiry client where a patient user is located receives the video call, and the user clicks a corresponding key on a corresponding interface of the remote inquiry client to make a video call connection instruction. And the remote inquiry client receives the video call connection instruction and opens the camera. In an embodiment, the camera may be a camera in the remote inquiry client, or may be a camera on the terminal device.
The position of the camera is adjusted so that the user's face is presented to the video capture area of the camera. Detecting a face image of a user through a video acquisition area, identifying information in the face image, and extracting first vital sign information in the face image from the information, wherein the first vital sign information can be a micro expression, a facial color and the like of the face.
Because the parameters corresponding to the first vital sign information are different in different physiological states of the user, for example, the user is easy to feel tired in a physiological state of uncomfortable body, the micro-expression can be in a selected tired state, and specifically, the micro-expression of the patient can be detected to judge whether the patient is in a tired state or not through the following steps: firstly, collecting facial expression images of a patient user to obtain the facial expression images of the patient user; then, preprocessing the image, converting the facial expression image into a gray image, and performing histogram equalization on the gray image; positioning a face region, positioning an eye region, a mouth region and an eyebrow region of a person, carrying out segmentation extraction on the face region image, and carrying out size homogenization on the segmented and extracted image; extracting texture features of an eye area, texture features of a mouth area and texture features of an eyebrow area of a patient user; feature fusion is carried out on the texture features of the eye area, the texture features of the mouth area and the texture features of the eyebrow area to obtain facial texture features; classifying the current facial texture features of the patient user according to the facial texture features of the fatigue state micro-expressions in the facial texture micro-expression library so as to identify the micro-expressions of the patient user, and judging whether to enter the fatigue state or not.
For another example, the user's illness can also be detected by facial color. For example, when a patient user suffers from jaundice, the complexion is yellow, and as the jaundice is gradually healed, the complexion also changes from yellow to normal. Specifically, the patient's face may be checked to determine the extent of disease recovery by: firstly, face information images of a patient user are acquired, face images of the patient user are obtained, color values of all face pixel points of the patient user are obtained, the color is extracted to be a yellow area according to the color values, and the cure degree of jaundice diseases of the patient user is judged according to the color depth and the area of the yellow area.
S120, acquiring second vital sign information detected by the user through the portable wearable sensing device.
Optionally, the portable wearable sensing device may be a terminal device with small volume, such as a smart watch, a smart bracelet, a smart finger ring, a film sensor, etc., and is convenient for a user to carry about, and may be used for detecting second vital sign information of the user, such as pulse information, heart rate information, heart rhythm information, body temperature information, etc.
In an embodiment, the remote interrogation client is communicatively connected with the portable wearable sensing device. The portable wearable sensing device periodically or in real time detects second vital sign information of the user and sends the second vital sign information to the remote inquiry client. The remote inquiry client receives the second vital sign information sent by the portable wearable sensing device and carries out subsequent processing on the second vital sign information.
S130, comparing the first vital sign information and the second vital sign information with the reference vital sign information in a background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user.
The physical condition of the patient is known in the aspects of the traditional Chinese medicine such as looking and smelling, so as to improve the diagnosis result. In an embodiment, the first vital sign information is visually perceived vital sign information obtained from a video image, corresponding to information obtained by "hope". The second vital sign information is the tactile-sensing vital sign information obtained by physical, chemical or biological means, and corresponds to the information obtained by "cutting". The reference vital sign information may be vital sign information of a user under normal conditions, and is stored in a background database. Optionally, the reference vital sign information corresponding to the users of different diseases, different sexes and different ages is different. Of course, in the embodiment, since the physical states of the users are different, the reference vital sign information may be determined according to the actual situation of the users after the vital sign information in the normal state is collected and processed.
Further, comparing the first vital sign information with corresponding first reference vital sign information in a background database to obtain a first diagnosis result, namely a diagnosis result in the aspect of 'looking up'; and comparing the second vital sign information with the corresponding second reference vital sign information in the background database to obtain a second diagnosis result, namely a diagnosis result in the aspect of cutting. In this embodiment, a primary diagnosis result is obtained by combining a first diagnosis result of "hope" obtained through video information and a second diagnosis result of "cut" obtained through a portable wearable sensing device, where the primary diagnosis result includes a diagnosis state of "improvement" or "deterioration", and may further include a specific value of a detection parameter. The primary diagnosis result obtained by the remote inquiry client can be presented to the client in a mode of being displayed on a corresponding interface of the remote inquiry client, and can be sent to a medical monitoring center of a relevant hospital in a network communication mode.
The information processing method for remote inquiry provided by the embodiment receives a video call instruction of a user, opens a camera, detects a face image of the user in a video acquisition area, identifies the face image, and extracts first vital sign information in the face image; acquiring second vital sign information detected by a user through the portable wearable sensing device; and comparing the first vital sign information and the second vital sign information with the reference vital sign information in the background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user so as to realize visual or tactile perception of the vital sign information of the user and improve the accuracy of remote inquiry.
In an embodiment, the information processing method of remote inquiry may further include the following steps:
s201, acquiring third vital sign information input by a user in advance.
The third vital sign information can be vital sign information which is displayed on a display interface of the remote inquiry client side according to the user and needs the patient user to fill in by himself, such as 'whether dizziness', 'whether palpitation', 'insomnia and dreaminess', and the like.
S202, comparing the third vital sign information with corresponding third reference vital sign information in a background database to obtain a third diagnosis result, and combining the third diagnosis result with the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
After the remote inquiry client acquires the third vital sign information, comparing the third vital sign information with the corresponding third reference vital sign information in the background database, wherein the third vital sign information filled in by the user is: and (3) comparing the third vital sign information with third reference vital sign information to obtain a third diagnosis result, wherein the third diagnosis result is as follows: poor appetite. And simultaneously, comprehensively judging the third diagnosis result by combining the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result. If the first diagnosis result is pale face, the second diagnosis result is: the pulse is normal, and the third diagnosis result is: poor appetite, the preliminary diagnosis result is: the state is slightly improved, but more rest is needed, and the patient is re-diagnosed in a hospital if necessary.
In an embodiment, before the step of extracting the first vital sign information in the face image in S110, the method further includes:
s100, according to a matching relation between preconfigured third vital sign data and facial features, facial features corresponding to the third vital sign data are obtained, and the facial features are synthesized to the facial image.
Firstly, pre-configuring the corresponding relation between third vital sign data and facial features, and storing the corresponding relation between the third vital sign data and facial features in a database.
When a user inputs third vital sign data through a remote inquiry client, facial features corresponding to the third vital sign data input by the user are determined according to the corresponding relation between the third vital sign data and facial features stored in a database, and the facial features are synthesized into a facial image to improve the facial image acquired by the camera. For example, a patient user may have jaundice, and one of the symptoms of jaundice is yellow, and then facial features include yellow skin, because current cameras generally can whiten a human face through adjustment of shooting parameters, or distort a picture. The facial features are combined into the face images acquired by shooting according to the third vital sign data input by the patient user, so that the face images are improved.
The remote inquiry client obtains third vital sign data input by a patient, judges possible diseases of the patient, obtains corresponding symptoms, extracts facial features corresponding to the symptoms, adds the facial features into facial images in each frame of video image in the video transmission process of the facial images acquired by the camera, reduces transmission error distortion of transmission equipment such as the camera and the like, and improves the accuracy of remote inquiry.
In an embodiment, the information processing method of remote inquiry may further include the following steps:
s301, acquiring voice information of a user in a video call process, and extracting fourth vital sign information of the user from the voice information.
During the video call process, the patient user can input voice information, and the voice information can be the voice information sent by the patient user at will or can be the voice information for making the patient user pronounce according to the appointed statement. And performing voice processing on the voice information, and obtaining fourth vital sign information according to voice characteristics such as tone, audio and the like obtained after voice processing, wherein the fourth vital sign information comprises whether voice is dumb or not and the like.
S302, comparing the fourth vital sign information with the fourth reference vital sign information corresponding to the background database to obtain a fourth diagnosis result, and combining the fourth diagnosis result with the first diagnosis result, the second diagnosis result and the third diagnosis result to obtain a preliminary diagnosis result.
After the remote consultation client obtains the fourth vital sign information, comparing the fourth vital sign information with the corresponding fourth reference vital sign information in the background database, if the fourth vital sign information is sound, such as a sunken and sandy voice, and the fourth reference vital sign information of the patient user stored in the background database is clear, comparing the fourth vital sign information with the fourth reference vital sign information to obtain a third diagnosis result, wherein the third diagnosis result is as follows: the sound is sandy and dumb. And meanwhile, comprehensively judging the fourth diagnosis result by combining the first diagnosis result, the second diagnosis result and the third diagnosis result to obtain a preliminary diagnosis result. If the first diagnosis result is pale face, the second diagnosis result is: the pulse is normal, and the third diagnosis result is: poor appetite; fourth diagnostic result: the voice is hoarse, and the preliminary diagnosis result is as follows: the state is slightly improved, but more rest is needed, and the patient is re-diagnosed in a hospital if necessary.
In an embodiment, the information processing method of remote inquiry further includes:
s401, acquiring historical second sign information detected by the user through the portable wearable sensing equipment, and determining the change trend of the second sign information of the user according to the historical second sign information.
In an embodiment, the historical second sign information of the pulse, the heart rate, the heart rhythm, the body temperature or the like of the patient user in the preset time period can be detected through a portable wearable sensing device with a sensing function such as a smart watch, a smart bracelet or a film-shaped pressure sensor, and the change trend of the second sign information of the patient user in the preset time period is obtained. In an embodiment, the preset time period may be within a set duration before the video call is performed, if the video call time is 11 am, the preset time period is 6 am to 11 am.
S402, combining the first diagnosis result, the second diagnosis result and the change trend of the second sign information to obtain the preliminary diagnosis result.
Since the trend of the second sign information can reflect the change situation of the physical condition of the patient user, in an embodiment, the trend of the second sign information is obtained, and the first diagnosis result and the second diagnosis result are combined to obtain the preliminary diagnosis result. For example, the first diagnosis is pale face and the second diagnosis is: the pulse is normal; the second sign information remains stable for a preset period of time, indicating that the patient user's condition is improved and the condition is optimistic. If the first diagnosis result is pale face, the second diagnosis result is: the pulse is normal; the second sign information changes greatly in the preset time period, which indicates that the first diagnosis result and the second diagnosis result are optimistic, but the actual situation may be unstable, and the patient user may need to be re-detected again or repeatedly, so as to improve the accuracy of the initial diagnosis result and avoid detection errors caused by unstable situations.
In one embodiment, the step of sending the preliminary diagnosis result to the user in the information processing method of remote inquiry includes:
s501, displaying the preliminary diagnosis result.
S502, receiving an external instruction to correct the preliminary diagnosis result.
And S503, transmitting the corrected preliminary diagnosis result to the user.
Specifically, after the remote inquiry client performs data processing on the obtained sign information, a preliminary diagnosis result is obtained, and is displayed to medical staff first. The medical staff checks the preliminary diagnosis result and further judges whether the preliminary diagnosis result is correct or not by combining the first vital sign information, the second vital sign information, the third vital sign information or the fourth vital sign information possibly acquired by the remote inquiry client. If the preliminary diagnosis result needs to be corrected, corresponding actions can be made to correct the preliminary diagnosis result. For example, the remote inquiry client determines that the situation of the patient user is optimistic according to the acquired vital sign information of the patient user, however, by further referring to the vital sign information, the medical staff considers that the patient user needs to go to the hospital for examination, an external action can be made to the remote inquiry client, so that the remote inquiry client receives an external instruction made by the user to correct the preliminary diagnosis result, the automatically generated preliminary diagnosis result of "state is slightly improved, but multiple rest is needed is corrected to" please go to the hospital for examination ", and the corrected preliminary diagnosis result is sent to the user. According to the information processing method for remote inquiry provided by the embodiment, the automatic generation of the preliminary diagnosis result is determined by the medical staff, and the preliminary diagnosis result which is possibly wrong is corrected, so that the accuracy of diagnosis of remote inquiry is improved.
Related embodiments of the information processing apparatus for remote inquiry are described in detail below.
Fig. 2 is a schematic structural diagram of an information processing apparatus for remote inquiry according to an embodiment, which is applicable to an information processing device for remote inquiry, such as a remote inquiry client. Specifically, as shown in fig. 2, the information processing apparatus for remote inquiry may include a first acquisition module 110, a second acquisition module 120, and a result generation module 130.:
the first obtaining module 110 is configured to receive a video call instruction from a user, turn on a camera, detect a face image of the user in a video acquisition area, identify the face image, and extract first vital sign information in the face image;
a second acquiring module 120, configured to acquire second vital sign information detected by the user through the portable wearable sensing device;
the result generating module 130 is configured to compare the first vital sign information and the second vital sign information with reference vital sign information in a background database, respectively, to obtain a preliminary diagnosis result, and send the preliminary diagnosis result to the user.
The information processing device for remote inquiry provided by the embodiment receives a video call instruction of a user through a first acquisition module, opens a camera, detects a face image of the user in a video acquisition area, identifies the face image, and extracts first vital sign information in the face image; the second acquisition module acquires second vital sign information detected by a user through the portable wearable sensing device; the result generation module compares the first vital sign information and the second vital sign information with the reference vital sign information in the background database respectively to obtain a preliminary diagnosis result, and sends the preliminary diagnosis result to the user so as to realize visual or tactile perception of the vital sign information of the user and improve the accuracy of remote inquiry.
In one embodiment, the result generation module 130 includes:
the first diagnosis unit is used for comparing the first vital sign information with the corresponding first reference vital sign information in the background database to obtain a first diagnosis result;
the second diagnosis unit is used for comparing the second vital sign information with the corresponding second reference vital sign information in the background database to obtain a second diagnosis result;
and the result diagnosis unit is used for combining the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
In one embodiment, the information processing apparatus for remote inquiry further includes: a third diagnostic module is provided for the user to determine,
the third diagnosis module is used for acquiring third vital sign information input by a user in advance; comparing the third vital sign information with corresponding third reference vital sign information in a background database to obtain a third diagnosis result, and combining the third diagnosis result with the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result.
In one embodiment, the information processing apparatus for remote inquiry further includes: a fourth diagnostic module configured to determine, based on the first diagnostic module,
the fourth diagnosis module is used for acquiring voice information of the user in the video call process and extracting fourth vital sign information of the user from the voice information; comparing the fourth vital sign information with the corresponding fourth reference vital sign information in the background database to obtain a fourth diagnosis result, and combining the fourth diagnosis result with the first diagnosis result, the second diagnosis result and the third diagnosis result to obtain a preliminary diagnosis result.
In one embodiment, the information processing apparatus for remote inquiry further includes: a change trend acquisition module;
the change trend acquisition module is used for acquiring historical second sign information detected by the user through the portable wearable sensing equipment and determining the change trend of the second sign information of the user according to the historical second sign information;
the result generation module 130 is further configured to combine the first diagnosis result, the second diagnosis result, and the trend of the second sign information to obtain the preliminary diagnosis result.
In one embodiment, the information processing device for remote inquiry further comprises a synthesizing module;
the synthesis module is used for acquiring facial features corresponding to the third vital sign data according to the matching relation between the preconfigured third vital sign data and facial features; and synthesizing the facial features to the facial image.
In an embodiment, the first vital sign information includes facial color and micro-expressions; the second vital sign includes pulse information, heart rate information, and body temperature information.
In an embodiment, the result generation module 130 is further configured to: displaying the preliminary diagnosis result; receiving an external instruction to correct the preliminary diagnosis result; and sending the corrected preliminary diagnosis result to the user.
The information processing device for remote inquiry provided by the above embodiment has corresponding functions and beneficial effects when executing the information processing method for remote inquiry provided by any embodiment.
The embodiment of the application also provides a computer device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the information processing method of the remote inquiry in any embodiment when executing the program.
Alternatively, the computer device may be a mobile terminal, a tablet computer, a computer or a server, etc. The computer device provided by the above embodiment has corresponding functions and beneficial effects when executing the information processing method of remote inquiry provided by any one of the above embodiments.
The present embodiments also provide a storage medium containing computer executable instructions, which when executed by a computer processor, are for performing an information processing method of remote interrogation, comprising:
receiving a video call instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image, and extracting first vital sign information in the face image;
acquiring second vital sign information detected by the user through the portable wearable sensing device;
and comparing the first vital sign information and the second vital sign information with the reference vital sign information in a background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user.
Of course, the storage medium containing the computer executable instructions provided by the embodiment of the invention is not limited to the operations of the information processing method of remote inquiry as described above, but can also execute the related operations in the information processing method of remote inquiry provided by any embodiment of the invention, and has corresponding functions and beneficial effects.
From the above description of embodiments, it will be clear to a person skilled in the art that the present invention may be implemented by means of software and necessary general purpose hardware, but of course also by means of hardware, although in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a FLASH Memory (FLASH), a hard disk, or an optical disk of a computer, where the instructions include a plurality of instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the information processing method for remote inquiry according to any embodiment of the present invention.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the flowcharts of the figures may include a plurality of sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily being sequential, but may be performed in turn or alternately with other steps or at least a portion of the other steps or stages.
The foregoing is only a partial embodiment of the present application, and it should be noted that, for a person skilled in the art, several improvements and modifications can be made without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.
Claims (3)
1. An information processing apparatus for remote inquiry, which is applied to a remote inquiry client, comprising:
the first acquisition module is used for receiving a video call instruction of a user, opening a camera, detecting a face image of the user in a video acquisition area, identifying the face image and extracting first vital sign information in the face image;
a second acquisition module for acquiring second vital sign information detected by the user through the portable wearable sensing device;
the result generation module is used for comparing the first vital sign information and the second vital sign information with the reference vital sign information in the background database respectively to obtain a preliminary diagnosis result, and sending the preliminary diagnosis result to the user;
the result generation module comprises: the first diagnosis unit is used for comparing the first vital sign information with the corresponding first reference vital sign information in the background database to obtain a first diagnosis result; the second diagnosis unit is used for comparing the second vital sign information with the corresponding second reference vital sign information in the background database to obtain a second diagnosis result;
the information processing apparatus for remote inquiry further includes: the third diagnosis module is used for acquiring third vital sign information input by a user in advance; comparing the third vital sign information with corresponding third reference vital sign information in a background database to obtain a third diagnosis result, and combining the third diagnosis result with the first diagnosis result and the second diagnosis result to obtain a preliminary diagnosis result;
the information processing apparatus for remote inquiry further includes: the system comprises a fourth diagnosis module, a fourth diagnosis module and a third diagnosis module, wherein the fourth diagnosis module is used for acquiring voice information of a user in the video call process and extracting fourth vital sign information of the user from the voice information; comparing the fourth vital sign information with the corresponding fourth reference vital sign information in the background database to obtain a fourth diagnosis result, and combining the fourth diagnosis result with the first diagnosis result, the second diagnosis result and the third diagnosis result to obtain a preliminary diagnosis result;
the information processing apparatus for remote inquiry further includes: a change trend acquisition module; the change trend acquisition module is used for acquiring historical second sign information detected by the user through the portable wearable sensing equipment and determining the change trend of the second sign information of the user according to the historical second sign information; the information processing device of the remote inquiry also comprises a synthesis module; the synthesis module is used for acquiring facial features corresponding to the third vital sign data according to the matching relation between the preconfigured third vital sign data and facial features; and synthesizing the facial features to the facial image.
2. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor performs the steps of the function of the information processing apparatus for remote interrogation as claimed in claim 1 when the program is executed by the processor.
3. A storage medium containing computer executable instructions which, when executed by a computer processor, are adapted to perform the steps of the functions of the information processing apparatus for remote interrogation as claimed in claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010066097.1A CN112168141B (en) | 2020-01-20 | 2020-01-20 | Information processing method, device, equipment and storage medium for remote inquiry |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010066097.1A CN112168141B (en) | 2020-01-20 | 2020-01-20 | Information processing method, device, equipment and storage medium for remote inquiry |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112168141A CN112168141A (en) | 2021-01-05 |
| CN112168141B true CN112168141B (en) | 2024-03-22 |
Family
ID=73919006
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010066097.1A Active CN112168141B (en) | 2020-01-20 | 2020-01-20 | Information processing method, device, equipment and storage medium for remote inquiry |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112168141B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113707301A (en) * | 2021-08-30 | 2021-11-26 | 康键信息技术（深圳）有限公司 | Remote inquiry method, device, equipment and medium based on artificial intelligence |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004008573A (en) * | 2002-06-07 | 2004-01-15 | Seiko Instruments Inc | Remote medical checkup apparatus, diagnostic method therefor and remote medical checkup program |
| KR20040012155A (en) * | 2002-08-01 | 2004-02-11 | (주) 굿커뮤니케이션 | Chinese medical service method for remote medical examination and prescription through network and system thereof |
| CN103258137A (en) * | 2013-05-28 | 2013-08-21 | 美合实业（苏州）有限公司 | Long-distance inquiring method |
| CN104398244A (en) * | 2014-10-20 | 2015-03-11 | 西北工业大学 | Tele medicine real time monitoring and positioning system based on Internet of things |
| CN105877709A (en) * | 2016-04-07 | 2016-08-24 | 新绎健康科技有限公司 | Health condition data acquisition device, health condition data acquisition analysis system and method |
| CN107242857A (en) * | 2017-06-12 | 2017-10-13 | 南开大学 | The intelligent traditional Chinese medical science based on deep learning integrates diagnosis and therapy system |
| CN107736875A (en) * | 2017-09-30 | 2018-02-27 | 深圳市易特科信息技术有限公司 | Chinese medicinal interrogation equipment and Chinese medicinal interrogation data processing equipment |
-
2020
- 2020-01-20 CN CN202010066097.1A patent/CN112168141B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004008573A (en) * | 2002-06-07 | 2004-01-15 | Seiko Instruments Inc | Remote medical checkup apparatus, diagnostic method therefor and remote medical checkup program |
| KR20040012155A (en) * | 2002-08-01 | 2004-02-11 | (주) 굿커뮤니케이션 | Chinese medical service method for remote medical examination and prescription through network and system thereof |
| CN103258137A (en) * | 2013-05-28 | 2013-08-21 | 美合实业（苏州）有限公司 | Long-distance inquiring method |
| CN104398244A (en) * | 2014-10-20 | 2015-03-11 | 西北工业大学 | Tele medicine real time monitoring and positioning system based on Internet of things |
| CN105877709A (en) * | 2016-04-07 | 2016-08-24 | 新绎健康科技有限公司 | Health condition data acquisition device, health condition data acquisition analysis system and method |
| CN107242857A (en) * | 2017-06-12 | 2017-10-13 | 南开大学 | The intelligent traditional Chinese medical science based on deep learning integrates diagnosis and therapy system |
| CN107736875A (en) * | 2017-09-30 | 2018-02-27 | 深圳市易特科信息技术有限公司 | Chinese medicinal interrogation equipment and Chinese medicinal interrogation data processing equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112168141A (en) | 2021-01-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11961620B2 (en) | Method and apparatus for determining health status | |
| RU2613580C2 (en) | Method and system for helping patient | |
| US11699529B2 (en) | Systems and methods for diagnosing a stroke condition | |
| CN111225612A (en) | Neural obstacle identification and monitoring system based on machine learning | |
| EP3485411A2 (en) | Processing fundus images using machine learning models | |
| US20170007126A1 (en) | System for conducting a remote physical examination | |
| EP3850638B1 (en) | Processing fundus camera images using machine learning models trained using other modalities | |
| CN109585001A (en) | A kind of data analysing method, device, electronic equipment and storage medium | |
| JP2018195164A (en) | Analysis device, analysis program, and analysis method | |
| JP2018007792A (en) | Expression recognition diagnosis support device | |
| CN112168141B (en) | Information processing method, device, equipment and storage medium for remote inquiry | |
| CN115101191A (en) | Parkinson disease diagnosis system | |
| CN115862868A (en) | Psychological assessment system, psychological assessment platform, electronic device and storage medium | |
| US20240138780A1 (en) | Digital kiosk for performing integrative analysis of health and disease condition and method thereof | |
| WO2008062416A2 (en) | A system and method for diagnosis of human behavior based on external body markers | |
| US20230018077A1 (en) | Medical information processing system, medical information processing method, and storage medium | |
| JP7327987B2 (en) | Medical diagnosis support system, medical diagnosis support device, medical diagnosis support method and program | |
| CN111916171A (en) | Safe referral method and system based on self-service inquiry terminal | |
| CN116509419B (en) | Electroencephalogram information processing method and system | |
| KR20190123141A (en) | System and method for diagnosing and analyzing disease | |
| TWI778464B (en) | Method for inputting image display information, method for processing physiological image information, and equipment for processing physiological image information | |
| WO2022270584A1 (en) | Information processing system, information processing method, and program | |
| CN113553460B (en) | Image retrieval method and device, electronic device and storage medium | |
| KR102555157B1 (en) | Integrated care system and method using heatlcare device | |
| JP2022105426A (en) | Method for generating learning model, method for processing information and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |