CN110619956A - Traditional chinese medical science intelligent robot - Google Patents

Traditional chinese medical science intelligent robot Download PDF

Info

Publication number
CN110619956A
CN110619956A CN201910882717.6A CN201910882717A CN110619956A CN 110619956 A CN110619956 A CN 110619956A CN 201910882717 A CN201910882717 A CN 201910882717A CN 110619956 A CN110619956 A CN 110619956A
Authority
CN
China
Prior art keywords
control module
patient
traditional chinese
image
chinese medicine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910882717.6A
Other languages
Chinese (zh)
Inventor
秦建增
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Sisi Digital Technology Co Ltd
Original Assignee
Guangzhou Sisi Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Sisi Digital Technology Co Ltd filed Critical Guangzhou Sisi Digital Technology Co Ltd
Priority to CN201910882717.6A priority Critical patent/CN110619956A/en
Publication of CN110619956A publication Critical patent/CN110619956A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4854Diagnosis based on concepts of traditional oriental medicine
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/10ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H80/00ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring

Abstract

The invention discloses a traditional Chinese medicine intelligent robot which comprises an operation room, and a video camera, a display screen, a loudspeaker, a microphone, a pulse diagnosis instrument and a control module which are arranged in the operation room, wherein the video camera, the display screen, the loudspeaker, the microphone and the pulse diagnosis instrument are all in communication connection with the control module; the operation chamber at least comprises a left side plate, a right side plate, a front panel, a back panel and a top plate; at least one of the left side plate, the right side plate, the front panel and the back panel is provided with a door body which can be opened and closed, and the door body is provided with an identification card identification access control device which is connected with the control module in a communication way; the control module is internally provided with a wireless communication module. The intelligent robot for traditional Chinese medicine can realize data collection required by inspection, auscultation, inquiry and palpation, and meet the requirements of the inspection, auscultation, four-diagnosis and joint reference.

Description

Traditional chinese medical science intelligent robot
Technical Field
The invention relates to the technical field of intelligent diagnosis of traditional Chinese medicine, in particular to an intelligent robot for traditional Chinese medicine.
Background
The traditional Chinese medicine constitution identification is a means of grasping the whole factors of health and diseases and individual differences from constitution states and characteristics of different constitution classifications by taking human constitutions as cognitive objects, thereby establishing a prevention and treatment principle, selecting corresponding treatment, prevention and health preservation methods and carrying out intervention according to human conditions. Although a considerable variety of traditional Chinese medicine robots appear in the market at present, the problem of single function generally exists, and the requirement of looking at the four diagnostic methods in traditional Chinese medicine diagnosis cannot be met.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to provide the intelligent robot for the traditional Chinese medicine, which can integrate the four diagnosis functions of the traditional Chinese medicine such as inspection, auscultation (auscultation), inquiry and palpation and has great practical value.
In order to achieve the purpose, the invention adopts the following technical scheme:
a traditional Chinese medicine intelligent robot comprises an operation room, and a video camera, a display screen, a loudspeaker, a microphone, a pulse diagnosis instrument and a control module which are arranged in the operation room, wherein the video camera, the display screen, the loudspeaker, the microphone and the pulse diagnosis instrument are all in communication connection with the control module; the operation chamber at least comprises a left side plate, a right side plate, a front panel, a back panel and a top plate; at least one of the left side plate, the right side plate, the front panel and the back panel is provided with a door body which can be opened and closed, and the door body is provided with an identification card identification access control device which is connected with the control module in a communication way; the control module is internally provided with a wireless communication module.
Further, the operation chamber is made of a sound insulation plate.
Further, a printer is further arranged in the operating room, and the printer is in communication connection with the control module.
Furthermore, a facial light supplement device is further arranged in the operating room, and the facial light supplement device is in communication connection with the control module.
Further, a standard color plate is arranged in the operation chamber, and the standard color plate is opposite to the camera.
Further, a seat is arranged in the operating room.
Furthermore, a lighting device is arranged on the top plate.
The invention also provides a method for utilizing the intelligent traditional Chinese medicine equipment robot, which comprises the following steps:
s1, the patient scans the identity card through the identity card identification entrance guard equipment, and enters the operation room after passing the verification;
s2, the control module receives the identity authentication information of the identity card identification access control equipment, automatically starts a diagnosis process, controls the camera to start recording, and sends a prompt tone to the patient through the loudspeaker;
s3, the patient walks to the front of the display screen, the camera acquires the face image of the patient and transmits the face image to the control module, the control module compares the face image with the face information in the received identity authentication information, if the comparison result is consistent, the step S4 is skipped, otherwise, an identity confirmation prompt is sent to the patient;
s4, carrying out the following diagnosis and treatment:
(1) and (3) inspection:
1.1) the control module sends out a preset image acquisition prompt, the image acquisition prompt is sent to a patient in at least one mode of sending out voice through a loudspeaker and displaying characters on a display screen, the patient does corresponding action according to the prompt, a camera acquires an image and then transmits the image to the control module, the control module wirelessly transmits the image to a cloud end, the cloud end performs primary detection on the image to judge whether the image is the required image or not, the image is fed back to the control module until the image is qualified, and the control module gives out an end prompt;
(2) and (3) cutting diagnosis:
the control module prompts the patient to put the wrist into the pulse diagnosis instrument in at least one of a mode of sending out voice through a loudspeaker and a mode of displaying characters through a display screen, and prompts the patient to finish pulse diagnosis in at least one of a mode of sending out voice through the loudspeaker and a mode of displaying characters through the display screen after pulse diagnosis information is collected;
(3) inquiry:
the control module sends out a prompt to a patient in at least one of voice or text mode for a preset inquiry question, the patient speaks own answer aiming at the microphone, and the microphone collects the answer voice of the patient and transmits the answer voice to the control module; the control module sends a prompt of the next inquiry question to the patient after receiving the answer voice;
s5, storing a natural language model, a pre-trained tongue picture recognition model based on a deep neural network, a pulse picture recognition model and a multi-mode deep neural network model in the cloud; the tongue image recognition model is used for recognizing and classifying tongue images acquired in inspection; the pulse condition identification model identifies and classifies pulse diagnosis information obtained in the palpation; the natural language model calculates the answer voice obtained in the inquiry, extracts all entity information and distinguishes the voice characteristics; the multimode deep neural network model carries out comprehensive calculation on the results obtained by the tongue picture identification model, the pulse picture identification model and the natural language model to obtain the traditional Chinese medicine syndrome type and obtain the corresponding traditional Chinese medicine prescription; the cloud feeds back the traditional Chinese medicine certificate type and the traditional Chinese medicine prescription to the control module, and the control module is displayed on the display screen for the patient to check;
s6, after the patient leaves the operation room, after the entrance guard of the identification card recognition device is locked again, the video camera finishes recording and uploads the video file to the cloud, and the control module initializes and prepares to start the next round of diagnosis and treatment process.
Further, in step S5, a two-dimensional code is provided on the display screen, the patient authorizes personal wechat information by scanning the two-dimensional code, and the cloud sends the diagnosis result and the medical scheme to the wechat of the patient.
Further, in step S5, the control module displays the printing option on the display screen, and when the patient needs to print, the patient clicks the printing option, and the control module sends the traditional Chinese medicine certificate and the traditional Chinese medicine prescription to the printer, and the printer prints the traditional Chinese medicine certificate and the traditional Chinese medicine prescription into a paper file.
The invention has the beneficial effects that:
1. the intelligent robot for traditional Chinese medicine can realize data collection required by inspection, auscultation, inquiry and palpation, and meet the requirements of the inspection, auscultation, olcultation, olfaction, ol;
2. the arrangement of the standard color card well solves the problem of distortion in image acquisition;
3. the closed space design is beneficial to protecting the privacy of patients;
4. the operating room is constant in temperature and humidity, so that the patient feels comfortable, various devices inside the operating room can be maintained conveniently, and the consistency of the diagnosis and treatment environment and the consistency of the collected information can be ensured;
5. the invention adopts artificial intelligence to process the acquired data and obtains the traditional Chinese medicine syndrome type and the traditional Chinese medicine prescription according to the acquired data, thereby ensuring the accuracy of the combination of four diagnosis and treatment and syndrome differentiation;
6. the invention adopts the identity card to combine with the face recognition to authenticate the identity of the patient, thereby ensuring the authenticity of the identity of the patient.
Drawings
FIG. 1 is a schematic view of the outside of an operation room in example 1 of the present invention;
fig. 2 is a schematic view of an inner back plate of an operating room in embodiment 1 of the present invention;
FIG. 3 is a schematic view of an inner front panel of an operating room in embodiment 1 of the present invention;
FIG. 4 is a schematic view of the ceiling inside the operation chamber in example 1 of the present invention.
Detailed Description
The present invention will be further described with reference to the accompanying drawings, and it should be noted that the present embodiment is based on the technical solution, and the detailed implementation and the specific operation process are provided, but the protection scope of the present invention is not limited to the present embodiment.
Example 1
The embodiment provides a traditional Chinese medicine intelligent robot, as shown in fig. 1-4, which includes an operation room 1, and a video camera 2, a camera 3, a display screen 4, a speaker 5, a microphone 6, a pulse diagnosis instrument 7 and a control module which are arranged in the operation room 1, wherein the video camera 2, the camera 3, the display screen 4, the speaker 5, the microphone 6 and the pulse diagnosis instrument 7 are all connected to the control module in a communication manner; the operation chamber 1 at least comprises a left side plate, a right side plate, a front panel, a back panel and a top plate; at least one of the left side plate, the right side plate, the front panel and the back panel is provided with a door body 8 which can be opened and closed, and the door body 8 is provided with an identification card identification access control device 9 which is connected with the control module in a communication way; the control module is internally provided with a wireless communication module.
In the above intelligent robot for chinese medical science, images of the tongue, etc. of a patient can be photographed by a camera. Through the speaker and the microphone, it is possible to ask a patient a preset inquiry question and collect the answer voice of the patient. The pulse diagnosis information of the patient can be collected by the pulse diagnosis instrument. The collected information can be transmitted to the cloud end through the control module in a wireless mode, the cloud end provides corresponding traditional Chinese medicine syndrome types and traditional Chinese medicine prescriptions through image information such as tongue images and inquiry answering voice and pulse diagnosis information of the patients and feeds the corresponding traditional Chinese medicine syndrome types and traditional Chinese medicine prescriptions back to the control module, and the control module obtains diagnosis results and medical schemes and then displays the diagnosis results and the medical schemes on a display screen in real time for the patients to read. The camera records the whole diagnosis process and forms a video file, and the video file is uploaded to the cloud for storage through the control module. The image shot by the camera can be displayed in real time through the display screen, and contents such as prompting animation, characters and the like are displayed, so that the use experience of a patient is better. Adopt ID card discernment entrance guard's equipment, not only can play the effect of entrance guard, prevent effectively that the diagnostic process from being disturbed, can also acquire patient's identity information simultaneously and transmit to control module, transmit to the high in the clouds through control module, and the diagnostic information of this patient is correlated with.
The intelligent robot integrates the function of collecting information of looking for the inquiry and the four diagnostic methods, can be used for carrying out comprehensive traditional Chinese medicine diagnosis, and has more practical value compared with the traditional single-function traditional Chinese medicine diagnosis equipment.
In addition, the intelligent robot for traditional Chinese medicine also has many other advantages, including that the closed house design is favorable for protecting the privacy of patients and the like.
In this embodiment, the operation chamber 1 is further provided with a base 10. The operation room formed by the left side plate, the right side plate, the front panel, the back panel, the top plate and the base has the characteristic of being movable, and can be integrally moved without being detached when necessary.
Further, the operation room 1 is made of a sound insulation board. In the embodiment, the sound-absorbing boards are adopted for the left side plate, the right side plate, the front panel, the back panel and the top plate. Privacy of patients can be involved in the diagnosis process, and the sound absorption plate is adopted to form the operation room in the embodiment, so that sound can be effectively prevented from being transmitted to the outside of the operation room.
In this embodiment, a printer 11 is further disposed in the operation room 1, and the printer 11 is communicatively connected to the control module. Through the printer, the patient can choose to print out the diagnosis result in real time.
In the present embodiment, the video camera 2, the camera 3, the display 4, the speaker 5, the microphone 6 and the control module are all fixed on the back panel 12; a diagnosis table 13 is arranged in the operation room 1, and the pulse diagnosis instrument 7 is arranged on the diagnosis table 13. Specifically, the table 13 is backed against the back panel 12.
Further, in this embodiment, the pulse diagnosis instrument 7 includes a left-hand pulse diagnosis instrument and a right-hand pulse diagnosis instrument. Through setting up the left hand pulse diagnosis appearance and the right hand pulse diagnosis appearance, can make things convenient for the patient to stretch into the pulse diagnosis appearance with the hand, provide good use experience.
Furthermore, a facial light supplement device 14 is further arranged in the operating room, and the facial light supplement device 14 is in communication connection with the control module. In this embodiment, the face light supplement device is fixed to the back panel 12. The light supplementing device mainly comprises an illuminating lamp. The normal light is darker in the operating room, can assist the camera to shoot clear, complete images such as face, tongue through the light filling device.
Further, a standard color plate 15 is arranged in the operation chamber 1, and the standard color plate 15 is opposite to the camera 3. In this embodiment, the standard color plate 15 is secured to a front panel 16 opposite the back panel 12. The robot of the embodiment is provided with a standard color card, the camera shoots together with the standard color card when shooting, and the real color of the image can be obtained through comparison with the standard color card.
Further, a seat 17 is provided in the operation room 1. In this embodiment, the seat 17 faces the back panel 12 and is backed to the front panel 16. In practical application, the chair can be selected from sofas, swivel chairs and the like, and the chair with adjustable height can be adopted in order to adapt to patients with different heights.
In this embodiment, the display screen 4 and the control module are integrated into a touch screen. And the patient watches the prompt animation and the characters through the human-computer interaction interface on the touch screen, and selects whether to print the diagnosis result, the medical scheme and the like.
Further, in the present embodiment, a lighting device 19 is disposed on the top plate 18.
Further, in the present embodiment, an air conditioning device and an air outlet 20 are disposed on the top plate 18. Through air conditioning equipment, can reach the effect of constant temperature, constant humidity in the control chamber, not only the patient is comfortable, is favorable to the maintenance of the various equipment of the inside, can guarantee the uniformity of the environment of diagnosing moreover and the uniformity of information collection. In practical application, the thickness of the top plate can be increased, the top plate is hollow, and the air conditioning equipment is arranged in the top plate.
Example 2
The embodiment provides a method for using the intelligent device robot in the embodiment 1, which includes the following steps:
s1, the patient scans the identity card through the identity card identification entrance guard equipment, and enters the operation room after passing the verification;
s2, the control module receives the identity verification information of the identity card identification access control equipment, automatically starts a diagnosis process, controls the camera to start recording, and sends a prompt tone to the patient through the loudspeaker, for example, the prompt tone can be welcome voice 'welcome to the doctor room of the intelligent robot in traditional Chinese medicine' and the like;
s3, the patient walks to the front of the display screen, the camera acquires the face image of the patient and transmits the face image to the control module, the control module compares the face image with the face information in the received identity authentication information, if the comparison result is consistent, the step S4 is skipped, otherwise, an identity confirmation prompt is sent to the patient; the identity confirmation prompt can be a voice prompt sent by a loudspeaker, a text prompt displayed on a display screen, or the identity confirmation prompt and the text prompt can be used simultaneously;
the identity card is combined with face recognition, so that the authenticity of the identity of the diagnostician can be powerfully guaranteed.
S4, carrying out the following diagnosis and treatment:
(1) and (3) inspection:
1.1) the control module sends out a preset image acquisition prompt, the image acquisition prompt is sent to a patient in at least one mode of sending out voice through a loudspeaker and displaying characters on a display screen, the patient does corresponding action according to the prompt, a camera acquires an image and then transmits the image to the control module, the control module wirelessly transmits the image to a cloud end, the cloud end performs primary detection on the image to judge whether the image is the required image or not, the image is fed back to the control module until the image is qualified, and the control module gives out an end prompt;
for example, when the image of the tongue needs to be acquired, the control module sends a voice prompt prompting that the mouth is opened as much as possible and the tongue is fully extended as much as possible to the patient through the loudspeaker, and corresponding text prompts can be displayed on the display screen at the same time; the camera acquires an image and transmits the image to the control module, and the control module transmits the image to the cloud; the cloud end carries out preliminary detection on the image until the obtained image is determined to be the image of the tongue, then the result is fed back to the control module, and the control module continues to send out an end prompt in a voice and/or text mode, wherein the end prompt is 'tongue picture inspection end, thank you for cooperation'! ".
(2) And (3) cutting diagnosis:
the control module prompts the patient to put the wrist into the pulse diagnosis instrument in at least one of a mode of sending out voice through a loudspeaker and a mode of displaying characters through a display screen, and prompts the patient to finish pulse diagnosis in at least one of a mode of sending out voice through the loudspeaker and a mode of displaying characters through the display screen after pulse diagnosis information is collected;
taking the robot in embodiment 1 as an example, when the patient starts the palpation, the control module sends out a voice prompt through the speaker to "please place your right hand in the right pulse diagnosis device", the patient places the right hand wrist in the right pulse diagnosis device, the pulse diagnosis device automatically aligns and starts the pulse diagnosis of the right hand, then the pulse diagnosis information of the right hand is transmitted to the control module, after the completion, the control module sends out a voice prompt through the speaker to "please place your left hand in the left pulse diagnosis device", the patient places the left hand wrist in the left pulse diagnosis device, the pulse diagnosis device automatically aligns and starts the pulse diagnosis of the left hand, then the left hand information is transmitted to the control module, after the completion, the control module sends out a voice prompt through the speaker to "the pulse diagnosis is completed, thanks to the cooperation of you! ". All prompts are simultaneously displayed on the display screen in a text mode. The control module uploads the collected left-hand and right-hand pulse diagnosis information to the cloud;
(3) inquiry:
the control module sends out a prompt to a patient in at least one of voice or text mode for a preset inquiry question, the patient speaks own answer aiming at the microphone, and the microphone collects the answer voice of the patient and transmits the answer voice to the control module; the control module sends a prompt of the next inquiry question to the patient after receiving the answer voice.
For example, when the inquiry is started, the control module firstly asks the first inquiry question to the patient in a voice mode through the loudspeaker in sequence, after the patient answers, the microphone transmits the collected answer voice to the control module, and after the control module receives the answer voice, the control module continues to send the voice of the next inquiry question to the patient through the loudspeaker until all preset inquiry questions are asked. All the inquiry questions are displayed on the display screen in a text mode at the same time. And the control module transmits the collected answer voice to the cloud.
S5, storing a natural language model, a pre-trained tongue picture recognition model based on a deep neural network, a pulse picture recognition model and a multi-mode deep neural network model in the cloud; the tongue image recognition model carries out recognition and classification on tongue images acquired in inspection, such as red tongue quality, thin and white fur and the like; the pulse condition identification model identifies and classifies pulse diagnosis information obtained in the palpation, such as floating left cun pulse, floating guan pulse, thin right cun pulse, weak ulnar pulse and the like; the natural language model calculates the answer voice obtained in the inquiry, extracts all entity information and distinguishes the voice characteristics; the multimode deep neural network model carries out comprehensive calculation on the results obtained by the tongue picture identification model, the pulse picture identification model and the natural language model to obtain the traditional Chinese medicine syndrome type and obtain the corresponding traditional Chinese medicine prescription; the cloud feeds back the traditional Chinese medicine certificate type and the traditional Chinese medicine prescription to the control module, and the control module is displayed on the display screen for the patient to check;
the diagnosis and treatment information of the patient comprises facial images, tongue images and the like required by inspection, pulse diagnosis information required by cutting diagnosis, answer voice of inquiry, sound characteristics of the patient required by auscultation and the like in the answer voice, and can be used for the cloud to make comprehensive diagnosis.
In this embodiment, the multi-modal deep neural network model is specifically based on a rational, legal and pharmaceutical theory to obtain a corresponding traditional Chinese medicine prescription from a traditional Chinese medicine syndrome.
In practical application, a two-dimensional code can be provided on a display screen, a patient can authorize personal wechat information by scanning the two-dimensional code, and the cloud sends a diagnosis result and a medical scheme to the wechat (in the form of a PDF file) of the patient.
Furthermore, printing options can be displayed on the display screen, when the patient needs to print, the printing options are clicked, the control module sends the traditional Chinese medicine certificate type and the traditional Chinese medicine prescription to the printer, and the printer prints the traditional Chinese medicine certificate type and the traditional Chinese medicine prescription into a paper file.
S6, after the patient leaves the operation room, after the entrance guard of the identification card recognition device is locked again, the video camera finishes recording and uploads the video file to the cloud, and the control module initializes and prepares to start the next round of diagnosis and treatment process.
Various corresponding changes and modifications can be made by those skilled in the art based on the above technical solutions and concepts, and all such changes and modifications should be included in the protection scope of the present invention.

Claims (10)

1. The intelligent robot for traditional Chinese medicine is characterized by comprising an operation room (1), a video camera (2), a camera (3), a display screen (4), a loudspeaker (5), a microphone (6), a pulse diagnosis instrument (7) and a control module, wherein the video camera (2), the camera (3), the display screen (4), the loudspeaker (5), the microphone (6) and the pulse diagnosis instrument (7) are all in communication connection with the control module; the operation chamber (1) at least comprises a left side plate, a right side plate, a front panel, a back panel and a top plate; at least one of the left side plate, the right side plate, the front panel and the back panel is provided with a door body (8) capable of opening and closing, and the door body (8) is provided with an identification card identification access control device (9) which is in communication connection with the control module; the control module is internally provided with a wireless communication module.
2. The intelligent robot of traditional Chinese medicine according to claim 1, wherein the operating room (1) is made of sound insulation boards.
3. The intelligent robot of traditional Chinese medicine according to claim 1, wherein a printer (11) is further disposed in the operation room (1), and the printer (11) is in communication connection with the control module.
4. The intelligent robot of traditional Chinese medicine according to claim 1, wherein a facial light supplement device (14) is further disposed in the operating room, and the facial light supplement device (14) is in communication connection with the control module.
5. The intelligent robot according to claim 1, wherein a standard color plate (15) is further disposed in the operation room (1), and the standard color plate (15) is opposite to the camera (3).
6. The intelligent robot according to claim 1, wherein a seat (17) is further provided in the operation room (1).
7. The intelligent robot according to claim 1, wherein the top plate (18) is provided with an illumination device (19).
8. A method of using the intelligent device robot of traditional chinese medicine of any preceding claim, comprising the steps of:
s1, the patient scans the identity card through the identity card identification entrance guard equipment, and enters the operation room after passing the verification;
s2, the control module receives the identity authentication information of the identity card identification access control equipment, automatically starts a diagnosis process, controls the camera to start recording, and sends a prompt tone to the patient through the loudspeaker;
s3, the patient walks to the front of the display screen, the camera acquires the face image of the patient and transmits the face image to the control module, the control module compares the face image with the face information in the received identity authentication information, if the comparison result is consistent, the step S4 is skipped, otherwise, an identity confirmation prompt is sent to the patient;
s4, carrying out the following diagnosis and treatment:
(1) and (3) inspection:
1.1) the control module sends out a preset image acquisition prompt, the image acquisition prompt is sent to a patient in at least one mode of sending out voice through a loudspeaker and displaying characters on a display screen, the patient does corresponding action according to the prompt, a camera acquires an image and then transmits the image to the control module, the control module wirelessly transmits the image to a cloud end, the cloud end performs primary detection on the image to judge whether the image is the required image or not, the image is fed back to the control module until the image is qualified, and the control module gives out an end prompt;
(2) and (3) cutting diagnosis:
the control module prompts the patient to put the wrist into the pulse diagnosis instrument in at least one of a mode of sending out voice through a loudspeaker and a mode of displaying characters through a display screen, and prompts the patient to finish pulse diagnosis in at least one of a mode of sending out voice through the loudspeaker and a mode of displaying characters through the display screen after pulse diagnosis information is collected;
(3) inquiry:
the control module sends out a prompt to a patient in at least one of voice or text mode for a preset inquiry question, the patient speaks own answer aiming at the microphone, and the microphone collects the answer voice of the patient and transmits the answer voice to the control module; the control module sends a prompt of the next inquiry question to the patient after receiving the answer voice;
s5, storing a natural language model, a pre-trained tongue picture recognition model based on a deep neural network, a pulse picture recognition model and a multi-mode deep neural network model in the cloud; the tongue image recognition model is used for recognizing and classifying tongue images acquired in inspection; the pulse condition identification model identifies and classifies pulse diagnosis information obtained in the palpation; the natural language model calculates the answer voice obtained in the inquiry, extracts all entity information and distinguishes the voice characteristics; the multimode deep neural network model carries out comprehensive calculation on the results obtained by the tongue picture identification model, the pulse picture identification model and the natural language model to obtain the traditional Chinese medicine syndrome type and obtain the corresponding traditional Chinese medicine prescription; the cloud feeds back the traditional Chinese medicine certificate type and the traditional Chinese medicine prescription to the control module, and the control module is displayed on the display screen for the patient to check;
s6, after the patient leaves the operation room, after the entrance guard of the identification card recognition device is locked again, the video camera finishes recording and uploads the video file to the cloud, and the control module initializes and prepares to start the next round of diagnosis and treatment process.
9. The method of claim 8, wherein in step S5, the two-dimensional code is provided on the display screen, the patient authorizes personal wechat information by scanning the two-dimensional code, and the cloud sends the diagnosis and the medical scheme to the wechat of the patient.
10. The method according to claim 8, wherein in step S5, the control module displays the option of printing on the display screen, and when the patient needs to print, the control module clicks the option of printing, and the control module sends the TCM syndrome type and the TCM prescription to the printer, and the printer prints the TCM syndrome type and the TCM prescription into a paper file.
CN201910882717.6A 2019-09-18 2019-09-18 Traditional chinese medical science intelligent robot Pending CN110619956A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910882717.6A CN110619956A (en) 2019-09-18 2019-09-18 Traditional chinese medical science intelligent robot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910882717.6A CN110619956A (en) 2019-09-18 2019-09-18 Traditional chinese medical science intelligent robot

Publications (1)

Publication Number Publication Date
CN110619956A true CN110619956A (en) 2019-12-27

Family

ID=68923391

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910882717.6A Pending CN110619956A (en) 2019-09-18 2019-09-18 Traditional chinese medical science intelligent robot

Country Status (1)

Country Link
CN (1) CN110619956A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110916628A (en) * 2019-12-31 2020-03-27 天津慧医谷科技有限公司 Chinese medicine inspection, sniffing, inquiry and four-diagnosis information acquisition and diagnosis device
CN111643060A (en) * 2020-05-22 2020-09-11 深圳市物联升科技有限公司 Doctor-patient contact-free traditional Chinese medicine auxiliary diagnosis system based on artificial intelligence
CN112006660A (en) * 2020-08-24 2020-12-01 武夷学院 Medical accompanying machine and control method
CN112652404A (en) * 2020-12-30 2021-04-13 华南师范大学 Traditional Chinese medicine self-service dialectical monitoring method based on big data artificial intelligence and robot

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107315926A (en) * 2017-08-29 2017-11-03 许成钊 A kind of traditional Chinese medical science diagnosis and treatment robot and its diagnosis and treatment method
CN107451407A (en) * 2017-07-31 2017-12-08 广东工业大学 A kind of traditional Chinese medical science intelligent diagnosing method, system and traditional medical system
CN107887024A (en) * 2017-12-14 2018-04-06 华子昂 Intelligent diagnosis system and traditional Chinese medical science robot based on traditional Chinese medical science robot
CN109285605A (en) * 2018-09-11 2019-01-29 青岛农业大学 A kind of medical diagnosis system and diagnostic method based on artificial intelligence
WO2019100584A1 (en) * 2017-11-25 2019-05-31 深圳市前海安测信息技术有限公司 Traditional chinese medicine disease prevention management system and method based on traditional chinese medicine four diagnostic instrument
CN110223769A (en) * 2019-06-11 2019-09-10 深圳市城润科技股份有限公司 A kind of unattended intelligent Chinese medicine consulting room system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107451407A (en) * 2017-07-31 2017-12-08 广东工业大学 A kind of traditional Chinese medical science intelligent diagnosing method, system and traditional medical system
CN107315926A (en) * 2017-08-29 2017-11-03 许成钊 A kind of traditional Chinese medical science diagnosis and treatment robot and its diagnosis and treatment method
WO2019100584A1 (en) * 2017-11-25 2019-05-31 深圳市前海安测信息技术有限公司 Traditional chinese medicine disease prevention management system and method based on traditional chinese medicine four diagnostic instrument
CN107887024A (en) * 2017-12-14 2018-04-06 华子昂 Intelligent diagnosis system and traditional Chinese medical science robot based on traditional Chinese medical science robot
CN109285605A (en) * 2018-09-11 2019-01-29 青岛农业大学 A kind of medical diagnosis system and diagnostic method based on artificial intelligence
CN110223769A (en) * 2019-06-11 2019-09-10 深圳市城润科技股份有限公司 A kind of unattended intelligent Chinese medicine consulting room system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王忆勤: "中医诊断技术发展及四诊信息融合研究", 《上海中医药大学学报》, vol. 33, no. 01 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110916628A (en) * 2019-12-31 2020-03-27 天津慧医谷科技有限公司 Chinese medicine inspection, sniffing, inquiry and four-diagnosis information acquisition and diagnosis device
CN111643060A (en) * 2020-05-22 2020-09-11 深圳市物联升科技有限公司 Doctor-patient contact-free traditional Chinese medicine auxiliary diagnosis system based on artificial intelligence
CN112006660A (en) * 2020-08-24 2020-12-01 武夷学院 Medical accompanying machine and control method
CN112652404A (en) * 2020-12-30 2021-04-13 华南师范大学 Traditional Chinese medicine self-service dialectical monitoring method based on big data artificial intelligence and robot

Similar Documents

Publication Publication Date Title
CN110619956A (en) Traditional chinese medical science intelligent robot
US20220331028A1 (en) System for Capturing Movement Patterns and/or Vital Signs of a Person
CN106236115A (en) A kind of psychological test system
US20190261914A1 (en) Physiologic audio methods and arrangements
US5802494A (en) Patient monitoring system
US20180125370A1 (en) System and apparatus for automated total body imaging
CN105011903B (en) A kind of Intelligent health diagnosis system
CN107169309B (en) Visual field detection method, system and detection device based on wear-type detection device
CN105808903A (en) Health report generation method and apparatus
US20080192202A1 (en) Device and Method for Investigating Changes in the Eye
CN108597621B (en) Health state monitoring device, system and method based on traditional Chinese medicine theory
WO2006064635A1 (en) Diagnosis system
CN110960193A (en) Traditional Chinese medicine diagnosis analysis system and method based on face and tongue image acquisition
CN110811564A (en) Intelligent face image and tongue image acquisition terminal system and face image and tongue image acquisition method
CN106725295A (en) A kind of miniature check-up equipment, device and its application method
CN112971746A (en) Psychological assessment system
CN208351494U (en) Face identification system
CN109998497A (en) System and plane of illumination illumination testing apparatus are sentenced in inspection of falling asleep in luminous environment
CN210325226U (en) Traditional chinese medical science intelligent robot
CN109411087A (en) A kind of more examine closes ginseng system
US20210369115A1 (en) Telemetry monitoring and assessment system of parameters of human vital functions and clinical signs of possible functional disorders and determination of methods of control
KR20210061211A (en) System for recognizing face and motion of clinical subject using video capture member
CN115662591A (en) Ward integrated management platform and server
CN114220160A (en) Anti-cheating remote examination equipment based on VR technology and use method thereof
CN114795125A (en) Middle and old aged physical examination system and device based on multi-modal physiological signal processing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination