KR20210077062A - AI-based interactive feedback bot for clinical training education - Google Patents

Abstract

Disclosed is an AI-based interactive feedback bot for clinical training education. The AI-based interactive feedback bot for clinical training education comprises: a U-portfolio system having an AI-based interactive chatbot and a feedback bot, providing training opening, training record management of trainees, patient medical record provision, preliminary examination record paper, clinical presentation, clinical skill, self-examination information, training evaluation paper, and test management information, providing questions, answers, and professor feedback information of a professor and a trainee terminal through the AI-based interactive chatbot and the feedback bot, storing and managing a training history of a trainee and evaluation information of a professor, and providing a clinical training education U-portfolio service; and a user terminal transmitting and receiving training location registration, clinical training-related information, and content to and from the U-portfolio system, and receiving questions, answers, professor feedback information, and evaluation information of a professor and a trainee terminal through the AI-based interactive chatbot and the feedback bot.

Description

AI-based interactive feedback bot for clinical training education

The present invention is a wired/wireless communication network (LAN, Wi-Fi, LTE 4G/5G) in a U-Portfolio system that provides ubiquitous-based clinical practice education for hospitals/medical colleges/dental colleges/pharmacy colleges/health and medical colleges User terminal (PC/laptop, smartphone, tablet PC) is connected through clinical practice photo or video), sending/receiving/deleting message, 3D rendering/video playback, clinical presentation (outpatient diagnosis, inpatient, PBL-problem-based learning), clinical skill (basic clinical skill, observational clinical skill), daily /Provides weekly reflection, practice evaluation, test management, and My practice management, and uses AI-based conversational chatbot and feedback bot of artificial intelligence (NLP) of U-portfolio system during clinical practice for instructor/practitioner It relates to a feedback bot for conversation for AI-based clinical practice education that provides Q&A and instructor feedback from the terminal.

Health and medical education in university hospitals/medical colleges/dental colleges/pharmacy colleges/colleges of health and medical care adopts theoretical education, practical education, and individual guidance by busy professors as basic education methods. Clinical practice information has not yet been properly managed due to limitations and structural differences in the practice department of university hospitals and medical clinical practice education sites. For example, in medical school, in the process of becoming a specialist after 2 years of pre-school, 4 years of main course, 1 year of internship (trainee), and 4 years of residency (major), 2 years of clinical course in 3rd and 4th year of main course A practical training course has been established, and clinical practice is as important as the theoretical training, such as the patient's disease and emergency room situations that require CPR.

Advanced health and medical education in the United States provides an ePortfolio, and the student directly accesses the web to register, manage, and store their class history in the ePortfolio system. are using

As a related prior art 1, "a remote medical practice education system capable of individual control" is registered in Patent Registration No. 10-1443125.

1 is a block diagram of a conventional remote medical practice education system capable of individual control.

The remote medical practice education system that can be individually controlled is

a recording means (10) provided in each of the plurality of practice spaces (P) and comprising a camera (12) and a microphone (14) for recording and recording the training process;

The operation of the camera 12 and the microphone 14 of the practice space P that is wirelessly connected to the central server 40, and the real-time reproduction of the recorded video, the recorded voice, and the checklist for evaluation, and the checklist a mobile control means 20 capable of controlling a bookmarking function for each practice space to be stored while synchronizing images, checklists, evaluation results, and evaluation result input time when inputting evaluation results;

Playback means 30 that reproduces the practice video, audio, and evaluation result stored in the central server 40 to the learner, and reproduces the image for a certain period of time before the input time of the evaluation result selected by the learner;

A recording storage unit 41 for storing recorded images and audio, a PTZ unit 42 for controlling vertical, horizontal, horizontal, and zoom operations of the camera 12, and evaluation results and evaluation inputted from the mobile control means 20 An evaluation storage unit 43 that synchronizes and stores time, a message transfer unit 44 that delivers a message required for the practice course to the practice space P at a set time, and a practice space selected by the mobile control means 20 The activation unit for activating only the recording means 10 of (P) and the inactivating unit for deactivating the recording means 10 of the rest of the practice space are composed of the recording storage unit 41 and the PTZ unit 42 only for the selected practice space (P). ), an evaluation storage unit 43, and a central server 40 including an individual control unit 45 for controlling the message delivery unit 44 to operate.

2A is a screen comparing the e-Portfolio system and the ubiquitous-based health care education U-Portfolio system using a tablet PC.

In particular, health and medical education in university hospitals/medical colleges/dental colleges/pharmacy colleges/health and medical colleges is a ubiquitous-based portfolio system that can be used in wired and wireless environments and offline/online environments through the web, PC, smart phone, or tablet. U-Portfolio) is required, and a clinical practice system operated in the practice field is required.

However, the clinical practicum curriculum for 2 years in the 3rd and 4th grades of the 6-year medical education course is a core curriculum for doctors, but focuses on the feedback of busy professors (doctors) in actual university hospitals (apprenticeship method). ), there were difficulties in the qualitative management of clinical practice education and standardization of the clinical practice system/patient record sheet/practicum sheet/evaluation sheet.

To this end, a health care practice system is built in a university hospital of a medical school, and an AI-based interactive feedback bot based on artificial intelligence that provides immediate feedback from instructors and instructors in a ubiquitous environment is provided for clinical practice training. AI-based interactive feedback bot using natural language processing was not provided for (preliminary record paper, weekly reflection).

Patent Registration No. 10-1443125 (Registration Date September 16, 2014), "Individually Controllable Remote Medical Practical Training System", Joo Seong-ju

An object of the present invention to solve the above problems is to provide a U-Portfolio system that provides ubiquitous-based clinical practice education for hospitals/medical colleges/dental colleges/pharmacy colleges/health and medical colleges in a wired/wireless communication network (LAN, Wi-Fi). -Fi, LTE 4G/5G) is connected to the user terminal (PC/laptop, smartphone, tablet PC), opening clinical practice, notifying the clinical practice schedule and practice schedule, registering the instructor/trainee in charge, Practice paper registration, file sending/receiving (practice paper, clinical practice photo or video), sending/receiving/deleting a note, 3D rendering/video playback, clinical expression (outpatient diagnosis, inpatient, PBL-problem-based learning), clinical skills (basic clinical practice) skills, observation clinical skills), daily/weekly reflection, practice evaluation, test management, and My practice management, and AI-based conversational chatbot using artificial intelligence natural language processing (NLP) of the U-portfolio system during clinical practice It provides a feedback bot for conversation for AI-based clinical practice education that provides Q&A and instructor feedback from the instructor/practitioner terminal by the feedback bot.

In order to achieve the object of the present invention, the feedback bot for conversation for AI-based clinical practice education is provided with an AI-based conversational chatbot and feedback bot, opening practice, managing practice records of practitioners, providing patient medical records, It provides pre-diagnosis record sheet, clinical expression, clinical skill, reflection information, practice evaluation sheet, and test management information, and provides Q&A and instructor feedback information of instructors and practitioner terminals through the AI-based interactive chatbot and the feedbackbot. , a U-portfolio system that stores and manages practitioner's practice history and instructor's evaluation information, and provides clinical practice education U-portfolio service; and sending and receiving training paper registration, clinical practice related information and contents to the U-portfolio system, and receiving questions and answers from instructors and practitioner terminals and instructor feedback information and evaluation information through the AI-based interactive chatbot and the feedback bot It includes a receiving user terminal.

The feedback bot for conversation for AI-based clinical practice education according to the present invention is wired and wireless to the U-Portfolio system that provides ubiquitous-based clinical practice education in hospitals/medical colleges/dental colleges/pharmacy colleges/health and medical colleges. User terminals (PC/laptop, smartphone, tablet PC) are connected through communication network (LAN, Wi-Fi, LTE 4G/5G), open clinical practice, announce clinical practice schedule and practice schedule, and instructor in charge of practice /trainee registration, practice paper registration, file sending/receiving (practice paper, clinical practice photo or video), sending/receiving/deleting a note, 3D rendering/video playback, clinical expression (outpatient diagnosis, inpatient, PBL-problem-based learning), Provides clinical skills (basic clinical skills, observational clinical skills), daily/weekly reflection, practice evaluation, test management, and My practice management. AI using natural language processing (NLP) of artificial intelligence of the U-portfolio system during clinical practice Q&A and instructor feedback are provided by the instructor/practitioner terminal by the interactive chatbot and feedbackbot.

It provides cloud clinical practice education using artificial intelligence and big data analysis technology using smart devices, and the U-portfolio system notifies the practice schedule and stores and manages training paper record information and practice history information, and natural language processing (NLP) Provides Q&A and practical instructor feedback from busy instructors/practitioners using an AI-based conversational chatbot using

The U-Portfolio system for ubiquitous-based clinical practice education allows practitioners to use tablet PCs to notify the instructor of the practice schedule and practice schedule from the instructor, record and upload it on the practice log, feedback from the instructor in charge of practice, and the instructor's evaluation ( evaluation paper), and the instructor underlines the field practice record provided by the learner/practitioner through a shared workspace or freely leaves feedback through text, drawing, photo, voice recording, etc., and the instructor’s practice field Feedback contents are immediately captured and sent to the server, providing hands-on training and evaluation solutions that receive immediate instructor feedback information, and using AI-based conversational chatbots and feedbackbots using natural language processing (NLP) Instructor/practitioner's Q&A and practical instructor's feedback are provided.

1 is a block diagram of a conventional remote medical practice education system capable of individual control.
2A is a screen comparing the e-Portfolio system and the ubiquitous-based health care education U-Portfolio system using a tablet PC.
Figure 2b shows that the medical school goes through the 4th grade course in the 2nd year of the pre-school course, the doctor goes through the clinical practice course in the 3rd and 4th year of the medical school, and the doctor goes through the internship (one year training course) course after the national examination, After that, after completing the 4 year residency (4 year major) course after the examination of the major, it is a drawing showing that the professional qualification is granted.
3 is a configuration diagram of the U-Portfolio system to which the SEED encryption algorithm is applied for data security in the cloud.
4A is a U-Portfolio system configuration diagram that provides ubiquitous-based clinical practice education in hospitals/medical colleges/dental colleges/pharmacy colleges/health and medical colleges.
4B is a flowchart illustrating a method of providing a U-Portfolio service that provides ubiquitous-based clinical practice education.
5 is a smart device (smartphone, tablet PC) school administrator [student/professor information registration, practice schedule registration, student practice feedback history monitoring, student practice history management, professor's practice evaluation management], students [practice plan ( Day/week/month), practice information recording and management, patient management-reflection], and the professor in charge of practice [practice management and practice feedback, patient management-reflection, evaluation, schedule management, exam].
6 is a configuration diagram of the system menu for clinical practice [My practice management, practice plan and reflection, clinical expression, clinical skills, practice paper registration/file transfer/send/receive note, evaluation, test management].
Figure 7a A configuration diagram of an AI-based interactive feedback bot that provides instructor/practitioner's Q&A and instructor's feedback in the ubiquitous-based clinical practice education portfolio (U-Portfolio) system of university hospitals, medical schools, and health and medical colleges according to the present invention. to be.
Figure 7b is a screen showing a natural language processing-based learning data/personal practice diagnostic analysis tool and feedback bot, i) an entity name recognition function for clinical expression, clinical technique, diagnosis name, patient history, and student reflection history;
This is a screen showing the ability to understand medical terminology through 200 learning events and 200 service calls based on WATSON's Bluemix API and Conversation Service. .
FIG. 7c is a configuration diagram of a U-portfolio system using a SaaS-based hybrid cloud computing technology linking public cloud and private cloud data.
7D is a service menu diagram of the medical school U-portfolio system.
7E is an example screen showing clinical expressions/clinical skills/practice attitudes/emotions showing instructor feedback information of practitioners and instructor terminals using AI-based interactive chatbots and feedbackbots.
Fig. 8a is the main screen and customer scenario 1) Yejin, Fig. 8b is 2) skill, Fig. 8c is the main screen- 3) Inpatient medical record, Fig. 8d is PBL (Problem Based Learning), case presentation, diagram 8e is the instructor's self-feedback screen.
9a to 9n are screens showing an embodiment of a medical school U-portfolio system for clinical practice.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

For standardization and quality management of clinical practice training documents, a SaaS-based hybrid cloud linking data from public and private clouds, user-written text, and instructor feedback through handwriting recognition or character recognition through handwriting recognition or character recognition to practice It provides an intelligent U-portfolio platform for personalized clinical practice education that includes a feedback bot that infers activity performance, an AI-based conversational chatbot, and a learning and practice management algorithm that can recommend supplements to students.

The trainee checks the QR code of the user terminal (tablet PC) to register the U-Portfolio platform server, or the trainee terminals with 13.56MHz RFID tag are registered in the U-Portfolio system by tagging the RFID reader in the field. The terminal confirms the presence of the terminal of the practitioners of the clinical practice.

SaaS-based hybrid cloud, SaaS-based hybrid cloud when answering questions with instructors/practitioners, practitioners/instructors’ text Q&A using feedback bots and AI conversational chatbots with instructors/practitioners, and between instructors and practitioners Using multithreads in a shared work space to highlight instructor feedback that displays concurrent feedback displayed simultaneously, practitioner/instructor text Q&A using feedbackbot and AI interactive chatbot, and sharing between instructor and practitioner Provides instructor feedback information that displays concurrent feedback displayed concurrently using multithreading in a shared work space.

The present invention provides a feedback bot for AI-based conversation for clinical practice education, and U-Portfolio system that provides ubiquitous-based clinical practice education for hospitals/medical colleges/dental colleges/pharmacy colleges/health and medical colleges Connect via wired/wireless communication network (LAN, Wi-Fi, LTE 4G/5G) using a user terminal (PC/laptop, smartphone, tablet PC) to open a practice, notify the clinical practice schedule and practice schedule, Practice instructor/trainee registration, practice paper registration, file sending/receiving (practice paper, clinical practice photo or video), sending/receiving/deleting message, sending/receiving file (practice paper, clinical practice photo or video), sending/receiving/deleting message , 3D rendering (3D VR/AR content)/medical image (MRI, CT, X-Ray, etc.)/video playback that displays real patient information, clinical representation (outpatient, inpatient, PBL-problem-based learning), Provides clinical skills (basic clinical skills, observational clinical skills), daily/weekly reflection, practice evaluation (group evaluation, individual presentation evaluation, face-to-face evaluation), test management, My practice management, AI using natural language processing (NLP) It uses an interactive chatbot and feedback bot to provide instructor/practitioner Q&A and practical instructor feedback.

It provides cloud clinical practice education using artificial intelligence and big data analysis technology using smart devices, and the U-portfolio system notifies the practice schedule and stores and manages training paper record information and practice history information, and natural language processing (NLP) Provides Q&A and practical instructor feedback from busy instructors/practitioners using an AI-based conversational chatbot using

The U-Portfolio system for ubiquitous-based clinical practice education allows practitioners to use tablet PCs to notify the training schedule and practice schedule from the instructor at the training site, send/receive files (practice papers, clinical practice photos or videos), and send/receive/receive notes. Delete, 3D rendering (3D VR/AR content)/medical image (MRI, CT, X-Ray, etc.)/video playback that displays actual patient information of the evaluation (evaluation sheet), and the instructor underlines the field practice record provided by the learner/practitioner through the shared workspace or freely leaves feedback through text, drawing, photo, voice recording, etc., and the instructor The on-site feedback content of the practice field is immediately captured and sent to the server, providing a hands-on training and evaluation solution that receives immediate instructor's feedback information, and uses an AI-based conversational chatbot using natural language processing (NLP) to Instructor/practitioner's Q&A and practical instructor's feedback information are provided to the practitioners' user terminal, and the practitioner's (student) practice record management, practice history management, and practice evaluation (group evaluation, individual presentation evaluation, face-to-face interview) are provided. evaluation) and test management, and immediate feedback (emergency measures, prescriptions) of the instructor's terminal is recorded, and the practice history of the practitioner and the instructor's evaluation information are stored and managed.

The U-Portfolio system utilizes a tablet PC to create a record of the contents of practical training in the field of practical education, receive notices from the instructor about the practice schedule, practice schedule, and subjects of practice, and provide immediate feedback from the instructor in theory, practice, evaluation, and practice field. ) as a practical training and evaluation solution, it can be used on smart devices of PCs, tablet PCs and smartphones.

In addition, the ubiquitous-based practice education portfolio (U-Portfolio) system was applied to clinical practice in the medical school/dental college/pharmacy college/nursing college/health and medical college, and the health and medical education sector of the physical therapy department of general universities.

(Example) U-portfolio service for medical school

○ Medical school clinical practice education management system U-Portfolio

- U-Portfolio service is a practical education evaluation solution that writes on the practice record at the clinical practice training site, receives evaluation from the instructor and feedback from the instructor. Smart devices such as PCs, tablet PCs, smartphones, and laptops can be used.

- Provide instructor/practitioner Q&A and practical instructor feedback using AI-based conversational chatbot using natural language processing (NLP)

Referring to Figure 2b, the medical school has a 2nd year pre-graduate course 4th year course, and in the case of a doctor, they go through a clinical practice course in the 3rd and 4th year of the medical school main course, and an intern (1 year training course after the doctor's national examination) ) course, and after the examination of the major, the four-year residency (four-year course of the major) course, and the passing of the specialist examination is granted to become a specialist.

(Example)

3 is a configuration diagram of the U-Portfolio system to which the SEED encryption algorithm is applied for data security in the cloud.

○ Medical school B2B U-Portfolio system development

- Hybrid Cloud Server Development (Public Cloud): Implementation of external services using Amazon (or Azure) services (services the functions of the user menu)

* Implementation of functions to write, save, upload, and receive feedback centered on medical practitioners

- VPN-based cloud implementation with high security (SEED encryption algorithm application and encryption/decryption function for data security)

- Cloud management program

* Account registration, user registration, form paper and menu settings, and usage status check

- [Student] PC, mobile, tablet PC program

* In the case of mobile and tablet PC, it is divided into site-oriented menus

- Development of feedback bot for clinical practice education (preliminary record sheet, weekly reflection)

- Provide AI-based feedback bot that learned clinical practice feedback results

・In consideration of the usability of all medical schools, the appropriate text length for text inference, and the length of the instructor's evaluation and feedback, the pre-diagnosis record sheet (the practice of writing the medical record in consultation with the patient before the professor sees the patient in advance) and daytime dragon

· Personalization practice method recommendation and feedback algorithm development

Application of question-and-answer technology of instructors/practitioners using artificial intelligence natural language processing (NLP) including text inference and AI-based conversational chatbot

· Personalization practice method recommendation and feedback algorithm development

- Increase the quality of practice and minimize the professor’s simple administrative tasks through AI-based self-feedback, personalized practice plan establishment and coaching, etc.

- [Professor] PC, mobile program

* In the case of mobile, menu implementation focusing on on-site evaluation and check list function

○ Expansion of real-time/asynchronous communication technology using smart devices

- Token issuance including user information and practice schedule when connecting to the Internet.

Native App. my save

- When not connected to the Internet, the native app. Save data after logging in by authenticating with my saved token

- Instructor-certified field evidence capture data and Txt double writing

- Implementation of final product recognition algorithm considering automatic synchronization, terminal time, and server time when connecting to the Internet

○ Development of analysis tools and feedback bots based on natural language processing

- Entity name recognition function for clinical expression, clinical technique, diagnosis name, patient history, and practitioner (student) reflection history

- Data cloud search function according to entity name recognition

- Based on WATSON's Bluemix API and Conversation Service, it is possible to understand medical terminology through 200 learning events and 200 service calls.

○ Instructor’s feedback on practical diagnosis using artificial intelligence

- Implementation of the function of inputting clinical skills practice papers into the question-and-answer system of the instructor/practitioner using AI-based interactive chatbot using natural language processing (NLP), and outputting the preliminary recording paper and weekly recording paper with the instructor's feedback sentences attached

- Ability to construct accurate sentences for feedback on the contents of practice diagnosis (more than 70% agreement with general professor feedback data)

- Implemented a function to analyze the cumulative/score trend of previous practice diagnosis scores and give feedback

- Implemented a function to provide and save results to the web (internet) and local files

4A is a U-Portfolio system configuration diagram that provides ubiquitous-based clinical practice education in hospitals/medical colleges/dental colleges/pharmacy colleges/health and medical colleges.

The U-Portfolio System uses smart devices to provide AI-based conversational chatbots and feedbackbots using artificial intelligence, big data analysis, and natural language processing (NLP) to answer questions from instructors and practitioners, and to provide instructor feedback for cloud clinical practice education. provide services.

The practitioner checks the QR code of the user terminal (tablet PC) and registers it in the server of the U-Portfolio system, or the terminal of the practitioners with the 13.56 MHz RFID tag is tagged with an RFID reader in the field training center. By registering in the instructor terminal, the practitioners of the clinical practice check the attendance of the terminal.

The U-Portfolio System that provides clinical practice education

Ubiquitous-based practical education (eg, health and medical education) portfolio service that provides UBT/SBT tests is provided, and academic calendars and academic calendars of medical schools/dental colleges/nursing colleges/health and medical colleges/general colleges Calendar, opening a practice, managing My information according to the training schedule and practice schedule according to the curriculum [practice schedule (calendar linkage), self-introduction (Portfolio), to-do list)], sending and receiving files (practice paper, clinical practice) photo or video), sending/receiving/deleting a message, 3D rendering (3D VR/AR content)/medical image (MRI, CT, X-Ray photo, medical image, etc.)/video playback that displays actual patient information, Practice record management for each learner/trainee, feedback information from instructor, evaluation information from instructor, clinical expression of patient by practice [outpatient diagnosis, inpatient/emergency patient, PBL (Problem Based Learning)], clinical skills (basic) Clinical skills, observational clinical skills), reflection information (daily/weekly/monthly whole-patient safety), practice evaluation, UBT (Ubiquitous Based Test)/SBT (Smart device Based Test) test management, statistical information, and clinical practice Each practitioner’s practice history and instructor’s evaluation information are stored and managed, and standardized/prescribed practice record sheets (daily/weekly/final reflection/preliminary examination/inpatient/PBL(Problem Based Learning)/basic clinical skills) / A U-Portfolio system 100 that provides observational clinical skills practice records, etc.) and a standardized evaluation sheet/feedback form; and

Synchronized with the U-portfolio system 100, practice-related information for ubiquitous-based practice education portfolio service is transmitted and received and stored, and user terminals (200, 300, 310) used by practitioners (students), professors, and administrative staff. ,

The main server 100 of the U-portfolio system is connected to the control unit, and further includes a 3D renderer that renders VR/AR content or animation produced as practice-related health and medical practice/learning content, and training-related learning videos and provides voice,

The clinical expression unit of the U-portfolio system 100 provides PBL (problem-based learning) and clinical practice information to outpatient pre-diagnosis and inpatients, and basic clinical skills to the patient by the clinical skills section of the main server. , provides observational clinical skill information,

The U-portfolio system 100 provides free feedback through text, pictures, photos, and voice recordings or underlines the field records provided by the learner/practitioner by the instructor in charge of the practice at the health and medical practice field using his/her user terminal. In addition, the instructor's practice field feedback content is immediately captured and transmitted to the main server, multicasting technology to the learner/practitioner's user terminals by multi-thread simultaneity control in the shared workspace of the main server Provides immediate instructor feedback information through the system, stores and manages immediate instructor feedback information for each practice, and manages training, practice paper registration, evaluation and testing of practitioners,

The U-Portfolio System linked with the Learning Management System (uLMS) provides test management and management of evaluation and grading scores.

The user terminal is a smart device including a PC 200, a smart phone 300 having a U-portfolio App, a messenger and a Wi-Fi communication unit, or a tablet PC 310 having a LAN connection unit and a Wi-Fi communication unit. and is connected to the U-portfolio system 100 through a wired/wireless communication network (LAN/WAN, Wi-Fi, LTE-A).

In the U-portfolio system 100, the instructor in charge of practice at the health and medical practice field uses his or her user terminal to send and receive text question and answer between the instructor and the practitioners through an AI-based interactive chatbot, and a feedback bot ), the instructor underlines the field record provided by the user terminal, or the instructor freely leaves feedback on the practitioners' user terminal through text, picture, photo, and voice recording, and the instructor's practical field feedback is immediately captured. is transmitted to the server of the U-portfolio system 100, and to the user terminals of the learner/practitioner by concurrent control of multi-thread in the shared workspace of the U-portfolio system 100 It provides immediate instructor feedback information through multi-thread and multicasting technology, and for each practice, the practitioner user terminal stores and manages immediate instructor feedback information.

SaaS-based hybrid cloud, SaaS-based hybrid cloud when answering questions with instructors/practitioners, practitioners/instructors using feedback bots and AI interactive chatbots with instructors/practitioners, and instructor terminals and practice In the shared work space of the U-portfolio system of the own terminal, using multi-thread and multicasting technology, it provides instructor feedback information that displays concurrent feedback displayed on the user terminals of the practitioners at the same time.

The AI-based conversational chatbot is used to answer text questions about the practitioners/instructor's clinical practice, such as sending and receiving simple chat data, and uses natural language processing (NLP) to enable the practitioners/instructors/instructors through the U-portfolio system. When answering a text question about the instructor's clinical practice, the text response to the text data query - database search with the text of the query - is output.

The U-portfolio system infers the performance of the practice activity by extracting the text written by the practitioner and the text related to the instructor feedback through handwriting recognition or character recognition from the feedback of the instructor, and Instructor's handwritten/graphic notes using multi-threads in shared work space, instructor's voice feedback using speech recognition, sending and receiving files, sending and receiving messages, and sending video files. do.

When the user terminal uses a tablet PC, a tablet PC dedicated to the SBT test or UBT test is used in i) Basic mode, ii) UBT mode, iii) SBT mode,

i) Basic mode provides normal tablet PC functions on the basic operating system,

ii) UBT mode provides an online test using LAN, Wi-Fi, and LTE communication network, and provides learning content by learner level, online test or ubiquitous-based test, selects an accredited test/non-approved test question type, test taker's test number/name , Save the answer as an image file after signing the signature (save as a jpg or png file image and send to the server) -> Send the image file to the U-portfolio system and submit, and automatically delete the test question after the test time has elapsed. ,

iii) SBT mode provides offline test and USB test questions, which are smart device-based tests using USB.

In the embodiment, health care institutions and educational institutions are applied to hospitals and medical schools, and medical school main department 3rd and 4th grade students/interns/trainees/specialists/specialists treat inpatients in hospitals under the supervision of a practical professor. As an example, health and medical practice was applied.

The user terminal may use a smart device including a PC 200, a smart phone 300 or a tablet PC 310 having a U-portfolio App and a messenger and a LAN connection unit or a Wi-Fi communication unit, In the embodiment, the user terminal used a dedicated tablet PC 310 .

The practitioner checks the QR code of the user terminal (tablet PC) to register the U-Portfolio platform server or registers in the U-Portfolio system by checking the 13.56MHz RFID code and the RFID reader's attendance at the field training site. Check the attendance (attendance) of trainees.

In the embodiment, the medical school in the health and medical education sector is described as an example, but the practice is not limited thereto, and the practice is medical school / dental college / nursing college / health and medical college / general college physical therapy department academic calendar and calendar, opening practice, According to the curriculum, it can be applied to various fields such as health care practice, clinical experimentation, field practice, etc. according to the practice schedule and practice schedule.

The U-portfolio system 100 includes a WWW server 101 connected to a user terminal through a wired/wireless Internet; a control unit 102 for controlling each function of the U-portfolio service; a member management unit 103 that manages U-portfolio service member information; a user authentication unit 104 for authenticating a user using the ID/Passwd method or the student ID/Passwd method; an academic calendar and calendar 105 providing academic schedule/practice schedule and calendar information; A student information register 106 that registers information about students who have paid tuition for the semester or trainees who are not students on leave of absence designated as trainees; Instructor information registration unit 107 for registering the information of the instructor in charge of practice; My information management includes calendar-linked practice schedule and practice schedule, self-introduction (Portfolio), my information management (name, social security number, address, student number, ID, password (Passwd), email address, contact information, etc.), to-do (To do list) and provides additional file attachment/receive/delete message, posting/deleting bulletin board file/file, sending/receiving mail, and calling/receiving phone call (VoIP). 108); a practice schedule registration unit 109 for registering a training schedule, a training schedule, and information on a professor in charge of training in conjunction with a calendar; Standardized/prescribed practice record sheets (daily/weekly/final reflection/preliminary/inpatient/PBL(Problem Based Learning)/basic clinical skills/observational clinical skills) and evaluation papers between health care institutions and educational institutions According to the practice schedule and practice schedule through the feedback form, each learner/trainee records the practice record sheet and stores it in the main server during practice. Practice record management unit 110 to record and manage; In the field of health and medical practice, the instructor's terminal (smart device, tablet PC) can underline the field training record provided by the intern's terminal, or through text, cursive/graphic memo, drawing/photo/video/file transmission/reception, and voice recording. The feedback information is left on the terminals of the practitioners who receive it, and the instructor's feedback information is immediately captured in real-time and transmitted to the database of the U-portfolio system, and the shared workspace of the server using group communication technology Instructor feedback information unit 112 that provides immediate instructor feedback information through 1:N multicasting technology to terminals of practitioners by multi-thread concurrency control in the workspace; a clinical expression unit 113 that provides outpatient pre-diagnosis, inpatient medical records, PBL (Problem Based Learning, problem-based learning), and clinical practice information for inpatients; a clinical skill unit 114 that provides basic clinical skill and observation clinical skill information for a patient; a reflection unit 115 for receiving and storing learner/practitioner's reflection information and instructor's reflection information from user terminals; In accordance with the practice schedule and practice schedule by the instructor in charge of practice and health care field practice, clinical experiment, field practice, each learner/trainee sees the practice information record for each learner/trainee, and the instructor's practice evaluation is made at the practice site, and the preliminary evaluation paperwork is evaluated. , inpatient medical record evaluation, case presentation evaluation, medical record evaluation of the first outpatient visit after discharge, PBL (problem-based learning) evaluation, clinical skill evaluation, patient safety gender analysis evaluation, problem-based learning small group discussion evaluation, individual presentation evaluation, face-to-face and a practice evaluation unit 116 that manages practice evaluation information of face evaluation and 360-degree evaluation (professor, major, patient).

The U-portfolio system 100 is connected to the control unit 102 and announces the test date and time under the supervision of the instructor in charge of practice, and uses a common user terminal (smart device, tablet PC) for each trainee (student). Test management unit (117) that conducts clinical practice and provides grading and grade management information by conducting UBT/SBT (Smart Device Based Test) or UBT test for official/non-certified exams, regular exams/non-regular exams after practice further includes

The main server 100 of the U-portfolio system manages the practice history of individual learners/practitioners (daily/weekly/month/year), manages the clinical practice evaluation history of the instructor’s practitioners (daily/weekly/month/year), practice Provides statistical information by analyzing related big data, supports 360-degree multi-faceted evaluation, and outputs statistics such as bar graphs, pie charts, box plots, and scatter diagrams in 2D/3D graphics or visually It further includes a management unit 118 .

The main server 100 of the U-portfolio system is connected to the control unit 102, and 3D VR/AR contents and learning contents or animations that display practice-related health and medical practice, actual patient information/medical knowledge/prescription information It further includes a 3D renderer 119 for 3D rendering.

The ubiquitous-based portfolio (U-Portfolio) system includes: a mail server 120 for transmitting and receiving email data between learners/practitioners, a professor in charge of practice, and an administrative staff in charge; and a messenger server 130 that provides a peer-to-peer (P2P) communication function by transmitting and receiving messenger data including chat data capable of attaching files between the learner/practitioner and the instructor.

A ubiquitous-based portfolio (U-Portfolio) system includes a camera 140 for recording video/audio related to practice/learning; an encoder 141 for encoding video/audio data captured from the camera 140; and the encoder 141 It further includes a streaming server 142 for transmitting the encoded video / audio data from the streaming method to a plurality of user terminals.

4B is a flowchart illustrating a U-Portfolio service providing method for providing ubiquitous-based clinical practice education in hospitals/medical colleges/dental colleges/pharmacy colleges/health and medical colleges.

How to provide U-Portfolio service

The user terminal accesses the main server of the U-portfolio system linked with the learning management system (uLMS) using the sequential probability ratio verification method (SPRT) through the wired/wireless communication network (LAN/WAN, Wi-Fi, LTE-A), Membership registration, user authentication step (S10);

providing the academic schedule and calendar of the health and medical education institution, and registering learner/trainee information, practice schedule, practice schedule, and instructor information in charge of practice by opening a practice (S20);

providing a practice record sheet, an evaluation sheet, and a feedback form by the practice information record management unit of the U-portfolio system, and the instructor in charge of the practice notifying the training schedule and practice schedule, the training instructor information, and the training subjects after opening the practice;

In the U-portfolio system, the terminal of the instructor in charge at the health and medical practice field underlines the field record provided by the practitioner, or freely through text, cursive/graphic memo, drawing/photo/video/file transmission/reception, and voice recording to the practitioner's terminal. Leaving the instructor's feedback, the instructor's feedback content is immediately captured and transmitted to the server of the U-portfolio system, and through multicasting technology to the terminal of the practitioner by multi-thread simultaneous control in the shared workspace of the server providing immediate instructor feedback information, and the practitioner terminals store and manage immediate instructor feedback information for each practice;

According to the practice schedule and practice schedule, each trainee records on the practice record sheet during practice at the appropriate place, and is stored and managed by the main server. and managing the practice evaluation information by recording the practice history of the practitioner and the evaluation history of the instructor; and

Providing a UBT/SBT test in the U-portfolio system linked with a uLearning Management System (uLMS), and providing grading management,

The user terminal accesses the U-Portfolio system through a wired/wireless communication network, is used by practitioners (students), professors, and administrative staff, and is a smart device having a PC, U-Portfolio App, a messenger, a LAN connection unit, and a Wi-Fi communication unit. A phone or tablet PC is used to access the U-Portfolio system.

The trainee is registered in the u-portfolio system by checking the QR code of the trainee's terminal (tablet PC) or by tagging the intern's terminal with a 13.56MHz tag with an RFID reader and registered in the U-portfolio system. Check the attendance of the clinical practice of those terminals.

My practice management is personally managed in the private domain by the My Practice management unit of the U-Portfolio system, and the calendar and academic calendar link Practice schedule and practice schedule, self-introduction (Portfolio), name, resident number, address, student number, ID , password (Passwd), e-mail address, management of my information including contact information, to-do list, sending/receiving/deleting a message with file attachments, uploading/deleting a file on the bulletin board, sending an e-mail It further includes a My information management step that provides /receive, make a call/receive a call (VoIP).

Render VR/AR content or animation produced as practice-related health and medical practice/learning content by a 3D renderer connected to the control unit of the main server of the U-portfolio system, or practice-related PPT, graphics/animation, 2D/3D content, learning providing audio and video; providing PBL (Problem Based Learning, problem-based learning) and clinical practice information for outpatient pre-diagnosis and inpatient by the clinical expression unit of the server of the U-portfolio system; providing basic clinical skill and observation clinical skill information to a patient by a clinical skill unit of a server of the U-portfolio system; and receiving and storing the practitioner's reflection information and the instructor's reflection information from user terminals by the reflection unit of the server of the U-portfolio system.

The server of the U-portfolio system manages individual learner/practitioner's practice history (daily/weekly/month/year), instructor's evaluation history management (daily/weekly/month/year), and practice-related big data by the statistics management unit. Provides statistical information through analysis, supports 360-degree multi-faceted evaluation, supports 360-degree multi-faceted evaluation, 2D/3D graphics and visuals such as bar graphs, pie charts, box plots, and scatter diagrams It further includes the step of outputting.

The U-portfolio system provides a P2P (Peer-to-Peer) communication function through a messenger server in a user terminal equipped with a messenger with practitioners and instructors to transmit and receive messenger data including file attachments and chatting data. include more

The server of the U-portfolio system is connected to the control unit by the test management unit, and the date and time of the test is announced under the supervision of the instructor in charge of practice, and the official test/non-certified test, regular test using the practice-related user terminal for each trainee Conduct SBT (Smart Device Based Test) test or UBT (Ubiquitous Based Test) test for test/non-regular test, store the answer in the main server, and replay the result in response to the educational institution scoring table defined by the administrator After processing, results are generated and stored in the main server according to the template form for user output, administrative team storage, academic information system storage and interlocking of educational institutions, and grade management information for each test taker is provided to test takers, professors, and administrative staff. further steps.

The U-Portfolio System linked with the learning management system (uLMS, ubiquitous Learning Management System) provides u-learning learning content and practical education content for each learner/practice level through evaluation before learning/practice and evaluation after learning/practice. It is transmitted to the server of the U-portfolio system 100 through the separately provided relay server 170 in the test or non-authorized test, and works with the instructor's supervisor terminal and the learner/practitioner's test taker terminals to manage the theory and learning for each learner level. /Practice, SBT (Smart device based Test) test or ubiquitous based test (UBT, Ubiquitous based Test) and scoring are made.

The user terminal is used as the supervisor terminal and the test taker terminals, and in the embodiment, a UBT-only tablet PC 310 was used, and the apk file of the Android OS used as the operating system of the UBT-only tablet PC was modified.

A tablet PC dedicated to the SBT test or UBT test is used in i) Basic mode, ii) UBT mode, and iii) SBT mode.

i) Basic mode provides normal tablet PC functions on the basic operating system.

ii) UBT mode [online test: LAN, Wi-Fi, LTE], the learning management system using sequential probability ratio verification method provides learning content by learner level, online test or ubiquitous-based test, and selects the type of question for an official test/non-certified test , After saving the answer as an image after the test taker's test number/name, and signature (save as a jpg or png file image and send to the server) -> Submit it to the uLMS learning management system, and automatically delete the test question after the test time has elapsed

iii) SBT mode [offline test, smart device-based test using USB], USB test questions

- Used for accredited certification exam, current national examination for doctors, pharmacist exam, accredited exam/non-certified exam

- Multimedia questions (MRI video, voice, image, text, VR/AR content animation, simulator)

- After signing/signing for non-repudiation during the SBT test or UBT test, the answer image file (png, jpg file) is saved to the server of the U-Portfolio system.

- SBT, stored in certified SD card (answer information, encryption/decryption)

Encryption/decryption uses AES 256 algorithm.

When the U-portfolio system 100 linked with the uLMS learning management system is connected to a user terminal (eg, tablet PC, 300) through a wired/wireless communication network, the learner/practitioner performs evaluation before learning/practice and evaluation after learning/practice. Evaluate the level, provide customized U-learning learning/practice content for each learner/practice level, SBT test, ubiquitous-based test (UBT), automatic deletion of test questions from the test taker's terminal after the test, 100) as the main server, and provides evaluation, grading, and grade management information.

5 is a smart device (smartphone, tablet PC) school administrator [student/professor information registration, practice schedule registration, student practice feedback history monitoring, student practice history management, professor's practice evaluation management], students [practice plan ( Day/week/month), practice information recording and management, patient management-reflection], and the professor in charge of practice [practice management and practice feedback, patient management-reflection, evaluation, schedule management, exam].

Ubiquitous-based hands-on training U-Portfolio system uses smart devices to open practice, manage instructor/trainee practices, and, for example, in clinical practice at medical schools and university hospitals, artificial intelligence of the U-Portfolio system in a ubiquitous environment. Text Q&A from instructor/practitioner terminals using AI-based conversational chatbot using big data analysis technology and natural language processing (NLP) and feedback bot from U-portfolio system. U-Portfolio service is provided that provides feedback from used instructors to the terminals of practitioners attending clinical practice.

Practice records include pre-diagnosis records, daily/weekly/final reflection, inpatient/PBL (problem-based learning), and practice records of basic clinical skills/observational clinical skills.

6 is a configuration diagram of the system menu for clinical practice [My practice management, practice plan and reflection, clinical expression, clinical skills, practice paper registration/file transfer/send/receive note, evaluation, test management].

The practical education has been described as an example of clinical practice in the 3rd and 4th grades of medical school in the health and medical education sector, and it is not limited thereto and can be applied to various practical education.

The system menu for clinical practice includes My Practice Management, Clinical Practice Registration, Practice Planning and Reflection, Clinical Expression, Clinical Skills, Evaluation and Test Management (SBT, UBT).

My practice management menu includes clinical practice registration/withdrawal, My practitioner's practice schedule (calendar linkage), self-introduction (Portfolio), my information management, To do list, uploading practice files /Download, send/receive message, write/mail/receive mail, and call/receive phone call (VoIP).

Practice planning and reflection includes process learning planning and reflection, weekly planning and reflection, daily planning and reflection, and patient safety reflection analysis.

Clinical representations provide inpatient medical records, outpatient premedication information, inpatient information, and problem-based learning (PBL).

Clinical skills include basic clinical skills and observational clinical skills.

Evaluation includes 360-degree multi-faceted evaluation, portfolio qualitative evaluation, weekly evaluation (auto-scoring), and final evaluation (auto-scoring + adjustment) functions.

The test management (SBT, UBT) module includes a custom notification function to the user terminal of the practitioners in response to the test schedule/location announcement, test questions, answers, and scoring delivered by the SBT/UBT system.

Figure 7a is an AI providing instructors / practitioners' Q&A and instructor's feedback in the ubiquitous-based clinical practice education portfolio (U-Portfolio) system of university hospitals, medical schools, dental colleges, pharmaceutical colleges, and health and medical colleges according to the present invention. This is a configuration diagram of a feedback bot for basic clinical practice education.

For standardization and quality management of documents in clinical practice education, a SaaS-based hybrid cloud linking data from public and private clouds, text written by the practitioner (student) terminal, and the instructor in the instructor terminal It provides an intelligent U-portfolio system for personalized clinical practice education, including a feedback bot that extracts relevant texts from feedback to infer the performance of practice activities, and a learning and practice management algorithm that can recommend supplements to students.

The U-Portfolio system is built as a SaaS-based hybrid cloud that links data from public public clouds of universities and hospitals and private clouds of practitioners for standardization of clinical practice education documents. The service is provided through a web browser on a PC) and an App on smart devices (smartphones, tablet PCs).

SaaS-based hybrid cloud, feedback bot with instructor/practitioner terminals, and text Q&A of practitioner/instructor terminals using AI interactive chatbot, shared workspace of the server of the U-portfolio system between instructor and practitioner terminals In the work space) using multithread and multicasting technology, a feedback bot that provides instructor feedback that displays concurrent feedback displayed simultaneously on the terminals of practitioners attending clinical practice, and an AI conversational chatbot for practitioners/instructor terminals Instructor displaying concurrent feedback, such as text question and answer, and cursive/graphic memo displayed simultaneously on practitioner terminals using multi-thread and 1:N multicasting technology in the shared work space of the server from the instructor's terminal Provide feedback information and evaluation information.

The ubiquitous-based clinical practice education portfolio (U-Portfolio) system of university hospitals, medical schools, dental colleges, colleges of pharmacy, and health and medical colleges is an AI-based conversation that provides text Q&A from instructor/trainee terminals for clinical practice education. brother chatbot; Through the U-Portfolio system, a feedback bot is provided that simultaneously provides the instructor's feedback from the instructor's terminal to the terminals of the practitioners attending the clinical practice.

The present invention is equipped with an AI-based interactive chatbot and feedback bot, and is equipped with practice opening, practice record management of practitioners, patient medical record provision, pre-diagnosis record sheet, clinical expression, clinical skill, reflection information, practice evaluation sheet, test management information It provides Q&A and instructor feedback information of the instructor terminal and the trainee terminal through the AI-based interactive chatbot and the feedback bot, and stores and manages the practice history of the practitioner and the instructor's evaluation information, and clinical practice U-portfolio system 100 for providing educational U-portfolio services; and

By accessing the U-portfolio system 100, inquire about the practice schedule and schedule, inquire about patient medical records, register the training paper with the U-portfolio system 100 during outpatient pre-exam or field practice, and view clinical practice-related information and contents and a user terminal that transmits and receives, and receives questions and answers from an instructor terminal and a practitioner terminal and instructor feedback and evaluation information through the AI-based interactive chatbot and the feedback bot,

Specifically, the U-portfolio system 100 is equipped with an AI-based interactive chatbot and feedback bot, and manages My practice according to the academic calendar, curriculum, and practice schedule, opens practice, announces clinical practice schedule and practice schedule, practice Instructor/trainee registration, practice paper registration, file sending/receiving (practice paper, clinical practice photo or video), sending/receiving/deleting a note, providing patient medical record information, training-related learning content/practice content/medical knowledge 3D rendering (3D VR/AR contents)/medical image (MRI, CT, X-Ray, etc.)/video playback, patient medical record provision/remark, pre-diagnosis paper, clinical expression (outpatient diagnosis, inpatient medical record/medical diagnosis result) /Prescription, PBL-problem-based learning), clinical skills (basic clinical skills, observational clinical skills), daily/weekly reflection, practice evaluation, and test management are provided. Management, instructor's evaluation sheet information, clinical expression, clinical skill, reflection information, practice evaluation (predictive evaluation, patient medical record evaluation, case presentation evaluation, first outpatient visit after discharge evaluation), inpatient case presentation evaluation, clinical skill evaluation , patient safety gender analysis evaluation, problem-based learning small group discussion evaluation, individual presentation evaluation, face-to-face evaluation, 360-degree evaluation (professor, specialist, patient)), test management information, AI using natural language processing (NLP) Using the interactive chatbot and feedback bot, text Q&A and instructor feedback information from the terminals of instructors and practitioners is provided to the terminals of practitioners, and the practitioner's practice history and instructor's evaluation information are stored for each clinical practice. Provides managed ubiquitous-based clinical practice education U-portfolio service.

The user terminal is synchronized and connected with the U-portfolio system 100, and the U-portfolio system 100 registers training papers, inquires patient medical records, sends and receives pictures/photos/videos/files (practice papers, clinical practice photos or videos), Send/receive/delete notes, clinical expression/clinical skills/reflection information/evaluation/test clinical practice-related information to and from the U-portfolio system 100, and actual patient medical record information, practice-related learning content/practice AI-based interactive chatbot and feedback bot of the U-Portfolio System 100 while playing 3D rendering (3D VR/AR content)/medical images (MRI, CT, X-Ray, etc.)/video displaying content/medical knowledge (feedback bot) is used to receive question-and-answer information and instructor feedback information and evaluation information from the terminals of instructors and practitioners.

The user terminal uses a PC, a smartphone or a tablet PC equipped with a U-portfolio App and a messenger.

The U-portfolio system 100 includes: a 3D renderer that is connected to a control unit and renders 3D VR/AR contents or animations produced as clinical practice/learning contents; And it further includes a streaming server that provides a training video and audio stream related to the practice.

The clinical expression unit of the U-portfolio system 100 provides PBL (problem-based learning) and clinical practice information to outpatient pre-diagnosis and inpatients, and basic clinical skills and observational clinical skills to the patient through the clinical skills section provide information.

In the U-portfolio system, the instructor in charge of practice at the health and medical practice field uses the user terminal, and the instructor terminal underlines the field record provided by the practitioner terminal through the feedback bot of the server of the U-portfolio system, or underlines text, cursive /Graphic memo, picture/photo/video/file transmission/reception, and voice recording to leave instructor feedback freely to the practitioner terminals, and the field instructor feedback information from the instructor terminal is immediately captured and shared on the server through the U-portfolio system Immediate feedback information of the instructor is provided to the terminals of the practitioners through 1:N multicasting technology to the terminals of the practitioners by multi-thread concurrency control in the shared workspace. The practitioner's user terminal stores and manages immediate instructor feedback information for each practice.

In the case of clinical practice education, the practice record sheet includes a preliminary examination record sheet, daily/weekly/final reflection, inpatient/PBL (problem-based learning), and basic clinical skills/observation clinical skills practice record sheet.

The AI-based conversational chatbot is used to answer text questions about the practitioners/instructor's clinical practice, such as sending and receiving simple chat data, and uses natural language processing (NLP) to enable the practitioners/instructors/instructors through the U-portfolio system. When answering a text question about the instructor's clinical practice, the text response to the text data query - database search with the text of the query - is output.

The U-portfolio system infers the performance of practice activities by extracting the text written by the trainee terminal through the Feedbatbot and the text related to the instructor feedback through handwriting recognition or character recognition from the feedback of the instructor terminal, Handwriting/graphic memo, voice recognition for concurrency control using multi-threads and multicasting technology of the shared work space of the server of the U-portfolio system, where the terminals of teachers and instructors are connected through wired/wireless communication networks It further includes a feedback bot that provides the instructor's voice feedback, sending and receiving pictures/photos/videos/files, and sending and receiving notes.

In natural language processing (NLP), sentences detect a language, and are divided into morpheme units through morphological analysis according to the characteristics of the language, and the selected morphemes are sentence vectors (sentence vectors). ) is used to create For example, a sentence vector is composed of attributes extracted from each question in FAQs classified into four query types. A similarity analysis of the user query sentence vector and the previously collected query sentence vector is performed.

In addition, the AI-based conversational chatbot can be implemented as a "voice recognition chatbot", receives voice query data, receives STT (Speech To Text) text data after voice recognition, and searches the database to query the selected instructor's voice It provides a service that automatically outputs response result texts and voice data by executing TTS (Text To Speech) on the response result.

Figure 7b is a screen showing a natural language processing-based learning data/personal practice diagnostic analysis tool and feedback bot, i) an entity name recognition function for clinical expression, clinical technique, diagnosis name, patient history, and student reflection history; ii) Data cloud search function according to entity name recognition, iii) Based on WATSON's Bluemix API and Conversation Service, it showed the ability to understand medical terminology by providing 200 learning events and 200 service calls is the screen

FIG. 7c is a configuration diagram of a U-portfolio system using a SaaS-based hybrid cloud computing technology linking public cloud and private cloud data of a school server of a university hospital.

The SaaS-based hybrid server that connects the data of the public cloud and the private cloud has a web server, a database, a school server, and its own server.

7D is a service menu diagram of the medical school U-portfolio system.

7E is an example screen showing clinical expressions/clinical skills/practice attitudes/emotions showing instructor feedback information of practitioners and instructor terminals using AI-based interactive chatbots and feedbackbots.

Fig. 8a shows the main screen and customer scenario 1) Yejin, Fig. 8b shows 2) skill, Fig. 8c shows the main screen- 3) Inpatient medical record inquiry, Fig. 8d shows PBL (Problem Based Learning), inpatient case Presentation, Figure 8e is a self-feedback screen of the instructor.

9a to 9n are screens showing an embodiment of a medical school U-portfolio system for clinical practice.

Referring to FIG. 9f , the outpatient practice (preliminary exam, once or twice a week) at the university hospital is pre-examined in the outpatient pre-exam room when the outpatient schedule comes out, recorded on the pre-exam paper/practice record sheet, and a confirmation request from the instructor is requested. Attend the medical school professor and observe the patient's actual treatment process. After the treatment is over, the instructor answers questions, receives evaluation/feedback from the instructor, and gives homework assignments.

Pre-examination record - SNAPPS (student -> professor): After the practitioner (student) pre-examines the outpatient, record the pre-exam on the pre-examination record sheet.

Preliminary Assessment - SNAPPS (Professor in charge -> Student -> Professor in charge of practical training): When the professor sees the preliminary examination paper made by the practitioner (student), the instructor evaluates/provides the instructor's feedback. The evaluation of the professor in charge is confirmed by the practitioner (medical college student) who establishes an improvement plan -> the professor in charge of practice.

Referring to Figure 9g, we provide a hands-on and on-site assessment process,

Practice evaluation includes pre-diagnosis paper evaluation, inpatient medical record evaluation, case presentation evaluation, first outpatient visit after discharge evaluation, inpatient case presentation evaluation, clinical skill evaluation, patient safety gender analysis evaluation, problem-based learning small group discussion evaluation, and individual evaluation. It provides presentation evaluation, face-to-face evaluation, and 360-degree evaluation (professor, specialist, patient).

Instructors monitor the study plans and reflections submitted by students and evaluate them against the school's rubric scorecard.

The university hospital consists of internal medicine / surgery / obstetrics and gynecology / digestive and adolescent department / mental health department / emergency medicine department,

In the case of internal medicine, it is necessary to standardize the types of records and medical terminology by major divisions such as circulatory, digestive, respiratory, kidney, hematological oncology, endocrine, rheumatism, infectious medicine, and surgery.

3rd and 4th graders of the medical school main department must practice clinical practice, and it is judged how much professional competence is reflected by practicing, receiving feedback from instructors, recording and reflecting, based on the university's curriculum and completion standards.

For standard clinical practice, a record/evaluation sheet is used.

The trainee checks the QR code of the user's terminal (eg, tablet PC) to register the U-Portfolio platform's server, or the intern's terminals (smartphones, tablet PCs) with 13.56MHz RFID tags are attached to the RFID reader in the field. By registering in the U-portfolio system by tagging, the instructor's terminal confirms the attendance of the terminals of the practitioners of clinical practice. The field practice record sheet for smart pen (stylus pen) is displayed on the trainee's terminal, recorded and saved in the U-portfolio system, and students, professors, and administrators can use their user terminals (PC, tablet PC) to communicate through wired and wireless communication networks. You can access the U-Portfolio system and check the practice information.

AI-based interactive chatbot and feedback bot are applied with artificial intelligence question-and-answer technology and personalized practice diagnosis algorithm between instructor and practitioner terminals of the U-portfolio system.

AI-based interactive chatbot and feedback bot apply artificial intelligence natural language processing and question-and-answer technology, including text inference, using WATSON API to provide Q&A and instructor feedback from terminals of instructors and practitioners through the U-portfolio system. became

The practitioner's user terminal collects and stores clinical practice-related learning data and learning contents opened from the U-portfolio system, and provides patient medical records during clinical practice. Clinical expression (outpatient pre-record paper, inpatient case presentation, PBL (problem-based learning)) practice paper, clinical skills (basic clinical skills, observational clinical skills) including instructor feedback information by the Q&A processing unit of the U-portfolio system ) Practice paper, reflection paper (daily/weekly/total), evaluation paper, inpatient medical record paper, preliminary examination paper with instructor feedback sentence attached to the instructor terminal, and daily/weekly recording paper are saved and printed out as a local file.

In the embodiment, a standardized education model and evaluation algorithm of clinical practice education are provided in the clinical practice medical field of university hospital professors and third and fourth grade practitioners (students) of the medical school, and evaluation/instructor feedback of field instructors A ubiquitous clinical practice education system that maximizes

○ Introduce U-Portfolio service, a medical school-specialized practice education management system, and develop customizing it for the medical school

※ Medical school specialized U-Portfolio

- Clinical practice education management solution for 3rd~4th graders of the medical school main course (practicum record writing/registration, teacher feedback management system, PC, tablet PC/smartphone support)

- Development of an R&D project jointly with the medical school completed the development of a prototype for the current 3rd and 4th grades of the main department.

- Provision of solution licenses only to educational institutions participating in joint research in the first half of 2017 (practice records and instructor evaluation/feedback)

- Provided 3rd~4th grade practice record sheet (preliminary record sheet, daily/weekly/final reflection, inpatient/PBL (problem-based learning), basic clinical skill/observation clinical skill practice record sheet, etc.) and evaluation/teacher feedback form

(2) Main function

○ Supports PC, smartphone/tablet PC based on web standards

○ In the case of hospital pre-diagnosis, it is implemented to enable tablet PC (Android)-based pre-diagnosis record, practice record, and professor feedback

○ Provide practice schedule and practice schedule management function (calendar format)

○ Daily/weekly/final reflection record writing/keeping/management and providing professor feedback

○ Prepare, store, manage and provide professor feedback/evaluation functions for various practice records such as pre-diagnosis/inpatient/PBL(Problem Based Learning)/basic clinical skills/observational clinical skills

○ Track record management of practitioners, practice evaluation

○ Individual integrated practice history management

[Student Tablet PC Platform]

- Use of UBT Enabled Tablet PC (providing UBT/SBT mode) used for nationally recognized qualification tests

- After the student logs in using a tablet PC, the personal field practice record is recorded and saved to the server, and the function to receive feedback from the instructor is implemented.

- Equipped with asynchronous communication technology introduced in nationally recognized qualification tests, etc., it is possible to operate using a relay server in an environment where the Internet is temporarily unavailable.

- The instructor's terminal underlines the field practice record paper presented by the trainee (student) terminal through the server of the U-Portfolio system, or sends and receives text, cursive/graphic memos, drawings/photos/videos/files, sending/receiving notes, Through voice recording, the instructor can freely leave feedback by transmitting the data to the practitioner terminals using multi-thread and maulticasting technology. The feedback from the instructor on the field is immediately captured and transmitted to the server of the U-portfolio system. Save

[Platform for Professors]

* main

- Exposure of academic calendar and to-do list

* Manage My Practice

- Provides learning schedule management and calendar management functions

- Manage and edit my information (password, email address, contact information, etc.)

- Implementation of to-do list collection view function

- In the case of the responsible professor, the function to collect and view the to-do list of the affiliated professors and the feedback of the instructor

* Study plan and reflection

- Monitoring study plans and reflections submitted by students, evaluation by the school's rubric scorecard, and feedback from instructors

* Clinical expression

- View patient medical records

- Check the learning outcomes based on the clinical expressions submitted by the students and evaluate them by the rubric scoring table

- Provides UI/UX to check learning outcomes in one case, such as field practice records, review records, and presentation results (photos/medical images/videos/medical diagnosis results/prescriptions/opinions)

* Clinical skills

- Search function for learning outcomes and field feedback results based on clinical expressions submitted by students

- The clinical practice field evaluation and feedback part should not be able to be written on the PC.

* Rating and feedback

- Daily, weekly, and course-specific evaluations and instructor feedback

- Evaluation is group evaluation, individual presentation evaluation, face-to-face evaluation, and it is downloaded in batches to Excel in a designated format.

[Mobile platform for professors]

- Provide mainly the contents that the instructor should record in the field of practice

- Practice schedule, to-do list, and feedback history inquiry function are provided

- Functions that need to be scored in the practice field, such as patient medical record inquiry, PBL (problem-based learning) evaluation, and inpatient case presentation evaluation, must be evaluated only on mobile devices, and the available time is controlled.

- Implementation of communication and feedback collection function between learners/practitioners and instructors

- Implementation of functions such as inquiry of learner/trainee (student) and professor information and contact via phone, text, etc.

[Platform for Administrators]

* main

- Academic calendar and to-do list exposure

* My practice information management menu

- Provides learning schedule management and calendar management functions

- Manage and edit my information (password, email address, contact information, etc.)

- Implementation of to-do list collection view function

- Implementation of functions to collect and view teachers' to-do list and feedback results

* Provides student and instructor information management function

- Able to register, edit, and manage student information and instructor information in Excel

- Guaranteed DB linkage with U-LMS system and UBT system

*Academic schedule management function provided

- Open regular and non-regular curriculum, monitor learning plans and reflections submitted by students, and evaluate and feedback based on the school's rubric scorecard

* My practice management menu provided

- It is possible to use each item based on the main menu and change the item name

* Provides management functions for clinical expression, clinical skills, and graduation competency items

- It should be possible to collectively register, modify, and manage learning keywords such as clinical expression, clinical skills, and graduation competency.

* Management of practice records and evaluation papers

- Provision of practice record sheets and instructor evaluation sheets for each item and each curriculum

* Faculty evaluation and feedback

- Q&A from practitioners and feedback from instructors using AI-based interactive chatbots and feedbackbots

- Practice evaluation management, exam

Embodiments of the method according to the present invention may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. Computer-readable recording media include storage, hard disks, magnetic media such as floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floppy disks. - optical media (magneto-optical media), and any type of hardware device specially configured to store and execute program instructions such as ROM, RAM, flash memory, etc. may be included. Examples of program instructions may include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention.

As described above, the present invention has been described with reference to the preferred embodiment, but to illustrate the technical idea as described above, it is not limited only to the same configuration and operation as the specific embodiment, and does not depart from the technical spirit and scope of the present invention. It can be implemented with various modifications within the limits. Accordingly, such modifications should be considered to fall within the scope of the present invention, and the scope of the present invention should be determined by the following claims.

100: U-Portfolio System
101: WWW server 102: control unit
103: member management unit 104: user authentication unit
105: Academic Calendar and Calendar 106: Student Information Register
107: Instructor Information Register 108: My Practice Management Department
109: practice schedule register 110: practice information record management unit
112: instructor feedback information section 113: clinical expression section
114: clinical skill section 115: reflection section
116: Practice Assessment Department 117: Test Management Department (SBT, UBT)
118: statistics management unit 119: 3D renderer
120: mail server 130: messenger server
140: camera 141: encoder
142: streaming server
170: local U-Portfolio relay server
200: PC 300: Smartphone
310: tablet PC

Claims (13)

Equipped with AI-based interactive chatbot and feedback bot, providing practice opening, practice record management of practitioners, patient medical record provision, pre-diagnosis record sheet, clinical expression, clinical skill, reflection information, practice evaluation sheet, and test management information. , provides Q&A and instructor feedback information of instructor and practitioner terminals through the AI-based interactive chatbot and the feedback bot, and stores and manages the practitioner's practice history and instructor's evaluation information, and clinical practice education U-portfolio U-portfolio system providing services; and
Receiving training paper registration, clinical practice-related information and contents with the U-portfolio system, and receiving Q&A and instructor feedback information and evaluation information from instructor and practitioner terminals through the AI-based interactive chatbot and the feedback bot Conversational feedback bot for AI-based clinical practice education, including user terminals. According to claim 1,
The user terminal is a feedback bot for AI-based clinical practice education, using a smartphone or tablet PC equipped with a PC, U-portfolio App and messenger. According to claim 1,
The U-portfolio system is
3D renderer connected to the control unit and rendering VR/AR content or animation produced as clinical practice/learning content; and
Conversational feedback bot for AI-powered lab training, further including a streaming server that provides hands-on training videos and audio streams. 3. The method of claim 2,
Check the QR code of the user terminal of the practitioner using the tablet PC and register it in the server of the U-portfolio system, or tag the RFID reader on the field of the practitioner terminal with a 13.56 MHz RFID tag to the U-portfolio system A feedback bot for conversation for AI-based clinical practice education that registers, and the instructor terminal checks the attendance of the user terminal of the practitioners of clinical practice. According to claim 1,
The clinical expression unit of the U-portfolio system provides PBL (problem-based learning) and clinical practice information to outpatient pre-diagnosis and inpatients, and basic clinical skills and observational clinical skills to patients by the clinical skills section of the main server Conversational feedback bot for AI-based clinical practice training that provides technical information. According to claim 1,
In the U-portfolio system, the instructor's terminal uses the user terminal at the health and medical practice field to underline the field recording paper provided by the practitioner's user terminal, or text, cursive/graphic memo, drawing/photo/file transmission/reception, and voice recording. Instructor's feedback is freely left through, and the practical field feedback information of the instructor's terminal is captured immediately, and the practitioner according to simultaneity control by multi-thread and multicasing technology in the shared workspace of the server through the U-portfolio system. A feedback bot for conversation for AI-based clinical practice education that provides immediate instructor feedback information through multicasting technology to their user terminals, and the practitioners' terminals store and manage immediate instructor feedback information for each practice. According to claim 1,
The U-portfolio system is
WWW Server;
a control unit for controlling each function of the U-portfolio service that provides clinical practice;
Member Management Department;
a user authentication unit for authenticating a user using an ID/Passwd method or a student number/Passwd method;
Academic calendars and calendars that provide academic calendar and calendar information for the institution;
a student information register that registers learner/practitioner information;
Instructor information register for registering information of the instructor in charge of practice;
The My practice management includes calendar-linked practice schedule and practice schedule, self-introduction (Portfolio), my information management, and to-do list. My information management unit that provides bulletin board file upload/deletion, mail sending/receiving, and calling/receiving calls (VoIP);
a practice schedule register that registers practice schedules, practice schedules, and information about professors in charge of training; a practice record management unit that records and manages the symptoms of the patient to be practiced, the practice history of the learner/trainee, and the evaluation history of the instructor according to the practice schedule and practice schedule through the practice record sheet, the evaluation sheet, and the feedback form;
The instructor's terminal freely leaves the instructor's feedback to the practitioner's terminals by underlining on the field practice record provided by the practitioner terminal, text, cursive/graphic memo, drawing/photo/video/file transmission/reception, and voice recording. Practice field feedback contents are immediately captured and transmitted to the U-portfolio system, and multicasting technology to the user terminals of the practitioners by multi-thread simultaneous control in the shared workspace of the server of the U-portfolio system Instructor feedback information unit that provides immediate instructor feedback information through;
a clinical expression unit that provides outpatient pre-diagnosis, inpatient medical records, PBL (problem-based learning), and clinical practice information for inpatients;
Clinical Skills Department that provides basic clinical skills and observational clinical skills information for patients;
a reflection unit for receiving and storing the reflection information of the practitioner and the reflection information of the instructor from the user terminals;
According to the practice schedule and practice schedule by the instructor in charge of the practice, the practice information record for each practitioner is viewed and the instructor's practice evaluation is performed at the training site for health and medical field practice, clinical experiment, and field practice. Medical record evaluation, inpatient case presentation evaluation, first outpatient visit after discharge evaluation, PBL (problem-based learning) evaluation, clinical skill evaluation, patient safety gender gap analysis evaluation, problem-based learning small group discussion evaluation, individual presentation evaluation, face-to-face a practice evaluation unit that manages practical evaluation information of evaluation and 360-degree evaluation (professor, specialist, patient); and
The U-portfolio system provides statistical information by analyzing individual practitioner's practice history management (daily/weekly/monthly/year), instructor's evaluation history management (daily/weekly/monthly/year), and clinical practice-related big data. , supports 360-degree multi-faceted evaluation, includes a statistical management unit that graphically and visually outputs bar graphs and pie charts, and a feedback bot for conversations for AI-based clinical practice education. According to claim 1,
At the time of clinical practice education, the practice record sheet includes a preliminary record sheet, daily/weekly/final reflection, inpatient/PBL (problem-based learning), basic clinical skills/observational clinical skills conversation papers for AI-based clinical practice education For feedback bots. According to claim 1,
The AI-based conversational chatbot uses natural language processing (NLP) to query text data- database search with query text- when answering questions about practitioner/instructor clinical practice through the U-portfolio system A feedback bot that outputs text responses to questions and is for AI-based clinical practice training. According to claim 1,
The U-portfolio system infers the performance of the practice activity by extracting the text written by the practitioner through the Feedbatbot and the text related to the teacher's feedback through handwriting recognition or character recognition from the feedback of the instructor's terminal, and sharing work between the practitioners and the instructor AI-based practicum training, which further includes a feedback bot that provides graphic notes using multi-threads and multicasting technology in a shared work space, voice feedback from the instructor using speech recognition, sending and receiving files, and sending and receiving notes. Conversational feedback bots for According to claim 1,
The U-portfolio system is a feedback bot for AI-based clinical practice education that uses SaaS-based hybrid cloud computing technology that links data from public public clouds and private clouds. According to claim 1,
The feedback bot
i) Name recognition function for clinical expression, clinical technique, diagnosis name, patient history, student reflection history,
ii) Data cloud search function according to entity name recognition;
iii) Based on WATSON's Bluemix API and Conversation Service, a feedback bot for AI-based clinical practice education with the ability to provide medical terminology through learning events and service calls. According to claim 1,
The practitioner's user terminal collects practice-related learning data and learning contents from the U-portfolio system, and provides the instructor's feedback on the practical diagnosis contents using artificial intelligence during clinical practice. Clinical presentation with feedback information (outpatient diagnosis, inpatient case presentation, PBL (problem-based learning)) practice paper, clinical skills (basic clinical skills, observational clinical skills) practice paper, reflection paper (daily/weekly/total), clinical Conversational feedback for AI-based clinical practice education, which provides the ability to save and print practice reports, evaluation papers, inpatient medical records, pre-diagnosis records with instructor feedback sentences from the instructor terminal, and daily/weekly records as local files bot.

Images