KR20230038623A - U-Portfolio AI estimation guide system - Google Patents

Abstract

Disclosed is a U-portfolio artificial intelligence evaluation guide system. Instructors and practitioners at a health care institution (hospital), medical school, dental school, and nursing school use a PC/laptop, smartphone, and tablet PC, especially tablet PC, to access a U-portfolio system through a wired and wireless communication network. According to the U-portfolio system, practice schedules and practice schedules are announced according to a medical curriculum and theory and practice information, instructor evaluation and feedback, and practice grade information are managed. During hospital training, the instructors and practitioners (bachelors/interns/residents) use a smart device and the U-portfolio system to record practice information such as check outpatient records, inpatient medical records, planning and reflection, clinical expressions, clinical techniques at a clinical training site on a record sheet for each clinical practice activity and store the same on a server. In addition, provided are instant feedback and evaluation from the instructors using the smart devices, a report card with scores given by the instructor according to evaluation criteria for each practice item, and an electronic portfolio containing a practice history. The U-portfolio artificial intelligence evaluation guide system improves a related practice process and provides standardization of the clinical practice, management of immediate evaluation and feedback from the instructor, practice process-centered evaluation and learning, and practice history management. Accordingly, it is possible to upgrade and commercialize a portfolio platform (U-Folio 2.0) for nurturing healthcare personnel (healthcare edu-tech platform, U-FOLIO system). The U-portfolio artificial intelligence evaluation guide system comprises: a user terminal; and a U-portfolio system.

Description

U-Portfolio AI evaluation guide system {U-Portfolio AI estimation guide system}

The present invention relates to a U-portfolio artificial intelligence evaluation guide system, and more specifically, professors and practitioners at health and medical institutions (hospitals), medical schools, dental schools, and nursing colleges use PCs/laptops, smartphones, and tablet PCs. In particular, by using a tablet PC to access the U-Portfolio system through wired/wireless communication networks, the practice schedule and practice schedule are announced according to the medical curriculum curriculum, and theory and practice information, instructor's evaluation and feedback, and practice grade information are provided. During hospital practice, through the smart devices and U-portfolio system of instructors and practitioners (bachelor/intern/resident), outpatient preliminary records, inpatient medical records inquiry, planning and reflection, clinical expression, clinical Practice information is recorded on the record sheet for each skill and clinical practice activity, stored on the server, and the instructor's feedback and evaluation are provided immediately using a smart device, and the evaluation criteria according to the AI practice evaluation guide and the score for each practice item are displayed. It is about a U-portfolio artificial intelligence evaluation guide system that provides an electronic portfolio with practice history.

Health and medical education provides theory and practice information according to the academic calendar and curriculum of doctors, dentists, and nurses at medical/dental/nursing colleges, announces practice schedules and practice schedules, and practices feedback and evaluation by instructors, and tests Information management, hospital field training, and basic education by specialized instructors' individual guidance are adopted and implemented. However, during practical education, the instructor's busy schedule in the health care field, the history management of the practitioner's student's field practice education, and the instructor's guidance and evaluation information were not properly managed. Health and medical education with an apprenticeship-type education method has systematic clinical practice education and practical training depending on the instructor's busy instructor evaluation and instructor's competency.

In advanced health and medical education such as the United States, students personally use an ePortfolio system that registers, manages, stores, and records their class history directly on the Web, but clinical practice in hospitals is based on feedback from instructors. There is a need for systematic management due to limitations and structural differences in evaluation and on-site medical environments.

As a prior art 1 related to this, in Patent Registration No. 10-1443125, "a remote medical practice education system capable of individual control" is registered.

Referring to FIG. 1, a conventional remote medical practice education system capable of individual control is

Recording means 10 composed of a camera 12 and a microphone 14 provided in each of the plurality of practice spaces P to record and record the practice process;

Operation of the camera 12 and microphone 14 of the practice space P selected by being wirelessly connected to the central server 40, real-time reproduction of the recorded video, recorded voice, and checklist for evaluation, checklist Mobile control means (20) capable of controlling the bookmarking function for each practice space so that the video, checklist, evaluation result, and evaluation result input time are synchronized and saved when the evaluation result is input for the;

Playback means (30) for playing back the practice video, audio, and evaluation results stored in the central server (40) to the learner, and reproducing the video for a certain period of time before the input time of the evaluation result selected by the learner;

A recording storage unit 41 that stores recorded video and audio, a PTZ unit 42 that controls up, down, left, right, and zoom operations of the camera 12, and evaluation results and evaluation input from the mobile control means 20 An evaluation storage unit 43 that synchronizes and stores time, a message delivery unit 44 that delivers messages necessary for the practice process to the practice space P at a set time, and the practice space selected by the mobile control means 20 It consists of an activation unit for activating only the recording means (10) of (P) and a deactivation unit for inactivating the recording means (10) of the rest of the practice space. ), an evaluation storage unit 43, and a central server 40 including an individual control unit 45 that controls the message transmission unit 44 to operate.

The recording means 10 is installed in the practice space P or practice room where medical practice is performed and consists of a camera 12 and a microphone 14 to record and record the practice process. The camera 12 records the process of practice, and the microphone 14 records the voices of practitioners.

As the camera 12, a movable or fixed camera may be used, and two or more cameras may be installed. In addition, the camera 12 uses a PTZ camera, and the PTZ camera is a camera having pan, tilt, and zoom functions, and the position of the camera can be remotely controlled.

The mobile control unit 20 is a device that can be carried and moved by an evaluator, and uses a touch-recognizable tablet PC or a wirelessly connectable laptop.

The playback means 30 causes the practice recorded video stored in the central server 40, the recorded voice, the evaluation result of the evaluator, and the time zone in which the evaluation result is input to be played together.

Learners can re-learn while watching their own or others' practice videos in their entirety, or lecturers can use them as lecture materials. In particular, since the bookmarking function is possible, when an evaluation result that needs to be checked is selected, the video of that time period is immediately moved and played for a certain period of time. For example, when an evaluation result item is selected, an image from before a certain time (eg, 10 seconds) to the evaluation time based on the input time can be reproduced.

The playback means 30 uses a PC, may be installed in a study room or lecture room, and may output evaluation results.

The central server 40 may be composed of a recording storage unit 41, a PTZ unit 42, an evaluation storage unit 43, a message delivery unit 44, and an individual control unit 45, and additionally a vital signal receiver. (46), a file conversion unit 47 may be further included.

The central server 40 further includes a vital signal receiving unit 46 that receives vital signals transmitted from the practice model and stores them in synchronization with the video recorded in the recording storage unit 41.

The central server 40 further includes a file conversion unit 47 that converts the video stored in the recording storage unit 41 into a video file for mobile and transmits it to the mobile control unit 20 .

The evaluation storage unit 43 synchronizes and stores the evaluation result inputted by the evaluator to the checklist in the mobile control means 20 and the input time of the evaluation result together. Of course, since it is interlocked with the recording storage unit 41, if one of the evaluation results is selected when playing in the reproducing unit 30, the recorded video of that time period is played for a certain period of time.

The message delivery unit 44 is a means of delivering a message related to practice progress to trainees, and can be transmitted as a voice through a speaker installed in the practice room or as a text message through a monitor. Such a message may be pre-entered or set for each time period to be delivered.

The individual control unit 45 controls the recording storage unit 41, the PTZ unit 42, the evaluation storage unit 43, and the message delivery unit 44 to operate only for the practice space P selected by the evaluator, It may be composed of an activating unit and a deactivating unit.

The activation unit activates the recording means 10 of the practice space P selected by the evaluator in the mobile control means 20 to operate. Therefore, only the camera 12 and the microphone 14 installed in the selected practice space P are operated to record, record and store images, and input evaluation results.

On the other hand, the inactivation unit blocks the operation of the recording means 10 other than the one selected by the activation unit.

In the health and medical education system, in order to become health care personnel such as doctors, dentists, and nurses, after graduating from related departments, you must pass the nationally recognized qualification license exam (written exam and practical exam-“national exam”). It takes 10 years of education/practice/training process to train one professional medical personnel, but since the process cannot be confirmed when selecting a doctor at the hospital, the results of the national license test, the name of the school attended and graduation credits, the hospital and surroundings Selection based on reputation. Due to changes in the educational paradigm and external environment, the importance of immediate process-oriented evaluation and portfolio quality evaluation is increasing.

However, there is a high level of concern in the field of clinical practice about the reality that the selection process for health and medical personnel who protects the health of the people is conducted through a one-time paper-and-pencil test and a model-based practical test. This is because doctors with good universities, high grades, and high scores in national examinations do not match good doctors in the clinical field. In order to overcome the limitations of these health care personnel education and evaluation methods, front-line universities have developed competency-based education, case-based learning (CBL), and problem-based discussion learning (Problem-based Learning, PBL). ), etc., and an E-learning system to which it is applied have been introduced and utilized. In paper-and-pencil assessment, a UBT system using multimedia questions, computers, tablet PCs, and mobile devices has been introduced and used to enable clinical competency-centered assessment. However, the teaching method and evaluation method of hospital clinical practice, which is called the flower of health and medical education, depends on the hospital, subject (internal medicine, surgery, etc.), department (gastroenterology medicine, cardiology medicine, etc.), and even the instructor. Although the method is different, the lecturer's clinical practice education and feedback are still conducted only orally. In the case of grade assessment, the clinical practice evaluation of practitioners is made without quantitative standards, making it difficult to nurture, evaluate, and select high-quality health care personnel.

2 is a diagram showing a past health care personnel evaluation method having different evaluation criteria for each professor and different records for each university/hospital/division.

In the past, all clinical practice activities were written/submitted on a paper basis, but the evaluation results were notified only as credits after the end of the semester without immediate feedback or evaluation from instructors. In addition, different records for each university/hospital/division and different evaluation standards for each professor (even within the same university, there are records with different names and contents for “same practice behavior” (there is no standardized evaluation standard. Students give feedback only with grades) Even within the same university, each major department uses a different record designation and form (in the case of University A, there are more than 300 practice records).

3 is a diagram showing the background of changes in the health care personnel evaluation method for training professional medical personnel. It takes 10 years of education/practice/training process to train one professional medical personnel, and since the process cannot be confirmed when a doctor is selected at a hospital, the results of the national license test, the name of the school attended and graduation credits, the hospital and surroundings Selection is based on reputation, and the importance of immediate process-oriented evaluation and portfolio quality evaluation is increasing due to changes in the health and medical education paradigm and external environment.

In the past, all clinical practice activities in the medical field were written/submitted based on practice papers, but there was a problem that the evaluation results could not be confirmed in real time as the evaluation results were notified only in terms of credits after the semester ended without immediate instructor evaluation or feedback.

Patent Registration No. 10-1443125 (Registration Date September 16, 2014), "Individually Controllable Remote Medical Practice Education System", Sungjoo Joo

The purpose of the present invention for solving the above problems is that professors and practitioners of health care institutions (hospitals), medical schools, dental schools, and nursing colleges use PCs / laptops, smartphones, and tablet PCs, especially using tablet PCs. It accesses the U-Portfolio system through wired/wireless communication networks, announces practice schedules and practice schedules according to the medical curriculum curriculum, manages theory and practice information, instructors' evaluation and feedback, and practice performance information. Outpatient pre-diagnosis record, inpatient medical record inquiry, planning and reflection, clinical expression, clinical technique, record sheet by clinical practice activity at the clinical practice site through smart devices and U-portfolio system The practice information is recorded and stored in the server, and the instructor's feedback and evaluation are provided immediately using a smart device, the evaluation criteria according to the AI practice evaluation guide, and the practice report card are displayed, and the score for each practice item is displayed. Provides a U-Portfolio artificial intelligence evaluation guide system that provides a portfolio.

Specifically, the U-Portfolio server sets/constructs clinical practice items, clinical practice activities, record sheets for each clinical practice activity, evaluation criteria table for each clinical practice activity, and final evaluation criteria table for each subject for each university, hospital, subject, and department, When an activity record related to clinical practice is received from at least one of the web, external server, and smart device, an evaluation criteria table according to the activity is created on the screen of the student, and the instructor performs evaluation and feedback according to the evaluation criteria table in the field, real-time It is characterized by tracking, managing and analyzing individual practice achievement by storing practice activity history, evaluation results, and meta data of evaluation criteria table.

In order to achieve the object of the present invention, the U-Portfolio AI evaluation guide system records practice information including field practice photos on a practice record sheet by practitioners in the clinical practice field, and provides feedback from instructors/educators/evaluators. and a user terminal displaying evaluation results; And instructors and practitioners use the user terminal to access through wired or wireless communication networks, and through learning, feature extraction and classification of pictures using artificial intelligence deep learning algorithms to detect disease parts in pictures, plan and introspection information, Provides clinical expression information, clinical skill information, practice record information, instructor feedback information and evaluation information, evaluation criteria according to the AI practice evaluation guide, practice report card displaying scores for each practice item, and electronic portfolio including practice history Includes the U-Portfolio system.

The U-portfolio artificial intelligence evaluation guide system of the present invention is used by professors and practitioners of health care institutions (hospitals), medical schools, dental schools, and nursing colleges using PCs/laptops, smartphones, and tablet PCs, especially tablet PCs. and accesses the U-portfolio system through wired/wireless communication networks, announces practice schedules and practice schedules according to the medical curriculum curriculum, manages theory and practice information, instructors' evaluation and feedback, and practice grade information, Outpatient pre-diagnosis record, inpatient medical record inquiry, planning and reflection, clinical expression, clinical technique, record sheet for each clinical practice activity at the clinical practice site through smart devices and U-portfolio system of instructors and practitioners (undergraduate/intern/resident) The practice information is recorded and stored in the server, and the instructor's feedback and evaluation are provided immediately using a smart device, the evaluation criteria according to the AI practice evaluation guide, and the practice report card are displayed, and the practice history is displayed for graduates. Provides an included electronic portfolio.

In medical schools and hospitals, medical records of outpatients and inpatients are inquired, and the clinical practice process is improved to record sheets for each clinical practice activity, standardization of clinical practice, immediate evaluation of instructors and management of feedback, evaluation criteria for each practice item. Provides points given according to the criteria, evaluation and learning centered on practice process, practice history management, and portfolio platform (U-Folio 2.0) advancement and commercialization (Healthcare Edu-Tech Platform, U-FOLIO system) for nurturing health and medical personnel is possible I did.

In addition, the ubiquitous-based practice education portfolio (U-Portfolio) system can be applied to clinical practice in the health and medical education sector of hospitals, medical colleges, dental colleges, pharmacy colleges, nursing colleges, health care colleges, and physical therapy departments in general universities. However, it can be applied to departments focused on clinical practice.

1 is a configuration diagram of a conventional remote medical practice education system capable of individual control.
2 is a diagram showing a past health care personnel evaluation method having different evaluation criteria for each professor and different records for each university/hospital/division.
3 is a diagram showing the background of changes in the health care personnel evaluation method for training professional medical personnel.
4 is a block diagram of the U-Portfolio artificial intelligence evaluation guide system according to the present invention.
5 is a screen showing an artificial intelligence evaluation guide feedback bot platform that provides practice information registration of practitioners and instructor feedback and evaluation information according to an embodiment of the present invention.
6 is a screen showing the concept of an electronic portfolio (U-Folio).
7 is a screen showing the U-Portfolio system platform.
8a is an AI guide result screen that includes explanation rubrics for each evaluation item according to supervised learning/reinforcement learning of instructors/educators/evaluators after student input and data comparison.
8B is a comparison screen of the learned data analysis summary table, data profiling summary, practitioner student input information and explanation rubric criteria.
8c and 8d are interaction and correlation analysis screens between input values and standard answer rubrics.
8E is a screen for generating a final sample score, corresponding to an explanation rubric, and delivering a final value during practice.
9 is a student/professor menu screen during clinical practice.
10 is a screen showing the definition of the clinical practice education environment process.
11 is a screen showing the configuration of clinical practice items.
12 is a screen showing a clinical practice process.
13 is a screen showing the composition of clinical practice activities-core clinical practice, essential/optional clinical practice.
14 is a screen showing the composition of clinical practice activities - long-term tracking integrated clinical practice, student internship, and autonomous clinical practice 1/2.
15 is a screen showing an outpatient pre-examination record (task)-student practice record sheet example: a record sheet authoring module for each practice activity.
16 is a screen showing a recording sheet evaluation method for each practice activity.
17 is a flowchart showing a field evaluation method using a smart device.
18 is a flowchart showing on-site authentication + post-task evaluation method using a smart device.
19 is a screen showing an outpatient pre-examination education method combining a smart device, on-site evaluation, and task-type evaluation.
20 is a screen showing an inpatient education method combining a smart device, on-site evaluation, and task-type evaluation.
21 is a screen showing problem-based learning education combining a smart device, on-site evaluation, and task-type evaluation.
22 is an example screen of an outpatient preliminary examination record (on-site) final report card (display of scores for each activity) provided to practitioners.
23 is a screen showing reading/outputting of an electronic portfolio stored in a cloud server of a U-portfolio system (U-FOLIO) upon graduation from a practice course.

Hereinafter, the configuration and operation of a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings. In the description of the present invention, if it is determined that a detailed description of a related known technology or known configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, drawing numbers are assigned the same drawing numbers in different drawings when indicating the same configuration.

The U-portfolio artificial intelligence evaluation guide system of the present invention is used by professors and practitioners of health care institutions (hospitals), medical schools, dental schools, and nursing colleges using PCs/notebooks, smartphones, and tablet PCs, especially tablet PCs. and connects to the U-Portfolio system through wired/wireless communication networks, announces practice schedules and practice schedules according to the medical curriculum curriculum, manages theory and practice information, instructors' evaluations, and grade information, and practices with instructors during hospital practice Utilizing smart devices and U-portfolio systems of students (undergraduates/interns/residents), practice schedules and announcements, outpatient pre-diagnosis records, inpatient medical records inquiry, planning and reflection, clinical expression, clinical skills, and practice at the clinical practice site Instructor's feedback (emergency measures for each patient, prescription, etc.) using a smart device that immediately records information in the field and stores it in the server, and evaluates every moment with the instructor's feedback (emergency measures for each patient, prescription, etc.) It provides a practice report card that displays the evaluation criteria and points for each practice item, and provides graduates with an electronic portfolio that includes their practice history after graduation.

The U-Portfolio artificial intelligence evaluation guide system improves related clinical practice processes to provide standardization of practice records and clinical practice, immediate instructor evaluation and feedback management, practice process-oriented evaluation and learning, and practice history management. It is for the advancement and commercialization of the portfolio platform (U-Folio 2.0) for manpower training (Healthcare Edu-Tech Platform, U-FOLIO system).

4 is a block diagram of the U-Portfolio artificial intelligence evaluation guide system according to the present invention. 5 is a screen showing an artificial intelligence evaluation guide feedback bot platform that provides practice information registration of practitioners and instructor feedback and evaluation information according to an embodiment of the present invention.

In the clinical practice field, practice information including measurement information (body temperature, blood pressure, pulse, etc.) and field practice photos/videos of medical devices for outpatients or inpatients are recorded as needed on the practice record sheet by practitioners. , a user terminal displaying feedback and evaluation results of instructors/educators/evaluators;

Instructors and practitioners connect through wired/wireless communication networks using the user terminals, and measurement information of medical devices for outpatients or inpatients ( temperature, blood pressure, pulse, etc.) and practice information including field practice photos/videos, store and provide feedback and evaluation results from instructors/educators/evaluators, and provide outpatient and inpatient medical records, prescriptions, and surgery information Inquiry, provision of practice record sheet, detection of disease parts in pictures through feature extraction and classification of pictures using artificial intelligence deep learning algorithm through learning, plan and reflection information, clinical expression information, clinical skill information, practice record information and instructor Provides feedback information and evaluation information, evaluation criteria according to the AI practice evaluation guide, practice report card (correlation analysis between input values and standard answer rubrics) displaying scores for each practice item, and provides an electronic portfolio containing practice history It includes a U-portfolio system that

The user terminal uses any one of PC/laptop, smart phone, and tablet PC. In the embodiment, a tablet PC was used.

Always-on user terminal

a data input unit for inputting practice information of a practitioner on the practice record sheet; and

Each exercise includes a result presentation part that displays feedback and evaluation results from instructors/educators/evaluators.

The U-portfolio system

An artificial intelligence platform connection unit connected to the user terminal through wired or wireless communication;

A data delivery unit that transmits and stores practice record information including measurement information of medical devices of a user terminal and field practice photos, and transmits and receives feedback and evaluation information of an instructor related to practice of the server;

Classification and supervised learning of field practice photos using Bayesian classifier or SVM classifier for practice record information including field practice photos, extracting and classifying feature points of field practice photos using deep learning (CNN) a learning unit that analyzes this or learns an evaluation result by reinforcement learning using a feedback bot;

A final learning model storage unit for storing a picture of the field practice and a final learning result analyzed and learned according to the learning model;

a data comparison unit that stores practice information and analyzes and compares big data; and

Includes a comparison result delivery unit that stores practice information, analyzes big data, and provides evaluation and practice transcripts.

The U-portfolio system

user authentication unit; and an electronic portfolio providing unit providing an electronic portfolio including individual practice records.

Using machine learning engine and learning model algorithm (Bayesian classifier, SVM classifier) or deep learning algorithm (CNN, etc.) of machine learning, feature extraction and classification of field practice photos and scoring for each practice record and clinical practice evaluation item and provide the instructor's evaluation results.

Additionally, the user terminal may further include image analysis SW of field practice photos. Image analysis SW of field practice photos can use i) gray scale image processing or ii) deep learning algorithm. As for the image of the camera video, grayscale image, RGB image, YCbCr, JPEG image, TIFF image, and GIF image can be used.

i) Grayscale image processing

Image analysis SW converts camera image data (RGB image) into gray scale image data, buffers and stores using gray scale image, performs image processing, and converts ROI (Region of Interest) to gray scale (grayscale), and the histogram of the image of the region of interest (ROI) using a specific threshold by experiment in which the outline of the region of interest (ROI) is extracted [pixels of each pixel of the x-axis image] value, the number (frequency) of pixel values corresponding to the y-axis] is obtained, and the ROI image is binarized to 0,1 based on the threshold value using the Ostu algorithm, and then histogram equalization is performed. Perform pre-processing of the image of the region of interest (ROI), obtain the derivative in the x direction and the derivative in the y direction using the sobel edge operator (sobel mask) or the canny edge operator (sobel mask) Defects in the edge image generated by detecting the edge (pixels located on the boundary of the object region and background region) of the region of interest image by convolution of multiplying the weight of by the pixel value of the image and adding them, and applying a specific threshold value. Detect contours of objects and extract shape features. For reference, when using the threshold method using the Ostu algorithm, the pixel values f(x,y) are separated into the object area and the background area for the input image based on a specific threshold value, and the pixel value f(x,y) If the pixel value f(x,y) is greater than the specific threshold value, it is determined as a pixel belonging to the object area, and conversely, if the pixel value f(x,y) is smaller than the specific threshold value, it is determined as a pixel belonging to the background area.

ii) Extract and classify features of images using deep learning algorithms (CNN algorithm, etc.), and use learning model algorithms to extract diseased object parts by comparing them with learning data of diseased part images in the accumulated learning data DB.

For image analysis, deep learning algorithms include CNN (Convolutional Neural Network), R-CNN (Recurrent Convolutional Neural Network), Fast RCNN, and Faster RCNN (Region based Convolutional Neural Network) algorithms, YOLO (You Only Look Once), SSD ( Single Shot Detector) algorithms are used to detect objects in the image (object detection).

The deep learning algorithm uses the CNN algorithm, and any one of AlexNet, ZFNet, VGGNet, GoogLeNet, and ResNet algorithm is used,

Image feature extraction and classification are performed using the CNN algorithm, and object parts with quality are extracted by comparing with training data of defect images accumulated and stored in the learning data DB according to the learning model.

A convolutional neural network (CNN) uses three layers including a convolutional layer, a pooling layer, and a fully connected layer (FC layer).

For example, the CNN algorithm repeats convolution and subsampling by a convolutional layer and a pooling layer while moving a mask (eg, 3x3 window) having weights. to reduce the amount of data in the image, extract features that are robust against distortion of the image, extract feature maps by convolution, and detect diseases according to the learning model by the neural network. Classify the object parts that are present.

In image processing using the CNN algorithm, convolution is image processing using a mask (eg, 3x3 window) having weights, and a mask (eg, 3x3 window) having weights is applied to an input image. While moving, after covering the current input image with a mask having weights, pixel values of the input image are multiplied by the weights of the mask, and the sum is determined as the pixel value of the output image.

Subsampling is a process of reducing the screen size, and max pooling is used to select the maximum value of the corresponding area.

The FC layer (Fully Connected Layer) classifies objects by learning by connecting them to the input terminal of the neural network. It currently consists of 5 layers of convolution layers and 3 layers of fully_connected layers.

The output of the convolutional layer is subsampled by the Max-Pooling layer to reduce the size of the image, and the output of the Max-Pooling classifies the object class in the FC layer (Fully Connected Layer).

As a result, in order to extract objects with defects in the camera image, a feature map including object location area and type information is extracted from several convolutional layers in the middle of the CNN structure, and a pooling layer ( As it passes through the Pooling layer), the size of the feature map decreases, and object location area information is extracted from feature maps of different sizes to detect objects, and the FC layer (Fully Connected Layer) Object parts with disease are classified by comparing with the pre-learning data of the learning model.

6 is a screen showing the concept of an electronic portfolio (U-Folio).

Traditionally, a portfolio refers to a set of materials created to prove one's resume, career, skills, etc.

The electronic portfolio presented in the present invention is based on the relationship between learner and instructor in the traditional learner-centered concept of U-portfolio, and the process-oriented evaluation platform that adds immediate evaluation and feedback from the instructor in clinical practice education. It is an electronic certificate.

7 is a screen showing the U-Portfolio system platform.

The U-Portfolio system provides outpatient and inpatient medical records and prescriptions, surgical information inquiry, provision of practice records, planning and reflection, clinical expression, clinical skills, practice record information, instructor feedback information, evaluation information, and practice transcripts (practice items). a practice management system that provides star ratings); An integrated management system that manages medical information for each patient in medical schools and hospitals; Instructor feedback (patient-specific AI-based feedback bot engine that provides first aid, prescription, etc.) and evaluation results; AI big data-based long-term tracking integrated learning performance analysis engine by referring to practice records related to clinical practice; and a personal portfolio management system providing an electronic portfolio containing individual practice records.

In the U-Portfolio system, practitioner students, professors, principal professors, and administrator terminals are connected to the U-Portfolio system at the clinical practice site, and individual practice records are entered and practice records are managed in the clinical practice field. Provides feedback (first aid for each patient, prescription, etc.) and evaluation, report card for each practitioner (scores for each practice evaluation item), and provides an electronic portfolio that includes each practitioner's practice history.

In the health care field or practice field, the instructor connects to the main server of the U-Portfolio system using his/her smart device (tablet PC), and uses the CSCW group communication technology by the feedback bot of the main server to create a shared workspace. ) using multi-thread and multicasting technology, the instructor underlines the field practice record presented by the practitioner, or freely leaves feedback through text, picture, photo, instructor's voice recording, and file transmission, and the instructor's practice field feedback The content is immediately captured and transmitted to the main server, immediate instructor feedback (emergency measures for each patient, prescription, etc.), instructor evaluation and practice performance management, mutual learning between practitioners and instructor, student practice history and instructor evaluation information To provide cloud practice education management service using artificial intelligence and big data analysis technology using smart devices including PC (Web), smartphone (App), and tablet PC (App).

In the embodiment, the U-Portfolio Service, which is a medical school/hospital specialized practice education management system, is provided for health care education.

The U-Portfolio system utilizes a tablet PC to write contents on the practice record sheet at the health care practice site, receive notice from the instructor of the practice schedule, practice schedule, and practice subjects, provide theory and practice training, and receive immediate instructor feedback. Provides education and instructor feedback and evaluation solutions.

In the embodiment, field practice in medical colleges/hospitals in the health care education sector has been described as an example, but it is not limited thereto and can be applied to other practical education sectors.

In addition, the ubiquitous-based practice education portfolio (U-Portfolio) system can be applied to clinical practice in the health and medical education sector of the Department of Physical Therapy in medical colleges, dental colleges, pharmacy colleges, nursing colleges, health care colleges, and general universities. It can be applied to departments that focus on field practice.

(Example) U-portfolio service for medical schools

In the healthcare education U-Portfolio system using a tablet PC, student practice information and practice history from health care institutions, hospitals, etc., instructor feedback and evaluation, immediate instructor on-site feedback from medical institutions and hospitals (by patient) first aid, prescription, nursing/emergency rescue).

○ U-portfolio of medical school specialized practice education management system

- U-Portfolio service is a practical education and evaluation solution that utilizes a tablet PC to write learners' educational content on the practice record and receive evaluation and feedback from the instructor at the clinical practice training site. It is operated in a smart device including a phone.

8a is an AI guide result screen that includes explanation rubrics for each evaluation item according to supervised learning/reinforcement learning of instructors/educators/evaluators after student input and data comparison.

8B is a comparison screen of the learned data analysis summary table, data profiling summary, practitioner student input information and explanation rubric criteria.

8c and 8d are interaction and correlation analysis screens between input values and standard answer rubrics. 8E is a screen for generating a final sample score, corresponding to an explanation rubric, and delivering a final value during practice.

The U-Portfolio system uses PCs/laptops, smartphones, and tablet PCs in the field of health and medical education through wired and wireless communication networks. /Interns/Residents) to notify practice schedule and practice schedule, theory and practice information, instructor's feedback and evaluation, practitioner's practice history management, peer-to-peer communication between instructor and learner/practicum using messenger, and On the U-portfolio system, individual student practice management and practice evaluation scores are provided.

9 is a student/professor menu screen during clinical practice, providing a practitioner student screen and an instructor screen, practice plans and announcements, feedback talk through chat between instructor and practitioner terminals, My information Management, planning and reflection by course, practice schedule, practice guidelines, core clinical practice, long-term follow-up integrated clinical practice, student internship, mandatory/optional clinical practice, autonomous clinical practice by school1,2, learning activities, research activities, practice activities , clinical expression-based learning improvement analysis, clinical skill-based learning improvement analysis, club activities, and final electronic portfolio are provided.

10 is a screen showing the definition of the clinical practice education environment process.

The clinical practice education environment process defines clinical practice activities (standard activities/free writing) -> defines essential practice item names (standard glossary/standard code) -> defines record sheets by clinical practice activities -> defines evaluation methods by clinical practice activities -> clinical practice Definition of evaluation criteria by practice activity or practice item -> definition of minimum number of practices and points per repetition -> definition of final report card reflection method by university, semester, and subject (internal medicine, surgery, etc.)

11 is a screen showing the configuration of clinical practice items.

The composition of clinical practice items is based on the learning outcomes of the Korean health and medical personnel standard and university learning outcomes (learning outcomes by subject, learning outcomes by integrated curriculum, learning outcomes by class, learning outcomes by clinical practice curriculum, and learning outcomes by practice subjects). Include clinical presentation (acute abdominal pain, dyspepsia, cough, dyspnoea, gastritis, gastric cancer, postoperative fever), diagnosis of essential patient group, clinical skills (basic clinical skills, observational clinical skills, surgical and other manipulations), and self-practice items. do.

12 is a screen showing a clinical practice process.

For example, clinical practice courses include core clinical practice, long-term follow-up integrated clinical practice, mandatory/optional clinical practice, student internship, self-directed clinical practice course 1, and free clinical practice course 2.

13 is a screen showing the composition of clinical practice activities-core clinical practice, essential/optional clinical practice.

Composition of clinical practice activities - core clinical practice, essential/optional clinical practice,

- Selection of practice record sheet [outpatient preliminary record, inpatient medical record (SOAP, Subjective, Objective, Assessment, Plan), progress record (SOAP), free record, 360-degree evaluation (patient)]

- Selection of practice record [outpatient pre-diagnosis record (on-site), inpatient medical record (POMR),

Surgical observation records, basic clinical skills, observational clinical skills, prescription records, free records

* Planning and reflection: clinical presentation planning and self-assessment, clinical skill planning and self-assessment,

Final reflection, weekly practice plan and reflection, daily practice record, practice record (morning/pm),

360-degree evaluation (specialist, colleague, patient, nurse/emergency technician/clinical technologist, etc.),

Introspection on doctor-likeness and patient safety

* Clinical expression: Outpatient preliminary examination record (site-final), outpatient preliminary examination presentation (site-final-SNAPPS),

Outpatient preliminary examination presentation (site-SNAPPS), outpatient visit (preliminary examination replacement), outpatient preliminary examination record (assignment), outpatient visit, inpatient medical record (POMR), inpatient case presentation, case presentation (emergency room), problem-based learning (problem) base Learning, PBL) (1st session), problem-based learning (2nd session), problem-based learning (task), treatment performance evaluation (CPX)

* Clinical skills: clinical skills (rubric assessment), clinical skills (scale assessment),

Clinical skills (observation), surgical observation records

* Self-practice: free recording (assignment), free recording (on-site presentation)

* Handwriting input: paper test, OSCE, CPX

14 is a screen showing the composition of clinical practice activities - long-term tracking integrated clinical practice, student internship, and autonomous clinical practice 1/2.

* Long-term follow-up integrated clinical practice: monthly reflection, monthly evaluation, final evaluation

Patient-specific records [outpatient pre-diagnosis record (assignment), inpatient medical record (SOAP), progress record (SOAP), surgical observation record, free record, 360-degree evaluation (patient)]

* Student intern: weekly practice plan and reflection, final evaluation,

Patient-specific records [outpatient preliminary records (on-site), inpatient medical records (POMR), progress records (SOAP), surgical observation records, basic clinical skills, observational clinical skills, prescription records, free records]

* Autonomous clinical practice 1: rotational observation attendance, daily clinical participation, pre-clinical practice,

Clinical practice by case, groundbreaking, seminar, total case, competency evaluation, critical thinking essay

Report

* Autonomous clinical practice 2:

Circular observation attendance, clinical participation by day, pre-clinical practice,

Clinical practice by case, groundbreaking, seminar, total case, competency evaluation, critical thinking essay

Report

15 is a screen showing an outpatient pre-examination record (task)-student practice record sheet example: a record sheet authoring module for each practice activity.

Outpatient preliminary examination record (assignment)-student practice record includes practice information (hospital, department, department, date, time), basic information (professor in charge (major), test professor), practice items (selection of clinical expression, selection of essential patient group, other input), patient information (type, patient name, age, gender, medical history number), practice contents (C.C, subject, purpose, assessment, plans-diagnosis, treatment, education), file upload (jpg, jpeg, png,docx,pptx,pdf).

[Practice record sheet authoring elements and functions]

A. Time input part

○ Time input type ○ AM/PM selectable ○ Unused (automatic recording)

B. Evaluator input

○ Time input type ○ AM/PM selectable ○ Unused (automatic recording)

C. Exercise item input part

○ Standard learning outcomes ○ University learning outcomes ○ Clinical expression ○ Essential patient group

○ Diagnosis ○ Clinical skills (basic skills / observation skills / other skills)

○ Free item (on-site) ○ Free item (assignment) ○ Handwritten input item

D. Patient information input device

○ Basic (detailed) ○ Simplified version (set the number of digits for patient information) ○ Unused

E. CASE information input tool

○ Use (set the number of CASE NO digits) ○ Not use

F. Practice activity input (text)

○ Used ○ Not used

G. Practice activity input (editor)

○ Used ○ Not used

H. Practice memo pad (can be modified after on-site evaluation)

○ Used ○ Not used

I. Attachment Input Method

○ Used ○ Not used

J. URL Input

○ Used ○ Not used

K. Whether or not to use the assignment assignment function after on-site evaluation

○ Used ○ Not used

L. Whether to use the rollover function of the record sheet (records that are not reflected in the final grade are carried over to the next semester)

○ Used ○ Not used

16 is a screen showing a recording sheet evaluation method for each practice activity.

(1) Assignment-type evaluation (general online assignment-type evaluation)

- Student submission -> Instructor evaluation

- Document version management upon return and return

(2) On-site evaluation (on-site evaluation using student smart devices)

- Submit after student writing and evaluator selection

- Print the evaluation criteria table on the student screen

- Instructor's on-site authentication (mobile authentication number, signature using handwriting, etc.)

(3) On-site certification + post-task evaluation (on-site certification and evaluation are conducted post-hoc)

- Student writing submission step

- On-site authentication stage of on-site evaluators such as majors on the student screen

(automatically submitted to final evaluator)

- The final evaluator evaluates (enters scores) based on student submissions and feedback from field evaluators

17 is a flowchart showing a field evaluation method using a smart device.

The on-site evaluation method using a smart device (tablet PC) selects student practice activities -> exposes the record sheet input form according to practice activities -> selects an evaluator -> selects practice items (required and optional) -> inputs the contents of the practice record sheet -> Save/submit to server -> Expose on-site evaluation criteria table according to practice activities and practice items on student screen (terminal) -> [Evaluator] Enter evaluation data, feedback contents, and personal authentication information -> Evaluator (personal authentication) -> On-site evaluation completed (transmitting evaluation results and feedback to students).

18 is a flowchart showing on-site authentication + post-task evaluation method using a smart device.

On-site authentication using a smart device + post-task type evaluation method, select student practice activity -> exposure of record sheet input form according to practice activity -> select evaluator -> select practice item (required, optional) -> input the contents of practice record sheet - > Save/submit to server -> Expose practice activities and on-site authentication areas according to practice items on student screen (terminal) -> [On-site authenticator] Enter personal authentication information and on-site notes -> Self-certification -> Complete on-site authentication (final evaluator automatically submitted) process.

The evaluator logs in to the U-Portfolio system -> Expose the certified record sheet (waiting for evaluation) on the To do list -> Select the record sheet waiting for evaluation -> Record contents according to practice activities and practice items, field certification, and memo history Exposure -> Enter evaluation data and non-feedback content -> Execute the process of completing post-evaluation (transmitting evaluation results and feedback to students).

19 is a screen showing an outpatient pre-examination education method combining a smart device, on-site evaluation, and task-type evaluation.

The practitioner student accesses the server of the U-Portfolio system using a user terminal, and names the activity (pre-outpatient examination), activity definition (before outpatient-professor outpatient treatment, the student meets the patient first and proceeds with consultation), record designation (pre-outpatient examination), Fill out/submit the record sheet (on-site)”) and record contents (patient information and SOAP (Subjective, Objective, Assessment, Plan-diagnosis/treatment/education in order) are stored in the server.

The student checks the name of the activity (supplementation/reflection of the outpatient preliminary examination record), supplements and submits the outpatient preliminary examination record sheet by referring to the contents received from on-site feedback, and prepares/submits the “outpatient preliminary examination record sheet (final)”. The student selects one of the submitted outpatient preliminary examination records (final) documents, creates and writes a presentation, and saves it on the server.

Student: activity name (preparation for outpatient examination CASE presentation), activity definition (preparation for outpatient examination case presentation materials), record designation (preparation/submission of “Outpatient Preliminary Examination Statement (SNAPPS)”), record content (preparation for outpatient examination case presentation materials) and save it to the server.

Instructor/student on-site evaluation includes activity name (after outpatient visit, on-site feedback on outpatient pre-examination record), activity definition (patient-professor outpatient treatment visit, preparation/submission in advance), record designation (“outpatient pre-examination record (on-site)”) On-site approval) and evaluation method (use of student smart devices, on-site approval) are evaluated.

When an outpatient pre-examination CASE is announced, instructor/student on-site evaluation includes activity name (announcement of outpatient pre-examination CASE), activity definition (select and announce one out of outpatient pre-examination cases), record designation (“Announcement of Outpatient Preliminary Examination (SNAPPS)”) Evaluation), evaluation method (use of student smart devices, on-site evaluation (presentation of SNAPPS evaluation criteria, provision of evaluation results)).

The instructor accesses the U-Portfolio system using the instructor's terminal, and the name of the activity (evaluation of the preliminary outpatient examination record sheet (final)), activity definition (evaluation of the preliminary outpatient examination record sheet submitted by the student), and the name of the record (“Outpatient preliminary examination record sheet (final) evaluation) ” is evaluated by task-type evaluation) and evaluation method (task-type evaluation (presentation of SOAP evaluation criteria)).

20 is a screen showing an inpatient education method combining a smart device, on-site evaluation, and task-type evaluation.

The practitioner student connects to the server of the U-Portfolio system using a user terminal, and names the activity (inpatient care), activity definition (assigned one inpatient patient, cares the patient), record designation (“inpatient medical record”) (POMR)”) and records (patient information, problem list, medical examination, physical examination, initial problem list, evaluation, plan, progress record) are prepared and stored in the server.

The student is required to select activity name (prepare for inpatient CASE presentation), activity definition (select one of the inpatient cases and prepare/submit case presentation data), record designation (prepare/submit “inpatient case presentation”), record contents ( Prepare inpatient case presentation materials) and save them to the server.

When presenting an inpatient case, the instructor/student field evaluation includes the activity name (inpatient case presentation), activity definition (select and present one of the inpatient cases), and record designation (onsite evaluation of “inpatient case presentation”). , The evaluation is executed by the evaluation method (use of student smart devices, on-site evaluation (presentation of evaluation criteria for case presentation, non-disclosure of evaluation results).

The instructor accesses the U-Portfolio system using the instructor's terminal, and names the activity (evaluation of inpatient medical record (POMR)), activity definition (evaluation of medical record submitted by the student), record designation (“POMR”). )” is evaluated by task-type evaluation) and evaluation method (task-type evaluation (presentation of POMR evaluation criteria)).

21 is a screen showing problem-based learning education combining a smart device, on-site evaluation, and task-type evaluation.

The practitioner student accesses the server of the U-Portfolio system using a user terminal and names the activity (problem-based learning (individual assignment) creation), activity definition (individual schema creation/submission), record designation (“problem-based learning (assignment) )”) and record contents (patient information, individual schema creation) are stored in the server.

Instructor/student on-site evaluation includes activity name (problem base learning 1st round), activity definition (group discussion), record designation (on-site group evaluation of “problem base learning (1st session)”), record content (promotion) Select this group member and submit their own device, and the instructor records and stores the group evaluation progress (proposing evaluation criteria, disclosing evaluation results) on the server.

In addition, instructor/student on-site evaluation includes activity name (Problem base Learning 2nd round), activity definition (group discussion), record designation (on-site group evaluation of “Problem base Learning (2nd round)”), record content (The leader selects members and submits their devices, the instructor proceeds with group evaluation (proposing evaluation criteria, disclosing evaluation results)) is recorded and stored on the server.

The instructor uses the instructor's terminal to access the server of the U-Portfolio system, and names the activity (problem-based learning (individual assignment) evaluation), activity definition (evaluation of the student's individual assignment), record designation ("problem-based learning ( Task)” is evaluated by task-type evaluation) and evaluation method (task-type evaluation (provision of evaluation criteria, disclosure of evaluation results)).

22 is an example screen of an outpatient preliminary examination record (on-site) final report card (display of scores for each activity) provided to practitioners.

The screen on the left is an example of the final report card, taking the outpatient preliminary education as an example.

A. Defining Points Per Activity by Activity

- Preliminary education (preliminary on-site approval + preliminary task evaluation) defined as 5 points per session

B. Defining the minimum number of practice strokes

- Defined as 6 times of pre-training education in the relevant department

C. Defining how to reflect the final score report

- How to assign raw points per practice: Accumulate points without limit on the number of practices

- Minimum practice setting method: Even if you practice a lot, only up to the minimum number of practices

Scores reflected (highest score, average score reflected, etc.)

D. Calculation of perfect score for each activity

- Based on the criteria of C, the score of A X B is calculated as a perfect score for each activity

E. Absolute evaluation settings

○ ON (PASS only when the PASS standard is reached) ○ OFF (Relative evaluation)

F. When setting A to E, the student grade calculation screen (preliminary education score, weekly calculation)

G. Screen for automatic calculation of the final report card displaying scores for each evaluation item in clinical practice

23 is a screen showing reading/outputting of an electronic portfolio stored in a cloud server of a U-portfolio system (U-FOLIO) upon graduation from a practice course.

All learning and clinical practice records and evaluation data can be tracked and analyzed by period and by clinical practice element, diagnosing/predicting individual student's clinical practice performance to establish a customized clinical practice plan. In addition, it provides an electronic portfolio that includes individual practice history after graduation, and the practitioner student can visualize and display his or her clinical practice achievement on the dashboard of the user terminal. It provides an electronic portfolio (electronic certificate) in which the history is accumulated.

Upon graduating from the practice course, graduates provide access to the U-Portfolio system by accessing the server URL of the U-Portfolio system through a wired/wireless communication network with a user terminal and using Decentralized Identifier (DID) after school authentication. U-FOLIO) can view/print electronic portfolios containing individual practice records stored in the cloud server.

In addition, the ubiquitous-based practice education portfolio (U-Portfolio) system can be applied to clinical practice in the health and medical education sector of hospitals, medical colleges, dental colleges, pharmacy colleges, nursing colleges, health care colleges, and physical therapy departments in general universities. However, it can be applied to departments that focus on clinical practice.

Embodiments according to the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer readable recording medium. The computer readable recording medium may include program instructions, data files, and data structures alone or in combination. Computer-readable recording media include storage, hard disks, magnetic media such as floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - A hardware device configured to store and execute program instructions in storage media such as magneto-optical media, ROM, RAM, flash memory, and storage may be included. Examples of program instructions may include those produced by a compiler and machine language codes as well as high-level language codes that can be executed by a computer using an interpreter. The hardware device may be configured to operate as one or more software modules to perform the operations of the present invention.

As described above, the method of the present invention is implemented as a program and can be read using computer software on a recording medium (CD-ROM, RAM, ROM, memory card, hard disk, magneto-optical disk, storage device, etc.) ) can be stored in

Although described with reference to specific embodiments of the present invention, the present invention is not limited to the same configuration and operation as the specific embodiments to illustrate the technical idea as described above, and within the limit that does not deviate from the technical spirit and scope of the present invention It can be implemented with various modifications, and the scope of the present invention should be determined by the claims described later.

Claims (12)

In the clinical practice field, a user terminal for recording practice information including field practice photos by practitioners on a practice record sheet and displaying feedback and evaluation results of instructors / educators / evaluators; and
Instructors and practitioners connect via wired/wireless communication networks using the user terminals, and perform medical records and prescriptions for outpatients and inpatients, search surgical information, provide practice records, and learn the characteristics of pictures using artificial intelligence deep learning algorithms. Detect disease parts in pictures through extraction and classification, planning and reflection information, clinical expression information, clinical skill information, practice record information, instructor feedback information and evaluation information, evaluation criteria according to AI practice evaluation guide, and each practice item U-Portfolio system that provides a practice report card with scores displayed and an electronic portfolio with practice history;
A U-Portfolio artificial intelligence evaluation guide system that includes According to claim 1,
The user terminal is a U-portfolio artificial intelligence evaluation guide system using any one of PC / laptop, smartphone, and tablet PC. According to claim 1,
Always-on user terminal
a data input unit for inputting practice information of a practitioner on the practice record sheet; and
A result presentation unit that displays feedback and evaluation results of instructors/educators/evaluators for each practice;
A U-portfolio artificial intelligence evaluation guide system that includes According to claim 1,
The U-portfolio system
An artificial intelligence platform connection unit connected to the user terminal through wired or wireless communication;
A data transmission unit for transmitting and storing measurement information of the medical device of the user terminal and practice record information including the field practice photo to the server, and transmitting and receiving feedback and evaluation information of the instructor related to the practice of the server;
Classification of field practice photos using Bayesian classifier or SVM classifier and learning by supervised learning for practice record information including field practice photos, extracting and classifying feature points of field practice photos using deep learning (CNN), and analyzing or feedback a learning unit learning an evaluation result by reinforcement learning using a bot;
A final learning model storage unit for storing a picture of the field practice and a final learning result analyzed and learned according to the learning model;
a data comparison unit that stores practice information and analyzes and compares big data;
A comparison result transmission unit that stores practice information, analyzes big data, and provides evaluation and practice report cards; and
U-Portfolio artificial intelligence evaluation guide system that includes an electronic portfolio providing unit that provides an electronic portfolio with individual practice history. According to claim 4,
The U-portfolio system
Outpatient and inpatient medical records and prescriptions, surgical information inquiry, provision of practice records, plans and reflections, clinical expressions, clinical skills, practice record information, instructor feedback information, evaluation information, and practice transcripts (scores for each practice item) are provided. practice management system provided; and
Instructor feedback and evaluation results on the practice record sheet for each practitioner using 1:1 or 1:N multithread and multicasting technology in a shared workspace by the feedback bot of the server of the practitioner terminal and instructor terminal an AI-based feedback bot engine that provides; and
U-Portfolio artificial intelligence evaluation guide system that includes a personal portfolio management system that provides an electronic portfolio with individual practice history. According to claim 5,
The U-portfolio system
AI big data-based long-term tracking integrated learning performance analysis engine by referring to practice records related to clinical practice; and
A U-Portfolio artificial intelligence evaluation guide system that further includes an integrated management system that manages patient-specific medical information in medical schools and hospitals. According to claim 5,
During clinical practice through the U-portfolio system, the student screen and the instructor screen are provided for the menu screen of the practitioner/instructor terminal, and practice plans and announcements, feedback talk through chat between the instructor and practitioner terminals , Information management in My, planning and reflection by course, practice schedule, practice guidelines, core clinical practice, long-term follow-up integrated clinical practice, student internship, mandatory/optional clinical practice, autonomous clinical practice by school 1,2, learning activities, research U-Portfolio AI evaluation guide system that provides activities, practice activities, clinical expression-based learning improvement analysis, clinical skill-based learning improvement analysis, and final electronic portfolio. According to claim 1,
The clinical practice is a U-portfolio artificial intelligence evaluation guide system that includes core clinical practice, long-term integrated clinical practice, mandatory/optional clinical practice, student internship, autonomous clinical practice course 1, and free clinical practice course 2. According to claim 8,
During the clinical practice,
Outpatient preliminary examination record (assignment)-student practice record includes practice information (hospital, department, department, date, time), basic information (professor in charge (major), test professor), practice items (selection of clinical expression, selection of essential patient group, other input), patient information (type, patient name, age, gender, medical history number), practice content (CC, subject, purpose, assessment, plans-diagnosis, treatment, education), file upload (jpg, jpeg, png,docx,pptx,pdf), U-Portfolio artificial intelligence evaluation guide system. According to claim 8,
In the case of outpatient pre-diagnosis combining smart device, on-site evaluation, and task-type evaluation,
Access to the U-Portfolio system using the user terminal of the practitioner student, name of activity (pre-outpatient examination), definition of activity (before outpatient-professor outpatient treatment, student meets patient first and proceeds with consultation), record designation (pre-outpatient examination record ( On-site)”), record contents (patient information and SOAP (Subjective, Objective, Assessment, Plan-in order of diagnosis/treatment/education) are stored on the server,
The student checks the name of the activity (supplementation/reflection of the outpatient preliminary examination record), supplements and submits the outpatient preliminary examination record sheet by referring to the contents received from on-site feedback, and prepares/submits the “outpatient preliminary examination record sheet (final)”. The student selects one of the submitted outpatient preliminary examination records (final) documents and creates, prepares, and saves the announcement sheet.
Student: activity name (preparation for outpatient examination CASE presentation), activity definition (preparation for outpatient examination case presentation materials), record designation (preparation/submission of “Outpatient Preliminary Examination Statement (SNAPPS)”), record content (preparation for outpatient examination case presentation materials) is created and stored,
Instructor/student on-site evaluation includes activity name (after outpatient visit, on-site feedback on outpatient pre-examination record), activity definition (patient-professor outpatient treatment visit, preparation/submission in advance), record designation (“outpatient pre-examination record (on-site)”) On-site approval), evaluation method (use of student smart devices, on-site approval), evaluation is carried out,
When an outpatient pre-examination CASE is announced, instructor/student on-site evaluation includes activity name (announcement of outpatient pre-examination CASE), activity definition (select and announce one out of outpatient pre-examination cases), record designation (“Announcement of Outpatient Preliminary Examination (SNAPPS)”) evaluation), evaluation method (use of student smart devices, on-site evaluation (presentation of SNAPPS evaluation criteria, provision of evaluation results), evaluation is executed,
The instructor accesses the U-Portfolio system using the instructor's terminal, and the name of the activity (evaluation of the preliminary outpatient examination record sheet (final)), activity definition (evaluation of the preliminary outpatient examination record sheet submitted by the student), and the name of the record (“Outpatient preliminary examination record sheet (final) evaluation) A U-Portfolio AI evaluation guide system that evaluates ” by task-type evaluation) and evaluation method (task-type evaluation (suggesting SOAP evaluation criteria)). According to claim 8,
In the case of inpatient education that combines smart devices, on-site assessments, and task-type assessments,
Access the U-Portfolio system using the practitioner student's user terminal, and name the activity (inpatient Care), activity definition (assign one inpatient, care the patient), record designation (“Inpatient Medical Record (POMR) )”), record contents (patient information, problem list, medical examination, physical examination, initial problem list, evaluation, plan, progress record creation) are stored in the server,
The student is required to select activity name (prepare for inpatient CASE presentation), activity definition (select one of the inpatient cases and prepare/submit case presentation data), record designation (prepare/submit “inpatient case presentation”), record contents ( Preparation of inpatient case presentation materials) is written and stored,
When presenting an inpatient case, the instructor/student field evaluation includes the activity name (inpatient case presentation), activity definition (select and present one of the inpatient cases), and record designation (onsite evaluation of “inpatient case presentation”). , evaluation is carried out by the evaluation method (use of student smart devices, on-site evaluation (presentation of evaluation criteria for case presentation, non-disclosure of evaluation results),
Using the instructor's terminal, connect to the server of the U-Portfolio system, name the activity (evaluation of inpatient medical record (POMR)), activity definition (evaluate the medical record submitted by the student), record designation (“POMR”) )” by task-type evaluation) and evaluation method (task-type evaluation (presentation of POMR evaluation criteria)), U-Portfolio AI evaluation guide system. According to claim 8,
In the case of problem-based learning education that combines smart devices, on-site assessment, and task-based assessment
The practitioner student accesses the U-Portfolio system using a user terminal and names the activity (problem-based learning (individual assignment) creation), activity definition (individual schema creation/submission), record designation (“problem-based learning (assignment)”) write/submit), record contents (patient information, personal schema creation) are stored in the server,
Instructor/student on-site evaluation includes activity name (problem base learning), activity definition (group discussion), record designation (on-site group evaluation of “problem-based learning (1st or 2nd session)”), record content (promotion) Select this member and submit their device, and the instructor records the group evaluation progress (provision of evaluation criteria, non-disclosure of evaluation results).
By accessing the U-Portfolio system using the instructor's terminal, the activity name (problem-based learning (individual assignment) evaluation), activity definition (individual assignment submitted by the student), record designation (“problem-based learning (assignment)”) U-Portfolio AI evaluation guide system that evaluates by task-type evaluation) and evaluation method (task-type evaluation (provision of evaluation criteria, disclosure of evaluation results)).

Images