RU2761714C1 - Transformable educational platform for simulation examination and training (tepset) - Google Patents

Abstract

FIELD: educating.

SUBSTANCE: invention relates to medical simulation equipment and is an automated complex for independent practice and objective assessment of skills and abilities, including medical ones, based on preset levels with variable detailing of the assessment. Proposed is a transformable educational platform for simulation examination and training, containing at least one set consisting of at least one medical simulator of the human body, medical equipment or simulation thereof, and consumable materials necessary for performing a manipulation, a control unit, at least one monitor, wherein, according to the proposal, the set comprises an interactive tabletop of the body with an LED panel built into the work surface for displaying the layout of the workplace of the medical specialist in the learning process and during the examination, at least two cameras for recording the video of the examination process from different angles, wherein the system also comprises at least one mobile apparatus of the teacher, at least one mobile apparatus of the student, and a router for combining the apparatuses of the system into a single network, as well as pre-installed software ensuring personal identification and implementation of the training and examination functions, software ensuring creation and editing of the training and control materials in the required format.

EFFECT: invention provides a possibility of independent performance of the procedures by students from beginning to end, training to a result at a convenient time with the appropriate amount of repetitions, relieving the teacher from routine work, allowing for more attention to work where the teacher is indispensable, using consistent requirements for the implementation of procedures.

5 cl, 15 dwg

Description

The invention relates to medical simulation equipment (simulators, simulators with extended functionality - systems) and is an automated complex for self-development and objective assessment of skills and abilities, including medical, at specified levels with variable evaluation detail.

Known neonatal imitation educational and practical complex containing a set of interconnected elements of a computer-medical information system and modules: diagnostic, imitation, surgical, resuscitation (utility model patent RU 103958). However, this complex allows you to work out individual manipulations outside the context of the operational process, the complex does not allow realizing the feedback "doctor's action - patient's response", does not educate the clinical thinking of trainees.

As a prototype, an automated system for the formation and assessment of professional medical skills and abilities (patent for invention RU2559929C1) was chosen, containing a medical simulator of the human body, including simulators of functional systems and organs, sensors for measuring and monitoring the current state of simulators and their position in the simulator, connected by a multiplexer with a simulator control unit containing a processor with a unit for setting the values of norm and pathology, a corrector for the degree of pathological state of functional systems and organs and a logical unit for assessing the correctness of the student's actions and a unit of corrections made with the possibility of making adjustments to the assessment of professional skills and associated with the instructor's unit, made with the possibility of forming tasks and their correction in the simulator of functional systems and organs of the medical simulator, and the monitor of the student's computer, connected to the instructor unit, while the medical simulator The body torus is equipped with actuating mechanisms for the formation of motion and position of simulators of functional systems and organs, connected with the processor and made with the possibility of formation of motion and position of simulators in a state of norm or pathology, and electronic normalizing signal converters associated with measurement sensors.

The described automated system is a simulator of a patient, with the ability to simulate various states of the human body (both pathological and physiological), as well as with the ability to simulate the body's response to simulated therapeutic and diagnostic effects on the simulator. This system is intended primarily for practicing clinical thinking and decision-making skills, and not for manipulation techniques. The system does not contain either training or evaluation components (for its use in the educational process, the developers propose the involvement of the Trainer, who will carry out training and evaluation of the cadet in accordance with his own ideas about effective medical practice). Also, for the system to function, an Instructor is required to control the simulator. Thus, for the organization using this system of one training / examination cadet / hour, it is necessary to provide two teachers / hours (Teaching + Instructor), which does not allow using it for self-training. In addition, this system is not intended for joint use with other simulators, and being, in fact, an independent simulator, it does not solve the problem of efficient operation of the simulation equipment already available in educational organizations.

The objective of the invention is the useful use of various simulation equipment in close connection with the teaching methodology, self-study, assessment and self-assessment, covering a wide range of professional skills, improvement of routine training and pedagogical control of the development of so-called "hard" skills, through self-training, automation of this process and the release of a colossal resource - the hours of work of the teaching staff with the preservation, and in some cases with the improvement of the quality of practical training of students.

Technical result:

- the opportunity for students to independently perform procedures from start to finish;

- training to the result at a convenient time with the required number of repetitions;

- freeing the teacher from routine work, allowing more attention to work where he is irreplaceable (for teaching decision-making, communication skills, team interaction and improving activities in general);

- the use of uniform requirements for the implementation of procedures.

This task is solved by a transformable educational platform for simulation exam and training (TOPSET), which contains:

• any, available in the educational organization, medical simulator of the human body or any of its parts;

• medical equipment (or its simulation) and consumables needed to perform the manipulation;

• Control block;

• at least one monitor (LCD demo panel);

• at least one interactive tabletop (as part of the body) with an LED panel built into the working surface to display the layout of the medical specialist's workplace during training and passing the exam;

• at least two cameras for video recording of the process of passing the exam from different angles;

• at least one microphone for audio recording of the examinee's voice;

• at least one mobile device of the teacher;

• at least one mobile device of the trainee;

• portable router for combining system devices into a single network;

• preinstalled software that provides identification of the person (cadet, teacher, administrator) and the implementation of training and examination functions

• software providing the creation and editing of training and control materials in the required format

• a portal with the ability to receive created and edited materials and distribute them to the sets connected to the portal (Web portal: see, for example: https://zen.yandex.ru/media/id/5b64be5b505f6500a95d481c/ webportal-vidy-otlichiia-ot -saita-5dc42cb9d5bbc300b1f52625);

• at least one light source for better visualization of the manipulation field;

• at least one headphones for playing the training audio.

It is advisable to make the body on hardware wheels with a shaft for at least one retractable monitor and cameras, a folded shelf to increase the area of the working surface of the table and under-table closing drawers for equipment and consumables.

The body can contain two monitors (like a multi-screen analogue): for demonstration of training videos and playback of a cadet's exam recording.

The invention is illustrated with corkscrews.

FIG. 1 shows a block diagram of a transformable educational platform for simulation exam and training.

FIG. 2 shows a general view of the case - the main element of the system in a mobile state.

FIG. 3 shows a general view of the case in working condition.

FIG. 4-7 show examples of an interactive tabletop with a human body medical simulator and medical equipment or its simulation and consumables.

FIG. Figures 8-13 show illustrations of the kit options in working order.

FIG. 14-15 show examples of monitor images.

For ease of use, the set (platform) should be mobile and easily transformable and is, in a folded state, a table on hardware wheels 1 with a shaft 2 for a retractable monitor (monitors) and cameras, a folded shelf 3 to increase the area of the working surface of the table and under-table closing 4 drawers for equipment and consumables and an LED panel 5 built into the working surface of the table.

The dimensions of the complex are selected in such a way that it can be moved around rooms with standard doorways with a width of 800 mm and more. The body is made of carbon fiber, which provides the necessary strength while saving weight, which also favorably affects the mobility of the complex. The working surface of the table (on which most of the skills are practiced) is an interactive tabletop (LED panel) 5 for quickly changing the layouts of the working surface (see Fig. 4-7), protected by tempered frosted glass. Glass matting is performed to eliminate the glare effect during video recording of actions on the working surface.

In the working (unfolded) state, a demonstration monitor 7 (with a multi-screen function - see Figs. 14-15) is pulled out of mine 2 using lifting mechanisms, with a rotary bar fixed above it with an anti-aircraft camera 8 and a front camera 6 on a flexible support. Monitor 7 displays the software interface of the complex to the user and selects and activates the required option. Anti-aircraft and front cameras 8 and 6 carry out video and audio recording, from two angles, of all actions performed on the working surface of the table. If more than 2 cameras are required to visualize the student's actions, it is possible to connect additional cameras.

To control the system, a mobile device (tablet) with a Wi-Fi module and an established connection with the control unit is used.

The hardware part of the system includes the following set of devices:

- control unit 9;

- monitor 7 (for demonstration of training videos and playback of the cadet's exam recording);

- an interactive tabletop 5 for displaying the table layout during training and passing the exam (depending on the hardware configuration, the monitor can be replaced by an LED panel) with a medical simulator of the human body 10 and medical equipment or its simulation and consumables 11;

- mobile device of cadet 12 to control the training mode, examination mode and self-control;

- teacher's mobile device 13;

- two IP cameras or Web cameras for video and audio recording or broadcasting of the exam passing process from different angles (items 6 and 8);

- Wi-Fi router 14 for combining devices 12, 13 and control unit 9 into a single network, as well as for connecting IP cameras;

- headphones 15;

- identity ID 16 (student, teacher, administrator), for example, RFID node.

- portal 17.

Algorithmization of skills and the creation of an assessment checklist on this basis is one of the most time-consuming tasks to be solved when creating the declared system.

The main problem is the choice of a specific algorithm and standard of activity with unambiguous criteria for confirming the correctness of execution, which meets the requirements of most experts (teachers). So, for example, the Algorithms of Technologies of Simple Medical Services were taken into account without fail, which in turn were detailed with information from SANPIN 2.1.7.2790-10 "Sanitary and Epidemiological Requirements for Organizations Carrying out Medical Activities", WHO recommendations on safe injection and other data, obtained by evidence-based medicine (EVM), therefore, the process of creating assessment criteria is stretched over time.

The assessment of the actions of the subjects in the TOPSET is carried out in the system of penalty points.

The reference execution is broken down into elementary stages (an action algorithm with external criteria for correct execution). To get an idea of the applicant's level of competence in this skill, each elementary stage of the skill is assessed. The stage is evaluated according to the pass / fail system. Each stage in the assessment system has a certain weight in penalty points, the size of which depends on its significance for the final result of the manipulation. Also, for every second spent on the procedure, the corresponding number of penalty points is awarded.

A specific feature of the evaluation system in penalty points is the presence of a conflict of requirements in it. On the one hand, it is necessary to reduce the time, the number of movements, consumables, which in real practice contributes to economic efficiency. On the other hand, such an approach increases the risk of making mistakes and failing to comply with the requirements of the sanitary-epidemiological regime, which in real practice leads to failure to achieve the goals of manipulation and failure to provide assistance to the patient or even worsen his condition.

Ensuring competence is only one component of a quality assurance program, but it is by no means unimportant.

The objectivity of pedagogical assessment increases if the measurement results are processed by mathematical methods and accompanied by characteristics of measurement accuracy, validity and reliability. Such systems are successfully used in computer testing, which is mainly aimed at assessing knowledge and mental skills.

In the training videos, all manipulations are recorded in fragments, with detailed comments on each element. The virtual trainer on the screen, clearly follows the instructions of the virtual commentator, demonstrating in detail the smallest details of the manipulation. For better visualization, individual fragments of manipulation are shown in close-up in a separate pop-up window on the screen.

All lessons in TOPSET are compiled according to algorithms that have a single 4-step structure:

Manipulation stage

Manipulation stage

Manipulation point

Manipulation point sign

The point weight in points is formed on the basis of: 1) its duration in seconds in relation to the duration of the entire scenario, 2) a sign of criticality, 3) a penalty for leaving the corridor of acceptable values taken from sensors, with conditions depending on other points in the scenario.

Equivalent to Failure Manipulation (EMF) = total duration of the script.

Initially, the weight of each structural unit is equal to its duration in seconds. Then the criticality of the units is put down and their weights are calculated according to the following algorithm:

1) Failure to complete each Stage is critical, therefore, Stages, as a rule, have a Critical sign. In this case, ENM is added to the weight of the Stage and it is distributed among the points of the Stage once in proportion to the duration of each point.

2) The next level of calculation is the critical point. If the item is critical, then the ENM is added to its weight, and the updated weight of the item is added to the weight of the Stage it belongs to, and the updated weight of the Stage, in turn, is added to the weight of the corresponding Stage.

3) The last level of criticality distribution is the Stage. If the Stage is critical, then the ENM is added to its weight, and the ENM is added to the weight of the Stage it enters into, and the change in the Stage weight is distributed among all the points included in it, in proportion to their duration.

Determining the desired learning outcomes plays a key role, both in an individual lesson and throughout the curriculum. It is important both the list of practical skills that need to be mastered and the level of proficiency in them. When using a skill development model, clearly defined outcomes and learning environments are highly influential.

User statuses consist of 4 roles

one. Administrator status - is intended for employees of the training structure engaged in management and / or administration of the system operation process and allows:

a. administer cadets (add new cadets to the complex and remove existing ones from it)

b. administer teachers (add new teachers to the complex database and remove existing ones from it)

c. choose a way to authorize users (student, teacher, administrator):

i. automatic (using the face detection function)

ii. manual (using login or login / password)

d. choice of exam format:

i. with cadet speech recognition function

ii. without cadet speech recognition function

e. retrieve exam results

2. Cadet status - intended for cadets and allows:

a) choose the lessons assigned to the student

b) view the recording with the virtual coach

c) exercise

d) record the examination video

e) independently evaluate their own examination video against the assigned checklists

f) send the most successful performance to the teacher for review

g) review the results of the assessment by the trainer

h) compare your results over time, as well as with the average, maximum and minimum among all participants

i) additional opportunities for testing mental skills (choice from the proposed options)

3. Teacher status - intended for teachers and allows you to:

a) check the exam videos previously made by cadets and make changes to the assessment results according to checklists filled out by cadets during self-assessment

b) evaluate the cadet's actions online (including remotely) according to the assigned checklists

c) receive statistical data on the training and examination activity of cadets using the built-in system of various filters

d) receive statistical data on the performance / non-performance of certain items of checklists by cadets

e) formation of examination sheets and export of results

f) managing cadet rosters

4. Designer status - intended for experts and technical specialists involved in creating new and updating old lessons, as well as improving and maintaining software and allows you to:

a. install new lessons in the software

b. edit existing lessons

c. remotely assign to different Platforms a list of available lessons

Status Description Administrator

The system is always logged in via login and password. For the administrator, the login and password are generated by the manufacturer during the installation of the software.

The administrator, starting to work with the platform, must pass authorization in one of two ways:

• automatically using the face recognition system

• manually

After logging into the system, a window for selecting actions opens, in which the following actions are available to the Administrator:

• transition to managing the list of cadets

• transition to managing the list of teachers

• exit from the System and return to the form for entering username and password.

In the interface for managing the list of cadets, the administrator has the following actions:

• adding units, groups, cadets;

• registration of cadets' faces for automatic entry into the system;

• editing the entered information of units, groups and cadets;

• single and group removal of units, groups and cadets.

Adding new users occurs in stages, first a unit (faculty / specialty / organization) is added, then a group within this unit is added, and only then the student (s) can be added.

Those. while there are no subdivisions and groups, the functionality of adding a cadet is unavailable, similarly until no subdivisions have been added, the functionality of adding groups is not available. A subdivision refers to an external organization or a structural subdivision of an organization in which this software operates. After adding an organization, the interface for adding cadet groups becomes available. Management of units, groups and cadets is carried out using the same type of controls located above the corresponding lists

Cadet Status Description

A cadet, starting to work with the platform, must pass authorization in one of two ways, which the administrator has chosen for him, having previously entered his data into the system:

• automatically using a face recognition system or via an RFID card

• manually, by selecting your unit and group and entering your last name, first name and (possibly) patronymic in the appropriate fields

The cadet's workplace can be launched from the simulator (for example, the touch screen of the monitor 7) or from a mobile device (tablet) 12 (two-tablet configuration).

After authorization, four modes become available to the student:

• "Training mode" - viewing video lessons in order to familiarize yourself with the material on which the training is carried out;

• "Exam" - during the examination, a video recording of the process of performing medical skills by the cadet is made;

• "Self-control" - allows the student to independently assess the level of mastering the required medical skills.

• "Performance Statistics" - Allows the trainee to see their performance relative to other participants who have completed similar medical skills.

In the Training mode, the student has the opportunity to select a lesson from the corresponding section and activate it. In case the number of lessons entered into the System makes it difficult to choose the necessary one, a search function is provided. To activate it, you must click the "Search" button.

After clicking the "Search" button to the right of it, a search query input field will appear. As you enter characters, lessons will be selected whose titles contain a sequence of characters from the search string. When you find lessons to the right of the search bar, search results navigation buttons appear.

When a lesson is activated, the table layout corresponding to the selected lesson is visualized on the interactive tabletop 5. The layout of the working surface for the lesson fully corresponds to the layout of the working surface of the table in the training video (monitor 7) and helps the cadet learn to perform actions in the most ergonomic way, using the working surface of the table as efficiently as possible. Also, when the lesson is activated, 4 video files become available to the cadet:

1. Demonstration front

2. Demonstration anti-aircraft

3. Teaching frontal

4. Training anti-aircraft

In the demonstration videos, the student can see the reference execution of the manipulation without comments and explanations, i.e. as close as possible to how it is done in real practice. In fact, this is a demonstration of what the exam video should look like, which is to be recorded by the cadet.

The lesson navigation system constantly informs the cadet at what stage of manipulation he is. The cadet has the ability to pause the video clip, go back and vice versa, move forward. For the convenience of the user, the lesson navigation system provides the ability to select the desired stage of manipulation, which allows the student to concentrate on the most interesting fragments of the manipulation.

When watching a tutorial video in single tablet mode, the entire navigation system is displayed on the simulator screen. When viewing the training video in a two-tablet configuration, the viewing control is carried out using the student's mobile device (tablet) 12.

In addition to the navigation system for the lesson, the training video implements a system of pop-up and called prompts, which provide a rationale for the actions shown, namely:

• links to normative and regulatory documents

• data from clinical trials

• statistical data on the outcome of manipulation

• other information

Since the Tutorials are presented in two angles, the system itself offers the most informative angle for each stage, but the student can independently choose the angle.

The student can switch between the stages and sub-stages of the lesson by clicking on the name of the stage (sub-stage) in the list of actions (checklist) or rewind the video using the rewind slider. If necessary, you can call the help screen by pressing the button with a question mark ("?").

In the Exam mode, the student has two modes:

• Starting the exam

• Commission (Online check)

In the "Start exam" mode, the student records the video of the execution, worked out by him in accordance with the manipulation lesson. In the course of its execution, the time is counted, which is accompanied by sound signals after 25% of the time, 50% and 75%. At the end of the time allotted for manipulation, video recording stops. When completing the execution before the expiration of this time, the student can use the "Finish" button. When using the "Virtual Patient" mode, on monitor 7 (one of the screens of monitor 7), an animation with a patient appears, who communicates with the cadet through the "Speech Recognition" system, within the specified algorithm.

The "Commission (Online Checking)" mode is implemented from a mobile device (tablet) 12, where an opportunity opens up for on-line assessment of the examination performance checklist. This mode allows, when a student starts an Exam, another person activates the checklist and evaluates the examiner's actions. This mode is intended for pair training of two cadets at the same time. One performs the manipulation, the second evaluates his actions according to the checklist, then the participants change roles. Also, this mode allows simultaneously performing educational manipulation in the "Exam" mode, to receive data to send to the teacher, saving the received data in the "Self-control" mode.

The exam results contain the following information:

• time of passing the exam in seconds: spent / maximum allowed;

• points scored when passing the exam;

• a link to switch to the self-control mode of the passed exam - "Perform self-control";

• link to go to the next exam - "Go to the next exam";

• link to shutdown and log out of the account - "Shut down".

After passing the exam, all data on the results will be available for the cadet in self-control mode and only after that they can be available for the teacher.

In the Self-control mode, the trainee can access all the videos recorded by him in the Exam mode. Entering the "Self-check" mode in single-plate and double-plate configurations can be done in two ways:

• in the "Exam" mode, press the "Go to self-control" button;

• on the main screen of the cadet's workplace, press the "Self-control" button.

When switching to the self-control mode from the main screen of the workplace or by clicking the link “Pass self-control of other tests”, you must select the exam record for self-control in the list of all attempts to pass exams by the student.

The student is shown on the screen a list of all his attempts to pass the exams with the corresponding results. The transition to self-control is performed by clicking on the line with the name of the exam.

During self-monitoring, the following functions are available:

• switching between the image from the frontal and anti-aircraft cameras on the screen of the monitor 7 (see Fig. 14, 15);

• group installation or removal of marks on the branches of the algorithm in the electronic control sheet;

• saving the results to the database

• During self-control, the cadet observes his actions on video recording from the front 6 and anti-aircraft 8 cameras of the simulator and notes in the electronic control sheet displayed on the simulator screen the fact of performing or not completing the action required according to the algorithm for performing the skill.

• After saving the test results of the exam, the self-test results window will be displayed. The scores gained during the check will be displayed in the "Self-control" column, both for the teacher in the check mode and for the cadet, while the exam status will not depend on the number of points.

The teacher checked, passed exam displays the "Pass" status in the list of all available exams when choosing a skill. The trainee can take the exam (record his own video) and grade it at different times. The assessment of each performance can be phased: first, the result appears in the form of duration, then an automatic software assessment, then a self-assessment. And if, self-assessment, corresponds to the passing score set in the software, then the System allows you to send this performance for verification to the teacher. The green highlight is the performance assessed by the passing grade, red - by the non-passed one.

In order to send a video for verification, you must:

1) conduct a self-assessment

2) score a passing grade as a result of self-assessment

3) confirm that all elements of self-esteem were well visualized

Status Description Teacher

The teacher, starting to work with the platform, must pass authorization in one of two ways, which the administrator has chosen for him, having previously entered his data into the system:

• automatically using the face recognition system

• manually (login and password).

The teacher's workplace is launched exclusively from a tablet computer.

After logging into the system, a window for selecting actions opens, in which the following functions are available to the user:

• "Test mode" - checking the assessment of the skill performance by cadets

• "Error rating" - viewing the rating of errors for the checked tasks

• Export of scan results

• transition to the management of the list of cadets registered in the System by pressing the button "Administration of cadets"

In the test mode, the teacher chooses the method of checking the completion of the assignment by the student. Verification can be performed in real time - online verification and verification after completion of the task - offline verification.

In turn, the online check can be performed in two ways: starting the exam from the teacher's mobile device (tablet) 13 and connecting to the exam started by the cadet in commission mode.

In the first case, the teacher starts through the "Start exam" check mode, having a list of examinees in front of him. To start the exam, either the teacher chooses the examiner from the list and he starts the execution, or the examiner starts by attaching his card to the RFID-node 16 before that, while he himself is not included in the System. With this method of starting the exam, the grade immediately falls into the section of the teacher's assessment and, depending on the available settings, the System itself assigns the status "Passed" or "Failed" to this entry.

"Starting the exam" is carried out in several steps:

• selection of a lesson (if the number of lessons entered into the System makes it difficult to select the required one, a search function is provided, for which you need to click the "Search" button and a field will appear to the right of it, as you enter characters, lessons will be selected whose names contain a sequence of characters from the search string)

• selection of a cadet (a window opens with forms for selecting a unit, group and a list of cadets of the selected group)

• launch and conduct of the exam (either by choosing the desired surname from the list, or by auto-opening a line using RFID identification)

In the second method of on-line verification "Commission (Online verification)", it is necessary that one of the cadets is authorized in the system. And, when the student starts the exam mode "Start exam", the teacher will be able to conduct the assessment in real time. In this case, the teacher's assessment falls into the "Commission" section of the exam results table and can be saved or changed by the student in the "Self-control" mode.

After clicking the "Start exam" button on the teacher's tablet, a window for managing the exam process with an electronic expert control sheet opens. During the exam, the teacher observes the actions of the cadet and notes in the electronic control sheet displayed on his tablet, the fact of completing or not completing the action required according to the algorithm for performing the skill.

Also, the teacher has the opportunity to observe the actions of the cadet, broadcast from the front 6 and anti-aircraft 8 cameras of the simulator. In the process of managing the exam, the teacher has the following functions:

• enable or disable hidden mode;

• switching between images from the frontal and anti-aircraft cameras;

• group installation or removal of marks on the branches of the algorithm in the electronic control sheet;

• stopping the exam;

• saving the results to the database.

Offline examination of the exam involves checking the results of the exam after its completion by video recording. To perform an offline check, you need to make sure that no cadets are working on the simulator and select a saved record. You can search for a record by the name of the lesson (exam) or by the last name of the student by selecting it in the heading of divisions and groups.

During the offline exam, the teacher observes the cadet's actions by video recording from the front 6 and zenith 8 cameras and notes in the electronic control sheet displayed on his tablet 12 the fact of performing or not performing the action required according to the algorithm for performing the skill. After checking the exam, you must save the results to the simulator database by clicking the "Save" button.

The "Error rating" mode allows you to view the error statistics for each lesson (skill) by going to the corresponding section. After selecting the required lesson in this form, a table with error statistics for each item on the expert control sheet opens. The teacher has the ability to export the data from this table to a Microsoft Excel file by clicking on the "Export" button.

By pressing the "Export" button on the main screen of the teacher's workplace, a form with the structure of cadets opens in which the cadets whose results must be exported are ticked off. By clicking on the "Export" button, a file is generated in Microsoft Excel format with the results of the selected cadets.

Cadet records are administered in the same way as an administrator.

Status Description Constructor

The person who has the authority to create content, when starting to work with the platform, must be authorized. Design functions are carried out through the software on the main server and, if there is an Internet connection, it can update and communicate with all user devices.

The "Constructor" window contains useful information and recently changed objects, "Selected" lessons (skills), the total number of lessons (you can open a list of scenarios by clicking), users, and other summary information.

Each structural unit (checklist item) can have a duration in seconds and necessarily has a weight in points. For each structural unit, a start and end timecode (in seconds) from the associated video can be specified.

Lesson - a sequence of points and sub-points of the tree structure associated with a video clip does not have cycles (since, as a rule, it is associated with a video).

Each lesson in the "Design" mode can have the statuses: In the process of creation, Approved, Published. An approved lesson cannot be edited. A published lesson cannot be deleted. All lessons can be seen in a single list of lessons.

Any checklist has a structure (structural units of the lesson)

- Stage

- Stage

- Paragraph

- Sub-item (sign of a manipulation item).

The structural unit of the lowest level (sub-item) can be linked to the Evaluation Heading (additional analytical feature), and only to one.

Each structural unit can be tagged (tags are put on it), and there can be more than one tag. Tags can be assigned automatically and / or manually.

Each structural unit can be identified with a pictogram. An icon editor and loading icons from a file should be available.

The structural unit of the lower level can be integrated with the sensors of some mannequins (10 human body simulators) and other sensors (for it, the corridor of permissible property values and penalties for leaving the corridor are indicated). Properties can be defined for the lower level structural unit. For example, the properties "Degree of depression" or "Ventilation volume" for integration with sensors. Each structural unit has default properties "Start", "End", "Duration" and "Weight".

For each lesson, the layout (drawing) of the working LED table (panel 5) is set in the format 320 * 128 pixels. The layout marks the location for some of the lowest-level structural units. Subsequently, the System monitors the compliance of this fact when evaluating in a special mode.

Each structural unit can be marked as critical, which will be automatically reflected in the weighting factor of this item. Also, each item has an information window, where information can be added for explanations and links to norm-forming information that can be retrieved by the Cadet by clicking on the button with a question mark.

If a structural unit contains nested items, it can be declared cyclical. When executing the script, the looping structures can be executed any number of times (that is, they are not considered completed when the last point is executed, but the counter goes to the beginning of the structure), the actual exit from the loop (the end of the looping Stage) will need to be specified explicitly.

For each scenario unit, you can specify an extended formula for its weight using:

- scenario item numbers (the link to the item is updated when the structure of the scenario changes),

- properties of each item, including basic ("Start", "End", "Duration", "Weight") and specific to a specific item (for example, "Volume of ventilation" or "Degree of depression"), - logical operators, - arithmetic operations , - numbers entered from the keyboard.

To ensure the operation of the system, the following technologies can be used to automate processes:

1) Integration of training video with checklist items

2) Integration in a single user window of reference video, cadet video and checklist

3) Face recognition

4) Object recognition

5) Speech recognition

6) RFID - node

7) Database maintenance

8) A single portal through the Internet connection

The integration of the training video with the checklist items occurs when creating a lesson in design mode; later, when using this function, the user in the "Cadet" status can start watching the video from any place by selecting the corresponding checklist item. Also, when creating new lessons, the System identifies similar options in the database (stages, stages, points and sub-points) and offers them. If stages, stages and points are similar, the system suggests them along with children and penalty points. If a sub-element is similar, only a penalty point.

Integration in a single user window of reference video, cadet video and checklist is performed automatically using a special function for adding recorded video in the "Exam" mode

Face recognition is carried out for the additional convenience of maintaining a database of cadets, their quick authorization in the System, as well as to ensure the procedure for identifying a person in the exam and regulating admission. For face recognition, you can, for example, use the VeryLook solution from NeuroTechnology.

Object recognition will help to automatically evaluate the required set of tools and consumables 11, etc. determined by the algorithm (checklist) for each lesson.

Speech recognition using a special program helps to solve three problems: 1) increase the degree of exam realism without using additional human resources in the form of simulated patients in hybrid simulation; 2) add variability to the performance of procedures by changing the prescription sheet (name, age, gender of the patient, name of the drug, its dosage, etc.); automatically evaluate the questions asked to the patient in the checklist in accordance with the checklist.

RFID - node 16 allows for faster identification of cadets in the exam, additionally ensuring the launch of the necessary software, opening the doors (access at a distance). This function is necessary to automatically determine the student and completely exclude the human factor from the certification results. When using these tools, the teacher no longer has to select the person to be assessed from the list or enter his number, which will eliminate the possibility of error. Access by RFID key to the station can be developed on the basis of existing access control systems, or from scratch based on data processing from RFID readers via USB or | RS232 / 485 interface.

Database maintenance - allows you to monitor and track the number of attempts, lists of skills and the level of preparedness of the array of students.

A single portal 17 via the Internet allows you to provide a single node for creating and editing content, updating it on all devices, as well as providing information support for the project.

Statistical data processing

The system calculates technical and true scores for each lesson. Statistical processing of measurement results in order to obtain true scores in the framework of the classical test theory includes several stages:

Formation of a matrix of answers. Each element of measurement (checklist item, lesson, assessment heading) consists not only of dichotomous tasks (done right / not done right), but there is also an indicator that did not have time to reach this point (lesson, assessment heading). Therefore, all elements of the matrix can have the value "0" - completed, "1" - not completed (did not manage to execute), "2" - an error (not completed in the process). The test subject's technical score is formed using the sum of the products of the matrix element and the weight of each item.

Culling . Before proceeding to the analysis of data based on the results of all measurements (estimates), the system culls - rows (checklist items) and columns (performers), consisting entirely of 0, 1 or 2, are deleted, i.e. delete items that no one was able to complete, on the contrary, they completed everything or did everything with an error. Likewise with cadets - for those who completed all the tasks or did not cope with any of the tasks, the true score cannot be determined using statistical processing.

Determination of the density of distribution of measured points, showing the ratio of the sizes of various groups of subjects (contingents) who received low, medium and high points. Calculation of the average values of the primary scores and the calculation of the variance of these scores. The average value of individual scores is calculated as the arithmetic mean of all scores: The variance (variation) of scores characterizes the measure of dispersion of individual scores of the subjects relative to the mean. Dispersion (δ) plays an important role in assessing the quality of a measuring instrument with an appropriate choice of the level of training (assessment scale). The normal distribution is characterized by the fact that the extreme values of the trait in it are quite rare, and the values close to the average are quite often.

, а сложные (

Если экспертным путем определялся уровень сложности пункта, то пункты первого уровня сложности должны соответствовать значения трудности

; пункты второго уровня сложности -

и пункты третьего уровня сложности -

В случае несовпадения предполагаемого уровня сложности пунктам необходим анализ причин несовпадения. Calculation of the difficulty of the checklist item, the entire lesson, the assessment heading. The optimal value of the measure of difficulty for any task with a coefficient of difficulty is 0.5. Easy items and lessons are those that have a difficulty rate

, and complex (

If the level of difficulty of an item was determined by an expert, then items of the first level of difficulty should correspond to the value of difficulty

; items of the second level of difficulty -

and items of the third level of difficulty -

In case of mismatch of the estimated level of complexity, the items need to analyze the reasons for the mismatch.

Calculation of the differentiating ability of checklist items, lessons, headings (discrimination). The purpose of creating many assessments (measurements) is to provide information on individual differences between trainees. Items, lessons, rubrics should be able to distinguish between cadets with different levels of training. Cadets, depending on the level of their training, hand over any skill in different ways. According to the final assessment, all cadets (a specific sample) are ranked and divided by this indicator into two groups: 50% of poorly trained and 50% of highly trained

For each item of the checklist (by lesson or by heading), the discriminative index (r _dis ) is calculated as the ratio of the average score of poorly trained to the average score of highly trained. The discrimination coefficient can take values from - 1 to +1. A high positive indicates that really well-trained cadets do a good job with this checklist item or with the lesson as a whole or with the heading, and vice versa, poorly prepared cadets do not fulfill this item or do not cope with this lesson or this heading. A high negative value indicates that this item of the checklist, lesson or heading is performed well by poorly trained cadets, and vice versa, well-trained cadets do a poor job with this item, lesson, heading. Zero or close to zero (both positive and negative) indicator indicates that there is no connection between the success of the cadets and the performance of this item or lesson in general. The index of discrimination can be measured with or without weighting factors.

Calculation of the correlation between items of checklists and lessons. You can use the correlation coefficient to assess the relationship between the results of the lessons. The higher the correlation coefficient between lessons, the stronger the level of preparation for them is connected. To measure current performance, the correlation coefficient between assignments should be as close to 1 as possible, which means that cadets who are strong in other skills are successful in this skill as well, and vice versa.

Measurement reliability (Cronbach's alpha). One of the options for calculating the reliability coefficient is presented as the correlation coefficient of experimental data in relation to the sample.

Measurement validity . Validity is understood as a characteristic of the quality of a measuring instrument, focused on assessing the adequacy of a set goal. Those. validity is a measure of the suitability of results for a particular purpose, i.e. compliance with its purpose. The concept of validity unites its various types, which have their own special meaning. Some types of validity can be assessed statistically, others require the involvement of experts.

Estimation of the measurement error and construction of the confidence interval. Knowing the reliability of the estimate, it is possible to estimate the standard error of the measurement. The resulting value is used to construct a confidence interval within which the true value of the subject's score is most likely located. To build the confidence interval, the error level is initially selected. Usually in pedagogy, a 5 percent level is used: (the probability of an error in 5 cases out of 100). To construct the interval, the Student's t-test is used.

In any case, the accuracy of measurements depends on the number of attempts (cadets) and the number of skills, i.e., the more measurement results, the more fair the assessment of the level of preparedness will be. Therefore, in order to standardize the assessment of this measuring instrument, the true passing grade can be established after receiving a large amount of data. Ultimately, a truly high level of practical excellence is very important for patients and therefore important for professionals wishing to be successful professionals.

Thus, the statistical analysis of the results is an important tool for assessing the level of training of cadets. The features of the assessment of professional qualifications are its integrative (holistic) nature, the need to carry it out in conditions as close as possible to real ones. A simple summation of the results of assessing knowledge and skills does not make it possible to judge the readiness to apply them and cannot lead to a conclusion about the availability of professional qualifications. Appraisal of practical training requires several steps, including the use of standardized grading scales. Increasing the realism of the simulation, as well as the multi-stage use of each skill, differentiates the level of achievement. In order to increase the validity, discrimination, as well as reduce the variance of the results, it is rational to increase the number of skills performed in the teacher's test mode. This form of assessing cadets using checklists and using a system of penalty points allows not only to carry out a statistical analysis, but also to identify both organizational flaws and weaknesses in the training of cadets.

Claims (5)

1. Transformable educational platform for simulation examination and training, containing at least one set consisting of at least one medical simulator of the human body, medical equipment or its simulation and consumables necessary to perform the manipulation, control unit, at least one monitor , characterized in that the kit contains an interactive tabletop of the case with an LED panel built into the work surface to display the layout of the medical specialist's workplace during training and passing the exam, at least two cameras for video recording of the exam passing process from different angles, the control unit contains blocks "mode administrator "," teacher mode "," cadet mode ", the system also contains at least one mobile device of the teacher, at least one mobile device of the student and a router for combining system devices into a single network, as well as a preinstalled program mm software that provides personal identification and the implementation of training and exchange functions, software that ensures the creation and editing of training and control materials, while the system includes a portal made with the ability to receive created and edited materials and distribute them to the kits connected to the portal, as well as block "constructor of modules" connected through the portal with the control unit. 2. Transformable educational platform according to claim 1, characterized in that each set contains at least one light source for better visualization of the manipulation field. 3. Transformable educational platform according to claim 1 or 2, characterized in that each set contains at least one headphones for playing educational audio. 4. Transformable educational platform according to claim 1 or 2, characterized in that the case with an interactive table top is made on hardware wheels with a shaft for at least one retractable monitor and cameras, a folded shelf to increase the area of the table's working surface and under-table closing drawers for equipment and consumables. 5. Transformable educational platform according to claim 1 or 2, characterized in that the set contains two monitors: for demonstration of training videos and playback of the student's exam recording.

Images