KR102211108B1 - VR-based clean verification procedure training system of biological safety cabinet for GMP environment monitoring - Google Patents

Abstract

The present invention relates to a virtual reality-based biosafety cabinet sterility verification procedure training system for GMP environment monitoring. According to the present invention, in a virtual reality based BSC sterility verification procedure education system, an HMD device mounted on a user's head to display a virtual reality image and guiding a training scenario corresponding to the work procedure, and the training scenario A communication unit receiving motion information corresponding to the hand motion from a hand motion sensor that senses the user's hand motion according to the user's hand motion, and the virtual reality image in which the BSC, the user's hand, and a plate for sterility verification are implemented as a 3D object in a virtual space. , Guide information for guiding a training scenario is provided to the HMD device, and in response to the received motion information, the plate prepared to be loaded on the worktable of the BSC in the virtual reality is moved one by one to a predetermined point on the worktable according to a predetermined procedure. And a control unit for virtually simulating a work procedure training for sterility verification, and an evaluation unit for converting an evaluation score corresponding to a user's motion for each work procedure on the training scenario based on the simulation result and providing an evaluation result.
According to the present invention, it is possible to easily and conveniently train a working procedure for sterility verification of a biosafety cabinet in a virtual reality environment without a separate temporal and spatial constraint.

Description

VR-based clean verification procedure training system of biological safety cabinet for GMP environment monitoring}

The present invention relates to a sterility verification procedure training system and method of a virtual reality-based biosafety cabinet for GMP environmental monitoring, and more particularly, to a biosafety cabinet (BSC) disposed and operated in a GMP (Good Manufacturing Practice) facility; Biological Safety Cabinet)'s sterility verification procedure training system and method for virtual reality-based biosafety cabinets that assist in training procedures for sterility verification in a virtual reality environment without any restrictions.

In general, the BSC (Biological Safety Cabinet), which is deployed and operated within GMP (Good Manufacturing Practice), is a facility that produces cell therapy products or medicines, and must exist in a sterile state without contamination sources such as fine particles and bacteria.

Standard procedures have been established to demonstrate the sterility of these BSCs. Until now, bio personnel in the BSC within GMP are directly undergoing a process of confirming (testing) sterility according to standard procedures, and it is desirable in terms of facility maintenance that all processes are performed by bio experts. As such, highly trained bio-professionals are required to proceed with the BSC's sterility verification process, but the pool of human resources in the bio field is not large.

Moreover, in order for a beginner such as an unskilled person to learn the work, it is necessary to receive an explanation from an educator directly in the GMP facility or in a separate training center and proceed with the practice. However, it is inefficient to consume GMP facilities for training/education, not for experiments and cultivation, and there is a problem of concern about damage to facilities by unskilled persons during the training process.

The technology behind the present invention is disclosed in Korean Patent Publication No. 10-2007-0023905 (published on Mar. 2, 2007).

The present invention is a sterility verification procedure of a virtual reality-based biosafety cabinet for GMP environment monitoring that enables trainees to easily train in a virtual reality environment a working procedure for verifying the sterility of a biosafety cabinet operated in a GMP facility It aims to provide an educational system and its method.

The present invention is a virtual reality-based BSC sterility verification procedure education system for training a sterility verification work procedure of a bio safety cabinet (BSC), mounted on a user's head to display a virtual reality image and correspond to the work procedure. An HMD device for guiding a training scenario, a communication unit for receiving motion information corresponding to the hand motion from a hand motion sensor that detects the hand motion of the user according to the training scenario, and the BSC, the user's hand, and a plate for sterility verification are virtualized. The virtual reality image implemented as a 3D object in the space and guide information for guiding the training scenario are provided to the HMD device, and a plate ready to be loaded on the workbench of the BSC in the virtual reality is provided in response to the received motion information. A control unit that virtually simulates the work procedure training for the sterility verification while moving one by one to a predetermined point on the work table according to a specified procedure, and an evaluation score corresponding to the user's motion for each work procedure in the training scenario based on the simulation result Provides a virtual reality-based biosafety workbench sterility verification procedure education system including an evaluation unit that converts and provides evaluation results.

In addition, the control unit may process the guide information of the training scenario into at least one of text and an image and combine it with a virtual reality image of the HMD device to guide it, or process it into an audio message and provide a voice guidance through an earset external to the HMD device. can do.

In addition, the hand motion sensor may be mounted on a front surface of the HMD device to operate in synchronization with the HMD device.

In addition, the hand motion sensor may be mounted on the user's hand and operated.

In addition, the training scenario proceeds in a manner in which the floating balance plates and surface balance plates prepared to be loaded on the worktable of the BSC are moved one by one to a predetermined point on the worktable according to a predetermined procedure, and the loaded floating balance plates are moved from above. Falling bacteria verification training to hold one by one and place them down on a part of the workbench in order for a predetermined period of time, and move the floating bacteria plate placed on the floor over the airborne bacteria measuring instrument placed on the workbench of the BSC to maintain a predetermined time and then lower it to the floor again. At least one of the training for verifying suspended bacteria to be placed, and the training for verifying surface bacteria to be placed back on the floor after holding the loaded plates one by one from above and moving them to the inner wall of the BSC for a predetermined period of time to contact the bottom of the plate. It may include.

In addition, the evaluation unit compares the motion information of the user for each work procedure with a preset reference motion range corresponding to the work procedure, and assigns a predetermined score if it is within the reference motion range, and gives a predetermined penalty score if it is outside the reference range. It is given, and the training completion result can be provided based on the total converted score for the entire work procedure.

In addition, the control unit, based on motion information according to the user's hand motion and the object shape of the BSC, determines that the user's hand is in contact with the inner wall of the BSC during training, the wearable mounted on the user's hand A warning signal is transmitted to a device, and the wearable device corresponds to the hand motion sensor mounted on the hand, and may output vibration feedback in response to the warning signal.

In addition, the wearable device includes a plurality of vibration units mounted to correspond to the user's fingertips, and the control unit determines the detailed position of the hand in contact with the inner wall, and the plurality of vibration units It is possible to control the vibration to be output through a predetermined vibration unit corresponding to the identified position.

In addition, the control unit, a simple training mode in which the virtual simulation is performed, a training mode that provides the evaluation score after the virtual simulation, but provides an audio-visual warning feedback when the user's motion information is out of the reference motion range during the simulation, In addition, after the virtual simulation, the evaluation score may be provided, but at least one of the test modes in which the warning feedback is not provided during the simulation may be provided.

In addition, the sterility verification procedure education system may further include a recording unit for recording and storing the virtual reality image during the virtual simulation so as to record the user's training process as an image.

In addition, the sterility verification procedure training system further comprises an educator terminal provided on the trainer side and providing real-time display of the virtual reality image under the virtual simulation and receiving real-time input of coaching information of the trainer, and the control unit, The trainer's coaching information received from the educator terminal may be provided in real time to the HMD device.

According to the present invention, it is possible to easily and conveniently train a working procedure for verifying the sterility of a biosafety cabinet disposed and operated in a GMP facility in a virtual reality environment without a separate temporal and spatial constraint. Accordingly, it is possible to replace existing textbooks, video education, and field education methods with a virtual reality-based distance education and evaluation system, and there is an effect of increasing the education effect through the configuration of the GMP environment and repeated practice almost identical to the actual one. .

In addition, the present invention implements a program for training a sterility verification procedure for environmental monitoring of BSC in a GMP facility in virtual reality, so that trainees can be sufficiently trained without using an actual GMP facility, and the ability and skill to perform the procedure can be maintained. As it can be verified and improved, it is possible to prevent damage to high GMP facilities and property damage due to the input of facilities or practice by unskilled persons.

1 is a view showing the configuration of a sterility verification procedure training system of a virtual reality-based biosafety cabinet for GMP environment monitoring according to an embodiment of the present invention.
FIG. 2 is a diagram showing a detailed configuration of the training terminal shown in FIG. 1.
3 is a view showing the actual state of the biosafety cabinet implemented in a virtual reality environment.
4 is a diagram illustrating an operation function of a training terminal in an embodiment of the present invention.
5 is a diagram illustrating a vibration unit of a wearable device mounted on a user's hand in an embodiment of the present invention.
6 is a diagram showing a guideline for a general BSC performance eligibility evaluation method.
7 is a diagram showing an initial screen of a VR image in an embodiment of the present invention.
8 is a diagram for explaining a VR image-based falling germ verification training procedure in an embodiment of the present invention.
9 to 10 are diagrams for explaining a VR image-based airborne bacteria verification training procedure according to an embodiment of the present invention.
11 is a diagram illustrating a VR image-based surface germ verification training procedure according to an embodiment of the present invention.
12 is a diagram showing a simulation end screen in an embodiment of the present invention.
13 is a diagram illustrating allocation points for a series of processes applied in an embodiment of the present invention.

Then, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention.

The present invention is a virtual reality-based biosafety cabinet (BSC; Biological Safety Cabinet) sterility verification procedure training system for GMP environment monitoring, the sterility verification procedure of a biosafety cabinet (hereinafter, BSC) deployed and operated in a GPM facility. Provides virtual reality training contents in which training programs for education are implemented on virtual reality.

1 is a view showing the configuration of a sterility verification procedure education system of a virtual reality-based biosafety cabinet for GMP environment monitoring according to an embodiment of the present invention, and FIG. 2 is a detailed configuration of the training terminal shown in FIG. It is a drawing.

As shown in Fig. 1, the sterility verification procedure education system of the biosafety cabinet includes an HMD device 200, a training terminal 100, a management server 300, and an educator terminal 400, and is connected through a mutual network. It communicates information and transmits and receives various information.

In the HMD device 200, the training terminal 100 is provided on the user (Trainee) side, respectively, and the educator terminal 400 is provided on the trainer side.

The HMD device 200 communicates with the training terminal 100 in a one-to-one connection while mounted on the user's head. The HMD device 200 displays a virtual reality image transmitted from the training terminal 100 in real time, and may visually or audibly guide a training scenario corresponding to the sterility verification work procedure in real time. In this case, a screen of the HMD device 200 or an ear set linked to the HMD device 200 may be used.

The training terminal 100 receives motion information corresponding to the user's hand motion in real time from the user's hand or a hand motion sensor mounted on the HMD device 200 to support user interaction, and responds to the motion information. ) Real-time control of the screen of the virtual reality image being output. The training terminal 100 may include a PC, a desktop, a notebook, a smart phone, a smart pad, and a tablet PC.

The hand motion sensor detects the user's hand motion according to the training scenario and provides motion information corresponding to the hand motion. The hand motion sensor may be mounted on the front of the HMD device 200 and operated in synchronization with the MHD device 200 in a wired or wireless connection state, or communicated with the training terminal 100 in a state directly mounted on the user's hand. May be.

In the former case, the HMD device 200 may sense a user's hand motion in real time according to a training scenario through a hand motion sensor and transmit the detected motion information to the training terminal 100 in real time through wired or wireless communication. In this case, the HMD device 200 may additionally include information tracking the movement of the head into the motion information, and in this case, the upper body of the user including the hand may be shaped as an avatar object.

In the latter case, the hand motion sensor may correspond to a conventional hand mocap device, or the like, and may transmit motion information sensed in response to hand motion to the training terminal 100 in real time through wired or wireless communication. Here, of course, the hand motion sensor can be implemented in the form of a wearable device.

Training terminal 100, as shown in Figure 2, the communication unit 110, the control unit 120, the display unit 130, the storage unit 140, the recording unit 150, the evaluation unit 160, the statistics unit 170, It includes a playback unit 180.

The communication unit 110 is for communication and information transmission and reception with the HMD device 200 and the management server 300, and may use a wired, wireless, or wired/wireless communication method. In addition, the communication unit 110 receives motion information corresponding to the hand motion from the hand motion sensor.

The controller 120 provides guide information for guiding a virtual reality image and training scenario to the network-connected HMD device 200. Here, the virtual reality image is an image in which a BSC (bio safety cabinet), a user's hand, and a plate for sterility verification are implemented as 3D objects in a virtual space, and all objects are 3D modeled and expressed.

When guiding a training scenario, the controller 120 may support at least one of a visual guidance method and an audible guidance method. That is, the control unit 120 may process the guide information of the training scenario into at least one of text and an image and combine it with the virtual reality image of the HMD device 200 to guide it, or process it into a voice message to be external to the HMD device 200. Voice guidance is possible through the earset.

The virtual reality education content may be separately programmed and stored in the storage unit 140 in the form of software. Here, the software may correspond to an application program, an application, etc. that can be installed and executed in the training terminal 100.

The controller 120 can load and execute the corresponding software from the storage unit 140 upon user request, and display the corresponding virtual reality image on the HMD device 200, and the virtual reality displayed on the HMD device) based on user interaction. You can control the video in real time. The virtual reality screen executed through the controller 120 is transmitted to the HMD device 200 and displayed, and may be simultaneously displayed through the display unit 130, which is a self-contained monitor.

The controller 120 supports user interaction of a virtual reality image. In response to motion information received from the hand motion sensor, the control unit 120 moves the plates (e.g., petri dishes, chalets) prepared to be loaded onto the workbench of the BSC in the virtual reality image one by one to a predetermined point on the workbench according to a predetermined procedure to verify sterility. Work procedure training for the virtual simulation.

The structure of the BSC is already known, but briefly describing it is as follows.

3 is a diagram showing an actual state of the biosafety cabinet and a state of implementing the biosafety cabinet in a virtual reality environment, respectively.

As shown in FIG. 3, the biosafety cabinet has a worktable shape in which a user can work, and has an open structure in the front to allow hand input.

Although not shown, only the front surface (front) of the total six surfaces is open, and the remaining five surfaces (the bottom surface of the worktable, the upper surface facing the floor surface, the left wall, the right wall, and the rear (rear)) have a closed structure. , Bio personnel can access the interior space (work space) of the workbench through the open front (front) of the BSC.

The left figure of FIG. 3 illustrates a state in which plates used for the purpose of cultivating bacteria are placed on the bottom of the workbench, and the user grips some of the plates.

The figure on the right of FIG. 3 is a screen that captures a VR image in which BSC is implemented in a virtual reality space, and it can be seen that a BSC object, a hand object, and a plate object are each formed into a 3D model. Here, of course, the upper body object including the hand can be formed into an avatar and displayed together in a virtual reality image.

The display unit 130 may display the same screen as the image currently displayed through the HMD device 200 in real time. The storage unit 140 may store virtual reality education content and may store data such as user information, user training images, and evaluation scores, and share the stored data with the management server 300.

The recording unit 150 records a virtual reality image during virtual simulation and stores the recorded image in the storage unit 140 so as to record the user's training process as an image. Through this, the user searches the recorded video anytime, anywhere and plays the recorded video through the player function of the playback unit 180 to re-read his training process so that additional review and learning are possible.

The evaluation unit 160 converts an evaluation score corresponding to the user's motion for each work procedure on the training scenario based on the virtual simulation result of the control unit 120 and provides the evaluation result.

Here, the evaluation unit 160 compares the motion information of the user for each work procedure with a preset reference motion range corresponding to the corresponding work procedure, and if it is within the standard motion range, gives a predetermined point (positive score) and is outside the standard range. If it is, a penalty score (negative score) is given.

In addition, the evaluation unit 160 may provide a result of training completion of the user based on a total converted score for all work procedures included in one cycle of the training scenario. If the total converted score is greater than or equal to the reference value, it is determined that training has been completed, and if it is less than the reference value, it is determined that the training has not been completed, and the determination result may be output through a virtual reality image of the HMD device 200. Of course, a series of evaluation results and determination results may also be output and provided through the display unit 130. In addition, the user (trainee) who has completed the training can be put into the actual GMP facility site, and can perform the related task (BSC's sterility verification verification procedure task) directly as a bio-personnel.

The statistics unit 170 processes score statistics for each training period (e.g., daily, monthly) of the user based on the result provided from the evaluation unit 160 in the form of a table, graph, etc. to provide the HMD device 200 and the display unit 130 ) Can be provided, and through this, it is possible to induce unskilled persons (trainees) to continuously verify and improve their ability and proficiency in performing work procedures.

The management server 300 is network-connected with the training terminal 100 of each user, and the information of each user received from the training terminal 100, the user's training image (real-time or recorded simulation image), training history, evaluation score , Training completion, etc. can be integrated and managed. In addition, the management server 300 may manage the educator terminal 400 provided on the trainer side.

The educator terminal 400 may also correspond to a PC, a desktop, a notebook, a smartphone, a smart pad, and a tablet PC.

The educator terminal 400 may improve learning efficiency by receiving a training image of a user in real time through the management server 300 and providing real-time feedback on coaching information to the user.

To this end, the educator terminal 400 displays the virtual reality image being simulated in real time in response to the user and provides it to the trainer, receives coaching information in real time from the trainer, and sends it to the training terminal 100 through the management server 300. Can be transmitted.

Then, the controller 120 may provide the trainer's coaching information received from the educator terminal in real time to the HMD device 200. If the input coaching information is voice, voice coaching can be supported in real time.

In addition, the educator terminal 400 may be connected to the training terminal 100 on the side of a predetermined user previously designated (allocated) from the management server 300 to monitor and coach training information of a corresponding user designated in charge. Here, of course, the educator terminal 400 may be connected to each training terminal 100 through the management server 300, but may be directly connected one-to-one.

In addition, the trainer can also check and coach the virtual reality image that the trainee is training in real time through his HMD device that communicates with the educator terminal 400. In addition, the training terminal 100 receives voice data of a user (trainee) input through a microphone mounted on the HMD device 200 and communicates with the trainer terminal 400 on the trainer side and the HMD device through a mutual conversation. To be able to train in the way of doing things.

4 is a diagram illustrating an operation function of a training terminal in an embodiment of the present invention.

As shown in Fig. 4, the training terminal corresponds to a client device for the management server, and includes a graphic rendering engine, a physical-based hand manipulation engine, a voice engine, a player, and a network communication function. The training terminal 100 is connected to the HMD device 200 and the hand motion sensor (hand mocap device) 500 by using a network communication function to transmit and receive information. Here, the HMD device 200 and the hand motion sensor 500 are shown to be included in the training terminal configuration for convenience of explanation, but are substantially connected to the outside to communicate with the training terminal 100.

Here, the hand mocap device 500 is a device that is mounted on a user's hand, and hereinafter, it is referred to as a wearable device for convenience of description.

The wearable device 500 communicates with the training terminal 100 and outputs vibration feedback so that the user can feel when a warning signal is received from the control unit 120 of the training terminal 100.

Based on the motion information according to the user's hand motion and the object shape (3D modeling information) of the BSC, if it is determined that the user's hand has touched the inner wall of the BSC during training, the wearable device mounted on the user's hand A warning signal is sent to (500). Here, the inner wall may include all five surfaces of the BSC described above.

Then, the wearable device 500 provides sensory feedback to the user's hand by outputting vibration in response to the warning signal. If the user's hand comes into contact with the wall while performing the BSC's sterility verification procedure at the actual site, the wall surface may be contaminated or particles on the plate may be disturbed by impact on the plate held by the hand. It is desirable to pay attention through separate vibration feedback so that the hand does not touch or collide.

Therefore, in order to educate about these precautions, the embodiment of the present invention makes the facts known as vibrations to be recognized.

5 is a diagram illustrating a vibration unit of a wearable device mounted on a user's hand in an embodiment of the present invention.

The wearable device 500 may include a plurality of vibrating units A that are mounted corresponding to each finger portion when mounted on the user's hand. For example, a vibration unit A may be provided for each finger or fingertip, or a plurality of vibration units may be provided along a finger joint.

The wearable device 500 may be implemented in the form of a glove, and may have a form in which the vibration unit A is installed along various parts of the glove, but as shown in FIG. 5, a haptic ring A is simply inserted into each finger like a ring. It is also possible to be implemented in the form of ). In addition, it is possible to provide feedback by attaching one haptic ring for each finger tip so as to notify only the hand contact, not the hand contact position. The haptic ring may be provided with a separate button, and when a button is input, a simple command (simulation end, start, etc.) may be transmitted to the training terminal.

Here, the control unit 120 determines the detailed position of the hand in contact with the inner wall of the BSC, and controls the vibration to be output only through a predetermined vibration unit corresponding to the currently identified position among the plurality of vibration units A. To be able to recognize and correct for yourself.

In addition, the control unit 120 may predict the contact strength (impact or contact strength) or area of the hand against the wall and adjust the vibration intensity based on the prediction result.For example, the vibration intensity increases as the strength or area increases. I can make it.

In addition, the controller 120 may provide at least one simulation mode of an education mode, a training mode, and a test mode to the user so that it can be selected. The training mode is a simple training mode in which only the above-described virtual simulation is performed and score evaluation during simulation is omitted. It is a mode in which repeated practice is possible without score evaluation.

In the training mode, evaluation scores are provided after the virtual simulation, but when the user's motion information is out of the reference motion range during the simulation, warning feedback is provided visually, thereby enabling work correction for incorrect movements in the training process.

In addition, the test mode provides an evaluation score after the virtual simulation, but does not give any warning feedback during the simulation, and corresponds to a practical test mode. In other words, a user who has undergone sufficient training can be fully evaluated for his or her job performance without additional warning feedback through the test mode.

In the embodiment of the present invention, detailed functions of the training terminal 100 may be performed based on a program previously provided by the management server 300 or may be performed under real-time jurisdiction or control of the management server 300. In addition, the management server 300 directly performs functions related to score evaluation, video recording, score statistics, information storage, etc. according to virtual simulation training by interworking with the training terminal 100 in real time, and provides the result to the training terminal 100 It is also possible to be implemented to be searchable. Of course, the management server 300 may perform only a simple information transmission and storage role.

Hereinafter, a virtual simulation process according to an embodiment of the present invention will be described in more detail.

In the embodiment of the present invention, the training scenario for the sterility verification work education of the BSC is pre-loaded on the worktable of the BSC in a virtual reality image (VR image) and prepared plates (floating bacteria plates, surface equalization plates) are specified. It can be proceeded by moving one by one to a predetermined point on the BSC's workbench plane as a procedure.

In addition, the training scenario may specifically include at least one of falling germ verification training, floating germ verification training, and surface germ verification training. These training scenarios are based on standard procedures implemented when demonstrating the sterility of the BSC. Therefore, the individual training listed above may mean one of the work procedures included in the training scenario of one cycle.

The standard procedure for proving the sterility of the BSC includes a procedure for measuring the falling or floating powdered milk bacteria falling on the plate through a measuring instrument after placing a plate with an empty inside on the work surface of the BSC for a predetermined time. . In addition, in order to check whether surface bacteria are present on the inner wall surface of the workbench, the bottom surface of the plate is contacted with the inner wall surface of the BSC for several seconds (ex, 5 seconds) and then removed again to measure the surface bacteria. Include.

In addition, the standard procedure is instructed to perform sterility verification experiments at various points (points) on the plane of the actual workbench, and through this, bacteria and fungi (falling bacteria, airborne bacteria, surface bacteria) Etc.). Here, falling bacteria, floating bacteria, and surface bacteria are depending on the location or state of the bacteria, and actually bacteria are classified into bacteria and fungi, so that both bacteria and fungi can be tested for each of falling bacteria, floating bacteria, and surface bacteria. It is desirable to test with sufficient number of plates.

6 is a diagram showing a guideline for a general BSC performance eligibility evaluation method. The implementation plan as shown in FIG. 6 is prepared based on a standard procedure, but is not necessarily limited thereto, and can be changed at any time.

In addition, evaluating the performance eligibility of the BSC means demonstrating that the BSC is sterile. As described above, BSC is a facility for researching and producing cell therapy products and pharmaceuticals, and must exist in a sterile state without contaminants such as fine particles and bacteria.

Referring to FIG. 6, it is possible to check the points at which the respective test plates S used for sterility verification are placed on the working surface of the BSC (Biosafety Workbench).

The plates (S) to be used are initially empty and will exist in a sterile state. Among the plates placed on the working surface, the bacterial plate is named SB and the fungal plate is named SF. In addition, by placing these SBs and SFs side-by-side at the same location (eg, four corners of the workbench plane, the center of the workbench plane) and testing, both fungal and bacterial tests at that point are possible.

In addition, P1, P2, and P3 represent points at which the airborne bacteria meter is placed, respectively, and exist in a total of three locations. In addition, C1 to C6 denote points for measuring the surface bacteria on the wall side (C1, C2, C3, C6) and the bottom side (C5, C6) of the interior space of the workbench.

Hereinafter, a training scenario will be described in more detail based on an actual driving screen of the virtual reality training content.

7 is a diagram showing an initial screen of a VR image in an embodiment of the present invention.

7 shows the initial screen that the user sees through the VR device, that is, the HMD device 200, and when the user moves his hand in the air and touches the start button, the motion corresponding to the hand movement in the HMD device 200 Is transmitted, and the training terminal 100 may control a virtual reality screen output to the HMD device 200 based on this.

In the following drawings, in order to help understanding the invention, an image of an actual user's movement is shown together in the upper left part of the virtual reality image drawing. In addition, through the image, it can be seen that the lip motion (white part) for motion detection is mounted on the front of the HMD device 200 worn by the user.

8 is a diagram illustrating a basic screen converted after FIG. 7. When the start button of FIG. 7 is pressed, the basic scene as shown in FIG. 8 is changed.

You can see that a total of 4 groups of plates are stacked on the workbench in the virtual reality space. Looking from the left, 6 Petri dishes with a diameter of 60 mm are stacked in two groups (A,B), and then a Petri dish with a diameter of 90 mm is stacked in two groups (A and B), respectively. Here, A represents a plate for general bacteria, and B represents a plate for fungi.

Overall, there are 10 plates for surface bacteria (90mm) (for general bacteria: 5, for fungi: 5), 6 plates for floating bacteria (90mm) (for general bacteria: 3, for fungi: 3), and It can be seen that 12 plates for surface equalization (60mm) (for general bacteria: 6, for fungi: 6) were used, and a total of 28 dishes exist.

First of all, arrange each dish for measuring falling bacteria. For the measurement of falling bacteria, a general bacteria dish and a fungal dish are placed side by side in a total of 5 locations (see positions SB1, SF1 to SB5, and SF5 in FIG. 6).

Falling bacteria verification training refers to work training in which the floating bacteria plates loaded in the virtual reality space are grasped one by one from the top, put them down one by one on a part of the floor of the work table, and maintained for a predetermined time.

8 is a diagram for explaining a VR image-based falling germ verification training procedure according to an embodiment of the present invention.

The upper figure of FIG. 8 shows a state in which the user grips one of the top plates among the plates, and the lower figure shows a state that the user moves it down to the lower left part of the worktable plane after gripping.

Next, it goes through the process of measuring suspended bacteria. In the process of measuring airborne bacteria, moving the plate near the airborne bacteria measuring device plays a measuring instrument animation, and when the measurement is finished, the plate in the hand can be instantaneously moved. In addition, if the plate moves at each point, a message indicating that 10 minutes has elapsed can be automatically output. Here, 10 minutes have not actually elapsed, but a message that has passed 10 minutes can be displayed virtually.

The floating bacteria verification training is a training on moving the floating bacteria plate placed on the floor onto the floating bacteria measuring device placed on the BSC's workbench, maintaining a predetermined time, and putting it down on the floor again. Here, in the virtual reality, the predetermined time may be omitted for rapid progress or may be set to be a very shorter time than the actual required time. If omitted, it can be considered that the predetermined time has elapsed simply by moving the dish onto the airborne bacteria meter.

9 to 10 are diagrams for explaining a VR image-based airborne bacteria verification training procedure according to an embodiment of the present invention.

Fig. 9 shows the act of holding an airborne bacteria measuring device that does not actually exist from the outside and bringing it to a corresponding point on the workbench. When the user changes the field of view by turning his or her head or body, the table on which the various measuring devices are placed is shown on the virtual environment. Among them, the airborne bacteria meter can be grasped and placed on the corresponding point on the workbench again.

The upper figure of FIG. 10 is a state in which the user grips a predetermined plate for measuring airborne bacteria. If the user moves it above the airborne bacteria measuring device after holding, the lid of the measuring instrument is automatically opened and the plate is placed on the top of the measuring instrument as shown in the figure below. The figure at the bottom shows the user re-grasps the plate on which the measurement has been completed on the measuring machine and puts it back down to a predetermined point on the floor of the BSC.

After the airborne bacteria measurement, a process of measuring the airborne particles in space by bringing the airborne particle measuring device to a work table may be included, such as an act of bringing the airborne bacteria measuring device virtually, and a detailed description thereof will be omitted.

Next, the surface bacteria are measured. At this time, the process of taking and stacking the plates for 5 seconds at each measurement point (C1 to C6 in Fig. 6) and the process of taking and stacking the plates for fungi for 5 seconds at each measurement point (C1' to C6') in the same manner. Go through. The location of the shots in the two processes is the same, but it is desirable to set the shots on a slightly different location to prevent cross contamination. This also applies to the reason that the measurement points for the fungal dish are classified as C1'~C6' rather than C1~C6.

It can also provide vibration feedback as to whether or not the plate has touched the wall when the plate is placed against the wall. At this time, the vibration pattern may be different from when the hand directly touches the wall. Since the vibration feedback can proceed on the same principle as described above, a detailed description will be omitted.

Surface germ verification training refers to training in which the loaded surface equalization plates are grasped one by one from the top, moved to the inner wall surface of the BSC, contacted the bottom surface of the plate for a predetermined time, and then put it down on the floor.

11 is a diagram illustrating a VR image-based surface germ verification training procedure in an embodiment of the present invention.

The upper figure of FIG. 11 shows a user gripping a plate for surface equalization with a small diameter of 60 mm, and the figure immediately below shows a state that the plate is moved and placed on the left inner wall. Here, as soon as the user puts the plate on the wall, an animation as shown in the figure below may be executed so that the bottom surface of the plate faces the inner wall surface. This lower figure shows the appearance of the bottom of the plate being stamped on the inner wall.

12 is a diagram showing a simulation end screen in an embodiment of the present invention.

As shown in the upper figure of FIG. 12, when the simulation is completed, the user confirms the completion of the simulation, and after confirmation, an evaluation score and a total score for each training procedure may be provided as shown in the figure below.

In addition, in the embodiment of the present invention, when the subject has completed the simulation step or wants to end it in the middle, long press the haptic ring. Do you want to end the haptic ring by long pressing it? Message pops up in the user interface menu, and clicking on it can display the scoring result table.

Of course, even if the simulation is not completely finished and is finished halfway, it is possible to provide points for the results performed before that time. There is a back button under the result table, and you can move to the initial start screen by clicking on it.

13 is a diagram illustrating allocation points for a series of processes applied in an embodiment of the present invention. Since these points are only an example, it goes without saying that more various embodiments may exist.

According to the present invention as described above, it is possible to easily and conveniently train a working procedure for verifying the sterility of a biosafety cabinet disposed and operated in a GMP facility in a virtual reality environment without a separate temporal and spatial constraint. Accordingly, it is possible to replace existing textbooks, video education, and field education methods with a virtual reality-based distance education and evaluation system, and there is an effect of increasing the education effect through the configuration of the GMP environment and repeated practice almost identical to the actual one. .

In addition, the present invention implements a program for training a sterility verification procedure for environmental monitoring of BSC in a GMP facility in virtual reality, so that educators can be sufficiently trained without using an actual GMP facility, and the ability to perform the procedure and proficiency are maintained. As it can be verified and improved, it is possible to prevent damage to high GMP facilities and property damage due to the input of facilities or practice by unskilled persons.

The present invention has been described with reference to the embodiments shown in the drawings, but these are only exemplary, and those of ordinary skill in the art will appreciate that various modifications and equivalent other embodiments are possible therefrom. Therefore, the true technical scope of the present invention should be determined by the technical spirit of the appended claims.

100: training terminal 110: communication department
120: control unit 130: display unit
140: storage unit 150: recording unit
160: evaluation unit 170: statistics unit
200: HMD device 300: management server
400: educator terminal 500: wearable device

Claims (11)

In the BSC's sterility verification procedure training system based on virtual reality for sterility verification work procedure training in a bio safety cabinet (BSC),
An HMD device mounted on a user's head to display a virtual reality image and to guide a training scenario corresponding to the working procedure;
A communication unit for receiving motion information corresponding to the hand motion from a hand motion sensor that detects a hand motion of a user according to the training scenario;
The virtual reality image in which the BSC, the user's hand, and the plate for sterility verification are implemented as a 3D object in a virtual space, and guidance information for guiding a training scenario are provided to the HMD device, and corresponding to the received motion information A control unit for virtually simulating the training of the work procedure for verifying sterility while moving the plate prepared to be loaded on the worktable of the BSC in the virtual reality to a predetermined point on the worktable one by one according to a predetermined procedure; And
Based on the simulation result, for each work procedure in the training scenario, including an evaluation unit that converts an evaluation score corresponding to the user's motion and provides an evaluation result,
The training scenario is,
It proceeds in a manner in which the floating balance plates and the surface balance plates prepared to be loaded on the worktable of the BSC are moved one by one to a predetermined point on the worktable according to a predetermined procedure,
Falling bacteria verification training to hold the loaded floating bacteria plates one by one from the top and put them down on a part of the bottom of the workbench for a predetermined time, and move the floating bacteria plate placed on the floor onto the floating bacteria measuring device placed on the work table of the BSC After maintaining a predetermined period of time, airborne bacteria verification training is put down on the floor again, and the loaded surface equalization plates are grasped one by one from the top and moved to the inner wall of the BSC for a predetermined period of time, and then lowered back to the floor. A virtual reality-based biosafety cabinet sterility verification procedure training system that includes at least one of the placement surface germ verification training. The method according to claim 1,
The control unit,
A virtual reality-based bio that processes the guide information of the training scenario into at least one of text and an image to guide it by combining it with a virtual reality image of the HMD device, or process it into a voice message and provide voice guidance through an earset external to the HMD device. Training system for procedures to prove sterility of safety cabinets. The method according to claim 1,
The hand motion sensor,
A virtual reality-based bio safety cabinet sterility verification procedure education system mounted on the front side of the HMD device and operating in synchronization with the HMD device. The method according to claim 1,
The hand motion sensor,
A virtual reality-based bio safety cabinet sterility verification procedure training system mounted on the user's hand and operated. delete The method according to claim 1,
The evaluation unit,
For each of the work procedures, the motion information of the user is compared with a preset reference motion range corresponding to the work procedure, and if it is within the reference motion range, a predetermined score is given, and if it is outside the reference range, a predetermined penalty score is given,
A virtual reality-based biosafety cabinet's sterility verification procedure training system that provides training completion results based on the total converted score for the entire work procedure. The method according to claim 1,
The control unit,
Based on the motion information according to the user's hand motion and the object shape of the BSC, when it is determined that the user's hand has touched the inner wall of the BSC during training, a warning signal is sent to the wearable device mounted on the user's hand. And
The wearable device,
A sterility verification procedure education system of a virtual reality-based biosafety cabinet corresponding to the hand motion sensor mounted on the hand and outputting vibration feedback in response to the warning signal. The method of claim 7,
The wearable device,
And a plurality of vibration units mounted to correspond to each fingertip of the user,
The control unit,
A virtual reality-based bio safety cabinet sterility verification procedure education system for controlling a detailed position of a hand in contact with the inner wall to output a vibration through a predetermined vibration unit corresponding to the identified position among the plurality of vibration units. The method of claim 7,
The control unit,
A simple education mode in which the virtual simulation is performed, a training mode in which the evaluation score is provided after the virtual simulation, but an audible warning feedback is provided when the user's motion information is out of the reference motion range during the simulation, and after the virtual simulation, the A virtual reality-based bio safety cabinet sterility verification procedure education system that provides at least one simulation mode among test modes that provide an evaluation score but do not give the warning feedback during simulation. The method according to claim 1,
A system for verifying sterility verification procedure of a virtual reality-based biosafety cabinet further comprising a recording unit for recording and storing the virtual reality image during the virtual simulation so as to record the user's training process as an image. The method according to claim 1,
Further comprising an educator terminal provided on the trainer side, providing real-time display of the virtual reality image under the virtual simulation and receiving real-time input of coaching information of the trainer,
The control unit,
A virtual reality-based bio safety cabinet sterility verification procedure education system that provides the trainer's coaching information received from the educator terminal in real time to the HMD device.

Images