KR102517292B1 - Virtual fire response education evaluation system and method using mixed reality - Google Patents

Abstract

A virtual fire response training evaluation system and method using mixed reality are provided. A virtual fire response training evaluation system using mixed reality according to an embodiment of the present invention includes a virtual fire scenario generating device configured to generate a virtual fire scenario by determining a virtual fire area and a scenario difficulty using a user terminal; Virtual fire scenario execution information configured to control a virtual fire extinguishing device to generate suppression information of a user for the virtual fire scenario or to generate evacuation information of the user to generate the suppression information or scenario execution information including the evacuation information generating device; and analyzing the scenario execution information to evaluate the response result of the user to the virtual fire scenario, reflect the evaluation result to the personalized difficulty level, or output training information on evaluation items below standard to perform the user's education. and a virtual fire scenario evaluation device, wherein the virtual fire scenario generating device includes a scenario area processing unit configured to acquire an external image using the user terminal and set a virtual fire area using the acquired external image. ; a scenario difficulty management unit configured to determine a virtual fire difficulty level, that is, a difficulty level of the virtual fire scenario, by using difficulty change information including individual difficulty information and fire difficulty information; and a virtual fire scenario generator configured to generate the virtual fire scenario by determining a virtual fire mode that is a mode of the virtual fire scenario, a fire environment, and an optimal fire response path.

Description

Virtual fire response education evaluation system and method using mixed reality

The present invention relates to a virtual fire response education evaluation system and method using mixed reality, and in particular, by using a terminal possessed by a user to create a mixed reality and create a virtual fire scenario in the mixed reality to respond to the user's fire scenario It relates to a virtual fire response training evaluation system and method using mixed reality that can evaluate and provide training for insufficient parts.

Recently, disaster preparedness training using virtual reality (VR) technology is attracting attention. Virtual reality technology has the advantage of being able to conduct disaster preparedness training economically because it is not only free in space and time, but also can arbitrarily set space and time through programming. However, expensive devices are required to experience virtual reality, and user-customized programs are required to perform disaster preparedness training in virtual reality in the user's real life radius, which increases the cost. do.

Korean Patent Registration No. 10-2137040

In order to solve the problems of the prior art as described above, an embodiment of the present invention uses mixed reality using a user terminal, and responds to a user's fire through a method in which a user uses a virtual fire extinguishing device and tracking a user's movement path. It is intended to provide a virtual fire response training evaluation system and method using mixed reality that can evaluate motion.

In addition, an embodiment of the present invention provides the user with a virtual fire scenario in which a fire area is set through mixed reality and the fire difficulty is adjusted using various fire-related information, so that the user can feel interest and perform repeatedly. It is intended to provide a virtual fire response training evaluation system and method using mixed reality.

According to one aspect of the present invention for solving the above problems, a virtual fire response training evaluation system using mixed reality is provided. The virtual fire response training evaluation system using the mixed reality includes a virtual fire scenario generating device configured to generate a virtual fire scenario by determining a virtual fire area and a scenario difficulty using a user terminal; Virtual fire scenario execution information configured to control a virtual fire extinguishing device to generate suppression information of a user for the virtual fire scenario or to generate evacuation information of the user to generate the suppression information or scenario execution information including the evacuation information generating device; and analyzing the scenario execution information to evaluate the response result of the user to the virtual fire scenario, reflect the evaluation result to the personalized difficulty level, or output training information on evaluation items below standard to perform the user's education. and a virtual fire scenario evaluation device, wherein the virtual fire scenario generating device includes a scenario area processing unit configured to acquire an external image using the user terminal and set a virtual fire area using the acquired external image. ; a scenario difficulty management unit configured to determine a virtual fire difficulty level, that is, a difficulty level of the virtual fire scenario, by using difficulty change information including individual difficulty information and fire difficulty information; and a virtual fire scenario generator configured to generate the virtual fire scenario by determining a virtual fire mode that is a mode of the virtual fire scenario, a fire environment, and an optimal fire response path.

The scenario area processing unit may include a virtual fire area setting module configured to obtain the external image and set the virtual fire area as a reference for generating the virtual fire scenario; and a reference point acquisition module that analyzes the external image and acquires a reference point represented by a QR code included in the external image.

The virtual fire area may be set using a 3D external image obtained using lidar or a ToF camera.

The scenario difficulty management unit; an individual evaluation information analysis module configured to acquire log-in information logged in through the user terminal, and analyze individual evaluation information obtained using the obtained log-in information to obtain the individual difficulty information; a fire information analysis module configured to generate the fire difficulty information by receiving and analyzing fire information analysis contents within a predetermined period from the outside; and a virtual fire difficulty determination module configured to determine the virtual fire difficulty by using the difficulty change information.

The individual evaluation information is cumulatively generated using evaluation results of the user after the end of the previous virtual fire scenario, and may be expressed as individual evaluation scores for a plurality of evaluation factors.

The individual difficulty information may be information obtained by sequentially acquiring the evaluation factors lower than the overall average of the evaluation scores and applying a weight to each of the obtained evaluation factors.

The fire information analysis content includes at least one of a cause of ignition, an ignition location, a fire size, a suppression time, and a fire damage area, and the fire difficulty information is based on a predetermined standard by synthesizing the fire information analysis content within the preset period. It may be information in which each fire information analysis content is graded according to.

The virtual fire difficulty determination module determines the difficulty level of the virtual fire scenario by combining the individual difficulty information and the fire difficulty information included in the difficulty change information, and uses the individual difficulty information to determine the number of occurrences of the evaluation factor. , and the size of the virtual fire can be determined using the fire difficulty information.

The virtual fire scenario generation unit may include a scenario mode determination module configured to determine the virtual fire mode as one of a suppression mode, an evacuation mode, and a mixed mode; a virtual fire environment determination module configured to determine a virtual fire environment using the virtual fire area and the virtual fire difficulty level; a virtual fire response path determination module configured to determine a virtual fire response path that can optimally respond to the virtual fire; and a virtual fire scenario generation module configured to generate a fire response scenario in the virtual fire area as the virtual fire scenario by using the virtual fire mode, the virtual fire environment, and the virtual fire response path. .

The virtual fire environment includes at least one of a virtual ignition cause, a virtual ignition location, a virtual fire size, and a virtual object arrangement, and may be determined for each reference point obtained.

The virtual fire response route is a route including an optimal fire suppression sequence when the virtual fire mode is the suppression mode, a route that can be evacuated most quickly and safely in the case of the evacuation mode, and fire suppression in the case of the mixed mode. It may be a route through which an evacuation route can be obtained.

According to one aspect of the present invention, a virtual fire response training evaluation method using mixed reality is provided. The virtual fire response training evaluation method using the mixed reality includes generating a virtual fire scenario by determining a virtual fire area and a scenario difficulty using a user terminal in a virtual fire scenario generating device; The virtual fire scenario execution information generating device controls the virtual fire extinguishing device to generate user's suppression information for the virtual fire scenario or to generate the user's evacuation information to suppress the suppression information or virtual fire scenario execution information including the evacuation information. generating; and a virtual fire scenario evaluation device analyzes the scenario performance information to evaluate the response result of the user to the virtual fire scenario, reflects the evaluation result to the personalized difficulty level, or outputs training information for evaluation items below the standard, so that the user and performing training of, wherein the generating of the virtual fire scenario includes acquiring an external image using the user terminal and setting a virtual fire area using the obtained external image; determining a virtual fire difficulty level, which is a difficulty level of the virtual fire scenario, by using difficulty change information including difficulty information for each individual and fire difficulty information; and generating the virtual fire scenario by determining a virtual fire mode that is a mode of the virtual fire scenario, a fire environment, and an optimal fire response path.

The setting of the virtual fire area may include setting the virtual fire area as a reference for generating the virtual fire scenario by acquiring the external image; and acquiring a reference point represented by a QR code included in the external image by analyzing the external image.

The virtual fire area may be set using a 3D external image obtained using lidar or a ToF camera.

The step of determining the virtual fire difficulty may include acquiring login information logged in through the user terminal, and obtaining the individual difficulty information by analyzing individual evaluation information acquired using the acquired login information; generating the fire difficulty information by receiving and analyzing fire information analysis contents within a predetermined period from the outside; and determining the virtual fire difficulty level using the difficulty change information.

The individual evaluation information is cumulatively generated using evaluation results of the user after the end of the previous virtual fire scenario, and may be expressed as individual evaluation scores for a plurality of evaluation factors.

The individual difficulty information may be information obtained by sequentially acquiring the evaluation factors lower than the overall average of the evaluation scores and applying a weight to each of the obtained evaluation factors.

The fire information analysis content includes at least one of a cause of ignition, an ignition location, a fire size, a suppression time, and a fire damage area, and the fire difficulty information is based on a predetermined standard by synthesizing the fire information analysis content within the preset period. It may be information in which each fire information analysis content is graded according to.

The determining of the virtual fire difficulty may include determining the difficulty of the virtual fire scenario by combining the individual difficulty information and the fire difficulty information included in the difficulty change information, and determining the difficulty of the evaluation factor using the individual difficulty information. The number of appearances may be determined, and the size of a virtual fire may be determined using the fire difficulty information.

The generating of the virtual fire scenario may include determining the virtual fire mode as one of a suppression mode, an evacuation mode, and a mixed mode; determining a virtual fire environment using the virtual fire area and the virtual fire difficulty level; Determining a virtual fire response path that can optimally respond to the virtual fire; and generating a fire response scenario within the virtual fire area as the virtual fire scenario by using the virtual fire mode, the virtual fire environment, and the virtual fire response path.

The virtual fire environment includes at least one of a virtual ignition cause, a virtual ignition location, a virtual fire size, and a virtual object arrangement, and may be determined for each reference point obtained.

The virtual fire response route is a route including an optimal fire suppression sequence when the virtual fire mode is the suppression mode, a route that can be evacuated most quickly and safely in the case of the evacuation mode, and fire suppression in the case of the mixed mode. It may be a route through which an evacuation route can be obtained.

Using the virtual fire response training evaluation system and method using mixed reality according to an embodiment of the present invention, the user's fire response behavior can be evaluated through the way the user uses the virtual fire extinguishing device and the user's movement path tracking It works.

In addition, if the virtual fire response training evaluation system and method using mixed reality according to an embodiment of the present invention are used, a user can create a virtual fire scenario in which a fire area is arbitrarily set and the fire difficulty is adjusted using various fire-related information. By providing to, there is an effect that the user can feel interest and perform repeatedly.

1 is a block diagram simply showing a virtual fire response training evaluation system using mixed reality according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a virtual fire scenario generating device and a mixed reality device of FIG. 1 .
FIG. 3 is a block diagram illustrating a scenario area processing unit of FIG. 2 .
4 is a block diagram illustrating a scenario difficulty management unit of FIG. 2 .
5 is a block diagram illustrating a virtual fire scenario generation unit of FIG. 2 .
6 is a diagram illustrating a device for generating virtual fire scenario execution information and a virtual fire extinguishing device of FIG. 1 .
FIG. 7 is a block diagram showing a control unit of the virtual fire extinguishing device of FIG. 6 .
8 is a block diagram illustrating a suppression information generation unit of FIG. 6 .
9 is a block diagram illustrating an evacuation information generating unit of FIG. 6 .
FIG. 10 is a block diagram showing the virtual fire scenario evaluation apparatus of FIG. 1 .
FIG. 11 is a block diagram illustrating a scenario execution information acquisition unit of FIG. 10 .
12 is a block diagram illustrating a scenario execution information evaluation unit of FIG. 10 .
13 is a block diagram illustrating a scenario performance information processing unit of FIG. 10 .
14 is a flowchart simply illustrating a virtual fire response training evaluation method using mixed reality according to an embodiment of the present invention.
15 is a flowchart illustrating step S10 of FIG. 14 .
16 is a flowchart illustrating step S110 of FIG. 15 .
17 is a flowchart illustrating step S120 of FIG. 15 .
18 is a flowchart illustrating step S130 of FIG. 15 .
19 is a flowchart illustrating step S20 of FIG. 14 .
20 is a flowchart illustrating step S210 of FIG. 19 .
21 is a flowchart illustrating step S220 of FIG. 19 .
22 is a flowchart illustrating step S230 of FIG. 19 .
23 is a flowchart illustrating step S30 of FIG. 14 .
24 is a flowchart illustrating step S310 of FIG. 23 .
25 is a flowchart illustrating step S320 of FIG. 23 .
26 is a flowchart illustrating step S330 of FIG. 23 .

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily carry out the present invention. This invention may be embodied in many different forms and is not limited to the embodiments set forth herein. In order to clearly describe the present invention in the drawings, parts irrelevant to the description are omitted, and the same reference numerals are assigned to the same or similar components throughout the specification.

1 is a block diagram simply showing a virtual fire response training evaluation system using mixed reality according to an embodiment of the present invention, FIG. 2 is a block diagram showing a virtual fire scenario generating device and a mixed reality device of FIG. 1, and FIG. 3 is a diagram. 2, Figure 4 is a block diagram showing the scenario difficulty management unit of Figure 2, Figure 5 is a block diagram showing the virtual fire scenario generator of Figure 2, Figure 6 is the virtual fire scenario performance information of Figure 1 7 is a block diagram showing the virtual fire extinguishing device control unit of FIG. 6, FIG. 8 is a block diagram showing the suppression information generator of FIG. 6, and FIG. 9 is an evacuation information generator of FIG. 6. 10 is a block diagram showing the device for evaluating the virtual fire scenario of FIG. 1, FIG. 11 is a block diagram showing the scenario execution information acquisition unit of FIG. 10, and FIG. 12 is a block diagram and diagram showing the scenario execution information evaluation unit of FIG. 10 13 is a block diagram illustrating a scenario performance information processing unit of FIG. 10 .

Hereinafter, a virtual fire response training evaluation system 1 using mixed reality according to an embodiment of the present invention will be described in detail with reference to FIGS. 1 to 13 .

Referring to FIG. 1, the virtual fire response training evaluation system (1, hereinafter referred to as the training evaluation system) using mixed reality of the present invention includes a virtual fire scenario generating device 10 and a virtual fire scenario performance information generating device 20 And it is formed to include a virtual fire scenario evaluation device 30, and is formed to acquire external information using the MR device 11 and the virtual fire extinguishing device 12. The MR device 11 may be any device capable of generating mixed reality (MR) formed by overlaying a virtual image on a real image, but in the present invention, a user terminal can be replaced by the MR device 11 can The user terminal may be a smart phone with a fairly high penetration rate, and in order to replace the MR device 11 with a head mount such as Google Cardboard shown in FIG. 11) can be used. Therefore, in the following, for convenience of description, the MR device will be referred to as a user terminal.

The education evaluation system 1 is configured to generate a virtual fire scenario, acquire information generated while a user performs the virtual fire scenario, analyze and evaluate the user's scenario execution information, and educate. To this end, the education evaluation system 1 of the present invention may include a virtual fire scenario generating device 10, a virtual fire scenario performance information generating device 20, and a virtual fire scenario evaluating device 30.

The virtual fire scenario generating device 10 is configured to generate a virtual fire scenario by determining a virtual fire area and a scenario difficulty level using the user terminal 11 . Referring to FIG. 2 , an apparatus 10 for generating a virtual fire scenario according to an embodiment of the present invention is formed to include a scenario area processing unit 110, a scenario difficulty management unit 120, and a virtual fire scenario generation unit 130. It can be.

The scenario area processing unit 110 is configured to acquire an external image using the user terminal 11 and set a virtual fire area using the acquired external image. To this end, the scenario area processing unit 110 may include a virtual fire area setting module 111 and a reference point acquisition module 112 as shown in FIG. 3 .

The virtual fire area setting module 111 is formed to set a virtual fire area, which is a standard for generating a virtual fire scenario by acquiring an external image. In the present invention, the virtual fire area is an area included in a virtual fire scenario, and preferably may include a continuous space from indoor to outdoor. Accordingly, the virtual fire area setting module 111 may set a virtual fire area using an external image continuously photographed from an indoor area where a user is located to an outdoor area through the user terminal 11 .

Here, the virtual fire setting module 111 may acquire an external image as either a still image such as a photograph or a dynamic image such as a video. By filming so that overlapping images exist, the photographed information can be continuously connected inside the virtual fire setting module 111.

Also, the virtual fire area may be formed to have 3D information. In order for a captured image to have 3D information, the depth within the image can be directly acquired using a LiDAR or ToF camera, but 3D information can be calculated by making a difference in the shooting angle using two lenses photographed from different angles. Alternatively, before obtaining a photographed image, a reference object may be placed at a reference distance through a calibration process, and a size thereof may be recognized, and then 3D information of objects in the image may be calculated and acquired using a calibration result.

The reference point acquisition module 112 is configured to obtain a reference point included in the external image by analyzing the external image. Here, the reference point may be, for example, a QR code. A QR code is a barcode made in the form of a two-dimensional matrix, and can store specific information therein. Therefore, if a pre-generated QR code is arbitrarily placed in an area where a virtual fire scenario is desired to be performed, the reference point acquisition module 112 may analyze an external image to recognize the QR code and acquire the corresponding location as a reference point.

In addition, the reference point acquisition module 112 may be configured to obtain predetermined information by recognizing the contents of the QR code instead of simply using the QR code as a reference point. That is, the reference point acquisition module 112 may recognize the content of the QR code and obtain data corresponding to the QR code to output data stored in the QR code to a virtual fire environment at the reference point described later.

The scenario difficulty management unit 120 is configured to determine a virtual fire difficulty level, which is a difficulty level of a virtual fire scenario, by using difficulty change information including individual difficulty information and fire difficulty information. The educational evaluation system 1 of the present invention requires difficulty level adjustment in order to continuously arouse user's interest. If a virtual fire scenario is created with a difficulty level that is too low for the user's level, or a virtual fire scenario is created with a difficulty level that is too high to overcome beyond the user's level, there is a possibility that the user will lose motivation to perform the virtual fire scenario. higher, thereby reducing the effect of the present invention. Therefore, in order to overcome this, the scenario difficulty management unit 120 is formed by including the individual evaluation information analysis module 121, the fire information analysis module 122, and the virtual fire difficulty determination module 123 as shown in FIG. can

The individual evaluation information analysis module 121 is configured to classify users and analyze individual evaluation information. The individual evaluation information analysis module 121 acquires log-in information logged in by the user through the user terminal 11, obtains individual evaluation information using the acquired log-in information, and then analyzes the obtained individual evaluation information for each user. It can be formed to obtain individual difficulty information of.

Here, the individual evaluation information is information obtained by accumulating the evaluation results of the user generated after the end of the virtual fire scenario previously performed by the user, and may be expressed as a plurality of evaluation factors and respective evaluation scores for each evaluation factor. .

In addition, for the individual difficulty information, after obtaining an overall average score using each evaluation score, evaluation factors having a lower evaluation score than the overall average score are obtained in the order of lower evaluation scores, and a weight is assigned to each evaluation factor obtained. It may be applied information. The weight is formed to adjust individual difficulty levels by making evaluation factors having low evaluation scores more frequently appear in virtual fire scenarios. Using this, the individual evaluation information analysis module may acquire individual difficulty information so that the weight of the lowest evaluation score appears more frequently than the evaluation factor closest to the average score.

The fire information analysis module 122 is configured to generate fire difficulty information by analyzing fire information. The fire information analysis module 122 obtains fire information analysis content within a predetermined period from the outside, analyzes the fire information analysis content, and generates fire difficulty information, where the fire information analysis content is the cause of ignition, the ignition location, and the size of the fire. , suppression time, and at least one of fire damage area.

The fire difficulty information may be information obtained by integrating and accumulating fire information analysis contents within a predetermined period and grading each fire information analysis contents according to a predetermined standard. Using the fire information analysis module 122, by identifying and analyzing the current state of fire occurrence within a predetermined period, information on recent frequently occurring fires can be acquired and reflected in a virtual fire scenario, so even if a similar fire occurs, the user can correctly There is an effect that can be educated to expect a response.

The virtual fire difficulty level determination module 123 is configured to determine the virtual fire difficulty level using the difficulty variation information. The virtual fire difficulty determination module 123 may determine the difficulty of the virtual fire scenario by combining the individual difficulty information and the fire difficulty information after acquiring the difficulty change information including the individual difficulty information and the fire difficulty information. In this case, the virtual fire scenario difficulty may be a difficulty in which the number of appearances of the evaluation factor is determined using individual difficulty information and the size and ignition factor of the virtual fire are determined using the fire difficulty information.

Finally, the virtual fire scenario generation unit 130 of the present invention is formed to generate a virtual fire scenario by determining a virtual fire mode, a fire environment, and an optimal fire response path. To this end, the virtual fire scenario generation unit 130 includes a scenario mode determination module 131, a virtual fire environment determination module 132, a virtual fire response route determination module 133, and a virtual fire scenario generation module, as shown in FIG. (134) may be formed.

The scenario mode determination module 131 is configured to determine the virtual fire mode as one of a suppression mode, an evacuation mode and a mixed mode. Suppression mode is a mode in which the fire must be extinguished to complete a virtual fire scenario, evacuation mode is a mode in which a fire must be safely evacuated to a safe area in order to complete a virtual fire scenario, and mixed mode is a mode in which both modes are combined. The combined mode may be a mode in which certain fire suppression must be performed for evacuation.

The virtual fire environment determination module 132 is configured to determine the virtual fire environment using the virtual fire area and the virtual fire difficulty level. The virtual fire environment is information related to the ignition environment of the virtual fire and may include at least one of a virtual ignition cause, a virtual ignition location, a virtual fire size, and a virtual object arrangement.

In addition, the virtual fire environment determination module 132 may perform the virtual ignition position and virtual object arrangement at the reference points acquired by the reference point acquisition module 112, respectively. That is, if the virtual fire environment determination module 132 is used, a virtual fire situation in a real space is presented to the user by synthesizing a virtual fire, a virtual obstruction, etc. into a virtual image at a reference point in an external image acquired through the user terminal 11. The effects that can be provided appear. Furthermore, the virtual fire environment determination module 132 may use the data included in the QR code of the reference point acquired by the reference point acquisition module 112 to output information stored in the corresponding data to the reference point.

The virtual fire response route determination module 133 is configured to determine a virtual fire response route capable of optimally responding to a virtual fire. The virtual fire response route may vary depending on the virtual fire mode, and when the virtual fire mode is a suppression mode, it may mean a route capable of performing fire suppression in an optimal sequence. In addition, if the virtual fire mode is the evacuation mode, it means the route through which the user can evacuate from the virtual fire scene to the safe area in the fastest and safest way. It means a route, and preferably means an evacuation route that can be evacuated most quickly and safely through minimum fire suppression.

Finally, the virtual fire scenario generation unit 130 is formed to generate a fire response scenario within the virtual fire area as a virtual fire scenario by using the virtual fire mode, the virtual fire environment, and the virtual fire response path. The virtual fire scenario generation unit 130 receives the virtual fire mode from the scenario determination module 131, receives the virtual fire environment through the virtual fire environment determination module 132, and uses the virtual fire response path determination module 133. Through this, a virtual fire response route can be delivered and a virtual fire scenario can be created. The virtual fire mode and virtual fire environment can be used to synthesize a virtual image into a real image in a virtual fire scenario, and the virtual fire response route can be used to evaluate the scenario performance after the user completes the virtual fire scenario.

On the other hand, when a virtual fire scenario is created, the education evaluation system 1 of the present invention can generate scenario performance information for a user by using the virtual fire scenario performance information generation device 20 and the virtual fire extinguishing device 12. there is.

The virtual fire scenario performance information generation device 20 of the present invention controls the virtual fire extinguishing device 12 to generate user's suppression information for the virtual fire scenario or to generate user's evacuation information to include suppression information or evacuation information. It is formed to generate scenario performance information that To this end, the virtual fire scenario execution information generating device 20 may include a virtual fire extinguishing device control unit 210, a suppression information generating unit 220, and an evacuation information generating unit 230 as shown in FIG. .

The virtual fire extinguishing device controller 210 is configured to control the virtual fire extinguishing device 12 . The virtual fire extinguishing device 12 is formed to include a handle 12a, a coupling member 12b, and a hose 12c as shown in FIG. can The virtual fire extinguishing device 12 is formed so that the user can press the handle 12a, the user can hold the hose 12c by hand to adjust the direction of the hose 12c, and the user can adjust the direction of the hose 12c by using a coupling member 12b. It may be formed to be coupled with the object 12d. The virtual fire extinguishing device 12 combined with the coupling object 12d using the coupling member 12b does not actually discharge the digestive fluid, but can provide the user with the feeling of actually holding the fire extinguisher, and directly operate the fire extinguisher. effect can be provided. In addition, the virtual fire extinguishing device 12 may include, for example, an Arduino sensor.

The virtual fire extinguishing device controller 210 may include a combined weight measurement module 211, a virtual fire extinguishing liquid setting module 212, a handle pressure control module 213, and a fire extinguishing motion acquisition module 214, and includes the above-described modules. It is possible to control and acquire the user's virtual fire extinguisher use operation by using.

The combined weight measuring module 211 is configured to measure a combined weight, which is the weight of a coupled object 12d, which is an object coupled to the coupled member 12b. In order to provide a user with an experience similar to a real fire extinguisher, it is necessary to provide an environment that is maximally similar to a general fire extinguisher. Therefore, the combined weight measuring module 211 may measure the combined weight by using the combined weight so that the user can experience the amount of extinguishing fluid of the standard fire extinguisher, which is a standard fire extinguisher having a similar weight to the corresponding weight.

The virtual digestive fluid setting module 212 is configured to set an initial virtual digestive fluid amount using the combined weight. The virtual fire extinguishing fluid setting module 212 receives the combined weight measured by the combined weight measurement module 211, obtains a weight ratio based on the weight of the standard fire extinguisher, and applies the obtained weight ratio to the amount of fire extinguishing fluid of the standard fire extinguisher for the first virtual fire extinguishing. You can set the amount of liquid. Here, the standard fire extinguisher may be a fire extinguisher having a weight most similar to the combined weight among specifications of fire extinguishers heavier than the combined weight.

That is, assuming that the combined weight of the combined object 12d is 5 kg and that the fire extinguisher specifications are divided into 2 kg units and that there are three specifications of 4 kg, 6 kg, and 8 kg in total, in the case of a 4 kg standard fire extinguisher, the combination Because of its smaller weight, it cannot be used as a standard fire extinguisher. An 8 kg fire extinguisher can be used as a standard fire extinguisher because it is heavier than the combined weight of 5 kg, but the virtual fire extinguishing solution setting module 212 of the present invention is a 6 kg standard fire extinguisher having the most similar weight among standard fire extinguishers with a combined weight of 5 kg or more for more efficient training can be set as a standard fire extinguisher.

Therefore, the virtual digestive fluid setting module 212 can obtain a weight ratio of about 83.33%, and set the initial virtual digestive fluid amount of the combined object 12d to an amount corresponding to 83.33% of the buffered digestive fluid amount of a 6 kg standard fire extinguisher. there is.

The handle pressure control module 213 is configured to control the pressure applied to the handle according to the remaining amount of the virtual digestive fluid. A typical fire extinguisher ejects a fire extinguishing fluid when a user presses a handle, and provides physical feedback to the user when the ejected fire extinguishing fluid decreases, such as a decrease in ejection pressure or a lightening of the weight of the fire extinguisher. However, in the case of the virtual fire extinguishing device 12, since it is difficult to provide actual physical feedback according to the decrease in digestive fluid, in one embodiment of the present invention, the pressure acting on the handle is controlled so that the user can control the amount of digestive fluid using physical feedback. can make you guess.

The handle pressure control module 213 may initially set the pressure applied to the handle based on the initial virtual amount of digestive fluid. Here, the pressure acting on the handle means a pressure acting in a direction opposite to when the user presses the handle, that is, in a direction that resists the user's pushing motion of the handle. Since the initial amount of virtual fire extinguishing liquid is determined according to the weight ratio between the reference fire extinguisher and the combined weight, the pressure applied to the handle 12a of the virtual fire extinguishing device 12 may also be set using the weight ratio. That is, as in the above assumption, when the weight ratio of the standard fire extinguisher and the combined weight is 83.33%, the initial handle pressure may also be set to 83.33% of the initial pressure of the standard fire extinguisher.

Also, in another example, the handle pressure control module 213 may set the initial handle pressure to a preset pressure and control the handle pressure according to the ratio of the virtual remaining amount of digestive fluid. That is, regardless of the initial virtual digestive fluid amount, the handle pressure control module 213 sets the initial handle pressure to a preset pressure, then reduces the pressure by 10% when 10% of the virtual digestive fluid is used, and reduces the pressure by 20% when 20% is used. It is also possible to control the handle pressure in a way that decreases the %.

The fire action acquisition module 214 is configured to acquire the fire action of the user. The fire extinguishing motion acquisition module 214 obtains the direction of the hose 12c of the virtual fire extinguishing device 12 based on the virtual ignition point, and obtains the amount of virtual fire extinguishing fluid used by the user pressing the handle 12a to obtain the hose 12c. It is possible to obtain a fire extinguishing operation including the direction of (12c) and the amount of virtual fire extinguishing fluid used.

On the other hand, the virtual fire extinguishing device control unit 210 of the present invention may simulate the case where a user uses a plurality of fire extinguishers by calculating the initial virtual fire extinguishing fluid amount again when the combination object 12d is changed, and the combination object 12d ), digestive fluid consumption information may be output to the user terminal 11 so as to change the combined object 12d.

The suppression information generation unit 220 of the present invention is formed to generate suppression information for a user's virtual fire by applying a fire extinguishing operation to a virtual fire scenario. For this purpose, as shown in FIG. 8, the virtual fire suppression determination module 221 , It may be formed by including a virtual fire suppression sequence acquisition module 222 and a total virtual fire extinguishing liquid usage acquisition module 223.

The virtual fire suppression determination module 221 is configured to determine whether to suppress a virtual fire by analyzing a fire extinguishing operation. The virtual fire suppression determination module 221 calculates the amount of virtual effective fire extinguishing fluid used to reach the virtual ignition point, and when the calculation result is equal to or greater than a preset standard, it may be determined that the virtual fire at the corresponding virtual ignition point has been extinguished. For this purpose, the virtual fire suppression determination module 221 checks the direction of the hose 12c of the virtual fire extinguishing device 12 from the fire extinguishing operation, and uses the fire extinguishing fluid spray radius and the amount of fire extinguishing fluid used to determine the virtual effective fire extinguishing fluid reaching the virtual ignition point. Calculate usage. When the calculation result is equal to or greater than the preset virtual fire suppression standard amount of extinguishing liquid, the virtual fire suppression determination module 221 determines that the virtual fire at the corresponding virtual ignition point has been suppressed.

The virtual fire extinguishing order acquisition module 222 may be configured to sequentially acquire virtual ignition points determined by the virtual fire extinguishing determination module 221 to have extinguished a virtual fire.

The total virtual fire extinguishing fluid amount acquisition module 223 may be configured to acquire the total virtual fire extinguishing fluid amount used until the user completes the virtual fire scenario by acquiring the virtual fire extinguishing fluid amount from the fire extinguishing operation.

The suppression information generating unit 220, which determines fire suppression in each module and obtains the order of suppression and the total amount of virtual fire extinguishing fluid used, generates suppression information. can include

On the other hand, the evacuation information generation unit 230 of the present invention is configured to generate evacuation information of the user by analyzing the user's operation in the virtual environment. To this end, the evacuation information generation unit 230 may include a virtual fire environment analysis module 231, a user evacuation operation analysis module 23, and a user evacuation route acquisition module 233, as shown in FIG. .

The virtual fire environment analysis module 231 receives the virtual fire scenario and analyzes the virtual fire environment. As described above, the virtual fire environment includes at least one of an ignition source, an ignition location, a fire size, and an object arrangement, and may be obtained for each reference point included in the virtual fire area. The virtual fire environment analysis module 231 may generate evacuation information including analysis results by analyzing the obtained virtual fire environment.

Here, the analysis result may be a three-dimensional safety obtained by using a virtual fire environment. The virtual fire environment analysis module 231 may obtain a three-dimensional safety level by analyzing the virtual fire environment and obtaining safety levels divided into at least two levels within the virtual fire area for each location. In general, the farther away from the ignition point, the lower the temperature as well as the lower the concentration of toxic substances. Therefore, the virtual fire environment analysis module 231 may generate a safety level for each position centered on an ignition point, that is, a reference point, using a preset criterion, and may generate a three-dimensional safety level by connecting the generated safety level for each position. there is.

The user evacuation motion analysis module 232 is configured to analyze a user's evacuation motion using the user terminal 11 . The user evacuation motion analysis module 232 may determine the user's posture when moving by using the height, gyro sensor, or acceleration sensor of the user terminal 11 . For example, when the height of the user terminal 11 is lowered, the user evacuation motion analysis module 232 may determine that the user has lowered the posture, and when a value is measured through a gyro sensor or an acceleration sensor, the corresponding measured value is analyzed. Thus, the user's movement motion may be acquired.

In addition, the user evacuation operation analysis module 232 may analyze the user's evacuation operation using the 3D information value of the virtual fire area obtained by the virtual fire area setting module 111, and the evacuation further includes an evacuation operation. information can be generated.

Meanwhile, in order to use the educational evaluation system 1 of the present invention, the user may further use additional accessories. For example, when a user is wearing an evacuation accessory that can be mounted on a hand or arm and transmits his/her location information through communication with the user terminal 11, the user evacuation motion analysis module 232 is an evacuation accessory The smoke protection operation may be further detected using the location of the .

For example, when the user wears an evacuation accessory and looks at a nearby towel or handkerchief, the user evacuation motion analysis module 232 confirms that the user picks up the towel by hand, and the location of the evacuation accessory is determined by the user terminal 11 If located below the , it may be determined that the user performed the smoke protection operation using a towel or handkerchief.

The user evacuation route obtaining module 233 is configured to obtain the user's evacuation route within the virtual fire area. The user evacuation route acquisition module 233 is formed to obtain the user's evacuation route using the captured image of the user terminal 11, and for this purpose, the virtual fire area having the 3D information value obtained from the virtual fire area setting module 111 An area image may be used, or a movement direction and speed may be acquired using an acceleration sensor or the like. In addition, the user evacuation route obtaining module 233 may generate evacuation information including the evacuation route when obtaining the evacuation route.

Finally, the educational evaluation system 1 of the present invention is formed to include a virtual fire scenario evaluation device 30 . The virtual fire scenario evaluation device analyzes scenario execution information to evaluate the user's response to the virtual fire scenario, reflects the evaluation result to the personalized difficulty level, or outputs training information for substandard evaluation items to perform user education. is formed to To this end, the virtual fire scenario evaluation device 30 may include a scenario performance information acquisition unit 310, a scenario performance information evaluation unit 320, and a scenario performance information processing unit 330 as shown in FIG. 10. .

The scenario performance information acquisition unit 310 is configured to obtain suppression information and evacuation information by receiving and analyzing scenario performance information. Referring to FIG. 11 , the scenario execution information acquisition unit 310 of the present invention may include a suppression information acquisition module 311 and an evacuation information acquisition module 312.

The suppression information acquisition module 311 is configured to acquire suppression information on which a user performs virtual fire suppression among scenario execution information, and the evacuation information acquisition module 312 obtains evacuation information on which a user performs virtual fire suppression among scenario execution information. formed to obtain At this time, the suppression information acquisition module 311 and the evacuation information acquisition module 312 are preferably formed to receive the suppression information and evacuation information generated by the suppression information generator 220 and the evacuation information generator 230, respectively. .

Next, the scenario performance information evaluation unit 320 is configured to evaluate the scenario performance information using the evaluation criterion information and generate an evaluation result. For this purpose, the scenario execution information evaluation unit 320 may include an evaluation reference information acquisition module 321, a suppression information evaluation module 322, and an evacuation information evaluation module 323 as shown in FIG. 12 .

The evaluation criterion information acquisition module 321 is configured to acquire evaluation criterion information from the outside. The evaluation criterion information includes standard suppression information and standard evacuation information, the standard suppression information includes an optimal fire suppression sequence and minimum fire suppression time, and the standard evacuation information includes an optimal evacuation route and essential evacuation operation. In this case, evaluation criterion information may be further obtained from the inside as well as from the outside. The internally obtained evaluation criterion information may be a virtual fire response route generated by the virtual fire response route determination module 133 .

The suppression information evaluation module 322 receives the user's suppression information and compares it with reference suppression information to perform suppression evaluation. The suppression information evaluation module 322 may receive suppression information from the suppression information acquisition module 311, analyze the received suppression information, and perform suppression evaluation using evaluation items and evaluation criteria included in the standard suppression information. . For example, the optimal fire suppression sequence included in the standard suppression information and the fire suppression sequence actually performed by the user included in the suppression information may be compared, and a predetermined evaluation score may correspond to the suppression sequence item according to the degree of correspondence of the suppression sequence. A fire suppression information evaluation result may be generated by comparing the fire suppression time and the time taken by the user to actually extinguish the fire, and corresponding a predetermined evaluation score to a fire suppression required time item.

The evacuation information evaluation module 323 is formed to perform evacuation evaluation by receiving the user's evacuation information and comparing it with standard evacuation information. The evacuation information evaluation module 323 may receive evacuation information from the evacuation information acquisition module 312, analyze the received evacuation information, and perform evacuation evaluation using evaluation items and evaluation criteria included in the standard evacuation information. . For example, the optimal evacuation route included in the evacuation suppression information and the evacuation route actually performed by the user included in the evacuation information may be compared, and a predetermined evaluation score may correspond to an evacuation route item according to the degree of agreement of the evacuation route, and a required evacuation operation An evacuation information evaluation result may be generated by comparing the evacuation operation performed by the user during evacuation with a preset evaluation score corresponding to an evacuation operation time item. Here, the evacuation operation means not only an operation to protect the user's body, but also an operation to be taken by the user before and during evacuation at a fire site.

Finally, the scenario corresponding information processing unit 330 is configured to reflect individual evaluation results and output educational information to the user terminal after the end of the virtual fire scenario. For this purpose, the scenario execution information processing unit 330 may include an individual evaluation result reflection module 331 and an education information output module 332 as shown in FIG. 13 .

The individual evaluation result reflection module 331 is formed to update the individual evaluation result by reflecting the obtained evaluation result to the individual evaluation result pre-stored for each user. The individual evaluation result reflection module 331 receives the suppression information evaluation result and the evacuation information evaluation result, receives the individual evaluation information from the individual evaluation information analysis module 121, and evaluates the suppression information evaluation result and the evacuation information evaluation result individually. It may be formed to update individual evaluation information by reflecting the information.

Through this, the individual evaluation information is accumulated each time the user performs a virtual fire scenario and can be used to determine the change in the user's fire response ability, and the updated individual evaluation information is later stored in the virtual fire analysis module 121. It can also be used to create individual difficulty levels when creating fire scenarios.

The education information output module 332 may output education information for an evaluation item that does not reach a predetermined reference value among obtained evaluation results so that the user completes the education. The training information output module 332 analyzes the evaluation results of the suppression information and the evaluation of the evacuation information, compares them with the standard scores of the evaluation items, and if there is an evaluation item that does not reach the standard score among the compared evaluation items, the corresponding evaluation item Education information, which is audio-visual material generated by using the model answer to , may be output to the user terminal 11 so that the user may perform education on the insufficient part in case of fire.

Meanwhile, FIGS. 14 to 26 illustrate a virtual fire response training evaluation method (2, hereinafter referred to as training evaluation method) using mixed reality according to an embodiment of the present invention. Hereinafter, for convenience of description, the present invention is written using the educational evaluation system 1 of FIGS. 1 to 13 described above, but the present invention does not necessarily correspond to this, and various systems or devices capable of processing similar operations available.

Referring to FIG. 14 , the training evaluation method 2 of the present invention generates a virtual fire scenario, generates information on a user performing the virtual fire scenario, evaluates a response result for the virtual fire scenario, and conducts user education. formed to perform To this end, the training evaluation method (2) of the present invention generates a virtual fire scenario (S10), generates virtual fire scenario performance information (S20), evaluates the response result for the virtual fire scenario, and performs user education. It may include a step (S30) of doing.

In the step of generating a virtual fire scenario (S10), a virtual fire scenario is generated by determining a virtual fire area and a scenario difficulty using a user terminal through a virtual fire scenario generating device. Referring to FIG. 15, generating a virtual fire scenario (S10) according to an embodiment of the present invention includes setting a virtual fire area (S110), determining a virtual fire difficulty (S120), and a virtual fire scenario. It may be formed including the step of generating (S130).

In the step of generating a virtual fire scenario (S10), an external image may be obtained using a user terminal, and a virtual fire area may be set using the acquired external image. To this end, step S10 may include setting a virtual fire area (S111) and acquiring a reference point (S112) as shown in FIG. 16 .

The step of setting a virtual fire area (S111) is formed to set a virtual fire area, which is a standard for generating a virtual fire scenario by acquiring an external image. In the present invention, the virtual fire area is an area included in a virtual fire scenario, and preferably may include a continuous space from indoor to outdoor. Accordingly, in step S111, a virtual fire area may be set using an external image obtained by continuously photographing from the indoor area where the user is located to the outdoor area through the user terminal.

Here, in step S111, either a still image such as a photograph or a dynamic image such as a video can be obtained as an external image. By photographing so as to do so, the photographed information can be continuously connected in step S111.

Also, the virtual fire area may be formed to have 3D information. In order for a captured image to have 3D information, the depth within the image can be directly acquired using a LiDAR or ToF camera, but 3D information can be calculated by making a difference in the shooting angle using two lenses photographed from different angles. Alternatively, before obtaining a photographed image, a reference object may be placed at a reference distance through a calibration process, and a size thereof may be recognized, and then 3D information of objects in the image may be calculated and acquired using a calibration result.

The step of obtaining a reference point (S112) is performed to obtain a reference point included in the external image by analyzing the external image. Here, the reference point may be, for example, a QR code. A QR code is a barcode made in the form of a two-dimensional matrix, and can store specific information therein. Therefore, if a pre-generated QR code is arbitrarily placed in an area where a virtual fire scenario is to be performed, in step S112, the external image may be analyzed to recognize the QR code, and the corresponding location may be obtained as a reference point.

In addition, step S112 may be configured to obtain predetermined information by recognizing the content of the QR code without simply using the QR code as a reference point. That is, in step S112, the contents of the QR code may be recognized and data corresponding to the QR code may be obtained to output data stored in the QR code to a virtual fire environment at a reference point described later.

In the step of determining the virtual fire difficulty (S120), the virtual fire difficulty, which is the difficulty of the virtual fire scenario, is determined by using the difficulty change information including the individual difficulty information and the fire difficulty information. The educational evaluation method (2) of the present invention requires difficulty adjustment to continuously arouse user interest. If a virtual fire scenario is created with a difficulty level that is too low for the user's level, or a virtual fire scenario is created with a difficulty level that is too high to overcome beyond the user's level, there is a possibility that the user will lose motivation to perform the virtual fire scenario. higher, thereby reducing the effect of the present invention. Therefore, in order to overcome this, the step of determining the virtual fire difficulty (S120) is the step of obtaining the individual difficulty information (S121), the step of obtaining the fire difficulty information (S112) and the virtual fire difficulty as shown in FIG. It may be formed including the step of determining (S123).

Acquiring difficulty information for each individual (S121) is formed to classify users and analyze individual evaluation information. Step S121 is formed to acquire login information logged in by the user through the user terminal, obtain individual evaluation information using the acquired login information, and then analyze the obtained individual evaluation information to obtain individual difficulty information for each user. can

Here, the individual evaluation information is information obtained by accumulating the evaluation results of the user generated after the end of the virtual fire scenario previously performed by the user, and may be expressed as a plurality of evaluation factors and respective evaluation scores for each evaluation factor. .

In addition, for the individual difficulty information, after obtaining an overall average score using each evaluation score, evaluation factors having a lower evaluation score than the overall average score are obtained in the order of lower evaluation scores, and a weight is assigned to each evaluation factor obtained. It may be applied information. The weight is formed to adjust individual difficulty levels by making evaluation factors having low evaluation scores more frequently appear in virtual fire scenarios. Using this, the individual evaluation information analysis module may acquire individual difficulty information so that the weight of the lowest evaluation score appears more frequently than the evaluation factor closest to the average score.

Acquiring fire difficulty information (S112) is formed to generate fire difficulty information by analyzing the fire information. Step S112 obtains fire information analysis content within a predetermined period from the outside, analyzes the fire information analysis content to generate fire difficulty information, where the fire information analysis content is the cause of ignition, ignition location, fire size, suppression time and fire It may include at least one of the damaged areas.

The fire difficulty information may be information obtained by integrating and accumulating fire information analysis contents within a predetermined period and grading each fire information analysis contents according to a predetermined standard. Using step S112, by identifying and analyzing the current state of fire occurrence within a predetermined period, it is possible to obtain information on fires that have recently occurred frequently and reflect it in a virtual fire scenario, so that even if a similar fire occurs, the user can expect correct response. There is an educational effect.

The step of determining the virtual fire difficulty level (S123) is formed to determine the virtual fire difficulty level using the difficulty change information. Step S123 may determine the difficulty of the virtual fire scenario by combining the individual difficulty information and the fire difficulty information after acquiring the difficulty change information including the individual difficulty information and the fire difficulty information. In this case, the virtual fire scenario difficulty may be a difficulty in which the number of appearances of the evaluation factor is determined using individual difficulty information and the size and ignition factor of the virtual fire are determined using the fire difficulty information.

Finally, the step of generating a virtual fire scenario of the present invention (S130) is formed to generate a virtual fire scenario by determining a virtual fire mode, a fire environment, and an optimal fire response path. To this end, the step of generating a virtual fire scenario (S130) includes determining a virtual fire mode (S131), determining a virtual fire environment (S132), and determining a virtual fire response path as shown in FIG. (S133) and generating a fire response scenario in the virtual fire area as a virtual fire scenario (S134).

The step of determining the virtual fire mode (S131) is configured to determine the virtual fire mode as one of a suppression mode, an evacuation mode, and a mixed mode. Suppression mode is a mode in which the fire must be extinguished to complete a virtual fire scenario, evacuation mode is a mode in which a fire must be safely evacuated to a safe area in order to complete a virtual fire scenario, and mixed mode is a mode in which both modes are combined. The combined mode may be a mode in which certain fire suppression must be performed for evacuation.

The step of determining the virtual fire environment (S132) is formed to determine the virtual fire environment using the virtual fire area and the virtual fire difficulty level. The virtual fire environment is information related to the ignition environment of the virtual fire and may include at least one of a virtual ignition cause, a virtual ignition location, a virtual fire size, and a virtual object arrangement.

Also, in step S132, the virtual ignition position and virtual object arrangement may be performed at the reference point obtained in step S112. That is, if step S132 is used, a virtual fire situation in a real space can be provided to the user by synthesizing a virtual fire, a virtual obstacle, etc. into a virtual image at a reference point in an external image acquired through the user terminal. Furthermore, in step S132, information stored in the corresponding data may be output to the reference point using the data included in the QR code of the reference point obtained in step S112.

The step of determining a virtual fire response route (S133) is formed to determine a virtual fire response route capable of optimally responding to a virtual fire. The virtual fire response route may vary depending on the virtual fire mode, and when the virtual fire mode is a suppression mode, it may mean a route capable of performing fire suppression in an optimal sequence. In addition, if the virtual fire mode is the evacuation mode, it means the route through which the user can evacuate from the virtual fire scene to the safe area in the fastest and safest way. It means a route, and preferably means an evacuation route that can be evacuated most quickly and safely through minimum fire suppression.

Finally, in step S130, a step S134 of generating a fire response scenario in a virtual fire area as a virtual fire scenario is performed. Step S134 is configured to generate a fire response scenario in the virtual fire area as a virtual fire scenario by using the virtual fire mode, the virtual fire environment and the virtual fire response path. In step S134, a virtual fire mode is received from step S131, a virtual fire environment is received through step S132, and a virtual fire response path is received through step S133 to generate a virtual fire scenario. The virtual fire mode and virtual fire environment can be used to synthesize a virtual image into a real image in a virtual fire scenario, and the virtual fire response route can be used to evaluate the scenario performance after the user completes the virtual fire scenario.

Meanwhile, in the education evaluation method 2 of the present invention, when a virtual fire scenario is generated, the user's scenario performance information may be generated using the step of generating virtual fire scenario performance information (S20).

In the step of generating virtual fire scenario performance information (S20) of the present invention, the user's suppression information for the virtual fire scenario is generated by controlling the virtual fire extinguishing device using the virtual fire scenario performance information generating device, or the user's evacuation information is generated. It is formed to generate scenario performance information including suppression information or evacuation information. To this end, step S20 includes controlling a virtual fire extinguishing device (S210), generating suppression information for a virtual fire (S220), and generating evacuation information (S230), as shown in FIG. can be formed by

The step of controlling the virtual fire extinguishing device (S210) is formed to control the virtual fire extinguishing device. As shown in FIG. 6, the virtual fire extinguishing device is formed to include a handle, a coupling member, and a hose, and may be formed in a shape similar to an upper portion of a general fire extinguisher, for example, except for the body. The virtual fire extinguishing device may be formed so that the user can press the handle, the direction of the hose may be adjusted by the user holding the hose by hand, and it may be formed to be coupled to a coupling object using a coupling member. The virtual fire extinguishing device combined with the coupling object using the coupling member does not actually discharge the digestive fluid, but can provide the user with a feeling of actually holding the fire extinguisher and provide an effect as if the fire extinguisher is directly operated. In addition, the virtual fire extinguishing device may include, for example, an Arduino sensor.

Step S210, as shown in FIG. 20 for this purpose, measures the combined weight (S211), sets the first virtual digestive fluid (S212), controls the pressure applied to the handle (S213), and obtains the fire extinguishing action. It may be formed including step 214 of doing.

The step of measuring the combined weight (S211) is formed to measure the combined weight, which is the weight of a coupling object that is an object coupled to the coupling member. In order to provide a user with an experience similar to a real fire extinguisher, it is necessary to provide an environment that is maximally similar to a general fire extinguisher. Therefore, in step S211, the combined weight can be measured using the combined weight so that the user can experience the amount of extinguishing fluid of the standard fire extinguisher, which is a standard fire extinguisher having a similar weight to the corresponding weight.

The step of setting the first virtual digestive fluid (S212) is configured to set the initial virtual digestive fluid amount using the combined weight. In step S212, the combined weight measured in step S211 may be received, a weight ratio based on the weight of the standard fire extinguisher may be obtained, and an initial virtual extinguishing fluid volume may be set by applying the obtained weight ratio to the extinguishing fluid volume of the standard fire extinguisher. Here, the standard fire extinguisher may be a fire extinguisher having a weight most similar to the combined weight among specifications of fire extinguishers heavier than the combined weight.

In other words, assuming that the combined weight of the combined object is 5kg and the fire extinguisher specifications are divided into 2kg units and there are three specifications of 4kg, 6kg and 8kg in total, in the case of a 4kg standard fire extinguisher, the combined weight is smaller than the combined weight. Therefore, it cannot be used as a standard fire extinguisher. The 8kg fire extinguisher can be used as a standard fire extinguisher because it is heavier than the combined weight of 5 kg, but in step S212 of the present invention, a 6 kg standard fire extinguisher having the most similar weight among standard fire extinguishers with a combined weight of 5 kg or more is set as a standard fire extinguisher for more efficient training. can

Therefore, in step S212, a weight ratio of about 83.33% can be obtained, and the initial virtual extinguishing fluid volume of the coupled object can be set to 83.33% of the extinguishing fluid volume buffered in the 6kg standard fire extinguisher.

The step of controlling the pressure acting on the handle (S213) is configured to control the pressure acting on the handle according to the remaining amount of the virtual digestive fluid. A typical fire extinguisher ejects a fire extinguishing fluid when a user presses a handle, and provides physical feedback to the user when the ejected fire extinguishing fluid decreases, such as a decrease in ejection pressure or a lightening of the weight of the fire extinguisher. However, in the case of a virtual fire extinguishing device, since it is difficult to provide actual physical feedback according to the decrease in digestive fluid, in one embodiment of the present invention, the pressure acting on the handle is controlled so that the user can guess the amount of digestive fluid using physical feedback. can

In step S213, the initial pressure applied to the handle may be set based on the initial virtual amount of digestive fluid. Here, the pressure acting on the handle means a pressure acting in a direction opposite to when the user presses the handle, that is, in a direction that resists the user's pushing motion of the handle. Since the initial amount of virtual fire extinguishing liquid is determined according to the weight ratio between the standard fire extinguisher and the combined weight, the pressure applied to the handle of the virtual fire extinguishing device may also be set using the weight ratio. That is, as in the above assumption, when the weight ratio of the standard fire extinguisher and the combined weight is 83.33%, the initial handle pressure may also be set to 83.33% of the initial pressure of the standard fire extinguisher.

In another example, in step S213, the initial handle pressure may be set to a preset pressure, and the handle pressure may be controlled according to the ratio of the amount of virtual remaining digestive fluid. That is, regardless of the initial virtual digestive fluid amount, in step S213, after setting the initial handle pressure to the preset pressure, the pressure is reduced by 10% when 10% of the virtual digestive fluid is used, and the pressure is reduced by 20% when 20% is used. You can also control the handle pressure.

The step of acquiring the fire extinguishing action (S214) is configured to acquire the fire extinguishing action of the user. In step S214, the direction of the hose of the virtual fire extinguishing device is acquired based on the virtual ignition point, and the amount of virtual fire extinguishing fluid used is obtained using the time the user presses the handle to obtain the fire extinguishing action including the direction of the hose and the amount of virtual fire extinguishing fluid. can

On the other hand, in step S210 of the present invention, if the combined object is changed, the initial virtual digestive fluid amount can be calculated again to simulate the case where the user uses a plurality of fire extinguishers, and when all the first virtual digestive fluid amounts of the combined object are used, Digestive fluid consumption information may be output to the user terminal to change the combined object.

The step of generating suppression information on virtual fire of the present invention (S220) is formed to generate suppression information on the user's virtual fire by applying a fire extinguishing operation to the virtual fire scenario. To this end, as shown in FIG. 21, the virtual fire It may be formed by including a step of determining whether to extinguish (S221), a step of obtaining a virtual fire suppression sequence (S222), and a step of obtaining the total amount of virtual fire extinguishing liquid (S223).

In the step of determining whether the virtual fire has been extinguished (S221), the fire extinguishing operation is analyzed to determine whether the virtual fire has been extinguished. In step S221, the amount of virtual effective fire extinguishing fluid used to reach the virtual ignition point is calculated, and when the calculation result is equal to or greater than a preset standard, it may be determined that the virtual fire at the corresponding virtual ignition point has been extinguished. To this end, step S221 checks the direction of the hose of the virtual fire extinguishing device from the fire extinguishing operation, and calculates the virtual effective fire extinguishing fluid usage amount reaching the virtual ignition point using the fire extinguishing fluid spray radius and the fire extinguishing fluid usage amount. If the calculation result is greater than or equal to the amount of fire extinguishing liquid based on the predetermined virtual fire suppression standard, step S221 determines that the virtual fire at the corresponding virtual ignition point has been extinguished.

The step of acquiring the order of extinguishing the virtual fire (S222) may be configured to sequentially acquire the virtual ignition points determined to have extinguished the virtual fire in step S221.

The step of acquiring the total virtual fire extinguishing fluid usage amount (S223) may be configured to obtain the total virtual fire extinguishing fluid usage amount, which is the total virtual fire extinguishing fluid usage amount used until the user completes the virtual fire scenario, by obtaining the virtual fire extinguishing fluid usage amount from the fire extinguishing operation. In addition, in step S223, suppression information including whether the fire is suppressed, the order of fire suppression, and the total amount of virtual fire extinguishing fluid used may be generated.

On the other hand, in the step of generating evacuation information (S230) of the present invention, the user's operation in the virtual environment is analyzed to generate the user's evacuation information. To this end, generating evacuation information (S230) includes analyzing a virtual fire environment as shown in FIG. 22 (S231), analyzing a user's evacuation operation (S232), and obtaining an evacuation route (S233). ).

In the step of analyzing the virtual fire environment (S231), a virtual fire scenario is received and the virtual fire environment is analyzed. As described above, the virtual fire environment includes at least one of an ignition source, an ignition location, a fire size, and an object arrangement, and may be obtained for each reference point included in the virtual fire area. Step S231 may generate evacuation information including analysis results by analyzing the obtained virtual fire environment.

Here, the analysis result may be a three-dimensional safety obtained by using a virtual fire environment. In step S231, a three-dimensional safety level may be acquired by analyzing the virtual fire environment and obtaining a safety level divided into at least two levels in the virtual fire area by location. In general, the farther away from the ignition point, the lower the temperature as well as the lower the concentration of toxic substances. Accordingly, in step S231, a safety level for each location centered on an ignition point, that is, a reference point, may be generated using a predetermined criterion, and a three-dimensional safety degree may be generated by connecting the generated safety levels for each position.

Analyzing the user's evacuation operation (S232) is formed to analyze the user's evacuation operation using the user terminal. In step S232, the posture of the user when moving may be determined using the height, gyro sensor, or acceleration sensor of the user terminal. For example, when the height of the user terminal is lowered, step S232 may determine that the user has lowered the posture, and when a value is measured through a gyro sensor or an acceleration sensor, the user's moving motion may be obtained by analyzing the measured value. there is.

In addition, in step S232, the user's evacuation operation may be analyzed using the 3D information value of the virtual fire area obtained in step S111, and evacuation information further including the evacuation operation may be generated.

Meanwhile, in order to use the education evaluation method 2 of the present invention, the user may further use additional accessories. For example, when a user is wearing an evacuation accessory that can be mounted on a hand or arm and transmits location information through communication with a user terminal, step S232 performs a smoke protection operation using the location of the evacuation accessory. may be more detectable.

For example, when the user wears an evacuation accessory and looks at a towel or handkerchief around him, step S232 confirms that the user picks up the towel with his hand, and when the location of the evacuation accessory is located at the bottom of the user terminal, the user It may be determined that the smoke protection operation is performed using a towel or handkerchief.

Obtaining an evacuation route (S233) is formed to obtain an evacuation route within the user's virtual fire area. Step S233 is formed to obtain the user's evacuation route using the captured image of the user terminal. For this purpose, the virtual fire area image having the 3D information value obtained in step S111 may be used, or the movement direction may be used by using an acceleration sensor or the like. and speed. In addition, in step S233, evacuation information including an evacuation route may be generated when an evacuation route is obtained.

Finally, the education evaluation method 2 of the present invention evaluates the response result for the virtual fire scenario using the virtual fire scenario evaluation device and performs a step (S30) of performing user education. Evaluating the response result to the virtual fire scenario and performing user training (S30) analyzes the scenario execution information to evaluate the user's response result to the virtual fire scenario, and reflects the evaluation result to the personalized difficulty level or evaluates below the standard It is formed to perform user education by outputting education information about the item. To this end, step S30 includes obtaining suppression information and evacuation information (S310), generating evaluation results (S320), and outputting educational information to a user terminal (S330), as shown in FIG. can be formed

Acquiring suppression information and evacuation information (S310) is configured to obtain suppression information and evacuation information by receiving and analyzing scenario execution information. Referring to FIG. 24, obtaining suppression information and evacuation information (S310) of the present invention may include obtaining suppression information (S311) and obtaining evacuation information (S312).

The step of obtaining suppression information (S311) is formed to obtain suppression information in which the user performs virtual fire suppression among the scenario execution information, and the step of obtaining evacuation information (S312) is the user performs virtual evacuation among the scenario performance information. It is formed to acquire evacuation information. At this time, step S311 and step S312 are preferably formed to receive the suppression information and evacuation information generated in step S220 and step S230, respectively.

Next, generating an evaluation result (S320) is formed to evaluate scenario performance information using the evaluation criteria information and generate an evaluation result. The step of generating evaluation results (S320) includes obtaining evaluation criteria information (S321), performing a suppression evaluation (322), and performing an evacuation evaluation (S323) as shown in FIG. can be formed, including

Acquiring evaluation criterion information (S321) is formed to obtain evaluation criterion information from the outside. The evaluation criterion information includes standard suppression information and standard evacuation information, the standard suppression information includes an optimal fire suppression sequence and minimum fire suppression time, and the standard evacuation information includes an optimal evacuation route and essential evacuation operation. In this case, evaluation criterion information may be further obtained from the inside as well as from the outside. Evaluation criterion information obtained from the inside may be a virtual fire response path generated in step S133.

In the step of performing the suppression evaluation (S322), suppression evaluation is performed by receiving the user's suppression information and comparing it with standard suppression information. In step S322, suppression information may be received from step S311, and the received suppression information may be analyzed and suppression evaluation may be performed using evaluation items and evaluation criteria included in the standard suppression information. For example, the optimal fire suppression sequence included in the standard suppression information and the fire suppression sequence actually performed by the user included in the suppression information may be compared, and a predetermined evaluation score may correspond to the suppression sequence item according to the degree of correspondence of the suppression sequence. A fire suppression information evaluation result may be generated by comparing the fire suppression time and the time taken by the user to actually extinguish the fire, and corresponding a predetermined evaluation score to a fire suppression required time item.

The step of performing evacuation evaluation (S323) is formed to perform evacuation evaluation by receiving the user's evacuation information and comparing it with the standard evacuation information. Step S323 receives the evacuation information from step S312, analyzes the received evacuation information, Evacuation evaluation may be performed using the evaluation items and evaluation criteria included in the evacuation information. For example, the optimal evacuation route included in the evacuation suppression information and the evacuation route actually performed by the user included in the evacuation information may be compared, and a predetermined evaluation score may correspond to an evacuation route item according to the degree of agreement of the evacuation route, and a required evacuation operation An evacuation information evaluation result may be generated by comparing the evacuation operation performed by the user during evacuation with a preset evaluation score corresponding to an evacuation operation time item. Here, the evacuation operation means not only an operation to protect the user's body, but also an operation to be taken by the user before and during evacuation at a fire site.

Finally, in the step of outputting the educational information to the user terminal (S330), after the end of the virtual fire scenario, individual evaluation results are reflected and the educational information is output to the user terminal. The step of outputting the educational information to the user terminal (S330) may include a step of updating individual evaluation results (S331) and a step of outputting previously stored educational information (S332) as shown in FIG. 26. there is.

In step S331 of updating the individual evaluation result, the individual evaluation result is updated by reflecting the acquired evaluation result to the individual evaluation result pre-stored for each user. Step S331 receives the suppression information evaluation result and evacuation information evaluation result, receives individual evaluation information from step S121, and updates the individual evaluation information by reflecting the suppression information evaluation result and the evacuation information evaluation result to the individual evaluation information. can

Through this, the individual evaluation information is accumulated each time the user performs a virtual fire scenario and can be used to determine the change in the user's fire response ability, as well as the updated individual evaluation information when generating a virtual fire scenario later in step S331. It can also be used to create individual difficulty levels.

In the step of outputting pre-stored education information ( S332 ), education information on evaluation items that do not reach a preset reference value among obtained evaluation results may be output so that the user can complete the education. In step S332, the suppression information evaluation result and the evacuation information evaluation result are analyzed and compared with the standard score of the evaluation item, and if there is an evaluation item that does not reach the standard score among the compared evaluation items, an exemplary answer for the evaluation item is selected. It is also possible to output educational information, which is audio-visual data generated using the audio-visual data, to the user terminal so that the user can perform training on insufficient parts in case of a fire.

Although one embodiment of the present invention has been described above, the spirit of the present invention is not limited to the embodiments presented herein, and those skilled in the art who understand the spirit of the present invention may add elements within the scope of the same spirit. However, other embodiments can be easily proposed by means of changes, deletions, additions, etc., but these will also fall within the scope of the present invention.

1: Virtual fire response training evaluation system using mixed reality
10: virtual fire scenario generating device
11: MR device 12: virtual fire extinguishing device
12a: handle 12b: coupling member
12c: Hose 12d: Combined object
20: virtual fire scenario performance information generating device
30: virtual fire scenario evaluation device
110: scenario area processing unit 111: virtual fire area setting module
112: reference point acquisition module 120: scenario difficulty management unit
121: individual evaluation information analysis module 122: fire information analysis module
123: virtual fire difficulty determination module 130: virtual fire scenario generation unit
131: scenario mode determination module 132: virtual fire environment determination module
133: virtual fire response route determination module
134: virtual fire scenario generation module
210: virtual fire extinguishing device control unit 211: combined weight measurement module
212: virtual digestive fluid setting module 213: handle pressure control module
214: fire extinguishing operation acquisition module 220: suppression information generation unit
221: virtual fire suppression determination module 222: virtual fire suppression sequence acquisition module
223: total virtual digestive fluid usage acquisition module
230: evacuation information generation unit 231: virtual fire environment analysis module
232: user evacuation motion analysis module 233: user evacuation route acquisition module
310: scenario execution information acquisition unit 311: suppression information acquisition unit
312: evacuation information acquisition module 320: scenario execution information evaluation unit
321: evaluation criteria information acquisition module 322: suppression information evaluation module
323: evacuation information evaluation module 330: scenario execution information processing unit
331: Individual evaluation result reflection module 332: Education information output module

Claims (22)

a virtual fire scenario generating device configured to generate a virtual fire scenario by determining a virtual fire area and a scenario difficulty level using a user terminal;
Virtual fire scenario execution information configured to control a virtual fire extinguishing device to generate suppression information of a user for the virtual fire scenario or to generate evacuation information of the user to generate the suppression information or scenario execution information including the evacuation information generating device; and
Formed to analyze the scenario execution information to evaluate the response result of the user to the virtual fire scenario, reflect the evaluation result to the personalized difficulty level, or output training information for evaluation items below the standard to perform the user's education Including; virtual fire scenario evaluation device;
The virtual fire scenario generating device,
a scenario area processing unit configured to obtain an external image using the user terminal and set a virtual fire area using the acquired external image;
a scenario difficulty management unit configured to determine a virtual fire difficulty level, that is, a difficulty level of the virtual fire scenario, by using difficulty change information including individual difficulty information and fire difficulty information; and
A virtual fire scenario generator configured to generate the virtual fire scenario by determining a virtual fire mode that is a mode of the virtual fire scenario, a fire environment, and an optimal fire response path;
The scenario area processing unit,
a virtual fire area setting module that obtains the external image and sets the virtual fire area, which is a reference for generating the virtual fire scenario; and
It is formed to include; a reference point acquisition module for acquiring a reference point represented by a QR code included in the external image by analyzing the external image,
The virtual fire area is set using a 3D external image obtained using a lidar or ToF camera,
The scenario difficulty management unit,
an individual evaluation information analysis module configured to acquire log-in information logged in through the user terminal, and analyze individual evaluation information obtained using the obtained log-in information to obtain the individual difficulty information;
a fire information analysis module configured to generate the fire difficulty information by receiving and analyzing fire information analysis contents within a predetermined period from the outside; and
A virtual fire difficulty determination module for determining the virtual fire difficulty by using the difficulty change information;
The individual evaluation information is cumulatively generated using the evaluation results of the user after the end of the previous virtual fire scenario, and is expressed as each evaluation score for a plurality of evaluation factors,
The individual difficulty information is information obtained by sequentially acquiring the evaluation factors lower than the overall average of the evaluation scores and applying a weight to each of the acquired evaluation factors. Virtual fire response training evaluation system using mixed reality. delete delete delete delete delete According to claim 1,
The fire information analysis content includes at least one of a cause of ignition, an ignition location, a fire size, a suppression time, and a fire damage area, and the fire difficulty information is based on a predetermined standard by synthesizing the fire information analysis content within the preset period. A virtual fire response training evaluation system using mixed reality, which is information that ranks each fire information analysis content according to According to claim 7,
The virtual fire difficulty determination module,
The difficulty of the virtual fire scenario is determined by combining the individual difficulty information and the fire difficulty information included in the difficulty change information, the number of occurrences of the evaluation factor is determined using the individual difficulty information, and the fire difficulty information A virtual fire response training evaluation system using mixed reality to determine the size of a virtual fire using According to claim 8,
The virtual fire scenario generating unit,
a scenario mode determination module configured to determine the virtual fire mode as one of a suppression mode, an evacuation mode, and a mixed mode;
a virtual fire environment determination module configured to determine a virtual fire environment using the virtual fire area and the virtual fire difficulty level;
a virtual fire response path determination module configured to determine a virtual fire response path that can optimally respond to the virtual fire; and
A virtual fire scenario generation module configured to generate a fire response scenario in the virtual fire area as the virtual fire scenario by using the virtual fire mode, the virtual fire environment, and the virtual fire response path; A virtual fire response training evaluation system using. According to claim 9,
The virtual fire environment includes at least one of a virtual ignition cause, a virtual ignition location, a virtual fire size, and a virtual object arrangement, and a virtual fire response training evaluation system using mixed reality determined for each reference point obtained. According to claim 10,
The virtual fire response route is a route including an optimal fire suppression sequence when the virtual fire mode is the suppression mode, a route that can be evacuated most quickly and safely in the case of the evacuation mode, and fire suppression in the case of the mixed mode. A virtual fire response training evaluation system using mixed reality, a route that can obtain an evacuation route through generating a virtual fire scenario by determining a virtual fire area and a scenario difficulty using a user terminal in a virtual fire scenario generating device;
The virtual fire scenario execution information generating device controls the virtual fire extinguishing device to generate user's suppression information for the virtual fire scenario or to generate the user's evacuation information to suppress the suppression information or virtual fire scenario execution information including the evacuation information. generating; and
The virtual fire scenario evaluation device analyzes the scenario performance information to evaluate the response result of the user to the virtual fire scenario, reflects the evaluation result to the personalized difficulty level, or outputs educational information for evaluation items below the standard so that the user's Including; performing education;
The step of generating the virtual fire scenario,
acquiring an external image using the user terminal and setting a virtual fire area using the acquired external image;
determining a virtual fire difficulty level, which is a difficulty level of the virtual fire scenario, by using difficulty change information including difficulty information for each individual and fire difficulty information; and
It is formed to include; generating the virtual fire scenario by determining a virtual fire mode, a fire environment, and an optimal fire response path, which are modes of the virtual fire scenario,
Setting the virtual fire area,
acquiring the external image and setting the virtual fire area as a reference for generating the virtual fire scenario; and
Analyzing the external image to obtain a reference point represented by a QR code included in the external image;
The virtual fire area is set using a 3D external image obtained using a lidar or ToF camera,
The step of determining the virtual fire difficulty,
acquiring login information logged in through the user terminal, and obtaining difficulty information for each individual by analyzing individual evaluation information acquired using the obtained login information;
generating the fire difficulty information by receiving and analyzing fire information analysis contents within a predetermined period from the outside; and
Determining the virtual fire difficulty level using the difficulty change information;
The individual evaluation information is cumulatively generated using the evaluation results of the user after the end of the previous virtual fire scenario, and is expressed as each evaluation score for a plurality of evaluation factors,
The individual difficulty information is information obtained by sequentially acquiring the evaluation factors lower than the overall average of the evaluation scores and applying a weight to each of the acquired evaluation factors. Virtual fire response training evaluation method using mixed reality. delete delete delete delete delete According to claim 12,
The fire information analysis content includes at least one of a cause of ignition, an ignition location, a fire size, a suppression time, and a fire damage area, and the fire difficulty information is based on a predetermined standard by synthesizing the fire information analysis content within the preset period. A virtual fire response training evaluation method using mixed reality, which is information that ranks each fire information analysis content according to. According to claim 18,
The step of determining the virtual fire difficulty,
The difficulty of the virtual fire scenario is determined by combining the individual difficulty information and the fire difficulty information included in the difficulty change information, the number of occurrences of the evaluation factor is determined using the individual difficulty information, and the fire difficulty information A virtual fire response training evaluation method using mixed reality to determine the size of a virtual fire using According to claim 19,
The step of generating the virtual fire scenario,
Determining the virtual fire mode as one of a suppression mode, an evacuation mode, and a mixed mode;
determining a virtual fire environment using the virtual fire area and the virtual fire difficulty level;
Determining a virtual fire response path that can optimally respond to the virtual fire; and
Creating a fire response scenario in the virtual fire area as the virtual fire scenario by using the virtual fire mode, the virtual fire environment, and the virtual fire response path; evaluating virtual fire response training using mixed reality, including method. 21. The method of claim 20,
The virtual fire environment includes at least one of a virtual ignition cause, a virtual ignition location, a virtual fire size, and a virtual object arrangement, and a virtual fire response training evaluation method using mixed reality determined for each reference point obtained. According to claim 21,
The virtual fire response route is a route including an optimal fire suppression sequence when the virtual fire mode is the suppression mode, a route that can be evacuated most quickly and safely in the case of the evacuation mode, and fire suppression in the case of the mixed mode. A method for evaluating virtual fire response training using mixed reality, which is a path that can obtain an evacuation route through

Images