KR20210007433A - Fire suppression education system and method using augmented reality - Google Patents

Abstract

A fire suppression education system and a method using augmented reality are provided. The fire suppression education method comprises the following steps: selecting a target object from a background image based on a previously stored unit object without using a separate marker; displaying an imaginary fire object on the selected target object; and suppressing the imaginary fire object based on nozzle position information and lever pressure information of an educational fire extinguisher.

Description

Fire suppression education system and method using augmented reality}

The present invention relates to a fire suppression education system and method using augmented reality.

Fire safety education is being conducted for infants/elementary school students. In order to improve learning efficiency, practical training is conducted through an educational fire extinguisher.

A conventional educational fire extinguisher was filled with fog liquid, and the fog liquid was sprayed in the form of smoke. Therefore, conventional educational fire extinguishers must be filled with fog liquid from time to time. In addition, it is difficult for infants/elementary students to handle the weight of the fog liquid and the weight of the circuit device for converting the fog liquid into smoke, and thus it is difficult to operate an educational fire extinguisher.

Korean Patent Registration No. 10-1059532

The problem to be solved by the present invention is to provide a fire suppression education system and education method using augmented reality.

The problems of the present invention are not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

One aspect of the fire suppression education method of the present invention for achieving the above object includes the steps of selecting a target object from a background image based on a previously stored unit object without using a separate marker; Displaying a virtual material object on the selected target object; And suppressing the virtual material object based on the information on the nozzle position and the lever pressure information of the educational fire extinguisher.

Here, further comprising the step of storing the unit object, wherein the storing of the unit object includes obtaining shape information of the product by three-dimensional scanning a product, and changing the shape information of the product to digital information It may include creating a unit object.

Alternatively, in the storing of the unit object, a polyhedron having a plurality of surfaces surrounding a product is assumed, the product is photographed in a plurality of directions to generate a plurality of photos, and the generated plurality of photos are It may include completing the unit object having a polyhedral shape corresponding to the product by corresponding to each of the plurality of faces of the polyhedron.

Meanwhile, it may further include determining spatial information on which the background image is captured. Here, the stored unit object is a plurality, each of the plurality of unit objects further includes installable spatial information, and the step of selecting a target object from the background image includes selecting a candidate object from the background image, and The object may be compared with a plurality of unit projects having installable spatial information equal to the determined spatial information, and determining a target object according to the comparison result.

Meanwhile, the step of suppressing the virtual material object may further include displaying the virtual material object and the residual amount of the virtual material together, and reducing the residual amount according to the nozzle position information and lever pressure information. have.

Or, before the step of suppressing the virtual material object, further comprising determining the type of the educational fire extinguisher, the step of suppressing the virtual material object, the virtual material object only within the determined total capacity of the educational fire extinguisher It may include suppressing.

Alternatively, the unit object may further include virtual material size information, and may further include displaying a fire suppression golden time of the virtual material, which is different according to the virtual material size information.

Alternatively, the unit object may further include virtual material area information in which a virtual material is to be generated among the unit objects.

Alternatively, before the step of suppressing the virtual material object, a reference point may be displayed, and the user may further include initializing the direction of the nozzle by pointing the nozzle of the educational fire extinguisher toward the reference point.

Here, a virtual nozzle object corresponding to the nozzle of the educational fire extinguisher is displayed, but the virtual nozzle object can only move within a preset range, and when the virtual nozzle object attempts to move outside the preset range, a warning is given to the user. can send.

One aspect of the fire suppression education system of the present invention for achieving the above other object is a display; Communication module; A memory for storing a plurality of unit objects; And a processor for controlling the display, the communication module, and the memory, wherein the processor displays a background image, does not use a separate marker, and based on a previously stored unit object, from the background image A target object is selected, the virtual material is displayed on the target object, and instructions for suppressing the virtual material are stored based on nozzle position information and lever pressure information of the educational fire extinguisher.

The pre-stored unit object may be generated by changing the shape information of the product acquired by 3D scanning the product into digital information.

In addition, there are a plurality of pre-stored unit objects, each of the plurality of unit objects further includes installable spatial information, and the memory further includes an instruction allowing the processor to determine spatial information on which a background image is photographed, and the Selecting a target object from a background image includes selecting a candidate object from the background image, comparing the candidate object with a plurality of unit projects having the same installable spatial information as the determined spatial information, and targeting according to the comparison result. You can determine the object.

Details of other embodiments are included in the detailed description and drawings.

1 is a block diagram illustrating a fire suppression education method according to some embodiments of the present invention.
2 is a view for explaining an exemplary configuration of the educational fire extinguisher 10 of FIG.
3 is a view for explaining an exemplary configuration of the fire suppression education system 100 of FIG.
4 is a flow chart for explaining a fire suppression training method according to the first embodiment of the present invention.
5 to 7 are diagrams for explaining the unit object storage step S210 of FIG. 4.
FIG. 8 is a diagram illustrating a target object selection step (S220) of FIG. 4.
9 is a view for explaining the display step (S230) and suppression step (S240) of the virtual material object.
10 and 11 are views for explaining a fire suppression training method for explaining a second embodiment of the present invention.
12 is a view for explaining a fire suppression training method for explaining the third embodiment of the present invention.
13 and 14 are diagrams for explaining a fire suppression training method for explaining a fourth embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments to be posted below, but may be implemented in a variety of different forms, and only these embodiments make the posting of the present invention complete, and common knowledge in the technical field to which the present invention pertains. It is provided to completely inform the scope of the invention to those who have it, and the invention is only defined by the scope of the claims. The same reference numerals refer to the same components throughout the specification.

Although the first, second, etc. are used to describe various elements and/or sections, of course, these elements and/or sections are not limited by these terms. These terms are only used to distinguish one component or sections from other components or sections. Therefore, it goes without saying that the first component or the first section mentioned below may be a second component or a second section within the technical idea of the present invention.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, “comprises” and/or “comprising” refers to the recited elements, steps and/or actions excluding the presence or addition of one or more other elements, steps and/or actions. I never do that.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, and in the description with reference to the accompanying drawings, identical or corresponding components are assigned the same reference numerals and duplicated Description will be omitted.

In the present specification, "configured to (configured to)" is changed according to the situation, for example, hardware or software, "suitable for," "having the ability to," "... ," "made to," "can do," or "designed to" can be used interchangeably. In some situations, the expression "a device configured to" may mean that the device "can" along with other devices or parts. For example, the phrase “a processor configured (or configured) to perform A, B, and C” means a dedicated processor (eg, an embedded processor) for performing the operation, or by executing one or more software programs stored in a memory device. , May mean a general-purpose processor (eg, CPU or application processor) capable of performing corresponding operations.

The term "module" used herein includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, parts, or circuits. The "module" may be an integrally configured component or a minimum unit that performs one or more functions, or a part thereof. "Modules" can be implemented mechanically or electronically, for example, known or future development, application-specific integrated circuit (ASIC) chips, field-programmable gate arrays (FPGAs), or It may include a programmable logic device. At least a part of a device (eg, modules or their functions) or a method (eg, operations) according to various embodiments is a command stored in a computer-readable storage medium (eg, memory 140) in the form of a program module Can be implemented as When the command is executed by a processor (for example, the processor 120), the processor may perform a function corresponding to the command. Computer-readable recording media include hard disks, floppy disks, magnetic media (e.g. magnetic tape), optical recording media (e.g. CD-ROM, DVD, magnetic-optical media (e.g. floppy disk)), internal memory, etc. The instruction may include a code generated by a compiler or a code executable by an interpreter A module or program module according to various embodiments may include at least one or more of the above-described components, or , Some may be omitted, or other components may be further included Operations performed by modules, program modules, or other components according to various embodiments may be sequentially, parallel, repetitively or heuristically executed, or at least Some operations may be executed in a different order, omitted, or other operations may be added.

The fire suppression training method according to some embodiments of the present invention may be performed by an electronic device. For example, the electronic device includes, for example, a smartphone, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, a portable multimedia player (PMP). , MP3 player, medical device, camera, or wearable device. Wearable devices include accessory types (e.g. watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted-devices (HMD)), fabric or clothing integrals (e.g. electronic clothing), It may include at least one of a body-attached type (eg, a skin pad or a tattoo), or a bio-implantable circuit In some embodiments, the electronic device includes, for example, a television, a digital video disk (DVD) player, Audio, refrigerator, air conditioner, vacuum cleaner, oven, microwave, washing machine, air purifier, set-top box, home automation control panel, security control panel, media box (e.g. Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ) , A game console (eg, Xbox ^TM , PlayStation ^TM ), an electronic dictionary, an electronic key, a camcorder, or an electronic frame.

In another embodiment, the electronic device includes various medical devices (e.g., various portable medical measuring devices (blood glucose meter, heart rate meter, blood pressure meter, or body temperature meter, etc.), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), CT (computed tomography), camera, or ultrasound), navigation device, global navigation satellite system (GNSS), event data recorder (EDR), flight data recorder (FDR), automobile infotainment device, marine electronic equipment (E.g., navigation devices for ships, gyro compasses, etc.), avionics, security devices, vehicle head units, industrial or home robots, drones, ATMs in financial institutions, point of sale (POS) in stores. of sales), or IoT devices (eg, light bulbs, various sensors, sprinkler devices, fire alarms, temperature controllers, street lights, toasters, exercise equipment, hot water tanks, heaters, boilers, etc.). According to some embodiments, the electronic device is a piece of furniture, a building/structure or a vehicle, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (e.g., water, electricity, Gas, or a radio wave measuring device, etc.). In various embodiments, the electronic device may be flexible or may be a combination of two or more of the aforementioned various devices. The electronic device according to the embodiment of the present document is not limited to the above-described devices. In this document, the term user may refer to a person using an electronic device or a device (eg, an artificial intelligence electronic device) using an electronic device.

1 is a block diagram illustrating a fire suppression education method according to some embodiments of the present invention. The fire suppression training method of FIG. 1 may be an operation implemented on the executed application after the user executes a specific application of the electronic device, or together with the executed application. Alternatively, the fire suppression training method of FIG. 1 may be a service operation that is used by accessing a web address, not an installation type application.

Referring to FIG. 1, the educational fire extinguisher 10 and the fire suppression education system 100 communicate with each other through wired and/or wireless. For example, wireless communication is, for example, LTE, LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), Or, it may include cellular communication using at least one of Global System for Mobile Communications (GSM) and the like. Or, the wireless communication, WiFi (wireless fidelity), LiFi (light fidelity), Bluetooth, Bluetooth low power (BLE), Zigbee (Zigbee), NFC (near field communication), magnetic secure transmission (Magnetic Secure Transmission), radio frequency ( RF), or a body area network (BAN). Alternatively, wireless communication may include GNSS. The GNSS may be, for example, a Global Positioning System (GPS), a Global Navigation Satellite System (Glonass), a Beidou Navigation Satellite System (hereinafter “Beidou”), or Galileo, the European global satellite-based navigation system. Wired communication is, for example, USB (universal serial bus), HDMI (high definition multimedia interface), RS-232 (recommended standard232), power line communication, or POTS (plain old telephone service), computer network (for example, LAN or WAN) and the like.

The fire suppression education system 100 uses augmented reality to allow users (eg, infants or elementary school students) to immerse themselves in fire suppression education with interest.

Meanwhile, in the conventional augmented reality implementation method, a marker is attached to a product in advance, and the marker is read with a camera or the like to implement a virtual object according to information stored in the marker. In this case, virtual objects can be implemented only for products with markers attached. That is, if a marker is not attached to a product (for example, furniture) in advance, fire suppression education using augmented reality cannot be performed.

On the other hand, in the fire suppression education method according to some embodiments of the present invention, a separate marker is not used. Specifically, the product (eg, furniture) itself is recognized as a marker, the recognized product is compared with a pre-stored unit object, and according to the comparison result (that is, the recognized product is a pre-stored unit object). If it is determined that they are the same), the recognized product is selected as a target object. The virtual material object is synthesized and displayed on the target object. Therefore, even if markers are not prepared in advance, fire suppression education using augmented reality can be performed.

In addition, the fire suppression education system 100 receives nozzle position information and lever pressure information from the education fire extinguisher 10. Based on the provided information, the virtual material object is entered.

2 is a view for explaining an exemplary configuration of the educational fire extinguisher 10 of FIG.

Referring to FIG. 2, the appearance of the educational fire extinguisher 10 is the same or similar to that of an actual fire extinguisher. However, a plurality of sensors and electrical and electronic devices for control/communication may be added to the educational fire extinguisher 10. The weight of the educational fire extinguisher 10 may be the same as or similar to the weight of the actual fire extinguisher.

The educational fire extinguisher 10 includes a safety pin 11, a nozzle 12, a lever 13, a body 14, a first sensor 21, a second sensor 22, a third sensor 23, and a fourth A sensor 24, a control unit 30, a communication unit 40, and the like may be included.

The lever 13 is provided on the upper side of the body 14, and the safety pin 11 suppresses the operation of the lever 13. The nozzle 12 is connected to the upper side of the body 14.

The control unit 30 controls the first to fourth sensors 21 to 24 and the communication unit 40.

The first to fourth sensors 21 to 24 detect an operation state in response to a user operation, and generate operation information.

The first sensor 21 is installed on or around the safety pin 11 to detect the manipulation of the safety pin 11. The first sensor 21 may detect whether the safety pin 11 is removed. When a trainee (for example, an infant or elementary school student) removes the safety pin 11, the first sensor 21 detects that the safety pin 11 has been removed, and generates a first sensing signal including safety pin removal information.

The second sensor 22 is installed on or around the nozzle 12 to detect movement of the nozzle 12. For example, the second sensor 22 may be a gyro sensor, but is not limited thereto. The second sensor 22 detects which direction the nozzle 12 is facing (ie, nozzle position information), and generates a second sensing signal including nozzle position information.

The third sensor 23 is installed on or around the lever 13 to detect the operation of the lever 13. The third sensor 23 detects whether the trainee has gripped the lever 13 or how much (ie, grip strength). The third sensor 23 generates a third sensing signal including such lever pressure information.

The fourth sensor 24 is installed on or around the body 14 to sense the movement or position of the body 14. The fourth sensor 24 generates a fourth sensing signal including location information of the body 14.

The communication unit 40 is a module for wired and/or wireless communication with the fire suppression education system 100. The communication unit 40 transmits the first sensing signal to the fourth sensing signal to the fire suppression education system 100.

3 is a view for explaining an exemplary configuration of the fire suppression education system 100 of FIG.

3, the fire suppression education system 100 includes a display 110, a processor 120, a communication module 130, a memory 140, a camera 155, a bus 150, an input/output interface, etc. can do.

By the bus 150, various components such as the display 110, the processor 120, the communication module 130, and the memory 140 may be connected and communicated with each other (ie, control message transfer and data transfer). .

The processor 120 may include one or more of a central processing unit, an application processor, and a communication processor (CP). The processor 120 may, for example, perform an operation or data processing related to control and/or communication of at least one other component of the fire suppression education system 100.

The display 110 includes, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical system (MEMS) display, or an electronic paper display. Can include. The display 110 may display various types of content (eg, text, images, videos, icons, and/or symbols, etc.) to a user, for example. The display 110 may include a touch screen, and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or a user's body part.

The memory 140 may be a volatile memory (eg, DRAM, SRAM, or SDRAM) and/or a nonvolatile memory (eg, one time programmable ROM (OTPROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, Flash memory, PRAM, RRAM, MRAM, hard drive, or solid state drive (SSD)). The memory 140 may include an internal memory and/or an external memory. The memory 140 may store, for example, a command or data related to at least one other component of the electronic device 260. In addition, the memory 140 may store software and/or programs. The program may include, for example, a kernel, middleware, an application programming interface (API), and/or an application program (or "application"). At least a portion of the kernel, middleware, or API may be referred to as an operating system.

The kernel is, for example, system resources (eg, bus 150, processor 120) used to execute an operation or function implemented in other programs (eg, middleware, API, or application program), or Memory 140, etc.) can be controlled or managed. In addition, the kernel may provide an interface for controlling or managing system resources by accessing individual components of the fire suppression education system 100 from middleware, API, or application programs.

The middleware may, for example, play an intermediary role so that an API or an application program communicates with the kernel to exchange data. In addition, the middleware may process one or more job requests received from the application program according to priority. For example, the middleware assigns a priority to use system resources (eg, bus 150, processor 120, or memory 140) to at least one of the application programs, and sends the one or more job requests. You can handle it.

API is an interface for the application to control functions provided by the kernel or middleware, and includes at least one interface or function (eg, command) for file control, window control, image processing, or character control, etc. can do.

The camera 155 generates a background image by photographing the surrounding environment. For example, the camera 155 photographs the surrounding environment in real time, and the photographed video may be shown on the display 110.

Meanwhile, the memory 140 stores instructions for performing a fire suppression education method to be described later using FIGS. 4 to 14.

For example, in the memory 140, the processor 120 displays a background image, does not use a separate marker, selects a target object from the background image based on a previously stored unit object, and uses a virtual It displays the fire, and stores the instructions to extinguish the virtual material based on the information on the nozzle position and the lever pressure of the educational fire extinguisher.

Here, the previously stored unit object may be generated by changing the shape information of the product obtained by 3D scanning the product into digital information.

Alternatively, the previously stored unit object, assuming a polyhedron having a plurality of faces surrounding the product, creates a plurality of photos by photographing the product from a plurality of directions, and places the generated photos on multiple faces of the polyhedron. It may be completed by matching each.

Meanwhile, there are a plurality of pre-stored unit objects, and each of the plurality of unit objects may further include installable spatial information. In this case, the memory 140 may further include an instruction to allow the processor 120 to determine spatial information on which a background image is captured. Here, selecting the target object from the background image includes selecting a candidate object from the background image, comparing the candidate object with a plurality of unit projects having the same installable spatial information as the determined spatial information, and selecting the target object according to the comparison result. You can include what you decide.

4 is a flow chart for explaining a fire suppression training method according to the first embodiment of the present invention. 5 to 7 are diagrams for explaining the unit object storage step S210 of FIG. 4. FIG. 8 is a diagram illustrating a target object selection step (S220) of FIG. 4. 9 is a view for explaining the display step (S230) and suppression step (S240) of the virtual material object.

First, referring to FIG. 4, at least one unit object is generated and stored (S210).

Specifically, the unit object is information generated based on a product, and may include, for example, shape information (eg, 3D shape information) of a product.

Here, the product may be, for example, a product that can be encountered in a residential space or an office space. Such products may be, for example, furniture such as chairs, desks, wardrobes, hangers, and bookshelves. Alternatively, it may be an electronic/electrical device such as a computer, a monitor, a printer, a copier, a facsimile, a television, a refrigerator, an air conditioner, and an electric fan.

As shown in FIG. 5, the product 300 is three-dimensionally scanned using the scanner 311 to obtain shape information of the product 300, and the shape information of the product 300 is changed to digital information to obtain a unit object. Can be created.

Alternatively, as shown in FIG. 6, a polyhedron 310 having a plurality of faces surrounding the product 300 is assumed. In addition, the product 300 is photographed in a plurality of directions (eg, at least one of +x, -x, +y, -y, +z, -z), and a plurality of photos (eg, P1, P2) , P3, P4, P5). As shown in FIG. 7, a polyhedron corresponding to the product 300 is made by matching a plurality of generated photos (for example, P1, P2, P3, P4, P5) to a plurality of faces of the polyhedron 310, respectively. The shape unit object 310a is completed.

The method of using the scanner 311 as shown in FIG. 5 has an advantage of being able to simply create 3D shape information corresponding to the product 300 by using the scanner 311. However, when the size of the product 300 is quite large, it may be difficult to take a picture while rotating the product 300 in a 360-degree direction with the scanner 311. In addition, even if the product 300 is all photographed with the scanner 311, the size of the 3D shape information may be considerably increased.

On the other hand, when the size of the product 300 is quite large, as described with reference to FIGS. 6 and 7, it is relatively possible to form a polyhedral unit object 310a by photographing the product 300 from various directions. easy. In addition, compared to the scanned 3D shape information, the size of the polyhedral unit object 310a may be relatively small.

In addition, the unit object may be created in advance by the manufacturer of the fire suppression education system 100. Fire suppression education using augmented reality is conducted in classrooms such as kindergartens, academies, and elementary schools. Products (eg, furniture) used in classrooms, such as kindergartens, academies, and elementary schools, are not complicated, and their sizes may be standardized. Accordingly, a manufacturer can easily generate unit objects in advance by receiving product information from a manufacturer of a product (eg, furniture). The unit objects generated by the manufacturer may be stored in the server, or transmitted from the server to the fire suppression education system 100 in the classroom through a network and stored.

Meanwhile, in the classroom, there may be products (furnitures) without corresponding unit objects. In this case, a user (for example, a teacher or a student) may use a scanner (see FIG. 5) or photograph the product from various directions (see FIGS. 6 and 7) to directly create a unit object. The unit object created by the user may be transmitted to and stored in the server as well as the fire suppression education system 100 in the classroom. The unit object created in this way can be shared with other users.

Meanwhile, the unit object may further include installable spatial information indicating where a corresponding product can be installed. The installable spatial information may indicate, for example, a general classroom, a science room, a music room, and an auditorium. The installable spatial information may additionally generate installable spatial information (eg, in the form of meta data) when a manufacturer obtains the shape information of a product and creates a unit object. This installable spatial information may be used in the step (S220) of selecting a target object.

Referring back to FIG. 4, a target object is selected from a background image based on a unit object without using a separate marker (S220).

Specifically, the camera 155 of the fire suppression education system 100 photographs a background image. The processor 120 selects at least one candidate object (eg, a desk object, a chair object, a bookcase object, etc.) from the background image. Since the candidate object is selected from the background image captured by the camera 155, it may or may not be a pre-stored unit object. Accordingly, at least one selected candidate object is compared with a plurality of previously stored unit objects. As a result of the comparison, it may be determined that at least one candidate object (eg, a chair object) is the same as a previously stored unit object. Candidate objects determined to be identical are selected as target objects. When there are multiple candidate objects determined to be the same (ie, the chair object and the desk object are determined to be the same), all of the candidate objects determined to be identical (ie, the chair object, the desk object) can be selected as target objects, and Some of the determined candidate objects (ie, only the chair object) may be selected as the target object.

As described above, the candidate object must be compared with a number of unit objects. However, since the larger the number of pre-stored unit objects is, the longer the comparison time is, so it may take a lot of time to select the target object.

The time it takes to select a target object can be reduced as follows.

First, spatial information on which a background image is photographed is determined. For example, it is possible to determine what kind of place (eg, whether it is a general classroom or an auditorium) through artificial intelligence analysis of the captured background image. Alternatively, a user (eg, a teacher or student) may input a shooting location before shooting a background image.

As shown in FIG. 8, unit objects stored in the memory 140 may be divided into a plurality of groups (A, B, C) based on installable spatial information. For example, unit objects (UO1, UO2, UO3, UO4) belonging to group (A) are for general classrooms, and unit objects (UO11, UO12, UO13, UO14) belonging to group (B) are The installable space is an auditorium, and the unit objects UO21, UO22, UO23, and UO24 belonging to the group C may be the case where the installable space is a special activity room. Of course, one unit object may be installable in more than one space (ie, may include more than one installable space information). For example, if the shooting location is a general classroom, the target object 309a is compared with a plurality of unit objects UO1, UO2, UO3, and UO4 belonging to the group A.

Here, referring to FIGS. 2 and 9, a virtual material object F1 is displayed on the selected target object 309a (S230 ).

Specifically, the processor 120 may synthesize (or overlay) the virtual material object F1 on a specific area of the target object 309a. Here, the specific region may be, for example, a plane. If the target object 309a is a chair object, the specific area may be a seat plate (a part where the hips touch) (for example, see 301a of FIG. 9 ).

Here, when the target object 309a is selected, the processor 120 may analyze the target object 309a to select the specific area in which the virtual material object F1 is to be synthesized.

Alternatively, the unit object may further include area information (ie, virtual material area information) to synthesize (overlay) the virtual material object F1. Although the virtual material area information varies according to the type of the unit object, it may represent a wide flat area in which the virtual material object F1 is easily synthesized. The virtual material area information may further generate virtual material area information (for example, in the form of meta data) when a manufacturer obtains the shape information of a product and creates a unit object. When the target object 309a is selected, the processor 120 may synthesize the virtual material object F1 according to the preset virtual material area information.

Next, referring to FIGS. 2 and 9, based on the nozzle position information and lever pressure information of the educational fire extinguisher 10, the virtual material object F1 is suppressed (S240).

As described above, the fire suppression education system 100 receives a first sensing signal including safety pin removal information from the education fire extinguisher 10. If the fire suppression education system 100 is not provided with the first sensing signal, the extinguishing liquid 19a is not sprayed from the virtual nozzle object 12a in the display 110 even if the third sensing signal including the lever pressure information is provided. .

After receiving the first sensing signal, the fire suppression education system 100 receives a second sensing signal including nozzle position information and a third sensing signal including lever pressure information from the educational fire extinguisher 10. The virtual nozzle object 12a moves within the display 110 according to the nozzle position information. In addition, the amount of the digestive fluid 19a varies according to the lever pressure information.

In particular, as illustrated in FIG. 9, the virtual material object F1 is displayed together with the remaining amount E1 of the virtual material. Accordingly, the degree to which the virtual material object F1 is suppressed is expressed according to the nozzle position information and the lever pressure information. That is, as the virtual nozzle object 12a accurately faces the virtual material object F1 and the lever 13 is pressed more strongly, the remaining amount E1 of the virtual material will decrease faster.

In addition, the remaining amount E1 of the virtual material may vary according to the virtual material size information of the target object 309a. The larger the size of the virtual material, the larger the size of the virtual material object F1 and the greater the residual amount E1. For example, after the target object 309a is determined, the processor 120 may determine the virtual material size information in consideration of the size, characteristics, and speech area of the target object 309a. Alternatively, when a manufacturer creates a unit object, virtual material size information may be additionally generated (eg, in the form of meta data).

10 and 11 are views for explaining a fire suppression education method for explaining a second embodiment of the present invention.

As described above, the education fire extinguisher 10 and the fire suppression education system 100 are separated from each other. The user (for example, a student) must point the nozzle 12 of the educational fire extinguisher 10 to the display 110 of the fire suppression education system 100 for fire suppression. Accordingly, the direction/position of the nozzle 12 of the educational fire extinguisher 10 and the direction/position of the virtual nozzle object 12a in the display 110 should be well matched.

Here, referring to FIG. 10, before suppressing the virtual material object F1, a reference point S is displayed on the display 110. After that, the user initializes the direction of the nozzle 12 by pointing the nozzle 12 of the educational fire extinguisher 10 toward the reference point S. In this way, the value of the second sensing signal generated by the second sensor 22 and the position in the display 110 may be matched.

Further, referring to FIG. 11, a virtual nozzle object 12a corresponding to the nozzle 12 of the educational fire extinguisher 10 is displayed on the display 110. The virtual nozzle object 12a can move only within a preset range (eg, only within the display 110).

If the user moves the nozzle 12 of the educational fire extinguisher 10 too much, and the virtual nozzle object 12a is about to be moved out of a preset range, the virtual nozzle object 12a is forcibly moved outside the display 110. You can do not exceed. That is, according to the second sensing signal including nozzle position information, the virtual nozzle object 12a should not go out of the display 110 and be visible, but (forced) the virtual nozzle object 12a does not go beyond the display 110. Can be avoided. Instead, it can send a warning to the user. The warning may be, for example, audible, visual, or tactile.

12 is a view for explaining a fire suppression training method for explaining the third embodiment of the present invention.

Referring to FIG. 12, a plurality of target objects 309a and 309b are displayed on the display 110.

As described above, the remaining amounts E1 and E2 of each of the target objects 309a and 309b and the sizes of the virtual material objects F1 and F2 may be determined according to the virtual material size information. In addition, the fire suppression golden time (G1, G2) of the virtual material, which varies according to the size information of the virtual material, may be displayed together.

For example, at the same time as the fire extinguishing starts, the golden times (G1, G2) may gradually decrease from 5 minutes. If you do not extinguish the fire within the golden time (G1, G2), the fire can spread greatly. Therefore, you must practice extinguishing the fire within the golden time (G1, G2) when training fire.

In addition, two or more users can suppress one virtual material object (eg, F1) together. In this case, the virtual material object (eg, F1) may be suppressed more quickly. That is, during fire suppression training, two or more users should practice fighting fire together for suppression within golden time (eg, G1).

13 and 14 are views for explaining a fire suppression training method for explaining a fourth embodiment of the present invention.

Referring to FIG. 13, before the step of suppressing the virtual material object, the user may determine the type of educational fire extinguisher. This is to educate users to extinguish the fire with a suitable fire extinguisher after confirming the cause of the virtual material object.

For example, reference numeral (a) is a powder fire extinguisher, which is a fire extinguisher using powder to extinguish a fire. As the extinguishing powder, sodium hydrogen carbonate or ammonium dihydrogen phosphate having a very small particle size can be used. In addition, a nonflammable high-pressure gas such as nitrogen or carbon dioxide is used together to emit the powder. Dry fire extinguishers are suitable for oil, chemical and electric fires.

Reference numeral (b) is a carbon dioxide fire extinguisher, which contains carbon dioxide in a liquefied state. When carbon dioxide is released from the container, the fire area is covered with carbon dioxide gas to cut off the supply of air to extinguish the fire. Carbon dioxide fire extinguishers are useful for extinguishing electric fires because they do not leave any water or powder.

Reference numeral (c) is a Haron fire extinguisher, and Haron gas is used. Since it does not leave water or powdery powder, it is widely used in general fires, including oil, chemicals, electricity, and gas.

To suppress the virtual material object, the virtual material object can be suppressed only within the total capacity of the determined educational fire extinguisher. That is, when the determined total capacity of the educational fire extinguisher is small, it may not be possible to completely suppress the virtual material object. By doing so, the user can predict the size of the virtual material object that can be extinguished with the determined educational fire extinguisher.

Referring to FIG. 14, after the user selects the type of fire extinguisher for education, a notification 112a related to fire suppression may be popped up to the user on the display 110.

For example, it could give you a reminder,'The educational fire extinguisher you selected is not suitable, so you must choose another fire extinguisher.

As another example, if the capacity of the fire extinguisher cannot be extinguished due to the small capacity of the fire extinguisher,'You cannot extinguish the fire alone with the selected fire extinguisher. Two or more people can extinguish the fire together.'

Although the embodiments of the present invention have been described with reference to the above and the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can implement the present invention in other specific forms without changing the technical spirit or essential features. You can understand that there is. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting.

10: educational fire extinguisher 11: safety pin
12: nozzle 13: lever
14: body 21: first sensor
22: second sensor 23: third sensor
24: fourth sensor 30: control unit
40: Ministry of Communications 100: Fire Fighting Education System
110: display 120: processor
130: communication module 140: memory
155: camera 300: product
309a, 309b: target object F1, F2: virtual material object
E1, E2: residual amount G1, G2: golden time

Claims (14)

Selecting a target object from a background image based on a previously stored unit object without using a separate marker;
Displaying a virtual material object on the selected target object; And
Fire suppression education method using augmented reality, comprising the step of suppressing the virtual material object based on the nozzle position information and lever pressure information of the educational fire extinguisher. The method of claim 1,
Further comprising the step of storing the unit object, wherein the step of storing the unit object,
3D scanning a product to acquire shape information of the product, and changing the shape information of the product to digital information to generate the unit object, fire suppression education method using augmented reality. The method of claim 1,
Further comprising the step of storing the unit object, wherein the step of storing the unit object,
Assuming a polyhedron with multiple faces surrounding the product,
The product is photographed in a number of directions to create a number of photos,
A fire suppression education method using augmented reality, comprising completing the unit object having a polyhedron shape corresponding to the product by matching the generated plurality of photos to a plurality of surfaces of the polyhedron, respectively. The method of claim 1,
A fire suppression education method using augmented reality, further comprising the step of determining spatial information on which the background image was photographed. The method of claim 4,
The stored unit object is a plurality, and each of the plurality of unit objects further includes installable spatial information,
The step of selecting a target object from the background image,
Selecting a candidate object from the background image,
Comprising: comparing the candidate object with a plurality of unit projects having installable spatial information identical to the determined spatial information, and determining a target object according to the comparison result, fire suppression education method using augmented reality. The method of claim 1,
The step of suppressing the virtual material object,
The virtual material object and the remaining amount of the virtual material are displayed together,
According to the nozzle position information and the lever pressure information, the remaining amount is further reduced, fire suppression education method using augmented reality. The method of claim 1,
Before the step of suppressing the virtual material object, further comprising determining the type of the educational fire extinguisher,
The step of suppressing the virtual material object comprises extinguishing the virtual material object only within the determined total capacity of the educational fire extinguisher, fire suppression education method using augmented reality. The method of claim 1,
The unit object further includes virtual material size information,
Fire suppression education method using augmented reality, further comprising displaying a fire suppression golden time of the virtual material, which varies according to the virtual material size information. The method of claim 1,
The unit object further includes information on a virtual material area in which a virtual material is to be generated among the unit objects, and fire suppression education method using augmented reality. The method of claim 1,
Before the step of suppressing the virtual material object,
Display the reference point,
A fire suppression education method using augmented reality, further comprising initializing the direction of the nozzle by allowing the user to point the nozzle of the educational fire extinguisher toward the reference point. The method of claim 10,
Display a virtual nozzle object corresponding to the nozzle of the educational fire extinguisher, the virtual nozzle object can move only within a preset range,
Fire suppression education method using augmented reality, sending a warning to a user when the virtual nozzle object is about to move out of the preset range. display;
Communication module;
A memory for storing a plurality of unit objects; And
Including a processor for controlling the display, the communication module and the memory,
The memory is the processor
Display the background image,
Without using a separate marker, based on a previously stored unit object, select a target object from the background image,
Displaying a virtual material on the target object,
Based on the nozzle position information and lever pressure information of the educational fire extinguisher, to extinguish the virtual material, to store instructions (instructions)
Fire suppression education system using augmented reality. The method of claim 1,
The pre-stored unit object,
Fire suppression education system using augmented reality that is generated by changing the shape information of the product acquired by three-dimensional scanning of the product into digital information. The method of claim 1,
There are a plurality of pre-stored unit objects, and each of the plurality of unit objects further includes installable spatial information,
The memory is the processor
To determine the spatial information in which the background image was photographed
Including more instructions,
Selecting a target object from the background image,
Selecting a candidate object from the background image,
Comparing the candidate object with a plurality of unit projects having installable spatial information identical to the determined spatial information, and determining a target object according to the comparison result,
Fire suppression education system using augmented reality.

Images