KR102584863B1 - Firefighting facility management and inspection apparatus based on augmented reality and building property information - Google Patents

Abstract

To enable the general public to conveniently register and manage firefighting equipment using augmented reality technology and video analysis technology, and to easily provide information on firefighting equipment to be placed indoors to the general public, especially building occupants. This provides technology to prevent fire accidents from the perspective of actual residents, and also provides technology to conveniently manage them. For this purpose, a firefighting equipment management and inspection device based on augmented reality and building attribute information according to an embodiment of the present invention is implemented as a computing device including one or more processors and one or more memories that store instructions that can be executed by the processor. It relates to a firefighting equipment management and inspection device based on augmented reality and building attribute information, which is information received from an external terminal, including at least the use of indoor space, area, floor height, and indoor drawing information, and pre-stored building attribute information. An equipment list that generates a list of fire-fighting equipment that must be installed in the indoor space corresponding to the building attribute information using equipment information including firefighting rule information and previously stored identification information and specification information of fire-fighting equipment installed or placed indoors. generation unit; Among the firefighting equipment included in the list of firefighting equipment created by the equipment list generator, the installation location of the indoor space for the firefighting equipment selected by the external terminal is calculated using the equipment information and building attribute information of the firefighting equipment. At the back, an installation location recommendation unit that processes the calculated installation location for each firefighting equipment and provides recommended facility installation location information to an external terminal; and an equipment management unit that receives inspection information from an external terminal about already installed fire-fighting equipment, manages it for each fire-fighting equipment, and provides inspection guidance information for each fire-fighting equipment to the external terminal.

Description

Firefighting equipment management and inspection device based on augmented reality and building property information {FIREFIGHTING FACILITY MANAGEMENT AND INSPECTION APPARATUS BASED ON AUGMENTED REALITY AND BUILDING PROPERTY INFORMATION}

The present invention relates to management and inspection technology for indoor fire-fighting equipment based on augmented reality and building attribute information. Specifically, it automatically recommends fire-fighting equipment to be installed indoors based on building attribute information, This relates to technology that allows convenient management, inspection, and registration of firefighting equipment using augmented reality technology.

In general, the design of firefighting facilities must be carried out when licensing buildings in order to protect the lives, bodies, and property of citizens from fires, disasters, disasters, and other emergency situations, and is essential for firefighting safety in an advanced modern society. The demand for is increasing infinitely.

In addition, not only the design of firefighting facilities, but also periodic monitoring of firefighting facilities and equipment is an essential element of firefighting safety. When referring to recent large-scale fire accidents, it is clear that the cause is lack of management of firefighting equipment, etc. It is clearly revealed.

Previously, in the purchase, installation, and management of firefighting equipment, management personnel of each building or buildings visited each room one by one to perform the work, or administrative agencies performed the work directly. Accordingly, there are frequent cases where inspection personnel are unable to perform accurate inspections, and the above-mentioned fire accidents frequently occur.

However, it is very difficult for ordinary people, such as residents, to install and manage firefighting equipment. In other words, when installing firefighting equipment, there are regulations (laws, enforcement ordinances, etc.) for installation depending on the purpose, area, floor height, etc. of each room, and without knowledge of these, it is very difficult to accurately install firefighting equipment. In addition, when it comes to managing firefighting equipment, it is very difficult to burden the general public who have difficulty knowing exactly how to use or manage the firefighting equipment.

In order to solve this problem, for example, in Korean Patent No. 10-2141219, etc., after storing the design drawing of the indoor space and inputting it into a convolutional neural network based on it, the fire-fighting disaster prevention installation and the installation location are determined. According to the designer's modifications, the technology for learning convolutional neural networks is being published.

This technology has the advantage of enabling automatic design of firefighting equipment using artificial intelligence with enhanced security, but it has the problem that it is very difficult for the general public to use the installation location of firefighting equipment and whether or not it is newly installed. There is a problem in that management such as inspection of equipment cannot be conveniently used, and in the end, only a small number of people can perform inspection of fire-fighting equipment as described above.

Accordingly, the present invention was developed to solve the problems of the existing and prior technologies described above, and allows the general public to conveniently register and manage firefighting equipment using augmented reality technology and image analysis technology, In particular, the purpose is to provide technology that can prevent fire accidents from the perspective of actual residents by easily providing information about firefighting equipment to be placed indoors to the general public, including building occupants.

In addition, another purpose is to provide intuitive management interfacing technology so that the general public can conveniently manage firefighting equipment that requires specialized management knowledge.

In order to achieve the above object, a firefighting equipment management and inspection device based on augmented reality and building attribute information according to an embodiment of the present invention includes one or more processors and one or more memories that store instructions that can be executed by the processors. It relates to a firefighting equipment management and inspection device based on augmented reality and building attribute information implemented by a computing device including information received from an external terminal, including at least the use, area, floor height, and indoor drawing information of the indoor space. Firefighting equipment to be installed in an indoor space corresponding to the building attribute information is determined by using equipment information including building attribute information, previously stored firefighting rule information, and previously stored identification information and specification information of firefighting equipment installed or placed indoors. A facility list generator that generates a list; Among the firefighting equipment included in the list of firefighting equipment created by the equipment list generator, the installation location of the indoor space for the firefighting equipment selected by the external terminal is calculated using the equipment information and building attribute information of the firefighting equipment. At the back, an installation location recommendation unit that processes the calculated installation location for each firefighting equipment and provides recommended facility installation location information to an external terminal; and an equipment management unit that receives inspection information from an external terminal about already installed fire-fighting equipment, manages it for each fire-fighting equipment, and provides inspection guidance information for each fire-fighting equipment to the external terminal.

The facility management department. Out of the areas output to the output means of the external terminal, output a boundary line of a first area where the image captured by each fire-fighting equipment should be located in the image output area where the image captured by the photographing means of the external terminal is output, and the first The above inspection guide information for fire-fighting equipment is printed near the boundary line of the area, but when printing the inspection points for each component of fire-fighting equipment derived for each fire-fighting equipment, each is printed in the area adjacent to each component of each fire-fighting equipment. As the inspection point for the component is output, the first visual effect is given to each component, and when it detects that the input means of the external terminal is located on one inspection point or a component for one inspection point, it responds to that inspection point. It is desirable to provide a second visual effect different from the first visual effect to the component.

The equipment management unit, when receiving a shooting input from an external terminal after the fire-fighting equipment is located in the first area, outputs an inspection interface that allows input of inspection points and the inspection information for the fire-fighting equipment photographed on the external terminal. Thus, it is possible to inspect the fire-fighting equipment through the external terminal, and after receiving the shooting input, the image of the fire-fighting equipment captured by the external terminal is captured by the first image regardless of changes in the shooting area of the subsequent shooting means. It is desirable to output in area 1.

The facility management unit provides space use information including occupant information, usage status information, and already installed firefighting equipment information of the indoor space input from an external terminal, space use information for other indoor spaces previously stored in the database, and other indoor spaces. Compared with the fire accident history information, fire-fighting equipment renewal recommendation information including proposed information on at least one of replacement of already installed fire-fighting equipment and installation of new fire-fighting equipment is generated and output to the output means of the external terminal. It is desirable to output the image to a second area that is different from the image output area.

The equipment management unit provides a different third visual effect to the boundary line of the first area or the captured image according to the inspection importance set for each fire-fighting equipment, and the inspection importance is determined by the supervision of fire-fighting equipment among the fire rules. It is desirable to calculate it through information on the status of the equipment calculated based on relevant laws and regulations, and inspection information already managed regarding the fire-fighting equipment.

The equipment management unit outputs an inspection interface that allows input of inspection information about the fire-fighting equipment to a third area different from the first area, and recognizes the fire-fighting equipment through object analysis of the fire-fighting equipment photographed in the first area. It is desirable to apply the identification information of the fire-fighting equipment derived as a result of comparing the objects and modeling data for each fire-fighting equipment stored in the database to the inspection interface for each fire-fighting equipment previously stored in the database so that different inspection interfaces are output depending on the fire-fighting equipment.

The installation location recommendation unit installs each fire-fighting equipment for indoor spaces using the correlation information between fire-fighting equipment and fire accidents derived as a result of learning information on fire-fighting equipment and fire accident history information already installed for other indoor spaces through machine learning. It is desirable to derive importance information and provide suggested information about the installation order in the order of the derived installation importance to the external terminal by including it in the recommended equipment installation location information.

The equipment management unit compares the objects recognized through object analysis of images captured from a photographing means of an external terminal, modeling data for each fire-fighting equipment stored in the database, and modeling data of the indoor space, and compares the fire-fighting equipment included in the captured image. As a result of identifying the installation location of fire-fighting equipment and comparing it with information on fire-fighting equipment already installed for each indoor space stored in the database, if it is determined that the identified fire-fighting equipment is not installed at the identified installation location, it will be installed at the identified installation location. Considering that the identified fire-fighting equipment is newly installed, it is desirable to update the fire-fighting equipment information already installed for each indoor space stored in the database.

If the fire-fighting equipment is connected to the equipment management unit through a network and the operation can be controlled by the equipment management unit, and the data generated by the fire-fighting equipment can be transmitted to the equipment management unit, the equipment management unit monitors the fire-fighting equipment in real time. As data generated during operation, real-time monitoring data including control commands causing the operation of the fire-fighting equipment, status information during operation of the fire-fighting equipment, and operation error information of the fire-fighting equipment are received from the fire-fighting equipment, and are included in the inspection information. It is desirable to manage it including.

According to the present invention, not only the interior design drawing, but also information related to the degree of damage in the event of a fire accident and information related to regulations for the installation of fire-fighting equipment, refer to the use, area, and floor height of the indoor space, and the corresponding space is provided. It provides a list of firefighting equipment that must be installed and recommends installation locations for each firefighting equipment. In addition, after installation, inspection information is received from external terminals such as those owned by residents, and management is performed for each firefighting equipment. I do it.

As a result, even ordinary people without specialized knowledge, such as residents of indoor spaces, can determine whether fire-fighting equipment is properly installed and, based on this, build fire-fighting equipment that conforms to indoor space regulations and is capable of preventing fire accidents. It has the effect of inducing it to happen.

In addition, due to additional features of the present invention, major inspection points for each fire-fighting equipment are visually expressed, and in particular, images taken of fire-fighting equipment are output through augmented reality techniques, allowing the general public without specialized knowledge of fire-fighting equipment to be used. It also has the effect of enabling convenient and intuitive management of firefighting equipment.

1 is a configuration diagram of a firefighting equipment management and inspection device based on augmented reality and building attribute information according to an embodiment of the present invention.
2 to 9 are examples of user interface screens output to an external terminal according to the implementation of an embodiment of the present invention.
10 is an example of the internal configuration of a computing device according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS Various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to facilitate a general understanding of one or more aspects. However, it will also be appreciated by those skilled in the art that this aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain example aspects of one or more aspects. However, these aspects are illustrative and some of the various methods in the principles of the various aspects may be utilized, and the written description is intended to encompass all such aspects and their equivalents.

As used herein, “embodiment,” “example,” “aspect,” “example,” etc. may not be construed to mean that any aspect or design described is better or advantageous than other aspects or designs. .

Additionally, the terms "comprise" and/or "comprising" mean that the feature and/or element is present, but exclude the presence or addition of one or more other features, elements and/or groups thereof. It should be understood as not doing so.

Additionally, terms containing ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, a first component may be referred to as a second component, and similarly, the second component may be referred to as a first component without departing from the scope of the present invention. The term and/or includes any of a plurality of related stated items or a combination of a plurality of related stated items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, are as commonly understood by a person of ordinary skill in the technical field to which the present invention pertains. It has the same meaning. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless clearly defined in the embodiments of the present invention, have an ideal or excessively formal meaning. It is not interpreted as

Figure 1 is a configuration diagram of a firefighting equipment management and inspection device based on augmented reality and building attribute information according to an embodiment of the present invention, and Figures 2 to 9 are diagrams output to an external terminal according to the implementation of an embodiment of the present invention. This is an example of a user interface screen.

Referring to FIG. 1, the firefighting equipment management and inspection device 10 (hereinafter referred to as the device of the present invention) based on augmented reality and building attribute information according to an embodiment of the present invention includes a facility list generator 11. , an installation location recommendation unit 12 and a facility management unit 13, and additionally, a database 14 that stores and manages all data managed in the present invention, depending on the amount of data managed, is included internally or externally. It can be included as a separate terminal.

The device 10 of the present invention performs the functions of the present invention, which will be described later, through data transmission and reception with the external terminal 20, as described later. At this time, the device 10 of the present invention and the external terminal 20 are separate. As a terminal, it can be connected through a wired or wireless network and configured to enable data transmission and reception. Alternatively, the device 10 of the present invention may be configured as a part of the external terminal 20 to enable data transmission and reception through a data transmission and reception line within one terminal. In the latter case, the device 10 of the present invention can be functionally distinguished from the external terminal 20 in terms of hardware or process.

In various embodiments of the present invention, the external terminal 20 is a management terminal of an organization that performs data management and administrative work for fire laws, fire regulations, enforcement ordinances, fire administration, etc., and an indoor space to which the function of the present invention is applied. A concept that includes all terminals, such as management terminals or resident terminals in indoor spaces, that are connected to the device 10 of the present invention and use the service or provide and receive various data on the basis of the service in implementing each embodiment. It can be understood as In addition, depending on each embodiment, the device 10 of the present invention may be included, that is, a website accessible for execution or function implementation of programs and applications for implementing the functions performed by the device 10 of the present invention. It will be understood as a concept that includes all terminals capable of accessing, etc.

Meanwhile, the database 14 of the present invention is data managed in the present invention, such as hardware memory or cloud storage space, and includes data on fire regulations, etc., programs that can perform various artificial intelligence algorithms such as machine learning, and user interface implementation. Data on accounts such as programs and users, data on specifications and attribute information of firefighting equipment, attribute information on indoor space already received from the external terminal 20, and two-dimensional or three-dimensional drawing data on indoor space, or It refers to the configuration of a concept that can store all data, including modeling data.

The equipment list generator 11 is information received from the external terminal 20, including at least the use of indoor space, area, floor height, and indoor drawing information, building attribute information, pre-stored firefighting rule information, and pre-stored indoor installation information. Alternatively, a function is performed to generate a list of fire-fighting equipment to be installed in the indoor space corresponding to the building attribute information using equipment information including identification information and specification information of the deployed fire-fighting equipment.

The equipment list generator 11 generates a list of fire-fighting equipment that needs to be installed in the indoor space and stores it in the database 14, thereby implementing the initial settings for the fire-fighting equipment that needs to be installed for one indoor space, and subsequently installing the fire-fighting equipment. This is a configuration that allows the facility management unit 13, which will be described later, to perform its function accurately after firefighting equipment is installed in the relevant indoor space through registration of the equipment, etc.

In the present invention, building attribute information is a two-dimensional or three-dimensional information, along with text data about the appearance of a building with indoor space or the use of the entire or each section of the indoor space, area, total number of floors, or number of floors of each indoor space (section), etc. It is a concept that includes 3D interior drawing data.

Basically, firefighting equipment must be installed in accordance with rules legislating the installation of firefighting equipment, such as the Fire Services Supervision Act. In this case, the installation of each firefighting equipment is categorized and legislated according to the use, area, number of floors, and shape of the building and indoor space.

For example, fire extinguishing equipment is stipulated as a required installation equipment for objects with a total floor area of 33 square meters or more, and sprinklers are stipulated to be installed in the basement of a specific fire-fighting object. Emergency alarm equipment, as an alarm equipment, must be installed in a specific fire-fighting target with a total floor area of 400 square meters or more or a basement or unwindowed floor area of 150 square meters or more.

In this way, the required fire-fighting equipment can be determined in accordance with all legal regulations that present standards for installing fire-fighting equipment, including the Fire Service Act and the Fire Service Supervision Act. Accordingly, as described above, the equipment list generator 11 receives the above-described building attribute information from the external terminal 20 and uses it to crystallize the required fire-fighting equipment. Hereinafter, as described above, the previously stored firefighting rules, that is, all legal regulations presenting the installation standards for the above-mentioned firefighting equipment, and information stored in the database 14, include identification information and specifications of firefighting equipment that can be installed or placed indoors. It performs a function of generating a list of firefighting equipment that must be installed in the indoor space corresponding to the relevant building attribute information, using equipment information including information. An example of this is shown in Figure 5.

Referring to FIG. 5, the external terminal 20 executes a program or application or connects to a website according to the use of the service of the present invention to input building attribute information as described above in order to generate a list of firefighting equipment. The user interface can be output to the external terminal 20 by performing . Referring to one screen 120 of the user interface, information about the use, area, number of floors, etc. of each building or indoor space can be input through the input menu 121.

In order for users using the service to check the basis for installing fire-fighting equipment, a menu 122 for checking related regulations, a menu 123 for checking a list of created fire-fighting equipment, etc. may be included.

Returning to the description of FIG. 1, the list of firefighting equipment generated is itself, that is, in the form of a list, output as an external terminal 20, for example, to the terminal of the manager of the indoor space or the terminal of the resident or user using the indoor space. It can be. The list of firefighting equipment described above and the data available according to the implementation of each embodiment of the present invention described later are output to the external terminal 20, which means that the service according to the performance of each function of the present invention can be used in the external terminal 20. This means that the corresponding data is output to the user interface (UI) implemented in the external terminal 20 by executing the installed program or application or connecting to the accessible web page to use the service.

Meanwhile, in the case of building attribute information, it can be received from a terminal that manages data on the above-described building attribute information, such as a building designer or construction manager terminal, a building manager terminal, or an administrative agency terminal, as an external terminal 20, and can be received from a database (14 ) can be managed by receiving in advance/periodically/in real time from administrative agencies that manage the information, terminals of firefighting equipment manufacturers and suppliers, etc.

Equipment information includes the type and identification information (ex. serial number, etc.) of fire-fighting equipment that can distinguish or identify various fire-fighting equipment as described above, and specification information of the fire-fighting equipment. The type of firefighting equipment is a concept that serves as information to distinguish firefighting equipment such as fire extinguishers, fire detection sensors, and sprinklers. Specification information is information related to the function of the firefighting equipment, for example, in the case of a fire detection sensor, it includes information on the conditions (temperature, etc.) under which fire is detected, and in the case of a sprinkler, it includes information on the operating conditions and spraying force of fire extinguishing liquid. This means information that can be used to understand the function of firefighting equipment.

Meanwhile, the installation location recommendation unit 12 determines the installation location in the indoor space for the fire-fighting equipment selected by the external terminal 20 among the fire-fighting equipment included in the list of fire-fighting equipment generated by the equipment list generating unit 11. , After calculating the installation location using the facility information and building attribute information of the fire-fighting equipment, the calculated installation location is processed for each fire-fighting equipment, and provides recommended equipment installation location information to the external terminal 20.

The external terminal 20 capable of selectively inputting fire-fighting equipment may be understood to include, for example, a building manager or building resident terminal that has the right or obligation to manage the fire-fighting equipment, as described above.

When a specific fire-fighting equipment is selected by the external terminal 20, the installation location recommendation unit 12 calculates the installation location of the fire-fighting equipment in the indoor space. At this time, artificial intelligence learning technology (machine learning, etc.) such as convolution neural network (CNN) can be used. In order to recommend the installation location of indoor space for fire-fighting equipment, indoor drawing information, identification information of necessary fire-fighting equipment, and information on specifications of fire-fighting equipment can be used as input values.

At this time, using the specification information of the fire-fighting equipment, for example, if the fire-fighting equipment is installed at a specific location on the indoor drawing, it can be determined whether a response to the fire accident can be effectively carried out in the event of a fire accident. For example, in the case of sprinklers, information on the spray range of fire extinguishing fluid is used as specification information, and by reflecting this on the indoor drawing, a plurality of optimal installation positions can be selected to ensure that there is no range in which fire extinguishing fluid is not sprayed. . The same algorithm can be applied to fire detection sensors, etc. The optimal location of fire extinguishers, emergency notification devices, etc. can be calculated through the machine learning technology described above depending on the interior drawing and the purpose of the building.

At this time, when firefighting equipment is already installed in the indoor space due to the performance of the function of the equipment management unit 13, which will be described later, the firefighting equipment is derived according to the performance of the functions of the equipment list generation unit 11 and the installation location recommendation unit 12, which are described above. In the list of firefighting equipment and the recommended installation location for each firefighting equipment, information on firefighting equipment already installed in the same or similar location is excluded from the list of firefighting equipment and information on firefighting equipment recommended for installation by location, or must be installed. When printing the list of firefighting equipment to be installed and each recommended installation location, a visual effect can be applied to distinguish the already installed firefighting equipment from other firefighting equipment.

When this machine learning technology is applied, it can perform the function of allowing people who do not have important or expert knowledge about fire-fighting equipment, such as managers and residents, to easily make decisions about the installation of fire-fighting equipment. In other words, the installation location recommendation unit 12 uses the information on the relationship between fire protection equipment and fire accidents derived as a result of learning information on already installed fire protection equipment and fire accident history information for other indoor spaces through machine learning to provide information on the fire accident in the indoor space. Installation importance information for each firefighting equipment can be derived, and suggested information on the installation order in the derived order of installation importance can be included in the recommended equipment installation location information and provided to the external terminal 20. An example of this is shown in Figure 8.

The screen 150 of FIG. 8 refers to a screen that is the same or similar to the screen 130 of FIG. 6, which will be described later. At this time, an indoor drawing image is displayed on the screen 130 of FIG. 8, and on the image, installation location information 151 of firefighting equipment already installed, and recommended equipment installation locations for firefighting equipment D1 and D2 recommended for installation, are displayed on the screen 130 of FIG. Information 152 may be output. At this time, the installation importance information 153 can be set to the number of stars, as can be seen. Through this, you can intuitively check the above-mentioned installation importance information regarding the fire-fighting equipment installed or to be installed in the indoor space, and determine whether the fire-fighting equipment is currently properly installed in the indoor space and which fire-fighting equipment should be installed first. Make it easy to check whether something needs to be done or not.

In the above description and the following description, the function of providing specific data to the external terminal 20, the function of causing the external terminal 20 to output specific data, etc., refers to the fact that the corresponding data is output from the external terminal 20 to the user. The corresponding data is transmitted to the external terminal 20 so that the external terminal 20 can recognize this, and the corresponding data is processed into visual data or audio data on the user interface output as described above by performing the function of the external terminal 20. This means controlling the output.

Meanwhile, the equipment management unit 13 receives inspection information from the external terminal 20 for already installed fire-fighting equipment, manages it for each fire-fighting equipment, and provides inspection guidance information for each fire-fighting equipment to the external terminal 20. Perform.

In other words, the facility management unit 13 manages installation information of fire-fighting equipment for each indoor space, manages guidance information on inspection methods for each fire-fighting equipment, and manages fire-fighting equipment by managers or residents using the above-described user interface, etc. It is a configuration that performs functions such as management of input inspection information.

Each function of the specific facility management unit 13 will be described later. First, the facility management unit 13 can output information on the performance of the inspection function and the inspection method for this on the above-described user interface of the external terminal 20. In particular, in the present invention, the augmented reality function can be used to intuitively and conveniently perform inspection with guidance.

in other words. The equipment management unit 13 sets a boundary line of the first area where the image taken of each fire-fighting equipment should be located in the image output area where the image captured by the external terminal's photography means is output among the areas output to the output means of the external terminal. It is possible to output the inspection guide information for firefighting equipment near the boundary line of the first area.

At this time, when outputting the inspection points for each component of the fire-fighting equipment derived for each fire-fighting equipment, the inspection points for each component are output in the area adjacent to each component of each fire-fighting equipment, providing the first visual effect to each component. When detecting that an input means of an external terminal is located at an inspection point or a component for an inspection point, a second visual effect different from the first visual effect is applied to the component corresponding to the inspection point. It can be done as much as possible. Examples of this are shown in Figures 2 to 4.

First, referring to FIG. 2, one screen 100 of the user interface is an example of a screen corresponding to a menu for photographing fire-fighting equipment for new registration or inspection of fire-fighting equipment. On the screen 100, users can check the boundary line 101 of the first area as described above, and the entire screen 100 will be displayed as a real-time screen captured through the photography means of the external terminal 20. You can. At this time, the recognition menu 102 and the boundary line 101 may be augmented and output on the real-time screen captured by applying the augmented reality effect. In other words, the image 200 in FIG. 2 is not an image created as a result of static or dynamic photography, but rather a screen that is currently being photographed in real time through a photographing means.

At this time, the screen 100 of FIG. 2 may be processed like the screen 110 of FIG. 3 to which an effect is applied. The screen 110 in FIG. 3 may also mean a real-time screen captured through a photographing means. However, when outputting a real-time screen and displaying augmented information on the screen, there is an inconvenience in that the user must maintain the captured image and maintain the external terminal 20 in a position facing a specific firefighting facility.

Accordingly, in another embodiment of the present invention, after the firefighting equipment 200 is located in the first area in the example of the screen 100 of FIG. 2, such as the screen 110 of FIG. 3, the recognition menu 102 is selected. When an action such as is detected, that is, after fire-fighting equipment is located in the first area and receives a shooting input from an external terminal, the equipment management unit 13 provides inspection points and the inspection information for the fire-fighting equipment photographed on the external terminal. It is possible to output an inspection interface that allows input of to enable inspection of the firefighting equipment through the external terminal.

At this time, after receiving the shooting input, the still image of the firefighting equipment generated as a result of being photographed by the external terminal 20 can be output to the first area regardless of the subsequent change in the capturing area of the photographing means. In other words, the image 210 output on the screen 110 of FIG. 3 may be a static image generated according to the still cut shooting results, as described above. That is, the image 200 on the real-time screen described above refers to a real-time image that can be captured by a view finder, etc., using camera technology as an example, and the image 210 is a still cut image created as a result of shooting. It means.

At this time, the boundary line 111 of the first area is also visually displayed differently from the boundary line 101 in FIG. 2 to guide the user so that he or she can recognize that the function is performed after the current image is captured. At this time, the inspection points (speech balloon 'cover', 'sensor', etc.) are output near the boundary line 111 as an area adjacent to each component 112, 113 subject to inspection of firefighting equipment, as shown in FIG. Components 112 and 113 that become inspection points are given a first visual effect, such as a dotted line, as shown in FIG. 3, so that the user can intuitively check the components and inspection points 114 for the firefighting equipment. ) can be confirmed.

Meanwhile, the inspection point 114 may be different for each component. As shown in FIG. 4, on the image 210 for firefighting equipment, the inspection point or the inspection point where the input means 116 of the external terminal 20 is located. In the case of the component 113 for the inspection point, as shown in FIG. 4, it may function to provide a second visual effect so that the visual effect is different from that of the other component 112. Through this, the user can check the inspection points for the component he or she wants to inspect and perform the inspection very simply and intuitively.

Meanwhile, in addition to these first and second visual effects, a distinct visual effect is given to components or fire-fighting equipment that are prioritized for inspection depending on the current status, making it more intuitive and specialized for priority inspection for safety. It can be done without any prior knowledge.

To this end, the equipment management unit 13 may provide a different third visual effect to the boundary line of the first area or the captured image according to the inspection importance set for each firefighting equipment. At this time, the importance of inspection is preferably calculated through information on the status of the equipment calculated based on the laws and regulations regarding the supervision of fire-fighting equipment among the fire regulations and inspection information already managed regarding fire-fighting equipment.

Using legal rules, information on the inspection cycle, inspection elements, and risk factors for essential fire-fighting equipment is derived, and the most frequently or important used fire-fighting equipment when the inspection cycle is approaching, the risk factors are high, or a fire accident occurs. The importance of inspection of firefighting equipment can be set to a high level. In addition, based on the already managed inspection information, the importance of inspection can be set for fire-fighting equipment whose inspection has been performed for a long time, fire-fighting equipment with a history of failure, and fire-fighting equipment in indoor spaces with a history of fire accidents. there is.

In this case, on the screen 110 of FIG. 3, a third visual effect 115, etc. is displayed near each component or fire-fighting equipment. As an example of the visual effect, fire-fighting equipment with a large number of stars indicates the importance of inspection. It can be implemented so that it can be perceived as high.

Meanwhile, an example of the above-described inspection interface for firefighting equipment output as described above is shown in FIG. 7. In the screens 110 and 100 described above, users may request execution of the inspection interface, and as a result of the execution, the interface screen 140 of FIG. 7 may be output. On the corresponding screen 140, users can recognize the first area through the boundary line 101 and the firefighting equipment to be inspected through the image 210 inside it.

At this time, by selecting each selection menu 142 as the inspection information input menu 141, inspection information for inspecting each component of a fire-fighting equipment can be input. At this time, referring to the inspection information input menu 141 shown in FIG. 7, it can be inferred that a menu that allows inspection of the corresponding firefighting equipment is output for each firefighting equipment.

In other words, the facility management unit 13 can output different inspection interfaces depending on the firefighting equipment. At this time, identifying fire-fighting equipment as a standard may vary depending on the results of filming and recognition of fire-fighting equipment, as can be inferred from the above-mentioned example.

That is, as described above, users can photograph firefighting equipment using the photographing means of the external terminal 20, and the facility management unit 13 analyzes the real-time captured image 200 or the captured image 210 accordingly. do. In other words, the identification information of the fire-fighting equipment derived as a result of comparing the object recognized through object analysis of the fire-fighting equipment photographed in the first area and the modeling data for each fire-fighting equipment stored in the database is sent to the inspection interface for each fire-fighting equipment previously stored in the database. By applying it, different inspection interfaces are output for each firefighting equipment.

Through this, each fire-fighting equipment can be conveniently recognized without specialized knowledge of the name of the fire-fighting equipment, and the different inspection methods can be learned very intuitively and conveniently, allowing for accurate inspection and inspection by residents and managers rather than experts. This has the effect of enabling continuous inspection of firefighting equipment.

Meanwhile, it is necessary to replace specific fire-fighting equipment depending on the history of fire accidents occurring in existing fire-fighting equipment, the history of fire accidents occurring in other indoor spaces, and the damage results (response results). Or, even if the use of indoor space changes, replacement of firefighting equipment may be necessary. In other words, if significant damage occurs in the event of a fire despite the initial design, or if the use of the indoor space has changed compared to the initial design, as a follow-up response, specific firefighting equipment is installed to ensure a more effective response. A replacement can be suggested.

For this purpose, in each embodiment of the present invention, the facility management unit 13 stores space use information including occupant information of the indoor space input from the external terminal 20, usage status information, and information on pre-installed firefighting equipment in the database. Renewal of firefighting equipment, including proposed information on at least one of replacement of already installed firefighting equipment and installation of new firefighting equipment, compared with previously stored space use information for other indoor spaces and fire accident history information for other indoor spaces. It is desirable to generate recommendation information and output it to a second area different from the image output area among the areas output to the output means of the external terminal 200.

An example of this is shown in FIG. 6, where the second area is output at the same time as the above-described first area where images 210 of firefighting equipment, etc. are output in the inspection interface, or the first area is displayed as in the screen 130 of FIG. 6. It can be implemented to be displayed on a tab different from the area or on a different interface screen.

For example, the second area is not a single fire-fighting equipment, but a screen where the fire-fighting equipment already installed in the indoor drawing image is displayed or the installation location for the fire-fighting equipment output by performing the function of the installation location recommendation unit 12 described above is displayed. It may mean (131). At this time, in addition to the installation position 134 of the new equipment and the installation position 132 of the already installed fire-fighting equipment, the installation position 133 of the fire-fighting equipment that has already been installed but needs to be replaced as a result of performing the process described above. It can be output, and at the installation location (134) of the new equipment, a recommended equipment view menu (135) is displayed so that the user can intuitively check which firefighting equipment is recommended to be installed at that location. When the user selects this, the recommended equipment view menu (135) is displayed. Equipment information on firefighting equipment recommended for installation in the location can be output.

Meanwhile, in the output of the installation location 133 of the fire-fighting equipment that needs to be replaced, similar to new equipment, the recommended equipment view menu ( 136) is output, and when the user selects it, equipment information on firefighting equipment recommended for replacement and installation at the corresponding location may be output.

Meanwhile, in addition to the management of the above-mentioned inspection and maintenance, the facility management unit 13 enables registration of the fire-fighting equipment as an already installed fire-fighting equipment when a specific fire-fighting equipment is installed, allowing users to more conveniently use fire-fighting equipment. It is possible to manage the installation of equipment in indoor spaces.

To this end, the equipment management unit 13 compares the object recognized through object analysis of the image captured by the external terminal 20, the modeling data for each firefighting equipment stored in the database, and the modeling data for the indoor space, and photographs the object. Identify the firefighting equipment included in the image and the installation location of the firefighting equipment. This can be implemented through object identification through image analysis, background color identification, shooting direction analysis through a geomagnetic sensor, and triangular signal quantity measurement of wireless network signals, along with performing the object identification function of the firefighting equipment described above.

Afterwards, as a result of comparing firefighting equipment information for each indoor space stored in the database, if it is determined that the identified firefighting equipment is not installed at the identified installation location, the identified firefighting equipment is newly installed at the identified installation location. If it is determined that this is possible, the firefighting equipment information already installed for each indoor space stored in the database can be updated.

On the other hand, if there is no automatic identification function for the installation location described above, users can use the user interface in which the menu where the indoor drawing image is output and the menu for registering new firefighting equipment are simultaneously displayed on a specific area on the indoor drawing image. You can also perform registration for new fire-fighting equipment by selecting and then entering a new fire-fighting equipment registration request for that location. At this time, the registration request may include processes such as taking images of the firefighting equipment described above.

An example of this is shown in FIG. 9. When a specific firefighting equipment 211 is located inside the boundary line 101 on the interface screen 160 of FIG. 9, the equipment management unit 13 performs image analysis and object recognition. Fire-fighting equipment 211 is detected through the system, and users are accordingly notified that new fire-fighting equipment has been detected. At this time, the user can register new firefighting equipment through the registration menu 161 displayed on the interface screen 160. At this time, registration is performed through the automatic location recognition described above or manual location input such as output of an indoor drawing image and location selection. This can be done.

Meanwhile, in addition to performing the function of receiving and managing inspection information through the external terminal 20 described above, the facility management unit 13 is a facility that is capable of receiving control and management information by connecting firefighting equipment on a network, The equipment can be automatically monitored regardless of receipt of inspection information from the external terminal 20.

That is, for example, in this embodiment, the firefighting equipment is connected to the equipment management unit 13 through a network, so that operation can be controlled by the equipment management unit 13, the external terminal 20, and/or other management terminals, and the firefighting equipment It will be understood that this can be implemented if the generated data is a facility that can be transmitted to the external terminal 20 of the facility management unit 13 and/or other management terminals.

In this case, the equipment management unit 13 is real-time data generated when the fire-fighting equipment is driven, including control commands that cause the fire-fighting equipment to operate, status information when driving the fire-fighting equipment, and operation error information of the fire-fighting equipment. Monitoring data can be received from firefighting equipment and managed by including it in inspection information.

That is, in addition to the inspection information for each fire-fighting equipment transmitted by the external terminal 20, there is a function such as generating inspection data from the fire-fighting equipment when the fire-fighting equipment operates or according to the inspection of the fire-fighting equipment with an automatic inspection function. When implemented, it is possible to receive and manage monitoring information according to the operation of the fire-fighting equipment, thereby enabling more accurate and integrated monitoring of the fire-fighting equipment.

FIG. 10 illustrates an example of the internal configuration of a computing device according to an embodiment of the present invention. In the following description, descriptions of unnecessary embodiments that overlap with the description of FIGS. 1 to 9 described above will be omitted. Do this.

As shown in FIG. 10, the computing device 10000 includes at least one processor 11100, a memory 11200, a peripheral interface 11300, and an input/output subsystem ( It may include at least an I/O subsystem (11400), a power circuit (11500), and a communication circuit (11600). At this time, the computing device 10000 may correspond to a user terminal (A) connected to a tactile interface device or the computing device (B) described above.

The memory 11200 may include, for example, high-speed random access memory, magnetic disk, SRAM, DRAM, ROM, flash memory, or non-volatile memory. there is. The memory 11200 may include software modules, instruction sets, or various other data necessary for the operation of the computing device 10000.

At this time, access to the memory 11200 from other components such as the processor 11100 or the peripheral device interface 11300 may be controlled by the processor 11100.

The peripheral interface 11300 may couple input and/or output peripherals of the computing device 10000 to the processor 11100 and the memory 11200. The processor 11100 may execute a software module or set of instructions stored in the memory 11200 to perform various functions for the computing device 10000 and process data.

The input/output subsystem 11400 can couple various input/output peripheral devices to the peripheral interface 11300. For example, the input/output subsystem 11400 may include a controller for coupling peripheral devices such as a monitor, keyboard, mouse, printer, or, if necessary, a touch screen or sensor to the peripheral device interface 11300. According to another aspect, input/output peripheral devices may be coupled to the peripheral interface 11300 without going through the input/output subsystem 11400.

Power circuit 11500 may supply power to all or some of the terminal's components. For example, power circuit 11500 may include a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator, or a power source. It may contain arbitrary other components for creation, management, and distribution.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, if necessary, the communication circuit 11600 may include an RF circuit to transmit and receive RF signals, also known as electromagnetic signals, to enable communication with other computing devices.

This embodiment of FIG. 10 is only an example of the computing device 10000, and the computing device 11000 omits some components shown in FIG. 10, further includes additional components not shown in FIG. 10, or 2. It may have a configuration or arrangement that combines more than one component. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor in addition to the components shown in FIG. 10, and may be configured to use various communication methods (WiFi, 3G, LTE) in the communication circuit 1160. , Bluetooth, NFC, Zigbee, etc.) may also include circuitry for RF communication. Components that may be included in the computing device 10000 may be implemented as hardware, software, or a combination of both hardware and software, including one or more signal processing or application-specific integrated circuits.

Methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded on a computer-readable medium. In particular, the program according to this embodiment may be composed of a PC-based program or a mobile terminal-specific application. The application to which the present invention is applied can be installed on a user terminal through a file provided by a file distribution system. As an example, the file distribution system may include a file transmission unit (not shown) that transmits the file according to a request from the user terminal.

The device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), It may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device may include multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used by any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. It can be embodied permanently or temporarily. Software may be distributed over networked computing devices and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with limited examples and drawings, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent. Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims (9)

It relates to a firefighting equipment management and inspection device based on augmented reality and building attribute information implemented as a computing device including one or more processors and one or more memories storing instructions executable by the processor,
Information received from an external terminal, including building attribute information including at least the use, area, floor height, and interior drawing information of the indoor space, previously stored firefighting rule information, and previously stored identification information and specification information of firefighting equipment installed or placed indoors. A facility list generator that generates a list of firefighting equipment to be installed in the indoor space corresponding to the building attribute information using equipment information including;
Among the firefighting equipment included in the list of firefighting equipment created by the equipment list generator, the installation location of the indoor space for the firefighting equipment selected by the external terminal is calculated using the equipment information and building attribute information of the firefighting equipment. At the back, an installation location recommendation unit that processes the calculated installation location for each firefighting equipment and provides recommended facility installation location information to an external terminal; and
It includes a facility management unit that receives inspection information from external terminals for already installed fire-fighting equipment, manages each fire-fighting equipment, and provides inspection guidance information for each fire-fighting equipment to external terminals;
The facility management department.
Out of the areas output to the output means of the external terminal, output a boundary line of a first area where the image captured by each fire-fighting equipment should be located in the image output area where the image captured by the photographing means of the external terminal is output, and the first The above inspection guide information on firefighting equipment should be printed near the boundary line of the area.
When outputting the inspection points for each component of firefighting equipment derived from each firefighting equipment, the inspection points for each component are output in the area adjacent to each component of each firefighting equipment, giving the first visual effect to each component. When detecting that the input means of the external terminal is located for an inspection point, a second visual effect that is different from the first visual effect provided to the component corresponding to the inspection point is provided,
The facility management department,
After the fire-fighting equipment is located in the first area, when receiving a shooting input from an external terminal, an inspection interface that allows input of inspection points and the inspection information for the fire-fighting equipment photographed in the external terminal is output to the external terminal. To enable inspection of the above fire-fighting equipment,
Augmented reality and building attribute information, characterized in that after receiving the shooting input, the image of the firefighting equipment captured by the external terminal is output to the first area regardless of changes in the capturing area of the subsequent capturing means. Firefighting equipment management and inspection device based.
delete delete According to paragraph 1,
The facility management department,
Space usage information including occupant information, usage status information, and information on firefighting equipment already installed in the indoor space input from an external terminal, space usage information for other indoor spaces previously stored in the database, and fire accident history for other indoor spaces. Compare the information to generate firefighting equipment renewal recommendation information including proposal information for at least one of replacement of already installed firefighting equipment and installation of new firefighting equipment, and output the image from the area output to the output means of the external terminal. A firefighting equipment management and inspection device based on augmented reality and building property information, characterized by outputting to a second area different from the area.
According to paragraph 1,
The facility management department,
A different third visual effect is given to the boundary line of the first area or the captured image according to the inspection importance set for each firefighting equipment,
The importance of the above inspection is,
Based on augmented reality and building attribute information, which is characterized in that it is calculated through information on the status of the equipment calculated based on the legal rules regarding the supervision of fire-fighting equipment among the fire-fighting rules and inspection information already managed regarding the fire-fighting equipment. Firefighting equipment management and inspection device.
According to paragraph 1,
The facility management department,
Output an inspection interface that allows input of inspection information about the fire-fighting equipment in a third area that is different from the first area,
The identification information of the fire-fighting equipment derived as a result of comparing the object recognized through object analysis of the fire-fighting equipment photographed in the first area and the modeling data for each fire-fighting equipment stored in the database is applied to the inspection interface for each fire-fighting equipment previously stored in the database. A fire-fighting equipment management and inspection device based on augmented reality and building property information, characterized in that different inspection interfaces are output depending on the fire-fighting equipment.
According to paragraph 1,
The installation location recommendation section,
Using the correlation information between firefighting equipment and fire accidents derived as a result of learning information on already installed firefighting equipment and fire accident history information for other indoor spaces through machine learning, information on the importance of installation of each firefighting equipment for indoor spaces is derived, A firefighting equipment management and inspection device based on augmented reality and building attribute information, characterized in that suggested information on the installation order in the order of installation importance is included in the recommended equipment installation location information and provided to the external terminal.
According to paragraph 1,
The facility management department,
Firefighting equipment and its installation location included in images captured by comparing objects recognized through object analysis of images taken from an external terminal, modeling data for each firefighting equipment stored in the database, and modeling data for indoor space. As a result of identifying and comparing firefighting equipment information for each indoor space stored in the database, if it is determined that the identified firefighting equipment is not installed at the identified installation location, the identified firefighting equipment is installed at the identified installation location. A firefighting equipment management and inspection device based on augmented reality and building property information, which is characterized by updating the firefighting equipment information already installed for each indoor space stored in the database upon determining that it is newly installed.
According to paragraph 1,
The facility management department,
If the fire-fighting equipment is connected to the equipment management unit through a network and the operation can be controlled by the equipment management unit, and the data generated by the fire-fighting equipment can be transmitted to the equipment management unit, the data generated when the fire-fighting equipment is driven in real time As such, real-time monitoring data including control commands causing the operation of the fire-fighting equipment, status information during operation of the fire-fighting equipment, and operation error information of the fire-fighting equipment are received from the fire-fighting equipment, and are included in the inspection information and managed. Firefighting equipment management and inspection device based on augmented reality and building attribute information.