KR101831874B1 - Apparatus and Method for Augmented reality based Escape from the Disaster Site - Google Patents

Abstract

The present invention relates to a device and a method for guiding augmented reality-based disaster site escape, which guide an escape route by using an augmented reality in an actual accident site. The method for guiding augmented reality-based disaster site escape which is executed in a computer terminal comprises the following steps of: executing an emergency escape augmented reality application; checking a disaster site location through a GPS location-based service; generating a site type and emergency escape route information from a current location; synthesizing a virtual image including the emergency escape route information, and generating augmented reality content; and synthesizing and displaying the generated augmented reality content with an actual image of the current location.

Description

TECHNICAL FIELD The present invention relates to augmented reality-based escape route guidance apparatus and method,

The present invention relates to a method and apparatus for detecting an accident in an actual accident scene where a person can not see objects due to toxic gas generation or power outage in an enclosed space due to various disasters such as fire, collapse or flooding in an indoor or outdoor environment of a subway or a building, Augmented reality-based disaster site escape guidance apparatus and method for guiding an escape route using an augmented reality (AR).

The entire world is exposed to various kinds of disaster safety accidents, fire and terrorism, and various education programs such as disaster preparedness training to protect lives. However, systems and programs Is not available.

If you can evacuate people who are in a crisis by giving them a path to escape the dangerous area faster and faster than 1 minute and 1 second in a disaster area where toxic gas and power outages can not be seen, do.

Recently, augmented reality technology has been developed and used in various industrial fields.

Therefore, according to the present invention, it is possible to provide a system and method for escape from a disaster site by combining mobile information applications based on an augmented reality, a structure of each building, and the like, We want to transmit real-time information.

Korean Patent Publication No. 10-2013-0085653 (Jul. 30, 2013)

SUMMARY OF THE INVENTION It is an object of the present invention to provide an augmented reality-based disaster scene escape guidance apparatus and method for guiding an escape route using an augmented reality at an actual accident site.

In addition, it is possible to realistically synthesize the building structure and shape of the target building in real time to the person wearing the apparatus of the present invention in real time on the monitor of the augmented reality device, the augmented reality glasses, In order to enable safe and quick escape from the disaster scene.

In addition, it is possible to attach obstacle detection, heat detection, smoke detection, respiration / pulse detection sensor, GPS position sensor, transmit health state and movement position of disaster person through real time network communication, The object of the present invention is to provide avoidance direction information.

It is also an object of the present invention to induce disaster personnel to move safely to the doorway by voice and LED induction lamps to individual terminals operating the system when the escape route guidance display displayed on various monitors is activated.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems which are not mentioned can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, an augmented reality-based disaster area escape guidance apparatus includes a GPS position sensor; The location of the disaster area is confirmed from the GPS position sensor through the GPS location based service, the emergency escape augmented reality application is executed, the field type and emergency escape route information are generated from the current position, and the emergency escape route information including the emergency escape route information A control unit for generating AR (Augmented Reality) contents; And a display unit for combining the augmented reality contents generated by the control unit with a real image of a current location and displaying the synthesized augmented reality contents.

The display unit may be implemented as any one of an augmented reality monitor, augmented reality glasses, and a respirator.

And a control unit for controlling the health state and the current position of the disaster person sensed by the sensors to the control server through the real time network communication of the communication unit, And escape direction information can be received so as to secure and guide a safe escape route.

It is preferable to output voice to the speaker of the individual terminal when the escape route guidance display displayed on the display unit is activated and to induce the disaster-prone persons to move to the safe entrance by lighting the LED induction lamp simultaneously with a plurality of terminals Do.

According to an embodiment of the present invention, an augmented reality-based disaster scene escape guidance method includes: executing an emergency escape augmented reality application executed in a computer terminal; Identifying a disaster site location through a GPS location based service; Generating field type and emergency escape route information from the current location; Generating an augmented reality content by synthesizing a virtual image including the escape route information; And synthesizing the generated augmented reality contents with a real image of a current location and displaying the synthesized augmented reality contents.

Preferably, the emergency escape augmented reality application is registered in advance in a memory through a building design drawing of each building, road view modeling information of a moving passage from each position to an entrance, and GPS position information.

Other specific details of the invention are included in the detailed description and drawings.

According to the augmented reality-based disaster scene escape guidance apparatus and method according to an embodiment of the present invention configured as described above, it is possible to guide an escape route using an augmented reality at an actual accident scene, Real-time synthesis of building structure and form in the target building in real-time to a person in real-time, such as augmented reality device monitor, augmented reality glasses, and augmented reality implementation gas mask device, And allow them to escape quickly.

In addition, it is possible to attach obstacle detection, heat detection, smoke detection, respiration / pulse detection sensor, GPS position sensor, transmit health state and movement position of disaster person through real time network communication, There is an effect of providing avoiding direction information.

In addition, when an escape route guidance display displayed on various monitors is activated, there is an effect of inducing disaster persons to move to a safe entrance through audio and LED induction lamps to individual terminals operating the system.

The effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

FIG. 1 is a block diagram illustrating an augmented reality-based disaster site escape guidance apparatus according to an embodiment of the present invention.
FIG. 2 is a flowchart illustrating a step of registering an augmented reality application according to an embodiment of the present invention;
3 is a flowchart illustrating a method of guiding a disaster site escape based on an augmented reality according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of the invention to those skilled in the art. To fully disclose the scope of the invention, and the invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The term " comprises " And / or "comprising" does not exclude the presence or addition of one or more other elements in addition to the stated element. Like reference numerals refer to like elements throughout the specification and "and / or" include each and every combination of one or more of the elements mentioned. Although "first "," second "and the like are used to describe various components, it is needless to say that these components are not limited by these terms. These terms are used only to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical scope of the present invention.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense that is commonly understood by one of ordinary skill in the art to which this invention belongs. In addition, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The terms spatially relative, "below", "beneath", "lower", "above", "upper" And can be used to easily describe a correlation between an element and other elements. Spatially relative terms should be understood in terms of the directions shown in the drawings, including the different directions of components at the time of use or operation. For example, when inverting an element shown in the figures, an element described as "below" or "beneath" of another element may be placed "above" another element . Thus, the exemplary term "below" can include both downward and upward directions. The components can also be oriented in different directions, so that spatially relative terms can be interpreted according to orientation.

With reference to the accompanying drawings, preferred embodiments of the present invention will be described in detail.

The present invention provides a method and apparatus for combining basic data such as architectural design drawings, bird's-eye views, photographs, and virtual escape route guidance displays to an augmented reality apparatus for emergency escape from actual fire disaster sites. Particularly, the present invention allows a fire to be seen on the screen even if it is not visible due to smoke when a fire occurs in the subway, so that it can escape. Therefore, the inside of a subway, a building, etc. can be seen in real time, so that the escape route can be guided to escape from a point where a fire occurs.

To this end, the present invention discloses an augmented reality-based disaster site escape guidance apparatus as shown in Fig.

1, the present invention includes an obstacle detection sensor 10, a heat detection sensor 11, a smoke detection sensor 12, a respiration / pulse detection sensor 13, a GPS position sensor 14, a controller 15 A speaker 16, an LED induction lamp 17, a display unit 18, a communication unit 19, a memory 20, and a communication terminal 21.

The communication terminal according to the present invention can be divided into a mobile terminal and a stationary terminal depending on whether the terminal can be moved or not. The terminal can be divided into a handheld terminal, And a vehicle mount terminal. In addition, various terminals can be applied.

For example, the mobile terminal may include a mobile phone, a smart phone, a laptop computer, a digital broadcast terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

The GPS position sensor 14 can use the GPS signal to determine the disaster scene position. A GPS (Global Position System) position sensor functions as a position information module for acquiring the position of the mobile terminal.

The control unit 15 confirms the disaster scene location through the GPS location based service from the GPS position sensor 14 and executes the emergency escape augmented reality application. Also, it is possible to generate scene type and emergency escape route information from the current position, and to generate Augmented Reality contents including the emergency escape route information.

The display unit 18 synthesizes the augmented reality contents generated by the controller 15 with the real image at the current position and displays the resultant.

The display unit 18 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

In addition, a camera and a microphone for inputting an audio signal or a video signal may be included. The camera processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display section 18. The image frame processed by the camera can be stored in the memory 20 or transmitted to the outside via the wireless communication unit 19. [

At this time, the display unit 18 is preferably implemented as any one of an augmented reality monitor, augmented reality glasses, and a respirator.

Further, the present invention further includes an obstacle detection sensor 10, a heat detection sensor 11, a smoke detection sensor 12 and a breathing / pulse detection sensor 13. The control unit 15 controls the sensors 10, 11, 12, and 13) to the control server 21 through the real-time network communication of the communication unit 19 and to secure and guide a safe escape route, Information can be received.

For example, the communication unit 19 may include a wired / wireless communication unit, a broadcast receiving module, a mobile communication module, a wireless Internet module, a short distance communication module, and a location information module.

In addition, when the escape route guidance display displayed on the display unit 18 is activated, voice is outputted to the speaker 16 of the individual terminal, and the LED induction lamp 17 is lighted simultaneously with a plurality of terminals, It is preferable to induce the passengers to move to a safe entrance to recognize the escape route.

FIG. 2 is a flowchart illustrating a step of registering an augmented reality application according to an embodiment of the present invention. FIG. 3 is a flowchart illustrating an augmented reality-based disaster site escape guidance method according to an embodiment of the present invention.

In the step of registering an augmented reality application according to an embodiment of the present invention, the emergency escape augmented reality application registers in a memory through a building design drawing of each building, road view modeling information of a moving passage from each position to a doorway, .

Therefore, as shown in FIG. 2, 3D building modeling (geometric modeling, procedural modeling, 3D scanning, and image-based modeling) of building design drawings can be performed in order to implement each building indoor / outdoor structure type modeling ).

At this time, route load view modeling of the moving passage from each position to the entrance can be performed. Alternatively, a fast path road view modeling (generation of a GPS-based position and orientation attitude information sensor) to an entrance through a DSLR camera photograph, a moving picture photographing, a GPS-based position distance coordinate allocation, and the like can be generated S120.

The fire escape accentuation augmented reality application thus generated can be registered in advance in the memory 20 (S130).

3 is a flowchart illustrating a method of guiding a disaster site escape based on an augmented reality according to an embodiment of the present invention.

As shown in the figure, the method for guiding a disaster area escape route based on an augmented reality according to an embodiment of the present invention includes the steps of: executing (S210) an emergency escape augmented reality application executed in a computer terminal; Confirming the disaster site location through the GPS location-based service (S220 to S240); Generating (S250) the scene type and emergency escape route information from the current location; (S260) of generating an augmented reality content by synthesizing a virtual image including the escape route information (S260), and displaying the generated augmented reality content by combining the augmented reality content with a real image of a current location (S270).

More specifically, in the step S210 of executing the emergency escape augmented reality application, the augmented reality application device is activated in the space of the current location as an emergency augmented reality building.

In the step S220 to S240 of confirming the disaster scene position through the GPS location-based service, a smart glass equipped with a camera for implementing an augmented reality (AR) driven respirator wearing augmented reality or augmented reality is worn, (Transmitting / receiving rotation information of the moving direction of the mobile device).

Then, the location of the current accident location is automatically generated by activating the GPS location based service.

In the step S250 of generating the scene type and the emergency escape route information from the current position, the current position and direction information is automatically generated in the augmented reality monitor. In this case, do.

In the step S260 of generating the augmented reality contents by synthesizing the virtual image including the emergency escape route information, the direction display virtual image is synthesized on the current position real image to display the direction and the distance to the exit.

In step S270, the generated augmented reality contents are combined with a real image of the current location and displayed, and the combined moving image of the escape route guidance is displayed. At this time, the real time moving location / situation is automatically transmitted to the control system to complete the escape .

As an additional function of the escape guidance augmented reality device, it monitors the real-time emergency situation of the disaster site and automatically avoids the danger scene, and sends the health state and damage situation of the disaster person to the real- Of-the-art on-site support.

In addition, it is possible to provide an optimization system for identifying the cause of various accidents such as the point of ignition and the point of collapse at the scene of the accident by activating the fire and emergency reality application for escape from the scene.

In addition, by activating the application, guidance of evacuation route can be synthesized to induce evacuation, evacuation route, etc. in real time, and devices / devices are equipped with obstacle detection sensor, open detection sensor, smoke concentration detection sensor, respiratory pulse detection sensor It is possible to display the avoidance mark on the monitor automatically to avoid the danger of the second danger and to send the current health status of the disaster person to the real-time control system to help the structure have.

In addition, real-time information of the GPS-based accident location is automatically linked with the application and real-time confirmation is made in the control system to prevent relief of the disaster who can not wear the device or equipment. This function can be used to guide the disaster-free disaster victims to the safe exit by lighting the LED red lamp on the front and back of the voice guidance system and the function.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

10: Obstacle detection sensor 11: Heat sensor
12: Smoke detection sensor 13: Respiration / pulse detection sensor
14: GPS position sensor 15:
16: Speaker 17: LED Induction Lamp
18: display unit 19: communication unit
20: memory 21: control server

Claims (6)

GPS position sensor;
The location of the disaster area is confirmed from the GPS position sensor through the GPS location based service, the emergency escape augmented reality application is executed, the field type and emergency escape route information are generated from the current position, and the emergency escape route information including the emergency escape route information A control unit for generating AR (Augmented Reality) contents;
A display unit for synthesizing and displaying the augmented reality contents generated by the controller with a real image at a current location; And
An obstacle detection sensor, a heat detection sensor, a smoke detection sensor, and a breathing / pulse detection sensor,
The control unit transmits the health state and the current position of the disaster person detected by the sensors to the control server through the real time network communication of the communication unit, receives the avoidance direction information to secure and guide the safe escape route,
When the escape route guidance display displayed on the display unit is activated, voice is output to the speaker of the individual terminal, and simultaneously the plurality of terminals are interlocked to light up the LED induction lamp, thereby inducing the disaster- Augmented reality based disaster site escape guidance device. The method according to claim 1,
Wherein the display unit is implemented as any one of an augmented reality monitor, augmented reality glasses, and a respirator. delete delete A computer-
Executing an emergency escape augmented reality application;
Identifying a disaster site location through a GPS location based service;
Generating field type and emergency escape route information from the current location;
Generating an augmented reality content by synthesizing a virtual image including the escape route information; And
Synthesizing the generated augmented reality contents with a real image of a current location, and displaying the result;
The computer terminal may further include an obstacle detection sensor, a heat detection sensor, a smoke detection sensor, and a respiration / pulse detection sensor. The health state and the current position of the disaster detected by the sensors are transmitted to the control server And receives escape direction information so as to secure and guide a safe escape route,
When the escape route guidance display displayed on the display unit is activated, audio is output to the speaker of the individual terminal, and simultaneously the plurality of terminals are interlocked with each other to light up the LED induction lamp to guide the disaster- Augmented reality - based escape guidance method. 6. The method of claim 5,
The emergency escape augmented reality application
A building design drawing of each building, road view modeling information of a moving path from each position to an entrance, and GPS position information.

Images