JP2021071925A - Evacuation guidance system - Google Patents

Abstract

To provide an evacuation guidance system enabling a person carrying a portable terminal to intuitively recognize a direction, in which the person should evacuate, by looking at a display section of the portable terminal in the event that the person encounters a disaster such as a fire indoors.SOLUTION: An evacuation guidance system includes a portable terminal that receives a signal sent from an originator installed in a predetermined area and transmits information on the originator, a position information server that can transmit image data, based on which an image showing a current position of the portable terminal is displayed, on the basis of originator information sent from the portable terminal, and an evacuation guidance server that determines an evacuation route or evacuation direction on the basis of fire information sent from a receiver capable of receiving a fire detection signal from a fire sensor, and portable terminal position information sent from the position information server, produces evacuation guidance information, and transmits the evacuation guidance information to the associated portable terminal. The portable terminal receives the evacuation guidance information and evacuation information, and displays on a display section an evacuation guidance image showing the position of the portable terminal and the evacuation route or evacuation direction.SELECTED DRAWING: Figure 2

Description

The present invention relates to an evacuation guidance system using a mobile terminal, and particularly to an evacuation guidance system capable of displaying evacuation information on a mobile terminal and performing evacuation guidance in the event of a fire in a facility such as a building or an underground shopping area. ..

When a disaster such as a fire occurs in a facility such as a building or an underground mall, many people are forced to evacuate all at once, but the larger the facility, the longer it takes to evacuate to a safe area. , It is important to properly inform information such as evacuation routes.
Conventionally, regarding a technique for displaying evacuation information such as an evacuation route using a mobile terminal, an invention has been proposed in which effective information is displayed when evacuating outdoors (see, for example, Patent Document 1). The present invention provides a mobile terminal with information that is effective when evacuating outdoors. Outdoors, by transmitting the position information of the mobile terminal to the server using GPS radio waves, the server is located at the position of the mobile terminal. Although it has the advantage of being able to provide evacuation information according to the situation, it cannot be applied to indoor evacuation guidance where GPS radio waves do not reach.

On the other hand, regarding indoor evacuation guidance, an invention of a disaster prevention support system has been proposed that enables disaster prevention personnel to transmit their own position information, fire position information, and evacuation route using a mobile terminal (for example, Patent Document 2). reference).
In the invention of Patent Document 2, a fire receiver is built in or associated with a terminal device of an automatic fire alarm system such as a fire detector or an alarm device arranged in a fire prevention object, and a disaster prevention personnel is provided. Local wireless communication is performed with the mobile terminal owned by the company to determine the terminal position, and the fire position information and the terminal position information are transmitted to the mobile terminal to support disaster prevention personnel in the event of a fire.

Japanese Unexamined Patent Publication No. 2011-186681 Japanese Unexamined Patent Publication No. 2015-153177

The invention of the disaster prevention support system described in Patent Document 2 can display a map showing the current position and evacuation route of the disaster prevention personnel carrying the mobile terminal on the display unit of the mobile terminal, but the orientation of the map Does not change according to the orientation of the mobile terminal, so disaster prevention personnel who see the map cannot intuitively recognize which direction to evacuate. Further, while it is dangerous to take an evacuation action while looking at the display unit displayed on the map, there is a problem that the situation cannot be grasped if the user moves away from the display unit.

Patent Document 1 describes that information such as an evacuation route is superimposed on a live-action image taken by an own terminal using AR (augmented reality) technology and displayed on a display unit, but the fire was damaged indoors. In this case, if the room is filled with smoke generated by a fire or the like, the live-action image becomes unclear, and it is not possible to intuitively recognize which direction to evacuate. Even if the AR technology can superimpose the evacuation information on the live-action video and display it, it is unrealistic for the terminal carrier to move while looking at the display unit of the terminal all the time. Since the evacuation information cannot be recognized while moving away, there is a problem that the situation cannot be grasped accurately.

The present invention has been made in the background as described above, and an object of the present invention is to evacuate by looking at the display unit of the mobile terminal when the carrier of the mobile terminal encounters a disaster such as a fire indoors. The purpose is to provide an evacuation guidance system that can intuitively recognize the direction to be taken.
Another object of the present invention is to provide an evacuation guidance system capable of recognizing the direction to evacuate from the display of the mobile terminal even if the room is filled with smoke and the live-action image becomes unclear. is there.
Still another object of the present invention is to provide an evacuation guidance system capable of knowing disaster-related information such as a degree of danger through hearing even while the carrier of the mobile terminal is looking away from the display unit of the mobile terminal. There is.

In order to solve the above problems, the present invention
It is equipped with a display unit that can display an image, an imaging means that can shoot a moving image, and a sensor that can detect the posture and orientation, and receives a signal from a transmitter installed in a predetermined area to identify the transmitter. A mobile terminal capable of transmitting transmitter information including information and self-identification information,
A location information server capable of transmitting image data to the mobile terminal for displaying an image corresponding to the current position of the mobile terminal on the display unit of the mobile terminal based on the transmitter information from the mobile terminal.
An evacuation route based on fire information including fire occurrence location information transmitted by a receiver capable of receiving a fire detection signal from a fire detector installed in the predetermined area and mobile terminal location information from the location information server. Alternatively, an evacuation guidance server that determines the evacuation direction, generates evacuation guidance information, and sends the evacuation guidance information to the corresponding mobile terminal.
In the evacuation guidance system equipped with
The mobile terminal receives the image data from the position information server and the evacuation guidance information from the evacuation guidance server, and displays the position and evacuation route or evacuation direction of the mobile terminal on the display unit as an extended reality image. Alternatively, an evacuation guidance image superimposed on the virtual reality image is generated so that it can be displayed on the display unit.

According to the evacuation guidance system having the above configuration, when a fire breaks out in the monitoring area, an image showing the position of the mobile terminal and the evacuation route or evacuation direction is displayed on the display unit of the mobile terminal. Therefore, even if a disaster such as a fire is encountered indoors in a facility with a large area, the carrier of the mobile terminal can evacuate quickly and safely.

Here, preferably, the mobile terminal transmits the posture and orientation information of the mobile terminal detected by the sensor to the evacuation guidance server.
The evacuation guidance server generates superposed evacuation guidance information based on the attitude and orientation information from the mobile terminal and the mobile terminal position information from the location information server, and sends the evacuation guidance information to the mobile terminal. ,
The mobile terminal that has received the evacuation guidance information can superimpose the received evacuation guidance information on the moving image of the surrounding scene taken by the imaging means and display it as an augmented reality image on the display unit. Configure.
According to such a configuration, since the AR image in which the evacuation information is superimposed on the live-action video is displayed on the display unit of the mobile terminal, the carrier of the mobile terminal can intuitively recognize the direction to evacuate and can quickly recognize the direction. And you can evacuate safely.

Further, preferably, the mobile terminal transmits the posture and orientation information of the mobile terminal detected by the sensor to the evacuation guidance server.
The evacuation guidance server
A storage means for storing virtual reality image data inside the predetermined area is provided.
Based on the posture and orientation information from the mobile terminal and the mobile terminal position information from the location information server, the evacuation guidance information to be superimposed is generated.
Based on the received position information of the mobile terminal and the posture and orientation information, the corresponding virtual reality image data is read from the storage means, and the evacuation guidance information is superimposed to obtain the evacuation guidance virtual reality image data of the mobile terminal. Send to
The mobile terminal that has received the evacuation guidance virtual reality image data is configured so that the received evacuation guidance virtual reality image can be displayed on the display unit.
According to this configuration, an image in which evacuation information is superimposed on a virtual reality image (VR image) is displayed on the display unit of the mobile terminal, so that the carrier of the mobile terminal can intuitively recognize the direction to evacuate. You can evacuate quickly and safely.

Further, preferably, the mobile terminal can transmit a moving image of the surrounding scene taken by the imaging means to the evacuation guidance server.
The quality of the field of view is determined based on the moving image of the surrounding scene, and when it is determined that the field of view is poor, the image is switched to the evacuation guidance virtual reality image and displayed on the display unit.
According to this configuration, when the room is filled with smoke and the live-action image becomes unclear, the evacuation information is superimposed on the virtual reality image instead of the live-action image (AR image), so that the carrier of the mobile terminal evacuates. You can correctly recognize the direction you should take and evacuate safely.

Further, preferably, the evacuation guidance server can acquire the position information of the mobile terminal and the fire information from the position information server, calculate the risk level, generate the risk level information, and transmit it to the corresponding mobile terminal. And
The mobile terminal can receive the evacuation guidance information and the risk level information from the evacuation guidance server from the position information server, and can display an evacuation guidance image in which the risk level information is superimposed on the display unit. It is configured as follows.
According to such a configuration, since the degree of danger is displayed on the mobile terminal, it is possible to make a judgment and take an action according to the degree of danger, and it is possible to evacuate calmly without panic.

Further, preferably, the evacuation guidance server heats the nearby fire detectors included in the fire information based on the fire information from the receiver and the mobile terminal position information acquired from the location information server. , Smoke, fire detection information,
Based on the mobile terminal position, the fire point position and the distance from the position information server, the attitude and orientation information from the mobile terminal, and the heat, smoke, and flame detection information of each fire detector. It is configured to calculate the degree of risk.
According to such a configuration, a highly reliable risk level can be calculated, and by displaying the risk level, the carrier of the mobile terminal can be evacuated in a safe direction.

Further, preferably, the mobile terminal is provided with a vibrator and / or a speaker, and when the risk information from the evacuation guidance server is received, the vibrator or the speaker causes a predetermined vibration according to the received risk. Configure to signal danger with a pattern or pronunciation pattern.
According to this configuration, the degree of danger can be judged through hearing without looking at the screen of the mobile terminal, so that it is appropriate and safe even if the action time is long while the eyes are off the display of the mobile terminal. Evacuation is possible.

Further, preferably, the display unit has a rectangular shape corresponding to the housing of the mobile terminal.
When the housing is oriented vertically, the image captured by the imaging means and the evacuation guidance image are displayed side by side on the display unit.
When the housing is oriented sideways, the image taken by the imaging means or the evacuation guidance image is enlarged and displayed on the entire display unit.
According to this configuration, the image taken by the imaging means (camera) and the evacuation guidance image are displayed side by side on the vertically long display unit, so that the position of the fire and its own position can be grasped from the evacuation guidance image. , The evacuation direction can be easily recognized from the moving image. Further, when the housing is turned sideways, the photographed image or the evacuation guidance image is enlarged and displayed on the entire display unit, so that it is easy to make a judgment based on the image.

Further, preferably, the display unit is a touch panel type display unit.
The mobile terminal is in a state where an image taken by the imaging means or an evacuation guidance image is displayed on the display unit, and the display unit responds to a predetermined operation performed on the display unit. It is configured to display a rescue request button for transmitting the information of the rescue requester carrying the mobile terminal to a predetermined terminal.
According to such a configuration, the carrier of the mobile terminal can make a rescue request to the disaster prevention center or the like where the predetermined terminal is located with a simple operation.

According to the evacuation guidance system according to the present invention, when a carrier of a mobile terminal encounters a disaster such as a fire indoors, he / she can intuitively recognize the direction to evacuate by looking at the display unit of the mobile terminal. it can. In addition, even if the room is filled with smoke and the live-action image becomes unclear, the evacuation information is superimposed on the VR (virtual reality) image and displayed so that the surrounding scene can be grasped and the evacuation should be further carried out. Can recognize the direction. Further, there is an effect that disaster-related information such as the degree of danger can be known through hearing even while the carrier of the mobile terminal is looking away from the display unit of the mobile terminal.

It is a block diagram which shows the structure of one Embodiment of the evacuation guidance system of this invention. It is a flowchart which shows an example of the processing procedure in the mobile terminal which comprises the evacuation guidance system of embodiment. It is a flowchart which shows an example of the processing procedure in the location information server which constitutes the evacuation guidance system of embodiment. It is a flowchart which shows an example of the processing procedure in the evacuation guidance server which comprises the evacuation guidance system of embodiment. It is a figure which shows the method of synthesizing the AR image displayed on the display part of the mobile terminal of a carrier when a fire breaks out. It is a figure which shows the display example of the AR image and the map image (floor figure image) displayed on the display part of the mobile terminal of a carrier when a fire breaks out. It is a figure which shows an example of the AR image displayed on the display part when the posture of a mobile terminal changes during the fire occurrence display, and the map image displayed when the screen is swiped. It is a figure which shows an example of the rescue request screen which is displayed on the display part of the mobile terminal of a carrier when a fire breaks out. It is a figure which shows an example of the photographed image when the room is filled with smoke. It is a timing chart which shows an example of the output pattern at the time of notifying the degree of danger by vibration or the alarm sound in the mobile terminal which comprises the evacuation guidance system of another embodiment.

Hereinafter, embodiments of the evacuation guidance system according to the present invention using a mobile terminal will be described with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of the evacuation guidance system of the present embodiment.
As shown in FIG. 1, the evacuation guidance system of the present embodiment can receive signals (radio waves) from beacons (transmitters) 10 arranged at a plurality of locations in a predetermined area A of a facility such as a building. A location information server 40 that performs data communication between a mobile terminal 20 and a mobile terminal 20 via a communication network N such as a mobile phone base station 30 and the Internet, and a plurality of locations in a predetermined area A inside the facility. Data communication between a fire receiver 60 capable of receiving a fire detection signal from the arranged fire detector 50 and a fire receiver 60 via a repeater 70 such as an interface or gateway and a communication network N. It is composed of an evacuation guidance server 80 and the like. The location information server 40 and the evacuation guidance server 80 may be configured as one support server.

The communication method of the beacon 10 for transmitting a wireless signal (unique information such as device ID and equipment information) to the mobile terminal 20 includes, for example, Bluetooth (registered trademark) communication or a wireless LAN such as WiFi in accordance with the IEEE 802.11 standard. Known communication methods such as infrared communication and visible light communication can be used. The interval at which the beacons 10 are arranged is not particularly limited, but in the following description, it is assumed that the communication range of the adjacent beacons 10 is arranged so as to cover the space in the facility.

Specifically, since fire detectors 50 and sprinkler heads are often installed in the facility at predetermined intervals, the beacon 10 built in or added to those devices, or Beacons 10 attached in the form of being installed in the vicinity of those devices can be used.
The beacon 10 includes a transmitting unit that periodically transmits predetermined information on a wireless signal to the surroundings. The signal (beacon signal) transmitted wirelessly by the beacon 10 may include at least the identification information (device ID of the transmitter) or the address information of the beacon 10, and further, information about the area where the beacon 10 is installed may be included. May be included.

The mobile terminal 20 is a portable device such as a smartphone having a receiving function for receiving a signal from the beacon 10, a wireless communication function, and a display unit. The internal memory of the mobile terminal 20 periodically receives a beacon signal transmitted wirelessly from the beacon 10 and extracts identification information (device ID) and the like included in the beacon signal, and beacon information including the identification information and the like. Is transmitted to the location information server 40 via the mobile phone base station 30 and the communication network N, and a floor diagram based on the floor map information transmitted from the location information server 40 via the communication network N and the mobile phone base station 30. An application program (position information display application) that executes a process of displaying an image on a display unit is stored.

Further, the mobile terminal 20 has a function of detecting the received radio wave strength of the beacon signal and a function of transmitting the detected received radio wave strength information to the position information server 40, and the position information server 40 responds from the received received radio wave strength information. It may have a function of calculating the distance from the beacon. Further, the mobile terminal 20 has a function of transmitting each beacon information to the position information server 40 when receiving a beacon signal transmitted from a plurality of beacons 10 (beacons 10 having overlapping communication ranges). You may.
Further, the mobile terminal 20 includes a touch panel type display unit, a sensor for detecting the posture and orientation of the terminal such as a 3-axis gyro sensor, a 3-axis acceleration sensor, and an electronic compass (geomagnetic sensor), and a camera capable of shooting a moving image. There is.

When the fire detector 50 detects the occurrence of an abnormal phenomenon such as heat, smoke, flame, or harmful gas, the fire detector 50 transmits a fire detection signal to the fire receiver 60 via the detector line 51. Further, the fire detector 50 fires information on the detected temperature in the case of a heat detector, information on the concentration in the case of a smoke or gas detector, and information on the size of the flame in the case of a flame detector. It may have a function of transmitting to the receiver 60. This information is used as information when the evacuation guidance server described later calculates the degree of danger around the mobile terminal. The fire detector 50 may be a type of detector that adds its own installation address to the fire detection signal, or may be a type of detector that does not add its own installation address to the fire detection signal. ..

When the fire receiver 60 receives the fire detection signal from the fire detector 50, the fire receiver 60 displays a fire alarm on the display unit and controls such as ringing of the district bell and interlocking with smoke prevention. Further, the fire receiver 60 transmits fire information including fire occurrence location information, fire occurrence time information, temperature and concentration, and flame size information to the evacuation guidance server 80 via the repeater 70 and the communication network N. Send.
When the installation address of the fire detector 50 is added to the fire detection signal, the fire receiver 60 identifies the location of the fire based on the installation address. On the other hand, when the installation address of the fire detector 50 is not added to the fire detection signal, the location of the fire is specified based on the detector line 51 (warning area) that transmits the fire detection signal.

The location information server 40 includes a database that stores map information (floor diagram) of each floor of the facility managed by the location information server 40, and identification information (device ID) or address information of the beacon 10. The map information (floor map information) of each floor includes the installation position information of each beacon in relation to the device ID or address information of the beacon 10 installed on each floor.

When the location information server 40 receives the device ID of the beacon 10 from the mobile terminal 20, it calculates the current position of the mobile terminal 20 based on the device ID or address information of the received beacon and the information stored in the database. Then, the map information (floor diagram) of the floor on which the mobile terminal 20 is located is read from the database, and the mark indicating the current position of the mobile terminal 20 is plotted on the read floor diagram to generate floor diagram image data. , The process of transmitting the generated floor map information to the mobile terminal 20 via the communication network N and the mobile phone base station 30 is executed. As a result, a floor map image showing the current position of the mobile terminal 20 is displayed on the display unit of the mobile terminal 20.

Further, when the location information server 40 of the present embodiment receives fire information (information including the location information of the fire) from the fire receiver 60, the location information server 40 generates floor map information reflecting the information and communicates with the location information server 40. It is configured to be able to execute a process of transmitting information to the mobile terminal 20 via the network N and the mobile phone base station 30. As a result, the display unit of the mobile terminal 20 reflects fire information including a mark indicating the current position of the terminal, a mark indicating the position where the fire occurred, and a mark indicating the positions of the fire transmitter, fire extinguisher, and fire hydrant. The floor map is displayed.

The evacuation guidance server 80 acquires floor map information (including the position information of the evacuation port), the position information of the mobile terminal 20, and the fire occurrence position information from the position information server 40. Then, it has a function of calculating an optimum evacuation route based on the acquired information and transmitting it to the mobile terminal 20 via the communication network N. Further, the evacuation guidance server 80 receives information indicating the posture and orientation of the terminal from the mobile terminal 20, calculates the direction in which the carrier of the mobile terminal 20 should evacuate, and transmits the information to the mobile terminal 20 via the communication network N. Has the function of

Next, the procedure of processing by the mobile terminal 20, the location information server 40, and the evacuation guidance server 80 constituting the evacuation guidance system of the present embodiment will be described with reference to the flowcharts shown in FIGS.
When the location information display application is activated, the mobile terminal 20 first determines whether or not it has received the beacon signal transmitted from the beacon 10, as shown in FIG. 2, for example (step S11). Then, when the beacon signal is received (step S11; Yes), the beacon information including the identification information (device ID) of the beacon 10 included in the beacon signal and the received radio wave strength of the beacon signal is transmitted to the mobile phone. It is transmitted to the location information server 40 via the base station 30 and the communication network N (step S12).

Next, the mobile terminal 20 determines whether or not the floor map information transmitted from the location information server 40 has been received (step S13). Then, when the floor map information is received (step S13; Yes), the floor map image based on the floor map information is displayed on the display unit (step S14). As a result, in the first step S14 after the location information display application is started, the latest floor map image is displayed on the display unit of the mobile terminal 20, and in the second and subsequent steps S14 after the location information display application is started. , The displayed floor map image is updated to the latest floor map image.
Subsequently, the mobile terminal 20 determines whether or not the evacuation information has been received from the evacuation guidance server 80 (step S15). Then, when the evacuation information is received (step S15; Yes), the evacuation route and the evacuation direction based on the evacuation information are added to the floor map image and displayed (step S16).

After that, the mobile terminal 20 determines whether or not the risk information transmitted from the evacuation guidance server 80 has been received (step S17). Here, the risk information includes information (for example, five levels) in which the risk is quantified for each local area with the signal range of the beacon 10 in the facility as a unit. When the mobile terminal 20 determines that the risk level information has been received (step S17; Yes), the mobile terminal 20 displays the risk level determined based on the risk level information from the evacuation guidance server 80 on the display unit (step S18). ..
The risk level is such that the larger the numerical value is, the higher the risk level is, for example, “risk level 5”. As a result, the carrier of the mobile terminal can visually grasp the degree of danger at the point where he / she is.

On the other hand, as shown in FIG. 3, the location information server 40 first determines whether or not the beacon information transmitted from the mobile terminal 20 has been received (step S21). Then, when it is determined that the beacon information has been received (Yes), the current position of the mobile terminal 20 is calculated based on the received beacon information, the terminal ID, and the information stored in the database (step S22). .. Subsequently, the floor map of the floor on which the mobile terminal 20 is located is read from the database, and floor map information is generated by plotting the mark indicating the current position of the mobile terminal 20 on the read floor map (step S23).

Next, the location information server 40 determines whether a fire has occurred in the facility where the mobile terminal 20 is located (step S24). Specifically, the location information server 40 determines that a fire has occurred, for example, when the fire receiver 60 receives the fire information transmitted via the repeater 70 and the communication network N. The fire information transmitted by the fire receiver 60 via the repeater 70 and the communication network N reaches the evacuation guidance server 80.
Then, when it is determined that no fire has occurred in the facility where the mobile terminal 20 is located (step S24; No), the floor map information generated in step S23 is used in the communication network N and the mobile phone base station 30. Is transmitted to the mobile terminal 20 via the above (step S29).

On the other hand, when the location information server 40 has a fire in the facility where the mobile terminal 20 is located (step S24; Yes), the location information server 40 acquires the fire occurrence location information from the fire receiver 60 (step S25). ). Then, it is determined whether or not a fire has occurred on the same floor as the floor on which the mobile terminal 20 is located (step S26).
Here, when it is determined that a fire has occurred on the floor on which the mobile terminal 20 is located (step S26; Yes), the floor diagram in which the current position of the mobile terminal 20 is plotted in step S23 is displayed. The location of the fire is plotted (step S27).

Next, the location information server 40 transmits the generated floor map information to the mobile terminal 20 via the communication network N and the mobile phone base station 30 (step S29). As a result, for example, an image of the floor map as shown in FIG. 7B is displayed on the display unit of the mobile terminal 20. Note that FIG. 7B shows a fire mark, its own mark, and an arrow indicating an evacuation route, assuming that a fire breaks out on the floor where the mobile terminal 20 is located. If a fire breaks out on the floor, the fire mark may be omitted and the own mark and evacuation route may be displayed.

On the other hand, when the location information server 40 determines that no fire has occurred on the floor on which the mobile terminal 20 is located (step S26; No), the floor map information generated in step S23 and other floors are used. Message information or the like known that a fire has occurred is added (step S28), and is transmitted to the mobile terminal 20 via the communication network N and the mobile phone base station 30 (step S29).

As shown in FIG. 4, the evacuation guidance server 80 first determines whether or not fire information (including fire occurrence position information) has been received from the fire receiver 60 in the monitoring area (step S31). Here, when it is determined that the fire information has been received (step S31; Yes), the location information of the mobile terminal 20 existing in the monitoring area is acquired from the location information server 40 (step S32).
Subsequently, the evacuation guidance server 80 determines an evacuation route (route) for the corresponding mobile terminal based on the fire occurrence position information and the position information of the mobile terminal, and creates a route guide map (step S33). Next, information on the posture and orientation of the corresponding mobile terminal 20 is acquired from the location information server 40 (step S34), the evacuation direction is determined based on the acquired posture and orientation of the terminal, and evacuation information (evacuation information) to the mobile terminal 20 (step S34). (Arrow, etc.) is transmitted (step S35).

Next, the evacuation guidance server 80 calculates the degree of risk for each mobile terminal based on the fire position information and the mobile terminal position information acquired in step S32 (step S36). Specifically, information on the temperature transmitted from the fire detector 50 to the fire receiver 60, information on the concentration of smoke and gas, information on the size of the flame (flame area), and the like are acquired, and based on the information. Then, the risk level is calculated by referring to the table stored in the database in advance.

Subsequently, the evacuation guidance server 80 transmits the calculated risk level (quantified five-level level) information as a pair with the area information to all the mobile terminals 20 existing in the facility (step S37). The evacuation guidance server 80 calculates the degree of danger for each mobile terminal existing in the facility based on the temperature information from the fire detector 50, the concentration information of smoke and gas, the flame area information, and the like, and responds. The risk level may be transmitted to the mobile terminal. If there is no such information, the degree of risk may be calculated based on the distance between the fire detector that detected the fire and the mobile terminal. Further, information on the posture and orientation of the mobile terminal may be taken into consideration in calculating the degree of risk. That is, when the mobile terminal is facing the direction of the fire point, the risk may be corrected to be high, and when the mobile terminal is facing the evacuation direction, the risk may be corrected to be low.

Next, the function of the mobile terminal 10 according to the second embodiment of the present invention will be described with reference to FIGS. 5 to 7. In the second embodiment, it is a condition that the mobile terminal 20 has a moving image shooting function (camera) in addition to a beacon signal receiving function, a wireless communication function, and a function of detecting the posture and orientation of the terminal.
When the mobile terminal 20 receives a notification of a fire from the evacuation guidance server 80, the mobile terminal 20 automatically or manually shifts to the moving image shooting mode. Then, the terminal position information (beacon device ID) indicating its own position, the posture and orientation information of the mobile terminal, and the photographed image data are transmitted to the evacuation guidance server 80.

Then, the evacuation guidance server 80 determines the position of the beacon in the image based on the received terminal position information and the attitude and orientation information of the mobile terminal and / or the captured image data, and determines the position of the fire and the position of the beacon in the image. The evacuation direction is determined from the above, an arrow image indicating the evacuation direction is generated, and the degree of danger is calculated and transmitted to the mobile terminal 20. At this time, the evacuation guidance server 80 may transmit only the arrow image, or may generate and transmit an image in which the arrow image and the risk level information are inserted into the received image.
Further, the evacuation guidance server 80 may transmit and display the evacuation instruction information, the distance information to the evacuation port, the time information until the rescuer arrives, and the like to the mobile terminal 20. Further, the evacuation guidance server 80 may transmit the terminal position information and the photographed image data received from the mobile terminal 20 to a terminal such as a disaster prevention center. As a result, when carrying out fire extinguishing activities and rescue activities, it is possible to grasp the detailed internal situation, and it is possible to accurately extinguish a fire and detect a person requiring rescue at an early stage.

The mobile terminal 20 that has received the evacuation information image such as an arrow uses AR (augmented reality) technology to display an image VP taken by its own camera, an arrow indicating the evacuation direction, and risk information as shown in FIG. It is displayed as a composite image CP that is a composite of the included image IP. Further, when the mobile terminal 20 receives an image in which an arrow image and a risk level information are inserted in the transmitted captured image, the received captured image is compared with the captured image of the current camera and matched. If so, the background image is switched to the currently captured image, and the arrow image and risk information are inserted and displayed. If they do not match, for example, retry processing may be performed. This makes it possible to avoid displaying the wrong evacuation direction.
Further, the evacuation guidance server 80 determines the fire occurrence position with respect to the captured image received from the mobile terminal 20, and inserts an image in which a fire mark or an entry prohibition mark is inserted in the direction of the fire occurrence position or the direction in which evacuation is not appropriate. It may be generated and sent.

Further, the mobile terminal 20 executes an evacuation route guide map (floor map) reception process from the evacuation guidance server 80 in parallel with the evacuation information display process on the captured image, and evacuates at an arbitrary timing. It is possible to switch and display the evacuation route guide map from the arrow image showing the direction and the photographed image in which the risk level information is inserted. Further, as shown in FIG. 6, the display unit DS of the mobile terminal 20 has a rectangular shape corresponding to the housing of the terminal, the captured image P1 is displayed on the upper half of the display unit DS, and the evacuation route is displayed on the lower half. It is configured so that the guide map P2 can be displayed.

Further, the mobile terminal 20 determines the posture of the terminal based on the signal from the sensor that detects the posture, and recognizes that the posture of the own machine has changed from the vertical direction to the horizontal direction, as shown in FIG. 7 (A). The captured image P1 in which the arrow image and the risk information are inserted is displayed on the entire screen of the display unit DS. Then, when the screen of the display unit DS is swiped in the horizontal direction or the vertical direction in this state, the evacuation route guide map P2 is displayed on the entire display unit as shown in FIG. 7B. There is.

Further, when the mobile terminal 20 of the present embodiment is swiped horizontally or vertically on the fire occurrence display screen DS shown in FIG. 6, for example, a "rescue request" or a "call call" is performed as shown in FIG. "Emergency request buttons B1 and B2 are displayed, and when the" rescue request "button B1 is tapped, the mobile terminal 20 informs the disaster prevention center that rescue is required and information on the rescue requester (including indoor location information). It is configured so that you can make a call with the disaster prevention center by sending and tapping "Call call" B2.

Further, the mobile terminal 20 is configured to emit a rescue request beacon radio wave or sound of a predetermined pattern by itself. Here, as a predetermined pattern, for example, it is conceivable to make the sound sound once every 5 seconds, and to repeat the operation again with a rest period after the 6th floor. The "rescue request" button B1 shown in FIG. 8 is displayed when the risk level is high, and is not displayed when the risk level is low, according to the risk level calculated in step S36 of FIG. You may do so. In addition, by emitting a beacon radio wave from the mobile terminal, it is possible to easily find the whereabouts of the rescue requester.

Next, the function of the mobile terminal 10 according to the third embodiment of the present invention will be described.
In the third embodiment, as shown in FIG. 9, the room is filled with smoke and the photographed image is displayed while the photographed image in which the arrow and the risk information are inserted by the AR (Augmented Reality) technology is displayed. This evacuation guidance system is provided with a countermeasure processing function when the image becomes unclear.
Specifically, the data of the VR (virtual reality) image in the target area is stored in the evacuation guidance server 80, and the AR image is manually or automatically switched from the AR image to the VR image.

In the case of manual switching, when the carrier of the mobile terminal taps the "VR switching" button B3 on the screen, the switching is performed, and the evacuation guidance server 80 reads the VR image according to the position, orientation and posture of the mobile terminal. The image data in which the arrow and the risk information are inserted into the VR image is transmitted, and the mobile terminal is configured to switch from the AR image to the VR image and display it.
It is also possible to display the "AR switching" button on the screen on which the VR image is displayed and return to the AR image by tapping the operation. The timing for automatic switching is, for example, when it is determined that the signal level of the image captured by the camera is lower than the threshold value (the screen is dark), or when it is determined that the contrast value has fallen below the threshold value due to smoke filling or power failure. It is possible that you did.

Further, in the third embodiment, the mobile terminal 20 has a vibration function (vibrator) and a sounding function (speaker) in addition to a beacon signal receiving function, a wireless communication function, and a function of detecting the posture and orientation of the terminal. The condition is that the terminal is vibrated or the danger level is notified by an alarm sound according to the risk level information transmitted from the evacuation guidance server 80.
Specifically, as shown in FIG. 10, when the degree of danger is the highest (level 5), a continuous vibration or a continuous alarm sound is emitted, and as the degree of danger decreases, the interval between vibrations or the alarm sound is lengthened. Control (intermittent ringing) is performed. In addition, instead of the alarm sound, the optimum evacuation instruction may be notified by voice in relation to the position where the fire occurred and the current position of the terminal. Further, a message having the same content as the voice may be displayed in characters on the display unit.

With the above functions, the degree of danger can be determined without looking at the screen of the mobile terminal, so it is appropriate and safe even if the action time is long while looking away from the display of the mobile terminal. Evacuation is possible. For example, if the vibration cycle becomes longer and the risk level becomes lower while moving away from the display, it is possible to recognize that you are evacuating in the correct direction, and you will be able to evacuate calmly. ..

Although the present invention has been described above based on the embodiments, the present invention is not limited to the above embodiments and can be appropriately modified without departing from the gist thereof. For example, in the above embodiment, the beacon 10 is installed in the vicinity of the fire detector 50, but it may be installed separately at a position suitable for each function. Further, in the above embodiment, it has been described that the beacon 10 has only a function of transmitting information, but a function of receiving a wireless signal from a mobile terminal or another transmitter (wireless tag, terminal, etc.) and further receiving. It may have a function of transmitting the collected information to the server.

Further, in the above embodiment, a system using positioning by a beacon is exemplified as the position information system, but the position information system is not limited to this, and the position information system may perform positioning by other methods such as IMES (Indoor MEssaging System). It may be the system used. That is, the transmitter is not limited to the beacon and may be an IMES transmitter or the like.
Further, in the above embodiment, the case where a fire is detected by a fire detector has been described as an example of an emergency, but it may be applied to the case where another emergency such as an earthquake or flood occurs.

10 Beacon (transmitter)
20 Mobile terminal 30 Mobile phone base station 40 Location information server 50 Fire detector 60 Fire receiver 70 Repeater 80 Evacuation guidance server

Claims (9)

It is equipped with a display unit that can display an image, an imaging means that can shoot a moving image, and a sensor that can detect the posture and orientation, and receives a signal from a transmitter installed in a predetermined area to identify the transmitter. A mobile terminal capable of transmitting transmitter information including information and self-identification information,
A location information server capable of transmitting image data to the mobile terminal for displaying an image corresponding to the current position of the mobile terminal on the display unit of the mobile terminal based on the transmitter information from the mobile terminal.
An evacuation route based on fire information including fire occurrence location information transmitted by a receiver capable of receiving a fire detection signal from a fire detector installed in the predetermined area and mobile terminal location information from the location information server. Alternatively, an evacuation guidance server that determines the evacuation direction, generates evacuation guidance information, and sends the evacuation guidance information to the corresponding mobile terminal.
It is an evacuation guidance system equipped with
The mobile terminal receives the image data from the position information server and the evacuation guidance information from the evacuation guidance server, and displays the position and evacuation route or evacuation direction of the mobile terminal on the display unit as an augmented reality image. Alternatively, an evacuation guidance system characterized in that an evacuation guidance image superimposed on a virtual reality image can be generated and displayed on the display unit. The mobile terminal transmits information on the posture and orientation of the mobile terminal detected by the sensor to the evacuation guidance server.
The evacuation guidance server generates superposed evacuation guidance information based on the attitude and orientation information from the mobile terminal and the mobile terminal position information from the location information server, and sends the evacuation guidance information to the mobile terminal. ,
The mobile terminal that has received the evacuation guidance information can superimpose the received evacuation guidance information on the moving image of the surrounding scene taken by the imaging means and display it as an augmented reality image on the display unit. The evacuation guidance system according to claim 1, wherein the evacuation guidance system is characterized. The mobile terminal transmits information on the posture and orientation of the mobile terminal detected by the sensor to the evacuation guidance server.
The evacuation guidance server
A storage means for storing virtual reality image data inside the predetermined area is provided.
Based on the posture and orientation information from the mobile terminal and the mobile terminal position information from the location information server, the evacuation guidance information to be superimposed is generated.
Based on the received position information of the mobile terminal and the posture and orientation information, the corresponding virtual reality image data is read from the storage means, and the evacuation guidance information is superimposed to obtain the evacuation guidance virtual reality image data of the mobile terminal. Send to
The evacuation guidance system according to claim 1 or 2, wherein the mobile terminal that has received the evacuation guidance virtual reality image data can display the received evacuation guidance virtual reality image on the display unit. The mobile terminal can transmit a moving image of the surrounding scene taken by the imaging means to the evacuation guidance server.
The third aspect of claim 3, wherein the quality of the field of view is determined based on the moving image of the surrounding scene, and when the field of view is determined to be poor, the image is switched to the evacuation guidance virtual reality image and displayed on the display unit. Evacuation guidance system. The evacuation guidance server can acquire the position information of the mobile terminal and the fire information from the position information server, calculate the degree of danger, generate the degree of risk information, and transmit it to the corresponding mobile terminal.
The mobile terminal can receive the evacuation guidance information and the risk level information from the evacuation guidance server from the position information server, and can display an evacuation guidance image in which the risk level information is superimposed on the display unit. The evacuation guidance system according to any one of claims 2 to 4, wherein the evacuation guidance system is characterized. The evacuation guidance server is based on the fire information from the receiver and the location information of the mobile terminal acquired from the location information server, and the heat, smoke, and flame of each nearby fire detector included in the fire information. Extract the detection information and
Based on the mobile terminal position, the fire point position and the distance from the position information server, the attitude and orientation information from the mobile terminal, and the heat, smoke, and flame detection information of each fire detector. The evacuation guidance system according to claim 5, wherein the evacuation guidance system is configured to calculate the degree of risk. The mobile terminal is provided with a vibrator and / or a speaker, and when the risk information from the evacuation guidance server is received, the vibrator or the speaker has a predetermined vibration pattern or sounding pattern according to the received risk, respectively. The evacuation guidance system according to claim 5 or 6, wherein the evacuation guidance system is characterized by notifying the danger. The display unit has a rectangular shape corresponding to the housing of the mobile terminal.
When the housing is oriented vertically, the image captured by the imaging means and the evacuation guidance image are displayed side by side on the display unit.
2. The second aspect of the present invention is that when the housing is oriented sideways, the image taken by the imaging means or the evacuation guidance image is enlarged and displayed on the entire display unit. The evacuation guidance system according to any one of 7 to 7. The display unit is a touch panel type display unit.
The mobile terminal is in a state where an image taken by the imaging means or an evacuation guidance image is displayed on the display unit, and the display unit responds to a predetermined operation performed on the display unit. The evacuation guidance system according to claim 8, further comprising displaying a rescue request button for transmitting information of a rescue requester carrying the mobile terminal to a predetermined terminal.

Images