JP6816909B1 - Evacuation guidance system, evacuation guidance method, and eyeglass-type display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an evacuation guidance system capable of improving the convenience of an evacuee in the event of a disaster and encouraging the evacuee to grasp the situation of the surrounding real space and implement an intuitive evacuation action. An evacuation guidance system including a glasses-type display 4 and a central management system 1. The central management system provides model management means for managing a three-dimensional model corresponding to a real space and disaster information. The collection means to be collected, the position acquisition means to acquire the position information including the position and orientation of the spectacle-type display, the disaster information collected by the collection means, the position information acquired by the position acquisition means, and the three-dimensional model are shown. It has a derivation means for deriving an evacuation route based on the shape of the evacuation route, and a control means for superimposing and displaying the evacuation route derived by the derivation means on a real space on a glasses-type display. [Selection diagram] Fig. 1

Description

The present invention relates to an evacuation guidance system based on a three-dimensional model corresponding to the real world, an evacuation guidance method, and a spectacle-type display.

In recent years, services using technologies such as Augmented Reality (AR) have become widespread. One example is the use of AR technology in the event of a disaster. For example, Patent Document 1 discloses a technique for supporting evacuees by superimposing an evacuation route or the like on a real space in the event of a disaster using a mobile terminal. Further, Patent Document 2 describes that a mobile terminal receives disaster prevention information in real time and displays it on a screen.

Japanese Unexamined Patent Publication No. 2014-142758 Japanese Unexamined Patent Publication No. 2011-186681

In the above-mentioned Patent Document 1, it is described that the evacuation route is displayed on the mobile terminal based on the position information to guide the evacuees, but the evacuation route in consideration of the shape in the real world is not displayed. Absent. In addition, since information is provided assuming a mobile terminal held in the hand, the convenience of the victim is not high when evacuating. Further, in Patent Document 2, although the disaster prevention information is displayed based on the position coordinates, the disaster prevention information in consideration of the shape in the real space is not displayed. Furthermore, since the configuration does not fully consider the situation that the evacuees are visually recognizing at the time of evacuation, there is room for improvement in order for the evacuees to intuitively perform evacuation actions.

In view of the above problems, the present invention makes it possible to improve the convenience of the evacuees in the event of a disaster, and to encourage the evacuees to grasp the situation of the surrounding real space and to carry out intuitive evacuation actions. The purpose is to provide the system.

In order to solve the above problems, the present invention has the following configuration. That is, it is an evacuation guidance system including a spectacle-type display and a management system.
The management system
Model management means for managing 3D models corresponding to the real space,
A collection method for collecting disaster information and
A position acquisition means for acquiring position information including the position and orientation of the spectacle-type display, and
A derivation means for deriving an evacuation route based on the disaster information collected by the collecting means, the position information acquired by the position acquiring means, and the shape shown by the three-dimensional model.
The escape route derived by the deriving means, have a control means for superimposing displayed on the real space in the eyeglass display,
The disaster information includes occurrence information indicating the occurrence of a disaster.
When the collecting means collects the occurrence information, the control means notifies the spectacle-type display that it urges evacuation in response to the disaster and that the spectacle-type display is worn. Let me .

Further, it has the following configuration as another embodiment of the present invention. That is, it is an evacuation guidance method using an evacuation guidance system including a glasses-type display and a management system.
In the management system
The collection process for collecting disaster information and
A position acquisition step for acquiring position information including the position and orientation of the spectacle-type display, and
Derivation to derive an evacuation route based on the disaster information collected in the collection process, the position information acquired in the position acquisition process, and the shape shown by the three-dimensional model generated corresponding to the real space. Process and
The escape route derived by the deriving step, have a control step for superimposing displayed on the real space in the eyeglass display,
The disaster information includes occurrence information indicating the occurrence of a disaster.
In the control step, when the occurrence information is collected in the collection step, the spectacle-type display is urged to evacuate in response to the disaster and to urge the spectacle-type display to be worn. Notify .

Further, it has the following configuration as another embodiment of the present invention. That is, it is a spectacle-type display that is communicatively connected to the management system.
A position detection means that acquires position information including the position and orientation of the own device,
A notification means for notifying the occurrence of a disaster based on an instruction from the management system,
An acquisition means that provides the location information to the management system after notifying the occurrence of the disaster and acquires an evacuation route corresponding to the location information.
Have a display means for superimposing display the escape routes in the real space,
When notifying the occurrence of the disaster based on the instruction from the management system, the notifying means notifies that evacuation is urged in response to the disaster and that the spectacle-type display is urged to be worn.
The evacuation route is derived based on the disaster information, the location information, and the three-dimensional model generated corresponding to the real space.

According to the present invention, it is possible to improve the convenience of the evacuees in the event of a disaster, and to encourage the evacuees to grasp the situation of the surrounding real space and to carry out intuitive evacuation actions.

The schematic diagram which shows the example of the whole structure of the evacuation guidance system which concerns on one Embodiment of this invention. The figure which shows the example of the functional structure of each apparatus which concerns on one Embodiment of this invention. The figure which shows the example of the data structure which concerns on one Embodiment of this invention. The figure which shows the display example on the eyeglass type display side at the time of evacuation which concerns on one Embodiment of this invention. The figure which shows the display example on the management system side at the time of a disaster which concerns on one Embodiment of this invention. The figure for demonstrating the cooperation between the apparatus which concerns on one Embodiment of this invention. The flowchart of the evacuation guidance process (glasses type display side) which concerns on one Embodiment of this invention. Flow chart of evacuation route derivation process (management system side) according to one embodiment of the present invention The flowchart of the evacuation guidance process (management system side) which concerns on one Embodiment of this invention. The flowchart of the safety registration process (management system side) which concerns on one Embodiment of this invention. The flowchart of the safety confirmation process (management system side) which concerns on one Embodiment of this invention. The figure which shows the example of the confirmation screen of the safety information which concerns on one Embodiment of this invention. The flowchart of the rescue request processing which concerns on 2nd Embodiment of this invention. The flowchart of the automatic rescue request processing which concerns on the 2nd Embodiment of this invention.

Hereinafter, embodiments for carrying out the present invention will be described with reference to drawings and the like. It should be noted that the embodiments described below are embodiments for explaining the present invention, and are not intended to be interpreted in a limited manner, and are described in each embodiment. Not all configurations are essential configurations for solving the problems of the present invention. Further, in each drawing, the same component is given the same reference number to indicate the correspondence relationship.

<First Embodiment>
Hereinafter, the first embodiment of the present invention will be described.

[System configuration]
FIG. 1 is a schematic diagram showing an example of the overall configuration of the evacuation guidance system according to the present embodiment. In the present embodiment, the evacuation guidance system includes a central management system 1, a disaster information providing system 2, an edge computer 3, a glasses-type display 4, and a mobile terminal 5. Each device is communicably connected via the network 6. The communication standard of the network 6 and the wired / wireless are not particularly limited, and a plurality of communication standards may be combined and realized. Further, in FIG. 1, one device is shown for each device, but a plurality of devices may be included. For example, the central management system 1 and the disaster information providing system 2 may be composed of a plurality of devices for load distribution and fault tolerance. Further, a plurality of edge computers 3 may be installed depending on the number of jurisdiction areas and the like. The person 7 is described as being an evacuee who evacuates in the event of a disaster and is a user (wearer) of the eyeglass-type display 4. The person 8 is a user of the mobile terminal 5, and will be described as using the service provided by the central management system 1 via the mobile terminal 5.

The central management system 1 is a system that comprehensively manages and controls evacuation information and disaster information. The disaster information providing system 2 voluntarily or in response to a disaster, such as when a disaster occurs, provides disaster information at the time of a disaster, a hazard map, area information of an evacuation site, and the like. The disaster information providing system 2 is provided by, for example, an administrative agency or a public institution. Although detailed explanation is omitted because the disaster information providing system 2 uses the existing system, the central management system 1 according to the present embodiment acquires disaster information and area information from the disaster information providing system 2 in a timely manner. Explain as if.

The edge computer 3 has a function of deriving and providing an evacuation route to an evacuation site in the event of a disaster or the like for the eyeglass-type display 4 located in a predetermined jurisdiction area 9. In the present embodiment, the jurisdiction area 9 is defined in advance in association with the edge computer 3. The installation position of the edge computer 3 is not particularly limited, and for example, it is installed in any of the buildings in the city and functions as a base station for deriving an evacuation route. The edge computer 3 communicates with the central management system 1 in a timely manner and acquires various information necessary for deriving the evacuation route.

The spectacle-type display 4 is a device equipped with a display function based on augmented reality (AR) technology, and provides information to the wearer by superimposing a predetermined object on the real space. Can be done. In the present embodiment, it is assumed that the spectacle-type display 4 can wirelessly communicate with the edge computer 3 corresponding to the jurisdiction area 9 in which the own device is located. Although not shown in FIG. 1, the spectacle-type display 4 may have a configuration capable of directly communicating with the central management system 1 via the network 6.

The mobile terminal 5 is an information processing device for using the service provided by the central management system 1 by using, for example, a Web browser (not shown). The mobile terminal 5 may be an information processing device such as a PC (Personal Computer) as well as a mobile terminal such as a smartphone or a tablet terminal.

[Functional configuration]
FIG. 2 is a diagram showing an example of a functional configuration of each device according to the present embodiment. As described above, the disaster information providing system 2 uses an existing system, and detailed description of the configuration here will be omitted. Further, the mobile terminal 5 may also have a function for accessing the central management system 1 via the network 6 from, for example, a Web browser (not shown), and detailed description thereof will be omitted here. ..

FIG. 2A is a diagram showing an example of the functional configuration of the central management system 1 according to the present embodiment. The central management system 1 is configured as an information processing device including a processing unit (not shown), a storage unit, and an input / output unit. The processing unit may be composed of, for example, a CPU (Central Processing Unit), a dedicated circuit, or the like. The storage unit may be composed of a non-volatile storage device such as a ROM (Read Only Memory) or an HDD (Hard Disk Drive), a volatile storage area such as a RAM (Random Access Memory), or the like. The input / output unit may include a network interface (NIC), a display, and the like. Each part shown below may be realized, for example, by the processing unit reading and executing the program stored in the storage unit.

The disaster information collecting unit 101 collects disaster information provided by the disaster information providing system 2. The collection here may be configured to periodically request the disaster information providing system 2 to acquire the disaster information, or a disaster transmitted from the disaster information providing system 2 in the event of a disaster or the like. It may be configured to acquire information. An example of disaster information will be described later with reference to FIG. The area information collecting unit 102 collects the area information provided by the disaster information providing system 2. The collection here may be configured to periodically request the disaster information providing system 2 and acquire the area information, or may be transmitted from the disaster information providing system 2 in normal times or when a disaster occurs. It may be configured to acquire the coming area information. In the present embodiment, both the disaster information and the area information will be described as a configuration provided by the disaster information providing system 2, but they may be provided by different systems.

The evacuation information collecting unit 103 collects information on the evacuation status (hereinafter referred to as evacuation information) via the edge computer 3 or directly from the eyeglass-type display 4. An example of evacuation information will be described later with reference to FIG. The safety information extraction unit 104 extracts and specifies the safety information based on the evacuation information collected by the evacuation information collection unit 103. The information management unit 105 registers the disaster information, area information, evacuation information collected by each collection unit, and the safety information extracted by the safety information extraction unit 104 in the DB configured in the storage unit (not shown). And manage it.

The three-dimensional model generation unit 106 generates a three-dimensional model based on the disaster information collection unit 101, the area information collection unit 102, or the separately collected map information, image information, and point cloud data. The generation timing of the three-dimensional model is not particularly limited, but it is assumed that the three-dimensional model is generated in advance before the occurrence of a disaster. The three-dimensional model may include the structure inside the building as well as the structure of the block. Further, a known method may be used as the method for generating the three-dimensional model, and the method is not particularly limited.

The 3D model management unit 107 manages the 3D model generated by the 3D model generation unit 106. Here, the position, time, and the like in the real space corresponding to the three-dimensional model may be related and managed. Further, the three-dimensional model management unit 107 detects a change in the shape of an object in the real space by comparing three-dimensional models generated in the past, comparing various collected data, and the like. At this time, as the change information, the amount of change, the direction of change, the tendency of change, etc. of the object with the passage of time may be detected.

The communication control unit 108 controls communication with an external device. For example, the communication control unit 108 periodically requests the disaster information providing system 2 for disaster information based on instructions from other parts, and periodically supplies the edge computer 3 with various information required for deriving an evacuation route. Send it.

FIG. 2B is a diagram showing an example of the functional configuration of the edge computer 3 according to the present embodiment. The edge computer 3 is configured as an information processing device including a processing unit (not shown), a storage unit, and an input / output unit. The processing unit may be composed of, for example, a CPU (Central Processing Unit), a dedicated circuit, or the like. The storage unit may be composed of a non-volatile storage device such as a ROM (Read Only Memory) or an HDD (Hard Disk Drive), a volatile storage area such as a RAM (Random Access Memory), or the like. The input / output unit may include a communication unit capable of realizing wireless communication, a network interface (NIC), and the like. Each part shown below may be realized, for example, by the processing unit reading and executing the program stored in the storage unit.

The area information acquisition unit 301 acquires area information regarding the jurisdiction area 9 under the jurisdiction of the own device from the central management system 1. For example, among the three-dimensional models generated and managed by the central management system 1, the three-dimensional model in the range included in the jurisdiction area 9 may be acquired. In addition, information on evacuation sites included in the jurisdiction area 9 and information on dangerous areas in the event of a disaster based on a hazard map or the like may be acquired. The disaster information acquisition unit 302 acquires disaster information related to a disaster that occurred from the central management system 1 when a disaster occurs. The information management unit 303 manages various information acquired by the area information acquisition unit 301 and the disaster information acquisition unit 302 in the storage unit (not shown).

The evacuation route derivation unit 304 derives an evacuation route to the evacuation site based on the current position of the glasses-type display 4 (person 7) in the event of a disaster. The evacuation route derivation process will be described later with reference to the drawings. The evacuation control unit 305 uses the spectacle-type display 4 to guide the user (person 7) of the spectacle-type display 4 to evacuate based on the evacuation route or the like derived by the evacuation route derivation unit 304. Control. The communication control unit 306 controls communication with an external device (for example, a spectacle-type display 4 or a central management system 1).

FIG. 2C is a diagram showing an example of the functional configuration of the eyeglass-type display 4 according to the present embodiment. The spectacle-type display 4 is configured as an information processing device including a processing unit (not shown), a storage unit, and an input / output unit. The processing unit may be composed of, for example, a CPU (Central Processing Unit), a dedicated circuit, or the like. The storage unit may be composed of a non-volatile storage device such as a ROM (Read Only Memory) or an HDD (Hard Disk Drive), a volatile storage area such as a RAM (Random Access Memory), or the like. The input / output unit may include a communication unit capable of realizing wireless communication, a network interface (NIC), a camera, and the like. Each part shown below may be realized, for example, by the processing unit reading and executing the program stored in the storage unit. The eyeglass-type display 4 may be a transmissive type that projects an image (object) on a glass portion (not shown), or a retinal projection type that projects an image (object) on the retina of the wearer. Good.

The image pickup unit 401 includes a camera (not shown) and takes a picture of the real space around the spectacle-type display 4. It is desirable that the shooting range includes at least the viewing range of the wearer of the spectacle-type display 4 (here, the person 7). The display unit 402 includes a glass unit (not shown) configured to cover the visual field range of the wearer of the spectacle-type display 4. Further, the display unit 402 has a function of superimposing and displaying evacuation route information and the like provided by the edge computer 3 on the actual space in the visual field range of the wearer.

The position detection unit 403 is a portion that detects the position of the own device. For example, a global positioning system (GNSS: Global Navigation Satellite System) that uses a positioning satellite such as GPS (Global Positioning System) can be used. At this time, a plurality of positioning satellites may be used. The position detection unit 403 includes the transmission time from the satellite in the received signal (radio wave), and uses the transmission time, the propagation time of the radio wave obtained from the reception time, and the speed of the radio wave to its own device. Detect the position of. Latitude, longitude, altitude, etc. correspond to the position of the own device. The sensor unit 404 detects the orientation of the wearer's face by means of an acceleration sensor, a gyro sensor, a geomagnetic sensor, or the like. The information that can be detected by the sensor unit 404 is not limited to the above, and a sensor for acquiring other information may be further included.

The display control unit 405 controls the content (for example, an object) to be displayed on the display unit 402. As the method of superimposing and displaying the object on the real space used in the present embodiment, a method based on a known AR technique may be used, and detailed description thereof will be omitted here. The voice input unit 406 is configured to include a microphone (not shown), and acquires the utterance of the wearer and the sound in the surrounding environment as input. The notification unit 407 includes a speaker (not shown), and notifies the wearer of various information by voice. For example, the notification unit 407 notifies that a disaster has occurred based on an instruction from the edge computer 3. The communication control unit 408 controls communication with an external device (for example, an edge computer 3 or a central management system 1).

[3D model]
In this embodiment, a three-dimensional model obtained by digitizing and reproducing a real-world building or feature in a three-dimensional shape is used. The three-dimensional model is generated and managed by an arbitrary method, and is updated according to the shape of the real space by using the image data and the point cloud data acquired in a timely manner. The three-dimensional model can be displayed and confirmed via an output device (not shown) on the central management system 1 side. Further, the display content of the three-dimensional model may be changed or modified via an input device (not shown) on the central management system 1 side. Here, an example of a method for generating a three-dimensional model using point cloud data obtained from image data will be described.

When creating a three-dimensional model, a plurality of captured images that may include the same object are collected, and candidate feature points of each captured image are detected using a feature amount calculation function. As this function, Harris, AKAZE, ORB (Oriented FAST and Rotated BRIEF), or the like can be used. Next, when the value of the feature amount of the detected feature point candidate exceeds a preset threshold value, the candidate is used as the feature point (feature point extraction).

When the feature points detected in each image are caused by the same object, those feature points correspond between the point cloud data. Therefore, feature points are associated between images (feature point matching). Since the feature points for which feature point matching is possible indicate a certain part of the same object, the three-dimensional coordinates of the object are calculated based on various information included in the measurement result. Examples of the information here include orientation and position information of the detection means. The plurality of three-dimensional coordinate points calculated in this way form a three-dimensional point cloud.

Since the three-dimensional point cloud is simply a collection of three-dimensional coordinate points, it is converted into a three-dimensional model so that humans can easily see it. In that case, the area surrounded by the three feature points in the vicinity of the image is attached to the three points of the three-dimensional coordinates formed by the three feature points (texture mapping). As a result, a three-dimensional model composed of triangular polygon planes can be formed. If the measuring device (not shown) that measures an object in the real space has a configuration that can acquire point cloud data, it is also possible to generate a three-dimensional model in the same manner using the point cloud data. is there.

[Data structure]
Hereinafter, the types of various data (information) and the configuration examples thereof according to the present embodiment will be described. The details of the usage of various data will be described together with a flowchart and the like described later. The names and classifications of various information shown below are for convenience only and are not limited to these.

(Disaster Information)
The disaster information according to this embodiment is timely provided from the disaster information providing system 2 to the central management system 1. The disaster information includes, for example, when a disaster occurs, the type of disaster, the location and damage status of the disaster, and future predictions. Furthermore, various information (images, etc.) regarding the situation of the city that changes with the occurrence of a disaster may be included.

(Area information)
The area information according to this embodiment is timely provided from the disaster information providing system 2 to the central management system 1. The area information includes, for example, a hazard map in each area and information on evacuation sites (capacity, disasters that can be dealt with, etc.). Furthermore, the area information may include the operating status of the evacuation site and the number of evacuees, which change from moment to moment in the event of a disaster.

(Evacuation information)
The evacuation information according to the present embodiment includes the position information of the eyeglass-type display 4 and the audio information input from the eyeglass-type display 4 due to the occurrence of a disaster. Evacuation information shall be timely acquired by the central management system 1 and the edge computer 3 from the eyeglass-type display 4.

(Safety information)
The safety information according to the present embodiment is information indicating the safety of the user (wearer) of the spectacle-type display 4 in the event of a disaster. The safety information is extracted based on the voice information acquired from the eyeglass-type display 4 and the position information.

(Evacuation route information)
The evacuation route information according to the present embodiment is information including an evacuation route presented to the user (wearer) of the spectacle-type display 4 in the event of a disaster. The evacuation route information may further include information about an object displayed on the spectacle-type display 4 in order to encourage evacuation.

(Management table)
FIG. 3 is a diagram showing a table configuration example of a database (DB) managed by the central management system 1. The specifications (number of digits, characters used, etc.) of various identification information (ID) described later are examples, and are not limited to these. Further, the items constituting each DB are also examples, and may be increased or decreased as necessary. Further, each DB described later may be divided into a plurality of DBs, or some of them may be collectively configured as one DB.

FIG. 3A shows a configuration example of a user management table for managing information of a user (for example, a person 7) of the eyeglass-type display 4. The user management table is composed of items such as device ID, user ID, name, address, age, gender, occupation, family, personal information disclosure availability, safety, current location, evacuation site ID, jurisdiction area, and movement history. To. The device ID is identification information for uniquely identifying the spectacle-type display 4. The user ID is identification information for uniquely identifying the user of the eyeglass-type display 4. Name, address, age, gender, occupation, and family are each personal information about the user. In addition, a part or all of personal information may be registered in advance, or may be registered at the time of evacuation by the process described later. Whether or not personal information can be disclosed is an item related to whether or not personal information can be disclosed at the time of evacuation. In this item, if "OK", it means that the disclosure of personal information is permitted when evacuating. If it is "impossible", it means that the disclosure of personal information is not permitted when evacuating. It should be noted that the personal information disclosure permission may be set for each item of personal information. The safety is information about the safety of the user. The current position indicates the current position of the spectacle-type display 4. The evacuation site ID indicates the ID of the evacuation site when the wearer of the spectacle-type display 4 evacuates due to the occurrence of a disaster. The jurisdiction area ID indicates the ID of the jurisdiction area corresponding to the current position of the spectacle-type display 4. The movement history shows the movement history of the spectacle-type display 4. The movement history here may be the movement history after the occurrence of a disaster, or may include the movement history in normal times.

FIG. 3B shows a configuration example of an evacuation site management table for managing evacuation site information. The evacuation site management table is composed of items such as evacuation site ID, location, name, capacity, jurisdiction area ID, number of evacuees, operating status, and disasters that can be dealt with. The evacuation site ID is identification information for uniquely identifying the evacuation site. The position indicates the location (position coordinates) of the evacuation site. The name indicates the name of the evacuation site. The number of people that can be accommodated indicates the number of people that can be accommodated in response to a disaster or the like. The jurisdiction area ID indicates the ID of the area that has jurisdiction over the evacuation site. The number of evacuees indicates the number of people evacuating at the present time. The operating status indicates the operating status of the evacuation site at the present time. The number of evacuees and operating conditions will change in a timely manner depending on the disaster information and area information, depending on the situation at the time of the disaster. Responsible disaster indicates the type of disaster when it can function as an evacuation site. For example, the evacuation site with the evacuation site ID "EID00001" indicates that it can function as an evacuation site when a flood occurs.

FIG. 3C shows a configuration example of a jurisdiction area management table for managing information on the jurisdiction area. The jurisdiction area management table is composed of items of jurisdiction area ID, edge ID, edge position, and area name. The jurisdiction area ID is identification information for uniquely identifying the jurisdiction area. The edge ID is identification information for uniquely identifying the edge computer corresponding to the jurisdiction area. The edge position indicates the installation position (position coordinates) of the corresponding edge computer. The area name indicates the name of the jurisdiction area. In the above example, for the sake of simplicity, the jurisdiction area 9 and the edge computer 3 are shown to have a one-to-one relationship, but the configuration is not limited to this. For example, one jurisdiction area may be supported by a plurality of edge computers 3, and vice versa.

[Display example]
(Glasses type display)
FIG. 4 is a diagram showing an example in which the evacuation route at the time of a disaster is superimposed and displayed on the real space in the eyeglass-type display 4 according to the present embodiment. FIG. 4A shows an example of a situation in which a user is visually recognizing a real space (indoor) through a glasses-type display 4. The frame 41 indicates an area in the field of view of the spectacle-type display 4 on which objects can be superimposed and displayed. In this example, the object 42 indicating the evacuation route is superimposed and displayed toward the exit which is an emergency exit in the real space. In addition, information for assisting the displayed object 42 is displayed as the object 43. FIG. 4B shows an example of a situation in which a user is visually recognizing a real space (outdoor) through a spectacle-type display 4. The frame 44 indicates an area in the field of view of the spectacle-type display 4 on which objects can be superimposed and displayed. In this example, the object 45 indicating the evacuation route is superimposed and displayed along the movable road toward the evacuation site in the real space. As the orientation of the face of the wearer of the spectacle-type display 4 changes, the real space included in the visual field range also changes, and therefore the displayed object also changes with this change.

(Central management system)
FIG. 5 is a diagram showing a display example of a three-dimensional model at the time of a disaster on the central management system 1 side according to the present embodiment. This screen may be displayed by a display means (not shown) included in the central management system 1. The managed 3D model is displayed on the screen 500. Further, depending on the content of the disaster, the objects 501 indicating the inundated area and the dangerous area are superimposed and displayed on the screen. In addition, an icon 502 indicating the evacuation site is selectably displayed at a position corresponding to each evacuation site. Here, icons 502 indicating each of the five evacuation sites (“evacuation site A” to “evacuation site E”) are displayed. When the icon 502 is selected, evacuation status information regarding the evacuation site is displayed. For example, when the icon 502 of "evacuation place C" is selected, the screen 503 showing the corresponding evacuation status is displayed. In this example, on the screen 503, a list 504 of the name of the evacuation site, the number of evacuees, and the evacuees ID (corresponding to the user ID in FIG. 3) indicating the evacuees is displayed. When any of the evacuees IDs is selected in the list 504, a screen 505 showing detailed information of the user corresponding to the evacuees ID is displayed. In this example, when the evacuee ID "UID010111" is selected in the list 504 of the screen 503, the name, age, address, occupation, and family of the evacuee corresponding to the evacuee ID "UID010111" on the screen 505. The configuration is displayed.

Since the information displayed on the screen 505 is personal information, the display may be controlled based on the setting of whether or not the personal information can be disclosed in the user management table shown in FIG. 3A. Further, the items displayed on the screen 503 and the screen 505 are not limited to the above, and other items may be included. Further, the viewpoint and enlargement / reduction of the three-dimensional model displayed on the screen 500 may be switched according to the operation. Further, the object 501 to be displayed in response to a disaster may also be configured to be switchable. Further, the position of the glasses-type display 4 during evacuation may be displayed on the three-dimensional model.

[Device functions and cooperation]
FIG. 6 is a schematic diagram for explaining the functions of the devices and the cooperation between the devices according to the present embodiment. The disaster information providing system 2 provides disaster information and area information to the central management system 1. The timing of providing disaster information and area information is not particularly limited, but at least in the event of an emergency such as when a disaster requiring evacuation occurs, disaster information related to the disaster is provided to the central management system 1.

The central management system 1 generates and updates a three-dimensional model. In addition, the central management system 1 manages disaster information and area information acquired from the disaster information providing system 2. Further, the central management system 1 provides the edge computer 3 with disaster information and area information corresponding to the area under the jurisdiction of the edge computer 3. Further, the central management system 1 collects evacuation information provided from the eyeglass-type display 4, extracts safety information from the evacuation information, and manages the evacuation information. In addition, the central management system 1 provides safety information to the mobile terminal 5 upon request. When a disaster occurs, the edge computer 3 derives an evacuation route corresponding to each of the spectacle-type displays 4 based on the position of the spectacle-type display 4 and various information, and provides the spectacle-type display 4 with the evacuation route. The position information of the eyeglass-type display 4 required for deriving the evacuation route is provided to the edge computer 3 in a timely manner. The eyeglass-type display 4 guides the user to evacuate using the evacuation route information provided by the edge computer 3 when a disaster occurs. Further, the spectacle-type display 4 provides evacuation information including position information and voice information to the central management system 1, so that the central management system 1 registers the safety information.

[Processing flow]
(Evacuation guidance processing: glasses-type display side)
FIG. 7 is a flowchart of the evacuation guidance process in the eyeglass-type display 4 according to the present embodiment. The processing shown below is realized, for example, by a CPU (not shown) included in the spectacle-type display 4 reading and executing a program stored in the storage device. Here, in order to simplify the explanation, when either the central management system 1 or the edge computer 3 is the processing subject, they may be collectively described as a “management system”.

In S701, the spectacle-type display 4 notifies the occurrence of a disaster and gives an evacuation instruction based on the instruction on the management system side. In the present embodiment, it is assumed that the eyeglass-type display 4 is registered in the management system, and its life-and-death state is confirmed by the management system by periodically communicating with the display 4. The notification method using the spectacle-type display 4 here is not particularly limited, but for example, voice notification may be performed using a speaker (not shown) included in the spectacle-type display 4. In addition, the outline of the disaster that has occurred may also be notified. At this time, the spectacle-type display 4 urges the user (here, the person 7) to evacuate after wearing his / her own device.

In S702, the spectacle-type display 4 determines whether or not the user (for example, the person 7) is equipped with the own device. The determination here may be determined based on, for example, a detection result by a sensor (not shown). When the spectacle-type display 4 is attached (YES in S702), the process of the spectacle-type display 4 proceeds to S703. On the other hand, if the eyeglass-type display 4 is not attached (NO in S702), the process returns to S701, and the notification and the evacuation instruction are repeated. It should be noted that the notification may be interrupted when the notification is performed a certain number of times or when a certain time has passed since the notification was started and the notification is not installed.

In S703, the spectacle-type display 4 acquires the position information of its own device by various sensors. At this time, the position information may include information on the orientation of the spectacle-type display 4 in addition to the current position.

In S704, the spectacle-type display 4 transmits the position information acquired in S703 to the management system side.

In S705, the spectacle-type display 4 acquires evacuation route information including an evacuation route corresponding to the transmitted position information.

In S706, the spectacle-type display 4 superimposes and displays a predetermined object in the real space based on the evacuation route information acquired in S705. For example, the display as shown in FIG. 4 is performed. The evacuation route information may also include disaster information in the area where the spectacle-type display 4 is located. In that case, the spectacle-type display 4 also notifies the user of the disaster information. The method of notifying the disaster information here is not particularly limited, but for example, it may be audibly notified by voice or visually displayed on the screen.

In S707, the spectacle-type display 4 acquires the position information of its own device by various sensors. At this time, the position information may include information on the orientation of the spectacle-type display 4 in addition to the current position.

In S708, the spectacle-type display 4 updates the content to be superimposed and displayed according to the change in position and orientation based on the position information acquired in S707.

In S709, the spectacle-type display 4 transmits the position information acquired in S707 to the management system side.

In S710, the spectacle-type display 4 determines whether or not the updated evacuation route information has been acquired in response to the position information transmitted in S709. For example, it is assumed that the situation is changing every moment at the time of a disaster. Therefore, if the evacuation site previously set is closed and it becomes impossible to evacuate, a new evacuation site will be set on the management system side and the evacuation route will be updated. In addition, when the glasses-type display 4 (that is, the person 7) moves to a route different from the evacuation route already acquired, it becomes necessary to update the evacuation route to the evacuation site. Even in such a case, new evacuation route information will be acquired. When the evacuation route is updated (YES in S710), the process of the spectacle-type display 4 proceeds to S711. On the other hand, when the evacuation route is not updated (NO in S710), the process of the spectacle-type display 4 proceeds to S712.

In S711, the spectacle-type display 4 notifies the user of the spectacle-type display (that is, the person 7) that the new evacuation route (and evacuation site) has been established. The notification method here is not particularly limited, but for example, it may be audibly notified by voice or visually displayed on the screen. Then, the process returns to S706 and the subsequent processing is repeated.

In S712, the spectacle-type display 4 determines whether or not the own device (that is, the person 7) has arrived at the evacuation site indicated by the evacuation route. The determination here may be made based on the position information of the own device. When arriving at the evacuation site (YES in S712), the spectacle-type display 4 ends this processing flow. On the other hand, if the evacuation site has not arrived (NO in S712), the process returns to S707 and the subsequent processing is repeated.

(Evacuation guidance processing: management system side)
FIG. 8 is a flowchart of the evacuation guidance process in the management system (central management system 1 or edge computer 3) according to the present embodiment. The processing shown below is realized, for example, by reading and executing a program stored in the storage device by a CPU (not shown) included in the central management system 1 or the edge computer 3. When this process is performed, it is assumed that the central management system 1 collects disaster information from the disaster information providing system 2 in a timely manner.

In S801, the central management system 1 determines whether or not a disaster requiring evacuation has occurred based on the collected disaster information (disaster scale, type, etc.). The determination here may be made for each jurisdiction area. When a disaster requiring evacuation occurs (YES in S801), the processing of the central management system 1 proceeds to S802. On the other hand, when no disaster has occurred (NO in S801), the determination in S801 is repeated and continued.

In S802, the central management system 1 notifies the spectacle-type display 4 located in the area via the edge computer 3 corresponding to the area of jurisdiction in which the disaster has occurred to urge the occurrence of the disaster and evacuation. To control. At this time, the central management system 1 may directly control the spectacle-type display 4 to notify the spectacle-type display 4 without going through the edge computer 3. By this process, the process of S701 in FIG. 7 is performed on the spectacle-type display 4 side.

In S803, the central management system 1 acquires the position information from the spectacle-type display 4 via the edge computer 3 or directly.

In S804, the central management system 1 reflects the position of the spectacle-type display 4 in the managed three-dimensional model based on the position information acquired in S803. Further, as shown in FIG. 5, the central management system 1 displays the reflected three-dimensional model on a display unit (not shown) included in the central management system 1.

In S805, the edge computer 3 derives an evacuation route based on the current position of the eyeglass-type display 4 located in the jurisdiction area, the position of the evacuation site, and the shape shown by the three-dimensional model. It is expected that the shape of buildings and roads will change due to a disaster, and the degree of congestion due to evacuation will change. Therefore, in the present embodiment, by reflecting this information in the three-dimensional model, it is used when deriving the evacuation route. Details of this process will be described later with reference to FIG.

In S806, the edge computer 3 provides the eyeglass-type display 4 with evacuation route information including the evacuation route derived in S805. Then, the edge computer 3 instructs the spectacle-type display 4 to superimpose and display the evacuation route information in the real space. At this time, the evacuation route information may include disaster information in the target area, and this disaster information is also notified. By this processing, the processing of S705 to S706 of FIG. 7 is performed on the spectacle-type display 4 side.

In S807, the edge computer 3 acquires the position information of the spectacle-type display 4.

In S808, the edge computer 3 determines whether or not the eyeglass-type display 4 (that is, the person 7) has arrived at the evacuation site indicated by the evacuation route information based on the position information acquired in S807. When arriving at the evacuation site (YES in S808), the edge computer 3 ends this processing flow. If the evacuation site has not arrived (NO in S808), the processing of the edge computer 3 proceeds to S809.

In S809, the edge computer 3 confirms updated information such as disaster information and area information. Here, in addition to the information on the evacuation site, newly acquired disaster information, updated information on the three-dimensional model, the operating status of the evacuation site, and the like may be referred to.

In S810, the edge computer 3 determines whether or not the situation of the evacuation site changes and it is necessary to change the evacuation site based on the disaster information referred to in S809. When it is necessary to change the evacuation site (YES in S810), the process of the edge computer 3 proceeds to S812. On the other hand, if it is not necessary to change the evacuation site (NO in S810), the processing of the edge computer 3 proceeds to S811.

In S811, the edge computer 3 determines whether or not the position of the spectacle-type display 4 is located at a position different from the evacuation route already provided. That is, the edge computer 3 determines whether or not the spectacle-type display 4 is moving on a route different from the evacuation route. When the spectacle-type display 4 is located at a location different from the evacuation route (YES in S811), the process of the edge computer 3 proceeds to S812. On the other hand, when the spectacle-type display 4 is located on the evacuation route (NO in S811), the processing of the edge computer 3 returns to S807, and the subsequent processing is continued.

In S812, the edge computer 3 sets an evacuation route corresponding to the new evacuation site based on the current position of the eyeglass-type display 4 located in the jurisdiction area, the position of the evacuation site, and the shape shown by the three-dimensional model. Derived. Then, the process returns to S806 and the subsequent processing is repeated. This process may be derived in the same manner as in S805, and will be described later with reference to FIG.

(Evacuation route derivation process: management system side)
FIG. 9 is a flowchart of the evacuation route derivation process by the management system side (for example, the edge computer 3). This process corresponds to the steps of S805 and S812 of FIG.

In S901, the edge computer 3 pays attention to one of the unprocessed evacuation sites from the preset evacuation sites. Evacuation sites shall be set in advance for each area, such as public facilities. Priority may be set for each evacuation site, and attention may be given in order based on the priority.

In S902, the edge computer 3 determines whether or not the evacuation site of interest is an appropriate evacuation site based on the type of disaster that has occurred. The determination here may be made based on, for example, the value of the item of respondable disaster shown in FIG. 3B and the type of disaster shown in the disaster information. Further, it may be determined from the position where the disaster occurs, the degree of danger shown in the hazard map, the distance from the current position of the eyeglass-type display 4, and the like. If it is determined that the evacuation site is appropriate (YES in S902), the process of the edge computer 3 proceeds to S903. On the other hand, when it is determined that the evacuation site is not appropriate (NO in S902), the processing of the edge computer 3 returns to S901, and the processing is repeated.

In S903, the edge computer 3 determines whether or not the evacuation site of interest is an appropriate evacuation site based on the area information. The determination here may be made based on, for example, the value of the item of the operating status shown in FIG. 3 (b). If it is determined that the evacuation site is appropriate (YES in S903), the process of the edge computer 3 proceeds to S904. On the other hand, when it is determined that the evacuation site is not appropriate (NO in S903), the processing of the edge computer 3 returns to S905 and the processing is repeated.

In S904, the edge computer 3 determines the evacuation site of interest as the evacuation site (destination) for guiding. Then, the edge computer 3 derives an evacuation route based on the determined evacuation site, the position of the eyeglass-type display 4, and the three-dimensional model.

In S905, the edge computer 3 determines whether or not the evacuation route can be derived by the process of S904. For example, it may be determined that the evacuation route cannot be derived when the road is blocked due to a disaster or when it is difficult to pass due to the congestion of evacuees. It is assumed that the blockade status and the congestion status in this case can be specified by referring to the information of the three-dimensional model. If the evacuation route can be derived (YES in S905), this processing flow is terminated and the process proceeds to the process of S806 in FIG. On the other hand, if the evacuation route cannot be derived (NO in S905), the process of the edge computer 3 proceeds to S906.

In S906, the edge computer 3 determines whether or not the processing after S901 is completed for all the preset evacuation sites. That is, the edge computer 3 determines whether or not all of the preset evacuation sites are determined to be inappropriate as evacuation sites for the disaster that has occurred. In the present embodiment, if it is determined that all the preset evacuation sites are not suitable as evacuation sites for the disaster that has occurred, the existing evacuation sites cannot be used, and the evacuation locations are determined according to the disaster that has occurred. To determine. When the processing is completed for all the evacuation sites (YES in S906), the processing of the edge computer 3 proceeds to S907. On the other hand, when there is an unprocessed evacuation site (NO in S906), the process of the edge computer 3 returns to S901, and the process for the unprocessed evacuation site is repeated.

In S907, the edge computer 3 derives an evacuation position where evacuation is possible based on the disaster information, the position of the eyeglass-type display 4, and the three-dimensional model. For example, the evacuation position may be derived based on the distance from the current position of the eyeglass-type display 4, the type of disaster, the shape of the land or the building, and the like. More specifically, in the event of a tsunami, a point above a predetermined altitude may be derived as an evacuation site, or in the event of an earthquake, high-rise buildings that may collapse in the surrounding area. A point that does not exist may be used as an evacuation site.

In S908, the edge computer 3 derives an evacuation route based on the evacuation position derived in S907, the position of the eyeglass-type display 4, and the three-dimensional model. Then, this processing flow is terminated.

Subsequently, the process relating to the safety of the evacuees according to the present embodiment will be described with reference to FIGS. 10 to 12. In the present embodiment, it is assumed that this process is performed after guiding the evacuees to the evacuation site by the above-mentioned evacuation guidance process.

(Safety registration process: management system side)
FIG. 10 is a flowchart of the evacuation guidance process in the central management system 1 according to the present embodiment. The processing shown below is realized, for example, by the CPU (not shown) included in the central management system 1 reading and executing the program stored in the storage device.

In S1001, the central management system 1 determines whether or not the user of the spectacle-type display 4 (for example, the person 7) has arrived at the evacuation site based on the position information of the spectacle-type display 4. The evacuation site information and the position information of the spectacle-type display 4 here may be acquired via the edge computer 3 or may be acquired directly from the spectacle-type display 4. When arriving at the evacuation site (YES in S1001), the process of the central management system 1 proceeds to S1002. On the other hand, if it has not arrived at the evacuation site (NO in S1001), the central management system 1 waits until it arrives at the evacuation site.

In S1002, the central management system 1 controls the eyeglass-type display 4 to prompt the user (for example, the person 7) to input the safety information by voice. Here, for example, the spectacle-type display 4 may be controlled so as to prompt the user to input by voice using a speaker (not shown) included in the spectacle-type display 4. Alternatively, as shown in the object 43 of FIG. 4A, a display that visually prompts the input of safety information may be performed. The control here may be performed via the edge computer 3. At this time, in order to support voice input, it may be urged to include predetermined information (for example, name, age, presence or absence of injury, etc.) at the time of input.

In S1003, the central management system 1 acquires the input voice information corresponding to the control of S1002. The voice information here may be acquired via the edge computer 3 or may be acquired directly from the eyeglass-type display 4. In addition, the configuration may be such that the voice information is acquired in a plurality of times.

In S1004, the central management system 1 performs voice analysis on the voice information acquired in S1003 and extracts safety information. The method of voice analysis here is not particularly limited, and a known method may be used. Further, in the voice analysis, a person wearing the spectacle-type display 4 may be identified or voice authentication may be performed based on the voice information of the individual registered in advance.

In S1005, the central management system 1 registers the safety information extracted in S1004 and the evacuation site information in association with each other as shown in FIG. Then, this processing flow is terminated.

(Safety confirmation process: management system side)
FIG. 11 is a flowchart of the safety confirmation process in the central management system 1 according to the present embodiment. The processing shown below is realized, for example, by the CPU (not shown) included in the central management system 1 reading and executing the program stored in the storage device.

In S1101, the central management system 1 receives a safety information confirmation request from the mobile terminal 5. The confirmation request here may be made as a request for a Web service via a Web browser (not shown) included in the mobile terminal 5, or as a request for an application installed and used on the mobile terminal 5. May be good.

In S1102, the central management system 1 provides the mobile terminal 5 with a confirmation screen in response to the request received in S1101. An example of the confirmation screen according to the present embodiment will be described later with reference to FIG.

In S1103, the central management system 1 acquires the search condition input via the confirmation screen.

In S1104, the central management system 1 searches for the corresponding safety information from the registered safety information based on the search conditions acquired in S1103.

In S1105, the central management system 1 provides the search result of S1104 as safety information so as to be displayed on the confirmation screen of the mobile terminal 5. At this time, if the corresponding safety information does not exist, a message to that effect is displayed. Then, this processing flow is terminated.

(Example of confirmation screen)
FIG. 12 is a diagram showing a configuration example of the safety information confirmation screen 1200 according to the present embodiment. The confirmation screen 1200 is displayed on the mobile terminal 5 when confirming the safety information. The confirmation screen 1200 includes a list 1201, a condition input area 1203, and a search button 1204. By inputting a search condition (here, a character string) in the condition input area 1203 and pressing the search button 1204, the safety information corresponding to the search condition is displayed in the list 1201. The information registered on the central management system 1 side is displayed in the list 1201. Here, the name, the safety of the person, the family information, the damage to the house, and the evacuation site are shown, but the displayed items and contents may change depending on the contents of the registered safety information.

Further, by selecting the area of the evacuation site 1202 in the list 1201, the route to the evacuation site is displayed based on the current position of the mobile terminal 5 and the position of the evacuation site. The route here may be derived by, for example, the central management system 1 by a method equivalent to the evacuation route derivation process described with reference to FIG. Further, the damage information of the house included in the list 1201 may be specified by estimating with reference to the three-dimensional model. In the above, the example in which the user of the mobile terminal 5 (here, the person 8) confirms the safety information based on the search condition input on the confirmation screen 1200 is shown. However, the configuration is not limited to this configuration, and the configuration is such that predetermined information (for example, family information) is registered in advance and the safety information of the person corresponding to the registered content is displayed in the list 1201. May be good.

As described above, according to the present embodiment, it is possible to improve the convenience of the evacuees in the event of a disaster, and to encourage the evacuees to grasp the situation of the surrounding real space and to carry out intuitive evacuation actions. ..

In the present embodiment, a configuration is shown in which an evacuation route to an evacuation site is derived using an edge computer 3 in which a predetermined jurisdiction area 9 is set. However, the configuration is not limited to this, and a management system in which the edge computer 3 and the central management system 1 are integrated may be configured to derive an evacuation route at the time of evacuation.

Further, in the above example, the safety information is confirmed from the mobile terminal 5, but the present invention is not limited to this. For example, the display unit (not shown) of the eyeglass-type display 4 may be configured to display the safety information of another user (for example, a family member) registered in advance.

<Second embodiment>
Hereinafter, the second embodiment according to the present embodiment will be described. The configuration that overlaps with the first embodiment will be omitted, and the differences will be focused on.

The evacuation guidance system according to the present embodiment may have the following functions in addition to the configurations shown in the first embodiment.
・ Rescue request function based on evacuees' voice input ・ Automatic rescue request function based on evacuees' behavior history ・ Automatic lighting function of eyeglass-type display ・ Real-time peripheral information (image) acquisition and 3D model update function

(Rescue request function)
During the evacuation, it is assumed that the evacuees will not be able to evacuate for some reason. Assuming such a case, the central management system 1 is provided with a function of accepting voice input via the eyeglass-type display 4 and making a rescue request based on the contents. In the following description, it is assumed that the central management system 1 performs the processing, but the edge computer 3 may execute the processing.

FIG. 13 is a flowchart of rescue request processing in the central management system 1 according to the present embodiment. The processing shown below is realized, for example, by the CPU (not shown) included in the central management system 1 reading and executing the program stored in the storage device. It is assumed that this process is started when a disaster occurs and is continuously and repeatedly executed in the central management system 1.

In S1301, the central management system 1 determines whether or not the voice information is received from the eyeglass-type display 4. The voice information here may be acquired via the edge computer 3 or may be acquired directly from the eyeglass-type display 4. In addition, the configuration may be such that the voice information is acquired in a plurality of times. At this time, the central management system 1 acquires the position information of the spectacle-type display 4 as well as the voice information. When the voice information is acquired (YES in S1301), the process of the central management system 1 proceeds to S1302. On the other hand, if the voice information is not acquired (NO in S1301), this processing flow is terminated.

In S1302, the central management system 1 performs voice analysis on the voice information acquired in S1301 and extracts the requested content. The method of voice analysis here is not particularly limited, and a known method may be used.

In S1303, the central management system 1 determines whether or not the request content extracted in S1302 corresponds to the rescue request. The determination criteria here are not particularly limited, but for example, if a predetermined keyword is included, it may be determined that the request is for rescue. If it is determined that the rescue request is made (YES in S1303), the process of the central management system 1 proceeds to S1304. On the other hand, if it is determined that the rescue request is not made (NO in S1303), this processing flow is terminated.

In S1304, the central management system 1 transmits a rescue request to a predetermined notification destination. At this time, the central management system 1 also transmits the position information of the rescue target person (glasses type display 4) and the information required for rescue (for example, the degree and situation of injury) among the information extracted in S1302. You can. The notification destination of the rescue request may be set in advance, and the notification destination may be switched according to the position of the rescue target person. Then, this processing flow is terminated.

(Automatic rescue request function)
During the evacuation, it is assumed that the evacuees cannot evacuate for some reason, and it is difficult for the evacuees themselves to request rescue. Assuming such a case, the central management system 1 provides a function of automatically making a rescue request based on the movement history of the eyeglass-type display 4. In the following description, it is assumed that the central management system 1 performs the processing, but the edge computer 3 may execute the processing.

FIG. 14 is a flowchart of rescue request processing in the central management system 1 according to the present embodiment. The processing shown below is realized, for example, by the CPU (not shown) included in the central management system 1 reading and executing the program stored in the storage device. It is assumed that this process is started when a disaster occurs and is continuously and repeatedly executed in the central management system 1.

In S1401, the central management system 1 acquires position information from the eyeglass-type display 4. The position information here may be acquired via the edge computer 3 or may be acquired directly from the spectacle-type display 4. At this time, the central management system 1 acquires the information of the evacuation site indicated by the evacuation route together with the location information.

In S1402, the central management system 1 determines whether or not the user has arrived at the evacuation site based on the location information acquired in S1401 and the evacuation site information indicated by the evacuation route. When arriving at the evacuation site (YES in S1402), this processing flow ends. On the other hand, if the evacuation site has not arrived (NO in S1402), the processing of the central management system 1 proceeds to S1403.

In S1403, the central management system 1 refers to the movement history as shown in the user management table of FIG. 3A. It is assumed that the position information timely acquired from the eyeglass-type display 4 is managed in the user management table as a movement history (that is, a position change history). The movement history here may be managed only for the movement history after the occurrence of a disaster.

In S1404, the central management system 1 determines whether or not the change in position is equal to or less than a predetermined threshold value from the time when the position information is acquired in S1401 to the period retroactive by a certain time. It is assumed that the threshold value here is set in advance. When the change in position is equal to or less than a predetermined threshold value (YES in S1404), the process of the central management system 1 proceeds to S1405. On the other hand, when the change in position is larger than the predetermined threshold value (NO in S1404), this processing flow is terminated.

In S1405, the central management system 1 controls the spectacle-type display 4 to urge the user to perform voice input for confirming safety. Here, for example, the spectacle-type display 4 may be controlled so as to prompt the user to input by voice using a speaker (not shown) included in the spectacle-type display 4. Alternatively, as shown in the object 43 of FIG. 4A, a display that visually prompts the voice input of the safety confirmation may be performed. The control here may be performed via the edge computer 3. That is, it is determined whether or not the user is intentionally not moving by performing voice input for confirming the safety.

In S1406, the central management system 1 determines whether or not the safety has been confirmed by voice-analyzing the voice information input in S1405. If the safety can be confirmed (YES in S1406), this processing flow is terminated. On the other hand, if the safety cannot be confirmed (NO in S1406), it is assumed that the evacuees are in a state where evacuation is difficult or impossible for some reason, and the processing of the central management system 1 proceeds to S1407.

In S1407, the central management system 1 sends a rescue request to a predetermined notification destination. At this time, the central management system 1 may also transmit the position information of the rescue target person (glasses type display 4) and the information required for rescue (for example, the personal information of the evacuation target person already registered). .. The notification destination of the rescue request may be set in advance, and the notification destination may be switched according to the position of the rescue target person. Then, this processing flow is terminated.

(Automatic lighting function)
The spectacle-type display 4 may further include a lighting unit (not shown) such as a light and a sensor (not shown) that detects the brightness of the surroundings. For example, when a disaster occurs at night, it is assumed that evacuation is carried out in a dark surrounding environment due to a power outage in the surrounding area. In such a situation, safer evacuation is possible by turning on the lights according to the brightness of the surroundings. Further, since the spectacle-type display 4 is provided with a lighting function, it is possible to take an evacuation action without blocking both hands of the evacuee, so that the safety can be further improved.

(Image acquisition function and 3D model update function)
As described above, the spectacle-type display 4 includes an imaging unit 401 including a camera. For example, when a disaster occurs, it is assumed that buildings and the like are damaged and their shapes are changing. In such a situation, the latest real world is obtained by acquiring the peripheral image through the image pickup unit 401 of the spectacle-type display 4 actually worn by the evacuees at the place and collecting it by the central management system 1. It is possible to update to a three-dimensional model that reflects the situation of. Then, by using the updated three-dimensional model, it becomes possible to derive a more appropriate evacuation route that matches the current real space.

As described above, the present embodiment makes it possible to further improve the convenience of evacuees in the event of a disaster, in addition to the effects of the first embodiment.

<Other Embodiments>
Further, in the present invention, one or more programs or applications for realizing the functions of one or more embodiments described above are supplied to a system or device using a network or a storage medium, and the system or device is used in a computer. It can also be realized by the process of reading and executing the program by the processor of.

As described above, the following matters are disclosed in this specification.
(1) An evacuation guidance system including a spectacle-type display and a management system.
The management system
Model management means for managing 3D models corresponding to the real space,
A collection method for collecting disaster information and
A position acquisition means for acquiring position information including the position and orientation of the spectacle-type display, and
A derivation means for deriving an evacuation route based on the disaster information collected by the collecting means, the position information acquired by the position acquiring means, and the shape shown by the three-dimensional model.
An evacuation guidance system characterized by having a control means for superimposing and displaying an evacuation route derived by the derivation means on a real space on the eyeglass-type display.
According to this configuration, it is possible to improve the convenience of the evacuees in the event of a disaster, and to encourage the evacuees to grasp the situation of the surrounding real space and to carry out intuitive evacuation actions.

(2) The disaster information includes occurrence information indicating the occurrence of a disaster.
When the collecting means collects the occurrence information, the control means notifies the spectacle-type display that it urges evacuation in response to the disaster and that the spectacle-type display is worn. The evacuation guidance system according to (1), characterized in that the evacuation guidance system is used.
According to this configuration, it is possible to urge evacuees to wear eyeglass-type displays and evacuate in the event of a disaster, and improve the convenience of evacuees.

(3) The control means is characterized in that the spectacle-type display is notified of disaster information according to the position information of the spectacle-type display among the disaster information collected by the collection means (1). ) Or the evacuation guidance system according to (2).
According to this configuration, disaster information according to the position of the eyeglass-type display can be displayed, and evacuation guidance can be performed according to the situation.

(4) The evacuation guidance system according to any one of (1) to (3), wherein the derivation means updates the evacuation route in response to the update of the position information.
According to this configuration, the evacuation route can be changed according to the change in the position of the spectacle-type display, and the evacuation guidance can be performed according to the current position.

(5) When the new position information of the spectacle-type display indicates a position different from the evacuation route already derived, the derivation means derives a new evacuation route according to the new position information. The evacuation guidance system according to (4).
According to this configuration, even if the spectacle-type display deviates from the evacuation route, the evacuation route can be changed according to the change, and evacuation guidance can be performed according to the current position.

(6) The evacuation guidance system according to any one of (1) to (5), wherein the control means switches the contents to be superimposed and displayed according to a change in the orientation of the spectacle-type display.
According to this configuration, evacuation guidance can be performed according to the situation by switching the content of the superimposed display according to the orientation of the spectacle-type display.

(7) When the three-dimensional model managed by the model management means is updated after the evacuation route is derived, the derivation means newly evacuates based on the updated three-dimensional model. The evacuation guidance system according to any one of (1) to (6), characterized in that a route is derived.
According to this configuration, when the three-dimensional model showing the situation in the real space is updated, the evacuation route can be updated to guide the evacuation according to the situation in the latest real space.

(8) The management system has a safety management means for managing the safety information of evacuees.
The glasses-type display has an audio input unit and has an audio input unit.
When the new position information of the spectacle-type display indicates the position of the evacuation site indicated by the evacuation route, the control means attaches the spectacle-type display to the spectacle-type display via the voice input unit. Notify that you are prompted to enter the safety information of the evacuees who are doing
The evacuation guidance according to any one of (1) to (7), wherein the safety management means registers the safety information input via the voice input unit in association with the evacuation site. system.
According to this configuration, it is possible to appropriately manage the safety information of evacuees as they evacuate to the evacuation site.

(9) The management system is
Further having an identification means for identifying the user of the spectacle-type display based on the voice input via the voice input unit.
The evacuation guidance system according to (8), wherein the safety management means manages the user identified by the identification means in association with the safety information.
According to this configuration, it is possible to suppress mistakes of evacuees and appropriately grasp the evacuation situation.

(10) The management system is
A first determination means for determining whether or not the user of the spectacle-type display can evacuate based on the voice input via the voice input unit, and
The evacuation guidance according to (9), further comprising a first notification means for notifying a predetermined notification destination of a rescue request when it is determined that evacuation is impossible by the first determination means. system.
According to this configuration, even if the evacuees themselves have difficulty in evacuation behavior, it is possible to provide appropriate rescue.

(11) A second determination means for determining whether or not the user of the eyeglass-type display can evacuate based on the evacuation route derived by the out-licensing means and the change history of the position of the eyeglass-type display.
(9) or (10) further includes a second notification means for notifying a predetermined notification destination of a rescue request when it is determined that evacuation is impossible by the second determination means. Described evacuation guidance system.
According to this configuration, even if the evacuees themselves have difficulty in evacuation behavior, it is possible to provide appropriate rescue.

(12) The management system is further characterized by further including a display means for displaying an icon based on the position information of the eyeglass-type display on the three-dimensional model managed by the model management means (1). The evacuation guidance system according to any one of (11).
According to this configuration, on the management system side, it is possible to grasp the three-dimensional model corresponding to the real space and the evacuation situation in association with each other.

(13) The spectacle-type display has an illumination unit and has an illumination unit.
One of (1) to (12), wherein the lighting unit adjusts the light emission intensity according to the brightness around the spectacle-type display when evacuating based on the evacuation route. Evacuation guidance system described in.
According to this configuration, even when the surrounding area is dark at the time of evacuation, it is possible to improve the convenience of the evacuees and appropriately guide the evacuation.

(14) The evacuation guidance system according to any one of (1) to (13), wherein the three-dimensional model includes an internal structure of a building and a structure of a block.
According to this configuration, even if the user is inside a building at the time of evacuation, it is possible to appropriately guide the evacuation according to the shape of the building.

(15) The eyeglass-type display is
Imaging unit and
It has a transmission means for transmitting the image captured by the imaging unit and the position information to the management system.
The evacuation guidance according to any one of (1) to (13), wherein the model management means updates the three-dimensional model by using the image and the position information transmitted from the eyeglass-type display. system.
According to this configuration, changes in buildings and the like caused by a disaster can be grasped, and evacuation guidance can be appropriately performed based on a three-dimensional model updated according to the changes.

(16) An evacuation guidance method using an evacuation guidance system including a glasses-type display and a management system.
In the management system
The collection process for collecting disaster information and
A position acquisition step for acquiring position information including the position and orientation of the spectacle-type display, and
Derivation to derive an evacuation route based on the disaster information collected in the collection process, the position information acquired in the position acquisition process, and the shape shown by the three-dimensional model generated corresponding to the real space. Process and
An evacuation guidance method comprising a control step of superimposing the evacuation route derived in the derivation step on a real space on the spectacle-type display.
According to this configuration, it is possible to improve the convenience of the evacuees in the event of a disaster, and to encourage the evacuees to grasp the situation of the surrounding real space and to carry out intuitive evacuation actions.

(17) An eyeglass-type display that is communicatively connected to the management system.
A position detection means that acquires position information including the position and orientation of the own device,
A notification means for notifying the occurrence of a disaster based on an instruction from the management system,
An acquisition means that provides the location information to the management system after notifying the occurrence of the disaster and acquires an evacuation route corresponding to the location information.
It has a display means for superimposing the evacuation route on the real space.
A spectacle-type display characterized in that the evacuation route is derived based on the disaster information, the position information, and a three-dimensional model generated corresponding to the real space.
According to this configuration, it is possible to improve the convenience of the evacuees in the event of a disaster, and to encourage the evacuees to grasp the situation of the surrounding real space and to carry out intuitive evacuation actions.

1 ... Central management system 2 ... Disaster information provision system 3 ... Edge computer (base station)
4 ... Glasses type display 5 ... Mobile terminal 6 ... Network 7, 8 ... Person

Claims (8)

An evacuation guidance system that includes a spectacle-type display and a management system.
The management system
Model management means for managing 3D models corresponding to the real space,
A collection method for collecting disaster information and
A position acquisition means for acquiring position information including the position and orientation of the spectacle-type display, and
A derivation means for deriving an evacuation route based on the disaster information collected by the collecting means, the position information acquired by the position acquiring means, and the shape shown by the three-dimensional model.
The escape route derived by the deriving means, have a control means for superimposing displayed on the real space in the eyeglass display,
The disaster information includes occurrence information indicating the occurrence of a disaster.
When the collecting means collects the occurrence information, the control means notifies the spectacle-type display that it urges evacuation in response to the disaster and that the spectacle-type display is worn. An evacuation guidance system characterized by letting people do it. The management system has a safety management means for managing the safety information of evacuees.
The glasses-type display has an audio input unit and has an audio input unit.
When the new position information of the spectacle-type display indicates the position of the evacuation site indicated by the evacuation route, the control means attaches the spectacle-type display to the spectacle-type display via the voice input unit. Notify that you are prompted to enter the safety information of the evacuees who are doing
The evacuation guidance system according to claim 1 , wherein the safety management means registers the safety information input via the voice input unit in association with the evacuation site. The management system
Further having an identification means for identifying the user of the spectacle-type display based on the voice input via the voice input unit.
The evacuation guidance system according to claim 2 , wherein the safety management means manages the user identified by the identification means in association with the safety information. The management system
A first determination means for determining whether or not the user of the spectacle-type display can evacuate based on the voice input via the voice input unit, and
The evacuation guidance according to claim 3 , further comprising a first notification means for notifying a predetermined notification destination of a rescue request when it is determined by the first determination means that evacuation is impossible. system. A second determination means for determining whether or not the user of the eyeglass-type display can evacuate based on the evacuation route derived by the derivation means and the change history of the position of the eyeglass-type display.
The third or fourth aspect of claim 3 or 4 , further comprising a second notification means for notifying a predetermined notification destination of a rescue request when it is determined that evacuation is impossible by the second determination means. Evacuation guidance system. The glasses-type display is
Imaging unit and
It has a transmission means for transmitting the image captured by the imaging unit and the position information to the management system.
The evacuation guidance according to any one of claims 1 to 5 , wherein the model management means updates the three-dimensional model by using the image and the position information transmitted from the eyeglass-type display. system. An evacuation guidance method using an evacuation guidance system that includes a glasses-type display and a management system.
In the management system
The collection process for collecting disaster information and
A position acquisition step for acquiring position information including the position and orientation of the spectacle-type display, and
Derivation to derive an evacuation route based on the disaster information collected in the collection process, the position information acquired in the position acquisition process, and the shape shown by the three-dimensional model generated corresponding to the real space. Process and
The escape route derived by the deriving step, have a control step for superimposing displayed on the real space in the eyeglass display,
The disaster information includes occurrence information indicating the occurrence of a disaster.
In the control step, when the occurrence information is collected in the collection step, the spectacle-type display is urged to evacuate in response to the disaster and to urge the spectacle-type display to be worn. An evacuation guidance method characterized by notifying . A spectacle-type display that is communicatively connected to the management system.
A position detection means that acquires position information including the position and orientation of the own device,
A notification means for notifying the occurrence of a disaster based on an instruction from the management system,
An acquisition means that provides the location information to the management system after notifying the occurrence of the disaster and acquires an evacuation route corresponding to the location information.
It has a display means for superimposing the evacuation route on the real space.
When notifying the occurrence of the disaster based on the instruction from the management system, the notifying means notifies that evacuation is urged in response to the disaster and that the spectacle-type display is urged to be worn.
A spectacle-type display characterized in that the evacuation route is derived based on the disaster information, the position information, and a three-dimensional model generated corresponding to the real space.

Images