JP7503409B2 - Evacuation Status Display System - Google Patents

Description

The present invention relates to an evacuation situation display system.

Conventionally, systems for grasping the evacuation status of people in a building in the event of a fire are known. For example, Patent Document 1 describes a surveillance system equipped with cameras and receivers placed in each room, in which the receiver determines the approximate number of people in each room based on images captured by the camera, and displays the determined approximate number of people on a drawing of the building.

JP 2016-133938 A

In general, when guiding evacuations, priority must be given to those who have difficulty evacuating, such as people with disabilities. To achieve this, it is important for rescuers, such as firefighters, to quickly determine the location of those who have difficulty evacuating.

The present invention was made in consideration of these circumstances, and aims to make it easier to determine the location of people who are unable to evacuate.

To solve the above problems, the evacuation situation display system of the present invention includes an identification unit that identifies, for each of a plurality of areas constituting a building, the presence or absence of people who are having difficulty evacuating based on a camera image of the area or entry/exit data recorded for the area, and a display control unit that causes a display unit to display a map image of the building in which, for each of the plurality of areas, information indicating the presence or absence of people who are having difficulty evacuating is associated with the map image.

In a preferred embodiment, the identification unit identifies the number of people who are unable to evacuate, and the information indicates the number of people who are unable to evacuate.

In a further preferred embodiment, the information is represented in color.

This invention makes it easier to determine the location of people who are having difficulty evacuating.

Diagram showing a fire monitoring system A block diagram showing the configuration of a display system 5. FIG. 13 is a diagram showing an example of a remainder number table 522. Flow diagram showing the process of determining the number of remaining people Flow diagram showing map screen generation processing A diagram showing an example of a map screen Flow diagram showing detailed screen generation processing FIG. 13 is a diagram showing an example of a details screen. Flow diagram showing email notification processing An example of an email

1. Embodiment A fire monitoring system according to an embodiment of the present invention will be described with reference to the drawings.
1-1. Configuration Fig. 1 is a diagram showing a fire monitoring system installed in a building B. The fire monitoring system shown in the figure includes a plurality of fire detectors 1, a fire receiver 2, a plurality of IP cameras 3, a plurality of smartphones 4, and a display system 5.

Of these, fire detectors 1 are placed in various locations in building B and are connected to fire receiver 2 via signal lines. When fire detector 1 detects the occurrence of a fire, it outputs a fire signal to fire receiver 2.

The fire receiver 2 is installed in the disaster prevention center or central control room of building B, and is connected to the display system 5 by wire. This fire receiver 2 judges a fire based on the fire signal output from the fire detector 1, and when it judges that a fire has occurred, it outputs fire information to the display system 5.

IP camera 3 is a network camera. This IP camera 3 is placed in various locations in building B and is connected to display system 5 via a LAN cable.

The smartphone 4 is carried by a member of the private fire brigade organized in building B. The smartphone 4 is connected to the display system 5 via a wireless LAN.

Display system 5 is a system that displays the evacuation status of people in the building in the event of a fire and supports the evacuation of people in the building. This display system 5 is installed in the disaster prevention center and central control room of building B.

Figure 2 is a block diagram showing the configuration of the display system 5. The display system 5 shown in the figure includes a control unit 51, a storage unit 52, an input unit 53, a display unit 54, and a communication unit 55.

Of these, the control unit 51 is a processor such as a CPU. The memory unit 52 is a storage device such as a ROM, RAM, or HDD. The input unit 53 is an input device such as a keyboard or mouse. The display unit 54 is a display device such as a liquid crystal display. The communication unit 55 is a communication module for communicating with the fire receiver 2 and the smartphone 4.

The memory unit 52 stores image data group 521, remaining personnel number table 522, camera position table 523, map data group 524, and team member data 525.

The image data group 521 is a collection of image data representing still images captured by the IP camera 3.

The number of remaining people table 522 is a table for recording the number of people remaining in building B when a fire breaks out. FIG. 3 is a diagram showing an example of this number of remaining people table 522. The number of remaining people table 522 shown in the figure stores the number of remaining people and the number of people who are unable to evacuate in association with the address of IP camera 3.

The camera position table 523 is a table that associates the address, which is the identification information of the IP camera 3, with its installation location.

Map data group 524 is a collection of image data representing floor plans of each floor of building B.

The member data 525 is a table that associates the ID of a private fire brigade member with the role and email address of that member.

The memory unit 52 also stores an evacuation support program. When the control unit 51 executes this evacuation support program, the following functions are realized: a remaining person number determination unit 511, a map screen generation unit 512, a detailed screen generation unit 513, a camera control unit 514, and an email notification unit 515.

The remaining person number determination unit 511 determines the number of remaining people for each of the multiple areas that make up building B, based on camera images of that area. It also determines the number of people who have difficulty evacuating. In this case, a person who has difficulty evacuating is someone who has fallen and is lying on the floor. The remaining person number determination unit 511 executes a remaining person number determination process, which will be described later, to determine the number of remaining people and the number of people who have difficulty evacuating for each area.

The map screen generating unit 512 generates a map screen of building B (see FIG. 6) and displays it on the display unit 54. On this map screen, for each of the multiple areas of building B, information indicating the number of remaining people identified for that area and information indicating the presence or absence of people who are unable to evacuate are associated with each other. Here, the information indicating the presence or absence of people who are unable to evacuate is represented by color. To generate this map screen, the map screen generating unit 512 executes a map screen generating process, which will be described later.

When the user selects one of the multiple areas that make up building B on the map screen, the detail screen generation unit 513 causes the display unit 54 to display a detail screen (see FIG. 8) including a camera image of the selected area and a notification button. To generate this detail screen, the detail screen generation unit 513 executes a detail screen generation process, which will be described later.

The camera control unit 514 controls the orientation and/or angle of view of the IP camera 3 in response to operations input by the user.

When the notification button is selected by the user, the email notification unit 515 sends an email regarding the selected area to the smartphone 4. Specifically, it sends an email to the smartphone 4 requesting assistance with the evacuation of people remaining in the selected area. The email sent by the email notification unit 515 includes information indicating the number of people remaining or information indicating whether or not there are people who are having difficulty evacuating. The email also includes a camera image of the selected area. In order to generate this email, the email notification unit 515 executes email notification processing, which will be described later.

1-2. Operation The operation of the fire monitoring system will be described. Specifically, the process of identifying the number of remaining people, the process of generating a map screen, the process of generating a detailed screen, and the process of sending an email will be described.

4 is a flow diagram showing the process of identifying the number of remaining people. The process of identifying the number of remaining people shown in the figure is executed by the display system 5. When the display system 5 receives fire information from the fire receiver 2, it starts this process.

The remaining person number determination unit 511 of the display system 5 first transmits a shooting request to each IP camera 3. The IP camera 3 that receives this shooting request shoots its monitoring area and transmits image data representing the captured still image to the display system 5. This image data includes the address of the IP camera 3 and shooting date and time information as attribute information. When the remaining person number determination unit 511 acquires the image data transmitted from each IP camera 3, it stores the image data in the storage unit 52 (step Sa1). When the image data is stored in the storage unit 52, it applies a well-known image recognition technology to each image data to determine the number of people appearing in the image (in other words, the number of remaining people) (step Sa2). When the number of remaining people is determined, it is stored in the remaining person number table 522 in association with the address of the IP camera 3 that generated the image data. In addition, the remaining person number determination unit 511 applies a difficult-to-evacuate person identification model to each image data to determine the number of difficult-to-evacuate people appearing in the image (step Sa3). Here, the model for identifying people with difficulty evacuating is a trained model that is generated by training a statistical model on the features of an image showing a person lying on the floor.

When the number of remaining people specifying unit 511 specifies the number of people who are unable to evacuate, it stores the image data in a number of remaining people table 522 in association with the address of the IP camera 3 that generated the image data.
This concludes the description of the remainder number determination process.

The remaining number determination unit 511 periodically executes this process to keep the remaining number table 522 up to date. When the user inputs an instruction to stop this process, this process ends.

1-2-2. Map screen generation process Fig. 5 is a flow diagram showing the map screen generation process. The map screen generation process shown in Fig. 5 is executed by the display system 5. The display system 5 starts this process when a command to display the map screen is input by the user. The display system 5 also executes this process when another floor is selected as the display target in the longitudinal section M2 described later.

The map screen generating unit 512 of the display system 5 first refers to the camera position table 523 to identify the IP camera 3 installed on the selected floor (step Sb1). The selected floor when the map screen is first displayed is the fire floor. After identifying the IP camera 3, the map screen generating unit 512 refers to the remaining person number table 522 to identify the number of remaining people and the number of people who are unable to evacuate corresponding to each identified IP camera 3 (step Sb2). After identifying the number of remaining people, etc., the display color of the number of remaining people corresponding to each IP camera 3 is identified based on the identified number of remaining people, etc. (step Sb3). Specifically, if the number of people who are unable to evacuate is "1" or more, the display color is yellow, if the number of people who are unable to evacuate is "0" and the number of remaining people is "3" or more, the display color is red, and if the number of people who are unable to evacuate is "0" and the number of remaining people is less than "3", the display color is white. Through the above-described steps Sb1 to Sb3, the corresponding number of remaining people and its display color are identified for each IP camera 3 installed on the selected floor.

Next, the map screen generating unit 512 identifies the number of remaining people for each floor and their display color. Specifically, first, the camera position table 523 is referenced to identify the IP camera 3 installed on the floor to be processed (step Sb4). After identifying the IP camera 3, the remaining person number table 522 is referenced to identify the number of remaining people corresponding to each identified IP camera 3 (step Sb5). After identifying the number of remaining people, the identified number of remaining people is summed up to identify the total number of remaining people on the floor to be processed (step Sb6). After identifying the total number of remaining people on the floor to be processed, the remaining person number table 522 is referenced to identify the number of people with difficulty in evacuating corresponding to each IP camera 3 identified in step Sb4 (step Sb7). After identifying the number of people with difficulty in evacuating, the identified number of people with difficulty in evacuating is summed up to identify the total number of people with difficulty in evacuating on the floor to be processed (step Sb8). After identifying the total number of people with difficulty in evacuating on the floor to be processed, the display color of the number of remaining people is next identified based on the number of remaining people identified in step Sb6 and the number of people with difficulty in evacuating identified in step Sb8 (step Sb9). Specifically, if the number of people who are unable to evacuate is "1" or more, the display color is yellow, if the number of people who are unable to evacuate is "0" and the number of people remaining is "3" or more, the display color is red, and if the number of people who are unable to evacuate is "0" and the number of people remaining is less than "3", the display color is white. After the map screen generating unit 512 has executed steps Sb4 to Sb9 for all floors (NO in step Sb10), it proceeds to step Sb11. The number of people remaining on each floor and its display color are identified by the above-mentioned steps Sb4 to Sb10.

In step Sb11, the map screen generation unit 512 generates a map screen based on the number of remaining people and the display color determined for the selected floor and the number of remaining people and the display color determined for each floor. The generated map screen is then displayed on the display unit 54 (step Sb12). Figure 6 is a diagram showing an example of this map screen. The map screen SR1 shown in the figure includes a plan view area AR1 and a cross-sectional view area AR2.

In the plan area AR1, a plan MP1 of the selected floor is displayed. A fire origin symbol SB1 indicating the origin of the fire and a camera symbol SB2 indicating an IP camera 3 are arranged on this plan MP1. Of these, the camera symbol SB2 is a selectable button. In addition, near this camera symbol SB2, the number of remaining people corresponding to the IP camera 3 represented by that symbol is displayed as a circled number CN1. The circle of this circled number CN1 is drawn in a display color specified for that number of remaining people. For example, if the specified display color is yellow, it is drawn in yellow. By looking at the number of this circled number CN1, the user can know the number of remaining people near that IP camera 3. In addition, by looking at the color of the circle of this circled number CN1, the user can know whether there are people who are having difficulty evacuating and the number of remaining people. In other words, the priority of evacuation can be known.

Meanwhile, in the cross-sectional view area AR2, a vertical cross-sectional view MP2 of building B is shown. Each floor of this vertical cross-sectional view MP2 is a selectable button. Furthermore, among the floors, the fire floor is drawn with a cross-hatched pattern. Furthermore, each floor of this vertical cross-sectional view MP2 is associated with a circled number CN2 indicating the number of remaining people on that floor. The circle of this circled number CN2 is drawn in a display color specified for the number of remaining people. For example, if the specified display color is red, it is drawn in red. By looking at the numbers of this circled number CN2, the user can know the number of remaining people on each floor. Furthermore, by looking at the color of the circle of this circled number CN2, the user can know whether there are people who are having difficulty evacuating on each floor and the number of remaining people. In other words, the priority of evacuation can be known.
This concludes the explanation of the map screen generation process.

The map screen generation unit 512 periodically executes steps Sb2 to Sb12 to keep the map screen up to date. When the user instructs the display of the map screen to be hidden, this process ends.

1-2-3. Detail screen generation process Fig. 7 is a flow diagram showing the detail screen generation process. The detail screen generation process shown in the figure is executed by the display system 5. The display system 5 starts this process when the user selects a camera symbol on the displayed map screen.

The detail screen generating unit 513 of the display system 5 identifies the IP camera 3 represented by the camera symbol selected by the user, and extracts the latest image data generated by the identified IP camera 3 from the image data group 521 (step Sc1). When the image data is extracted, a detail screen is generated based on the extracted image data (step Sc2). Then, the generated detail screen is displayed superimposed on the map screen (step Sc3). FIG. 8 is a diagram showing an example of this detail screen. The detail screen SR2 shown in the figure is superimposed on the map screen SR1. This detail screen SR2 includes a camera image PC1, a camera control button BT1, a notification button BT2, and an explanatory message MS1. Of these, the camera image PC1 is a camera image represented by the image data extracted in step Sc1. By looking at this camera image PC1, the user can check the situation around the selected IP camera 3 in the image. Next, the camera control button BT1 is a button for adjusting the direction and angle of view of the selected IP camera 3. When the camera control button BT1 is operated by a user, the camera control unit 514 transmits a control signal corresponding to the operation to the selected IP camera 3, thereby controlling the orientation and/or the angle of view of the IP camera 3. Next, the notification button BT2 is a button for notifying a self-defense fire brigade member of the situation around the selected IP camera 3.
This concludes the description of the detailed screen generation process.

The details screen generation unit 513 periodically executes steps Sc1 to Sc3 to keep the details screen up to date. When the user instructs the display of the details screen to be hidden, this process ends.

1-2-4. E-mail notification process Fig. 9 is a flow diagram showing the e-mail notification process. The e-mail notification process shown in the figure is executed by the display system 5. The display system 5 starts this process when the user selects the notification button on the displayed details screen.

The mail notification unit 515 of the display system 5 first refers to the camera position table 523 to identify the installation location of the selected IP camera 3 (step Sd1). After identifying the installation location, the mail notification unit 515 refers to the number of remaining people table 522 to identify the number of remaining people and the number of people who are unable to evacuate corresponding to each of the identified IP cameras 3 (step Sd2). After identifying the number of remaining people, etc., a message is created based on the identified number of remaining people, etc. (step Sd3). Specifically, if the number of people who are unable to evacuate is "1" or more, a message is created to notify the presence of people who are unable to evacuate and to request rescue. On the other hand, if the number of people who are unable to evacuate is "0", a message is created to notify the number of remaining people and to request evacuation guidance for the remaining people. After creating the message, the latest image data generated by the selected IP camera 3 is extracted from the image data group 521 (step Sd4). After extracting the image data, the mail address of the evacuation guidance officer and the main team member in charge of the installation location identified in step Sd1 is identified by referring to the team member data 525 (step Sd5). Once the email address is specified, an email is created based on the information acquired in steps Sd3 to Sd5 (step Sd6). The created email is then sent to the recipient's smartphone 4 (step Sd7). FIG. 10 is a diagram showing an example of this email. The email shown in the figure notifies the recipient that a person having difficulty evacuating is in front of the elevator on the second floor and requests rescue. This email includes a camera image PC2. This camera image PC2 is a camera image represented by the image data extracted in step Sd4. By looking at this camera image PC2, the recipient can check the situation around the selected IP camera 3 in an image.
This concludes the description of the email notification process.

With this email notification process, the user can request that members of the Japan Self-Defense Forces fire brigade assist in the evacuation of remaining residents near the selected IP camera 3 with the simple operation of selecting a notification button. In addition, the situation near the selected IP camera 3 can be notified by image.

2. Modifications The above embodiment may be modified as follows: The modifications described below may be combined with each other.

2-1. Modification 1
In step Sa3 of the above-mentioned remaining person number identification process, the remaining person number identification unit 511 identifies people who have fallen and are lying on the floor as people who have difficulty evacuating. Alternatively, wheelchair users may be identified as people who have difficulty evacuating. In this case, the remaining person number identification unit 511 applies a wheelchair user identification model to each image data acquired in step Sa1 to identify the number of wheelchair users appearing in the image. Here, this wheelchair user identification model is a trained model that is generated by having a statistical model learn the feature quantities of images of wheelchair users.

2-2. Modification 2
The remaining person number identifying unit 511 may identify the number of remaining people in each area of building B based on entry/exit data recorded in the entry/exit management system of building B instead of camera images. Here, the entry/exit data recorded in the entry/exit management system is data in which the type of entry/exit, the IDs of the people who entered and left, and the entry/exit times are associated with each area of building B. In addition, the remaining person number identifying unit 511 may identify the number of people who are unable to evacuate in each area of building B based on attribute data of people present in building B managed in building B in addition to the entry/exit data. Here, the attribute data of people present in building B is data in which the IDs of people present in building B are associated with at least information indicating the presence or absence of a disability.

2-3. Modification 3
In step Sa1 of the above-mentioned process of identifying the number of remaining persons, the number-of-remainers specifying unit 511 may acquire image data representing a video of several to several tens of seconds, instead of a still image, from each IP camera 3. In this case, the camera image included in the above-mentioned detailed screen and email will be a video.

2-4. Modification 4
The number of remaining persons determining unit 511 may start the above-mentioned number of remaining persons determining process when an earthquake occurs, in addition to when fire information is received from the fire receiver 2.

2-5. Modification 5
The thresholds referred to in steps Sb3 and Sb9 of the map screen generation process are merely examples, and may be changed as appropriate depending on the circumstances of the fire prevention object.

2-6. Modification 6
In the above map screen, the number of people who are unable to evacuate may be shown in addition to the number of people who remain. For example, in the case of Fig. 6, numbers in parentheses indicating the number of people who are unable to evacuate may be placed near the circled numbers CN1 and CN2.

2-7. Modification 7
In the above map screen, the information indicating the number of remaining people and the information indicating the presence or absence of people who have difficulty evacuating may be expressed by a method other than color. For example, they may be expressed by icons. Taking FIG. 6 as an example, an icon indicating the number of remaining people and an icon indicating the presence or absence of people who have difficulty evacuating may be placed near the circled numbers CN1 and CN2.

2-8. Modification 8
The notification buttons included in the above-mentioned detailed screen may be divided into two types: a first notification button for transmitting a still camera image, and a second notification button for transmitting a video camera image. When the first notification button of these notification buttons is selected by the user, the email notification unit 515 executes the above-mentioned email notification process. On the other hand, when the second notification button is selected by the user, the email notification unit 515 acquires video image data instead of still image image data in step Sd4 of the above-mentioned email notification process. Specifically, a shooting request is sent to the selected IP camera 3, and image data representing a video of several seconds to several tens of seconds is acquired from the IP camera 3. By dividing the notification buttons into two types in this way, the user can use still images and videos depending on the situation to be notified.

2-9. Modification 9
The notification button included in the above-mentioned detailed screen does not necessarily have to be included in the detailed screen. For example, it may be included in the above-mentioned map screen. Taking FIG. 6 as an example, it may be arranged in association with each camera symbol SB2. Alternatively, only one notification button may be arranged in the cross-sectional view area AR2, and when the notification button is selected by the user, the above-mentioned email notification process may be executed for each of all floors.

2-10. Modification 10
The smartphone 4 is an example of a terminal carried by a private fire brigade member. Instead of the smartphone 4, a tablet terminal or a wearable terminal may be carried by a private fire brigade member.

2-11. Modification 11
In step Sd7 of the above email notification process, the email notification unit 515 may send an email to a smartphone carried by a public fire brigade member in addition to or instead of the smartphone 4 carried by the private fire brigade member.

2-12. Modification 12
The email sent by the email notification unit 515 does not necessarily have to include information indicating the number of remaining people or information indicating whether there are people who are unable to evacuate. In other words, it may include only the camera images. Or, conversely, it may not include the camera images.

1...fire detector, 2...fire receiver, 3...IP camera, 4...smartphone, 5...display system, 51...control unit, 52...storage unit, 53...input unit, 54...display unit, 55...communication unit, 511...remaining personnel number determination unit, 512...map screen generation unit, 513...detailed screen generation unit, 514...camera control unit, 515...email notification unit, 521...image data group, 522...remaining personnel number table, 523...camera position table, 524...map data group, 525...team member data, AR1...floor plan area, AR2...cross-sectional view area, B...building, BT1...camera control button, BT2...notification button, CN1, CN2...circled numbers, MS1...explanatory message, PC1, PC2...camera image, SB1...fire symbol, SB2...camera symbol, SR1...map screen, SR2...detailed screen

Claims (4)

an identification unit that identifies the number of remaining people and the number of people who are unable to evacuate for each of a plurality of areas constituting the building based on a camera image of the area or entry and exit data recorded for the area;
a display control unit that causes a display unit to display a map image of the building, in which a first symbol indicating the number of the remainders and the number of the difficult to evacuate people identified for each of the plurality of areas is associated with the map image ,
The first symbol indicates the number of the remaining people by a number, and is expressed in different colors according to the number of the remaining people and the number of the people who are unable to evacuate.
Evacuation status display system. The evacuation situation display system according to claim 1 , wherein the identifying unit identifies a person lying on the floor as the person having difficulty evacuating based on the camera image. the map image includes a longitudinal section of the building;
A second symbol indicating the total number of the remaining people and the total number of the people who are unable to evacuate on each floor of the longitudinal cross-sectional view is associated with each floor of the longitudinal cross-sectional view,
The evacuation situation display system according to claim 1 or 2, characterized in that the second symbol indicates the total number of remaining people in numbers and is displayed in different colors depending on the total number of remaining people and the total number of people who are unable to evacuate. The evacuation situation display system described in any one of claims 1 to 3, further comprising a notification unit that transmits to a terminal carried by a member of the self-defense fire brigade in charge of the area, the camera image taken of the area and a message corresponding to the number of remaining people and the number of people who are unable to evacuate identified in the area.

Images