WO2022196474A1

WO2022196474A1 - Disaster damage information processing device, disaster damage information processing system, disaster damage information processing method, and program

Info

Publication number: WO2022196474A1
Application number: PCT/JP2022/010193
Authority: WO
Inventors: 郷太渡部
Original assignee: 富士フイルム株式会社
Priority date: 2021-03-19
Filing date: 2022-03-09
Publication date: 2022-09-22
Also published as: JPWO2022196474A1; US20240005770A1

Abstract

Provided are a disaster damage information processing device, a disaster damage information processing system, a disaster damage information processing method, and a program that extract and provide information of a building damaged by a specific cause of damage from an image including buildings. The present invention comprises: obtaining an image including buildings; extracting a first damaged building damaged by a first cause of damage from the obtained image; calculating the number of the extracted first damaged buildings; and providing at least a part of first disaster damage information related to the extracted first damaged buildings including the calculated number of the first damaged buildings, to a first terminal associated with the first cause of damage.

Description

DISASTER INFORMATION PROGRAM, DISASTER INFORMATION PROCESSING SYSTEM, DISASTER INFORMATION PROGRAM

The present invention relates to a disaster information processing device, a disaster information processing system, a disaster information processing method, and a program, and more particularly to a technique for providing disaster information of a desired cause of disaster.

When a large-scale disaster such as a major earthquake occurs, it is necessary for local governments, etc. to quickly and accurately grasp the damage situation.

Patent Document 1 discloses a method for detecting damaged houses using an image of a disaster area photographed from above and house polygons acquired before the disaster occurred.

JP 2017-220175 A

In an organization that has jurisdiction over a specific cause of disaster, it is necessary to distinguish between information on buildings damaged by the cause of damage under their jurisdiction and information on buildings damaged by causes outside of their jurisdiction. For example, in a survey of damage to houses during a disaster, collapsed houses are under the jurisdiction of local governments. On the other hand, burnt houses that have been destroyed by fire are generally under the jurisdiction of the fire department, and under the management of the fire department, damage investigation and damage certificate issuance are carried out. For this reason, when local governments formulate damage survey plans, it is necessary to exclude burned houses from the target. However, in large-scale disasters, collapsed houses due to earthquakes and burnt down houses due to fire coexist, and it is difficult to manually detect and count them.

The present invention has been made in view of such circumstances, and provides a disaster information processing apparatus, a disaster information processing system, and a disaster information processing method for extracting and providing information on a building damaged by a specific disaster cause from an image including the building. and to provide programs.

One aspect of a disaster information processing apparatus for achieving the above object comprises at least one processor and at least one memory for storing instructions to be executed by the at least one processor, wherein the at least one processor is , acquiring an image including buildings, extracting the first damaged buildings damaged by the first cause of damage from the acquired image, calculating the number of the extracted first damaged buildings, and extracting the first damaged buildings providing at least part of the first damage information including the calculated first number of damaged buildings to the first terminal associated with the first cause of damage It is a disaster information processing device that According to this aspect, it is possible to extract and provide information on a building damaged by a specific disaster cause from an image including the building.

At least one processor calculates the number of extracted first damaged buildings for each area, and stores at least part of the first damage information for each area including the calculated number of first damaged buildings for each area. is preferably provided to the first terminal. This makes it possible to provide disaster information for each area.

At least one processor acquires information of a first terminal for each area associated with a first cause of disaster, and converts at least part of the first disaster information for each area to a first terminal associated for each area. It is preferable to provide each for one terminal. Thereby, the disaster information for each area can be provided to the first terminal associated with each area.

The at least one processor causes the display to be selectable by the user, and converts at least a part of the first disaster information of the user-selected area to the first area associated with the user-selected area. preferably provided to the terminal. Thereby, it is possible to provide the disaster information of the desired area to the first terminal associated with the desired area.

It is preferable that at least one processor obtains regional area information corresponding to the obtained image, and obtains first disaster information for each area using the obtained regional area information. This makes it possible to appropriately obtain disaster information for each region.

The at least one processor preferably causes the display to display at least part of the first disaster information. This allows the user to visually recognize the disaster information.

It is preferable that at least one processor acquires building area information corresponding to the acquired image, and extracts buildings from the acquired image using the acquired building area information. Thereby, the building can be appropriately extracted from the image.

At least one processor cuts out an image of a building region from the image, inputs the cut out image of the building region into the first trained model, and determines whether the building in the cut out image is the first damaged building. , and the first trained model preferably outputs whether or not the cause of damage to the building in the input image is the first cause of damage when a building image is given as an input. This makes it possible to appropriately determine the building that caused the first damage.

A second damaged building damaged by a second cause of damage different from the first cause of damage is extracted from the acquired image, the number of the extracted second damaged buildings is calculated, and the extracted second damaged building providing at least part of second damage information including the calculated number of second damaged buildings to the second terminal associated with the second cause of damage; is preferred. This makes it possible to extract and provide information on buildings damaged by a second cause of damage that is different from the first cause of damage.

At least one processor extracts, from the acquired image, damaged buildings damaged by each cause of damage among a plurality of causes of damage, calculates the number of extracted damaged buildings for each cause of damage, and calculates the number of damaged buildings related to the extracted damaged buildings. a third terminal different from the first terminal, wherein at least a part of the damage information for each cause of damage including the calculated number of damaged buildings for each cause of damage is transmitted to a third terminal different from the first terminal; It is preferable to provide to the third terminal respectively associated with each cause. This makes it possible to extract information on buildings damaged by a plurality of disaster causes from an image including buildings, and provide the information to the third terminal.

It is preferable that at least one processor identifies whether or not buildings included in the image are damaged, and extracts damaged buildings damaged by each damage cause from the buildings identified as being damaged. This makes it possible to extract information on damaged buildings without omission.

At least one processor extracts an image of a building region from the image, inputs the extracted image of the building region to a second trained model, and acquires whether or not the building in the extracted image is damaged; The second trained model preferably outputs whether or not the building in the input image is damaged when given a building image as an input. This makes it possible to appropriately extract damaged buildings.

　The first cause of damage is a fire, and the first terminal is preferably associated with a fire department. This makes it possible to provide information on buildings damaged by fire to the fire department that has jurisdiction over the fire.

The image is preferably an aerial image taken from an aircraft or a satellite image taken from an artificial satellite. As a result, it is possible to acquire damage information for a plurality of buildings from one image.

One aspect of a disaster information processing system for achieving the above object includes at least one first processor and at least one first memory storing instructions to be executed by the at least one first processor. , at least one second processor, and at least one second memory storing instructions for causing the at least one second processor to execute; a server comprising at least one A disaster information processing system comprising a fourth terminal comprising three third processors and at least one third memory storing instructions for causing the at least one third processor to execute, at least one third processor acquiring an image including buildings, extracting an image of a building region from the acquired image, providing the extracted building region image to a server, and at least one second processor acquires an image of a building area provided from a fourth terminal, extracts a first damaged building damaged by a first cause of damage from the acquired image of a building area, and extracts the extracted first damaged building The number of buildings is calculated, and at least part of the first damage information related to the extracted first damaged building, which includes the calculated first damaged building number, is transferred to the first terminal, at least one first processor obtains at least part of the first disaster information provided from the server, and outputs at least part of the first disaster information to the first display It is a disaster information processing system that displays According to this aspect, it is possible to extract and provide information on a building damaged by a specific disaster cause from an image including the building.

One aspect of the disaster information processing method for achieving the above object is an image acquisition step of acquiring an image including a building; 1, a damaged building extracting step, a calculating step of calculating the number of extracted first damaged buildings, and first damage information related to the extracted first damaged building, which is the calculated number of first damaged buildings. and a providing step of providing at least part of the first disaster information including to the first terminal associated with the first cause of disaster. According to this aspect, it is possible to extract and provide information on a building damaged by a specific disaster cause from an image including the building.

One aspect of the program for achieving the above object is a program for causing a computer to execute the above disaster information processing method. A computer-readable non-transitory storage medium in which this program is recorded may also be included in this embodiment.

According to the present invention, it is possible to extract and provide information on buildings damaged by a specific disaster cause from an image containing buildings.

FIG. 1 is a schematic diagram of a disaster information processing system. FIG. 2 is a block diagram of the disaster information processing system. FIG. 3 is a functional block diagram of the disaster information processing system. FIG. 4 is a flow chart showing each step of the disaster information processing method. FIG. 5 is a process diagram of each step of the disaster information processing method. FIG. 6 is a process diagram of disaster information processing for each region. FIG. 7 is a process diagram of the process of notifying the fire department in charge. FIG. 8 is a process diagram of sorting out collapsed houses, burnt houses, and flooded houses. FIG. 9 is a process diagram of sorting the collapsed houses and the flooded houses.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[Overall configuration of disaster information processing system]
FIG. 1 is a schematic diagram of a disaster information processing system 10 according to this embodiment. As shown in FIG. 1 , the disaster information processing system 10 includes a drone 12 , a local government server 14 , a fire station terminal 16 and a local government terminal 18 .

The drone 12 (an example of a "fourth terminal") is an unmanned aerial vehicle (UAV: unmanned aerial vehicle, an example of a "flying object") remotely controlled by the local government server 14 or a controller (not shown). Drone 12 may have an autopilot function that flies according to a predetermined program. For example, when a large-scale disaster occurs, the drone 12 captures an image of the ground from above to obtain an aerial image (high-altitude image) including buildings. Buildings refer to dwellings such as "single-family homes" and "multi-family housing," but may also include general buildings such as "stores," "offices," and "factories." In the following, buildings are referred to as "houses" without distinguishing between types.

The local government server 14 is installed in the department involved in the housing damage certification survey within the government building of the local government. The local government server 14 is realized by at least one computer and constitutes a disaster information processing device. The municipality server 14 may be a cloud server provided by a cloud system.

The fire department terminal 16 is installed in a fire department that is an organization that has jurisdiction over fires (an example of a "first cause of damage") and is associated with the municipality where the municipality server 14 is installed. The fire station terminal 16 (an example of a "first terminal") is realized by at least one computer and constitutes a disaster information processing device.

The local government terminal 18 is installed in a department different from the department in which the local government server 14 is installed, inside the government building of the local government. The municipality terminal 18 is realized by at least one computer and connected to the communication network 20 . The local government terminal 18 may be installed at a branch office of the local government.

The drone 12, the local government server 14, the fire station terminal 16, and the local government terminal 18 are each connected via a communication network 20 such as a 2.4 GHz band wireless LAN (Local Area Network) so that data can be transmitted and received.

Note that the drone 12, the local government server 14, the fire station terminal 16, and the local government terminal 18 need only be able to exchange data, and do not have to be directly connected so that data can be sent and received. For example, data may be exchanged via a data server (not shown).

[Electrical Configuration of Damage Information Processing System]
FIG. 2 is a block diagram showing an electrical configuration of the disaster information processing system 10. As shown in FIG. As shown in FIG. 2, drone 12 includes processor 12A, memory 12B, camera 12C, and communication interface 12D.

The processor 12A (an example of a "third processor") executes instructions stored in the memory 12B. The hardware structure of the processor 12A is various processors as shown below. Various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and acts as various functional units, a GPU (Graphics Processing Unit), which is a processor specialized for image processing, A circuit specially designed to execute specific processing such as PLD (Programmable Logic Device), which is a processor whose circuit configuration can be changed after manufacturing such as FPGA (Field Programmable Gate Array), ASIC (Application Specific Integrated Circuit), etc. Also included are dedicated electrical circuits, which are processors with configuration, and the like.

One processing unit may be composed of one of these various processors, or two or more processors of the same or different type (for example, a plurality of FPGAs, a combination of CPU and FPGA, or a combination of CPU and GPU). Also, a plurality of functional units may be configured by one processor. As an example of configuring a plurality of functional units in a single processor, first, as represented by a computer such as a client or server, a single processor is configured by combining one or more CPUs and software. There is a form in which a processor acts as a plurality of functional units. Secondly, as typified by SoC (System On Chip), etc., there is a mode of using a processor that realizes the functions of the entire system including multiple functional units with a single IC (Integrated Circuit) chip. In this way, various functional units are configured using one or more of the above various processors as a hardware structure.

Furthermore, the hardware structure of these various processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor elements.

The memory 12B (an example of a "third memory") stores instructions to be executed by the processor 12A. The memory 12B includes RAM (Random Access Memory) and ROM (Read Only Memory), not shown. The processor 12A uses the RAM as a work area, executes software using various programs and parameters stored in the ROM, and uses the parameters stored in the ROM or the like to perform various processes of the drone 12. Run.

The camera 12C includes a lens (not shown) and an imaging device (not shown). The camera 12C is supported by the drone 12 via gimbals (not shown). The lens of the camera 12C forms an image of the received subject light on the imaging plane of the imaging element. The imaging element of the camera 12C receives the subject light imaged on the imaging plane and outputs an image signal of the subject.

The camera 12C may acquire the angles of the roll axis, pitch axis, and yaw axis of the optical axis of the lens using a gyro sensor (not shown).

The communication interface 12D controls communication via the communication network 20.

The drone 12 may include a GPS (Global Positioning System) receiver, an air pressure sensor, an orientation sensor, a gyro sensor, etc. (not shown).

Also, as shown in FIG. 2, the municipality server 14 includes a processor 14A, a memory 14B, a display 14C, and a communication interface 14D. Fire department terminal 16 includes processor 16A, memory 16B, display 16C, and communication interface 16D.

The configuration of the processor 14A (an example of the "second processor") and the processor 16A (an example of the "first processor") is the same as the configuration of the processor 12A. Also, the configurations of the memory 14B (an example of the "second memory") and the memory 16B (an example of the "first memory") are the same as the configuration of the memory 12B.

The display 14C is a display device for making the information processed by the disaster information processing system 10 visible to the staff (user) of the local government. As the display 14C, a large-screen plasma display, or a multi-screen multi-display in which a plurality of displays are joined together, or the like can be applied. The display 14C also includes a projector that projects an image onto the screen.

The display 16C (an example of the "first display") is a display device for allowing fire department personnel to view information processed in the disaster information processing system 10. The configuration of the display 16C is similar to that of the display 14C.

The configurations of the communication interface 14D and the communication interface 16D are the same as the communication interface 12D.

Although not shown in FIG. 2, the configuration of the local government terminal 18 is similar to that of the fire station terminal 16.

[Functional configuration of disaster information processing system]
FIG. 3 is a functional block diagram of the disaster information processing system 10. As shown in FIG. As shown in FIG. 3, the disaster information processing system 10 includes a house detection unit 30, a damage determination unit 32, a damage classification unit 34, a burnt house totalization unit 36, a burnt house information display unit 38, and a burnt house information display unit 38. and a house information notification unit 40 .

The functions of the house detection unit 30 are implemented by the processor 12A. Moreover, the functions of the disaster determination unit 32, the disaster type sorting unit 34, the burnt house counting unit 36, the burnt house information display unit 38, and the burnt house information notification unit 40 are realized by the processor 14A. All these functions may be implemented by either processor 12A or processor 14A. Moreover, the disaster information processing system 10 may be interpreted as a "disaster information processing device" implemented by a plurality of processors.

The house detection unit 30 detects a house area included in the high-altitude image acquired from the camera 12C, cuts out each of the detected house areas, and generates a house cutout image. The house detection unit 30 detects a house area from the high-altitude image and house area information (an example of "building area information") of the area captured by the high-altitude image. The house area information is information including at least one of house boundary line information, house position information, and house address information. The house boundary line information may be polygon information. House polygon information is generated from house outer shape data, house height data, and land elevation data. The house location information includes latitude and longitude information. The house address information includes information on prefectures, municipalities, town areas, chomes, and street numbers. The house area information is stored in the memory 12B.

The damage determination unit 32 determines (identifies) whether or not the house included in the cut-out image of the house is damaged. The fact that the house is damaged means that the house is damaged by the disaster. The disaster determination unit 32 includes a disaster determination AI (Artificial Intelligence) 32A.

The damage determination AI32A (an example of the "second learned model") is a learned model that outputs whether or not the house included in the cut-out house image is damaged when given the cut-out image of the house as an input. The damage judgment AI32A is machine learning based on a learning data set for learning, which is a set of a cut-out image of a house from which the region of the house is cut out and whether or not the house is damaged in the cut-out image of the house. be. The disaster determination AI 32A can apply a convolution neural network (CNN: Convolution Neural Network).

The damage type sorting unit 34 sorts the damage type of the house in the cutout image of the house determined to be damaged, and determines whether the house was damaged by fire (an example of the “first cause of damage”) from the cutout image of the house. A burnt house (an example of a “first damaged building”) is extracted, and a collapsed house damaged by a collapse (an example of a “second cause of damage”) (an example of a “second damaged building”) is extracted from the cutout image of a house. ).

The disaster type sorting unit 34 includes a burn detection AI 34A and a collapse detection AI 34B. The burnt-down detection AI 34A (an example of the “first trained model”) is a trained model that outputs whether or not the house included in the cut-out house image is burnt down when given the cut-out image of the house as an input. The term "house destroyed by fire" means that the house is damaged by fire, and includes not only "completely burned" but also "half-burned," "partially burned," and "burned." The burnt-down detection AI34A performs machine learning using a learning data set for learning, which is a set of a cut-out image of the house from which the area of the house has been cut out and the presence or absence of the burnt-down house included in the cut-out image of the house. be.

The collapse detection AI 34B is a trained model that outputs whether or not the house included in the cutout image of the house has collapsed when given the cutout image of the house as an input. A collapsed house means that the house is destroyed, and includes not only "total collapse" but also "large-scale partial collapse" and "partial collapse". The collapse detection AI 34B performs machine learning using a learning data set for learning, which is a set of a cut-out image of a house from which the area of the house has been cut out and the presence or absence of collapse of the house included in the cut-out image of the house. be. The burn detection AI 34A and the collapse detection AI 34B can apply convolutional neural networks.

The burnt house tallying unit 36 tallies (an example of "calculation") the number of houses determined to be burnt down by the disaster classification unit 34 (burnt houses).

The burnt house information display unit 38 displays at least part of the damage information related to the burnt houses sorted by the disaster type sorting unit 34 and including the number of burnt houses tallied by the burnt house tallying unit 36. , is displayed on the display 14C. The disaster information includes at least one of an image of the burnt-down house, location information, and address information.

The burnt house information notification unit 40 receives damage information related to burnt houses sorted by the disaster type sorting unit 34 and including the number of burnt houses aggregated by the burnt house aggregation unit 36 (“first disaster information ”) is notified (an example of “providing”) to the fire department terminal 16 associated with the fire.

In the disaster information processing system 10, it is sufficient if the local government server 14 can provide disaster information to the fire department terminal 16, and the local government server 14 does not necessarily have to directly notify the fire department terminal 16 of the disaster information. For example, the local government server 14 may upload the disaster information to a server (not shown), and the fire station terminal 16 may download the disaster information from the server (not shown).

[Damage information processing method]
FIG. 4 is a flow chart showing each step of the disaster information processing method by the disaster information processing system 10. As shown in FIG. Moreover, FIG. 5 is a process diagram in each process of the disaster information processing method. The disaster information processing method is implemented by causing the processor 14A to execute a disaster information processing program stored in the memory 14B. The disaster information processing program may be provided by a computer-readable non-temporary storage medium. In this case, the local government server 14 may read the disaster information processing program from the non-temporary storage medium and store it in the memory 14B.

In step S1 (an example of the "image acquisition process"), the drone 12 flies over the city immediately after the large-scale disaster according to the instructions of the local government server 14, and captures high-altitude images including houses with the camera 12C.

In step S2 (an example of a "first damaged building extraction step"), the disaster information processing system 10 extracts a burnt house (an example of a "first damaged house") from the high-place image. First, the house detection unit 30 of the processor 12A of the drone 12 detects a house area from the high-altitude image captured in step S1 based on the house area information acquired from the memory 12B.

FIG. 5 shows a high-altitude image 100 and house area information 102 at the same angle as the high-altitude image 100 . The house area information 102 is information created from a high-altitude image taken before the occurrence of a large-scale disaster, and here is information representing the outline shape of a house with lines.

Also, FIG. 5 shows a synthesized image 104 obtained by synthesizing the high place image 100 and the house area information 102 . By generating such a composite image 104, the house detection unit 30 can recognize that the area surrounded by lines in the house area information 102 in the composite image 104 is a house.

The house detection unit 30 cuts out the house areas detected by the composite image 104 from the high-altitude image 100 to generate house cutout images. FIG. 5 shows house clipped

images

106A, 106B, . . . House cutout images are generated by the number of houses detected.

The drone 12 transmits (an example of "providing") the house cut-out

images

106A, 106B, . The municipality server 14 receives (an example of "acquisition") the cut-out

house images

106A, 106B, . . . through the communication interface 14D.

Next, the damage determination unit 32 of the processor 14A of the municipality server 14 sequentially inputs the plurality of cut-out house images to the damage determination AI 32A, and determines whether or not the house included in each cut-out house image is damaged. do. That is, the damage determination unit 32 selects, from among the plurality of house cutout images, house cutout images in which the house is damaged and house cutout images in which the house is not damaged. FIG. 5 shows an example of inputting cut-out

house images

106A, 106B, . . . to the disaster determination AI 32A.

Subsequently, the damage type sorting unit 34 sequentially inputs the cut-out house images, among the multiple cut-out house images, for which the damage determination unit 32 determines that the house is damaged, to the burnt-down detection AI 34A, and It is determined whether or not the house included in the clipped image has been destroyed by fire. That is, the burnt-down detection AI 34A sorts out a house cut-out image in which the house is burnt down and a house cut-out image in which the house is not burnt down.

In addition, the damage classification unit 34 selects a house cut-out image for which the damage determination unit 32 has determined that the house has been damaged among the plurality of house cut-out images, and which has been destroyed by fire in the burn-down detection AI 34A. The house cut-out images determined not to be collapsed are sequentially input to the collapse detection AI 34B, and it is determined whether or not the house included in each house cut-out image is collapsed. That is, the collapse detection AI 34B sorts out a house clipped image in which the house is collapsed and a house clipped image in which the house is not collapsed.

In this way, the damage type sorting unit 34 selects, among a plurality of house cutout images in which a house is damaged, a house cutout image in which a house has been destroyed by fire and a house cutout image in which a house has collapsed. , and cropped images of damaged houses other than burnt down and collapsed houses. Therefore, the disaster information processing system 10 can extract burnt houses from high-place images. FIG. 5 shows an example of inputting a cut-out image of a house to the burnt-down detection AI 34A and the collapse detection AI 34B.

Here, in the disaster type sorting unit 34, it is determined whether or not the house is destroyed after determining whether or not the house is destroyed by fire, but the order of sorting burnt houses and collapsed houses may be reversed. That is, the disaster type sorting unit 34 may determine whether the house has been destroyed by fire after determining whether the house has collapsed.

In addition, the damage determination unit 32 determines whether or not the house included in the cut-out house image is damaged. However, the processes of the disaster determination unit 32 and the disaster type sorting unit 34 may be reversed. That is, the damage classification unit 34 sorts out the types of damage to the houses included in the cut-out house images, and for the cut-out house images that are not sorted, the damage determination unit 32 decides whether or not the house is damaged. It may be determined whether

Next, in step S3 (an example of the "calculation process"), the burnt-down house tallying unit 36 tallies the number of burnt-down houses included in the high-place image. The number of burnt houses corresponds to the number of cutout images of houses determined to be burnt down in the process of the burnt house detection AI 34A in step S2. The burnt house tallying unit 36 may tally the number of collapsed houses (an example of the “second damaged house”) included in the high place image together with the tallying of the number of burnt houses.

Finally, in step S4 (an example of a "providing step"), the burnt-down house information notification unit 40 sends damage information (an example of "first damage information") related to the burnt-down house extracted in step S2 to the fire station terminal 16. It is notified by the communication interface 14D. The damage information includes the number of burnt houses counted in step S3. The burnt house information notification unit 40 may notify the fire station terminal 16 of at least part of the disaster information.

The burnt house information display unit 38 may display at least part of the disaster information on the display 14C. The burnt-down house information notification unit 40 is the damage information relating to the collapsed houses determined in step S2 and includes the number of collapsed houses aggregated in step S3 (an example of "second damage information"). may be notified to the local government terminal 18 (an example of the “second terminal”). The burnt house information display unit 38 may display at least part of this disaster information on the display 14C.

The processor 16A of the fire department terminal 16 receives the disaster information transmitted from the burnt house information notification unit 40 through the communication interface 16D and displays it on the display 16C. As a result, the fire department staff can visually recognize the information on the burnt-down house included in the high-altitude image.

In addition, the processor 14A of the local government server 14 displays at least a part of the damage information regarding the collapsed houses determined in step S2 and including the number of collapsed houses counted in step S3 on the display 14C. You may let Furthermore, the processor 14A of the local government server 14 may display at least a part of the damage information of houses caused by damage other than burning and collapse on the display 14C or may provide it to the local government terminal 18. FIG.

As described above, according to the disaster information processing system 10, it is possible to extract information on houses damaged by fire from high-altitude images including houses, and provide the information to the fire department that has jurisdiction over the fire. In addition, according to the disaster information processing system 10, it is possible to extract information on houses that have been damaged by collapse from high-place images including houses, and to provide the information to the departments of the local government that have jurisdiction over the collapse. Furthermore, it is possible to extract information on houses that have caused damage other than fires and collapses from high-altitude images that include houses, and provide this information to local government departments that have jurisdiction over the causes of damages other than fires and collapses. Information can be provided without omission.

[Damage information processing method for each region]
The disaster information processing method may be performed for each region. For example, the burnt house tallying unit 36 tallies the number of burnt houses by region, the burnt house information display unit 38 displays information on burnt houses by region, and the burnt house information notification unit 40 displays disaster information by region. You may notify to the fire station terminal 16 for every area. Each region may be for each ward or municipality, may be for each town area, or may be for each chome.

Fig. 6 is a process diagram of disaster information processing for each region. FIG. 6 shows burnt house information 110 and chome area information 112 in a certain area. The burnt house information 110 includes at least one of an image of the burnt house, position information, and address information. The chome area information 112 is an example of the area area information corresponding to the high-altitude image including the burnt house information 110. Here, the chome area information 112 is represented by white lines representing the boundaries of each chome. Information.

The burnt-down house tabulation unit 36 uses the chome region information 112 to perform tabulation processing for each chome. If the burnt house information 110 does not include address information, the boundary line information is used to determine which chome the burnt house is in and totalize.

FIG. 6 shows an example of situation grasping information displayed on the display 14C by the burnt-down house information display unit 38, including tabulated

results

114 and 116 for each chome, an address list 118 of burnt-out houses, a cut-out image 120 of a house, Estimate 122 of the amount of work for the housing damage certification survey.

The tally result 114 is a map of the area, and the chome area is color-coded according to the number of burnt houses in each chome. For example, the burnt-down house information display section 38 displays chomes with a relatively large number of burnt-down houses in red, and chomes with a relatively small number of burnt-down houses in blue. The burnt-down house information display section 38 may also display a higher density for each color area as the number of burnt-down houses is relatively larger.

The tally result 116 is a map in which a part of the tally result 114 is enlarged. The tabulation result 116 displays the name of each chome and the number of burnt houses in each chome.

The address list 118 is a list of addresses of burnt houses included in the chome selected by the user from the displayed map.

The house cutout image 120 is, for example, an image of a burnt house included in the chome selected by the user from the high place image. House clipping image 120 may be an image of a burnt house selected by the user from address list 118 .

The estimate 122 includes the total number of burnt houses in the chome selected by the user from the displayed map and the number of houses surveyed by the local government. In the example shown in FIG. 6, the number of surveyed houses is 91,535 (449,269 houses), of which 12,782 burnt down houses account for 14% of the number of surveyed houses. Estimate 122 includes a pie chart displaying the number of these houses, with 14% corresponding to burnt houses shown in red and the other 86% shown in a color other than red.

　These status comprehension information may be displayed on the display 16C.

[Notify the fire department with jurisdiction]
The burnt-down house information notification unit 40 may notify the fire stations having jurisdiction over each chome of at least a part of the disaster information for each chome.

FIG. 7 is a process diagram of the process of notifying the fire department in charge. FIG. 7 shows tabulation results 130 and tabulation results 132 for each chome, and fire station information 134 that has jurisdiction over each chome.

The aggregated

results

130 and 132 are similar to the aggregated

results

114 and 116 shown in FIG. In the fire station information 134, each chome name is associated with the fire station that has jurisdiction over the chome.

Also, FIG. 7 shows an address list 136 of chome selected on the map. Address list 136 is similar to address list 118 shown in FIG. The burnt house information display unit 38 allows the display 14C to selectably display the user's desired chome (an example of "area"), and displays the user-selected chome address list 136 on the display 14C.

In addition, the burnt-down house information display unit 38 acquires the information of the fire station that has jurisdiction over each chome from the fire station information 134, automatically assigns the fire station in charge of each chome, and displays the fire station in charge. In the example shown in FIG. 7, above the address list 136, the name 137 of the fire station that has jurisdiction over the chome of the address list 136 and a button 138 for notifying the fire station of disaster information are displayed. When the user clicks a button 138 using a pointing device (not shown), the burnt house information notification unit 40 notifies the fire station terminal 16 of the fire station with the name 137 of the damage information included in that chome.

[Distribution of damage causes other than fire and collapse]
So far, an example has been described in which disaster types are sorted into three types of fire, collapse, and others, but it is also possible to sort by other types of disaster.

Fig. 8 is a process diagram of processing when houses burnt down by fire, houses destroyed by shaking, and houses flooded by inland water are mixed due to the occurrence of an earthquake disaster. Here, the disaster type sorting unit 34 includes a burnt-down detection AI 34A, a collapsed house detection AI 34B, and a flood detection AI 34C, and sorts out burned houses, collapsed houses, flooded houses, and other damaged houses. .

The flood detection AI34C is a trained model that outputs whether or not the house included in the cutout image of the house is flooded when given the cutout image of the house as input. The house being flooded is not limited to "above-floor flooding," in which water reaches above the floor of the dwelling, but also includes "underfloor flooding," down to below the floor of the dwelling. The inundation detection AI34C is machine-learned using a learning data set for learning, which is a set of a cut-out image of a house from which the area of the house is cut out and the presence or absence of flooding in the house included in the cut-out image of the house. be.

FIG. 8 shows an example of inputting the cut-out

house images

140A, 140B, . . . The disaster determination AI 32A determines whether or not the house included in each house clipped image is damaged.

A cut-out house image determined by the damage determination AI 32A that the house included in the cut-out house image is damaged is input to the disaster classification unit 34 . The damage type sorting unit 34 inputs the cut-out house images determined by the damage determination unit 32 that the house is damaged to the burnt-down detection AI 34A, and determines whether or not the house included in each cut-out house image is burnt down. determine whether

In addition, the damage classification unit 34 selects a house cut-out image for which the damage determination unit 32 has determined that the house has been damaged among the plurality of house cut-out images, and which has been destroyed by fire in the burn-down detection AI 34A. The cut-out image of the house that is determined not to have collapsed is input to the collapse detection AI 34B, and it is determined whether or not the house included in the cut-out image of the house has collapsed.

Furthermore, the damage type sorting unit 34 selects a house cut-out image for which the damage determination unit 32 determines that the house is damaged among the plurality of house cut-out images, and the house has been destroyed by fire in the burn-down detection AI 34A. It is determined that the house has not collapsed, and the collapse detection AI 34B determines that the house has not collapsed. do.

In other words, the damage type sorting unit 34 divides a plurality of house cut-out images in which a house is damaged, a house cut-out image in which the house is destroyed by fire, a house cut-out image in which the house is destroyed, and a house cut-out image in which the house is destroyed. It is possible to sort out the cutout image of the flooded house and the cutout image of the damaged house other than burnt down, collapsed and flooded.

In the example shown in FIG. 8, fire station terminal 16 is notified of burnt house information, collapsed house information and flooded house information are notified to municipality terminal 18, and other damaged house information is sent to other terminal 19. I am notifying you. The local government terminal 18 and other terminals 19 are examples of "third terminals associated with each cause of disaster".

FIG. 9 is a process diagram of processing when houses collapsed due to storm and flooded houses due to flooding of external water or inland water coexist due to the occurrence of wind and flood damage. Here, the disaster type distribution unit 34 includes a collapse detection AI 34B and a flood detection AI 34C, and distributes collapsed houses and flooded houses.

In this way, the disaster information processing system 10 can sort disaster types according to the situation of the disaster and provide disaster information to the terminals of the organizations that have jurisdiction over each type of disaster.

〔others〕
Here, an example of using an aerial image of the disaster situation captured from above the city by the camera 12C mounted on the drone 12 as the high-altitude image has been described. It may be an image captured by a camera. Also, the high-altitude image may be a satellite image captured by a geostationary satellite (an example of an “artificial satellite”).

The technical scope of the present invention is not limited to the scope described in the above embodiments. Configurations and the like in each embodiment can be appropriately combined between each embodiment without departing from the gist of the present invention.

10... Disaster information processing system 12... Drone 12A... Processor 12B... Memory 12C... Camera 12D... Communication interface 14... Local government server 14A... Processor 14B... Memory 14C... Display 14D... Communication interface 16... Fire station terminal 16A... Processor 16B... Memory 16C Display 16D Communication interface 18 Local government terminal 19 Other terminal 20 Communication network 30 House detector 32 Damage determination unit 32A Damage determination AI
34... Disaster classification unit 34A... Burning detection AI
34B... Collapse detection AI
34C: Flood detection AI
36 Burned house tallying unit 38 Burned house information display unit 40 Burned house information notification unit 100 Height image 102 House area information 104 Composite image 106A House cutout image 106B House cutout image 110 Burned house Information 112 Chome area information 114 Aggregation result 116 Aggregation result 118 Address list 120 House cut-out image 134 Fire station information 136 Address list 137 Name 138 Button 140A House cut-out image 140B House cut-out image S1 to S4: Each step of the disaster information processing method

Claims

at least one processor;
at least one memory storing instructions for execution by the at least one processor;
with
The at least one processor
Get an image containing buildings,
Extracting a first damaged building damaged by a first cause of damage from the acquired image,
calculating the number of extracted first damaged buildings;
At least a part of the extracted first damage information related to the first damaged building including the calculated number of first damaged buildings is associated with the first cause of damage. provided to the first terminal that was
Damage information processing device.
The at least one processor
calculating the number of extracted first damaged buildings for each region;
providing to the first terminal at least part of the first disaster information for each region, including the first number of damaged buildings calculated for each region;
The disaster information processing apparatus according to claim 1.
The at least one processor
Acquiring information of the first terminal for each region associated with the first disaster cause,
providing at least part of the first disaster information for each region to the first terminals associated with each region;
The disaster information processing apparatus according to claim 2.
The at least one processor
displaying the region on a display so that the user can select it;
providing at least part of the first disaster information of the area selected by the user to a first terminal associated with the area selected by the user;
The disaster information processing apparatus according to claim 2.
The at least one processor
obtaining regional area information corresponding to the obtained image;
obtaining first disaster information for each region using the obtained regional area information;
A disaster information processing apparatus according to any one of claims 2 to 4.
The at least one processor
displaying at least part of the first disaster information on a display;
The disaster information processing apparatus according to any one of claims 1 to 5.
The at least one processor
acquiring building area information corresponding to the acquired image;
extracting the building from the acquired image using the acquired building area information;
A disaster information processing apparatus according to any one of claims 1 to 6.
The at least one processor
cutting out an image of the area of the building from the image;
inputting the image of the cut-out building region to a first trained model to determine whether the building in the cut-out image is the first damaged building;
When the first trained model is given an image of a building as an input, it outputs whether or not the cause of damage to the building in the input image is the first cause of damage.
The disaster information processing apparatus according to any one of claims 1 to 7.
Extracting a second damaged building damaged by a second cause of damage different from the first cause of damage from the acquired image,
Calculate the number of the extracted second damaged buildings,
second damage information relating to the extracted second damaged building, wherein at least part of the second damage information including the calculated number of second damaged buildings is associated with the second cause of damage; provided to a second terminal that is
The disaster information processing apparatus according to any one of claims 1 to 8.
The at least one processor
Extracting each damaged building damaged by each damage cause among the plurality of damage causes from the acquired image,
Calculate the number of extracted damaged buildings for each damage cause,
damage information for each cause of damage related to the extracted damaged building, wherein at least part of the damage information for each cause of damage including the calculated number of damaged buildings for each cause of damage is different from that of the first terminal; A third terminal, provided to each third terminal associated with each disaster cause,
A disaster information processing apparatus according to any one of claims 1 to 9.
The at least one processor
identifying whether a building included in the image is damaged;
extracting each of the damaged buildings damaged by each of the damage causes from the buildings identified as being damaged;
The disaster information processing apparatus according to claim 10.
The at least one processor
cutting out an image of the area of the building from the image;
inputting the cutout image of the area of the building into a second trained model to acquire whether or not the building in the cutout image is damaged;
When the second trained model is given an image of a building as an input, it outputs whether the building in the input image is damaged.
The disaster information processing apparatus according to claim 11.
The first damage cause is a fire,
the first terminal is associated with a fire station;
A disaster information processing apparatus according to any one of claims 1 to 12.
The disaster information processing apparatus according to any one of claims 1 to 13, wherein the image is an aerial image taken from an aircraft or a satellite image taken from an artificial satellite.
a first terminal comprising at least one first processor and at least one first memory storing instructions for causing the at least one first processor to execute;
a server comprising at least one second processor and at least one second memory storing instructions for causing the at least one second processor to execute;
a fourth terminal comprising at least one third processor and at least one third memory storing instructions for causing the at least one third processor to execute;
A disaster information processing system including
The at least one third processor,
Get an image containing buildings,
extracting an image of the building area from the acquired image;
providing an image of the extracted building area to the server;
The at least one second processor,
obtaining an image of a building area provided by the fourth terminal;
extracting a first damaged building damaged by a first cause of damage from the acquired image of the area of the building;
calculating the number of extracted first damaged buildings;
providing to the first terminal at least part of the extracted first damage information relating to the first damaged building, the first damage information including the calculated number of first damaged buildings; ,
The at least one first processor,
obtaining at least a portion of the first disaster information provided by the server;
displaying at least part of the first disaster information on a first display;
Disaster information processing system.
an image acquisition step of acquiring an image including a building;
a first damaged building extraction step of extracting a first damaged building damaged by a first cause of damage from the acquired image;
a calculating step of calculating the number of extracted first damaged buildings;
At least a part of the extracted first damage information related to the first damaged building including the calculated number of first damaged buildings is associated with the first cause of damage. a providing step of providing to the first terminal provided;
A disaster information processing method comprising:
A program for causing a computer to execute the disaster information processing method according to claim 16.
A non-temporary computer-readable recording medium, in which the program according to claim 17 is recorded.