JP2023113145A - Inundation height calculation system, inundation height calculation method, and inundation height calculation program - Google Patents

Abstract

To enable measuring inundation height with ease.SOLUTION: A detector 211 detects a reference object from image data including an inundation line on a wall surface. A unit height calculator 212 calculates unit height which is height per unit pixel, from a pixel count in a height direction of the reference object in the image data and actual height which is real height of the reference object. An inundation height calculator calculates inundation height which is a distance from a floor surface to the inundation line, from a pixel count from the floor surface to the inundation line in the image data, and the unit height.SELECTED DRAWING: Figure 3

Description

The present disclosure relates to technology for calculating flood height from image data.

When flood damage occurs, property and casualty insurance companies dispatch assessors to the policyholder's building. Then, the assessor determines whether or not the damage situation meets the requirements for payment of the insurance money.

The payment requirement for insurance claims is, for example, to satisfy at least one of the following two conditions. Condition 1: There is flooding above the floor, Condition 2: There is flooding above a certain height (for example, 45 cm or more) from the ground level.
Condition 1 can be easily determined by visually observing the inside of the building or by checking image data of the inside of the building. However, condition 2 requires an assessor to measure the inundation height using a measure or the like, which is time-consuming.

Patent Literature 1 describes comparing a photographed image of the accident vehicle with a registered image of the vehicle type of the accident vehicle, and specifying the degree of damage from the difference.

JP-A-2001-76055

When applying the technique of Patent Literature 1 to the measurement of the flood height, the image data must contain information that can identify the height. Therefore, for example, it is necessary to take a picture of a tape measure or the like together with a flooded building. In addition, a human visual confirmation work of reading the tape measure is required. When flood damage occurs, there is a possibility that a large number of insurance claims will be filed. It takes a long time to process the application if the work of human visual confirmation is performed.
An object of the present disclosure is to make it possible to easily measure the inundation height.

The inundation height calculation system according to the present disclosure is
a detection unit that detects a reference object from image data including a flood line on a wall surface;
The unit height, which is the height per unit pixel, is calculated from the number of pixels in the height direction in the image data of the reference object detected by the detection unit and the actual height, which is the actual height of the reference object. a unit height calculator for calculating;
calculating a flood height, which is a distance from the floor surface to the flood line, from the number of pixels from the floor surface to the flood line in the image data and the unit height calculated by the unit height calculation unit; and a high calculation unit.

The inundation height calculation system further includes:
A flood line setting unit that receives designation of the position of the flood line,
The inundation height calculation unit calculates the inundation height using the position received by the inundation line setting unit as the inundation line.

The flood height calculation unit calculates the flood height using the lower end of the reference object as the floor surface.

The inundation height calculation method according to the present disclosure includes:
A computer detects a reference object from the image data including the flood line on the wall surface,
a computer calculates a unit height, which is the height per unit pixel, from the number of pixels in the height direction in the image data of the reference object and the actual height, which is the actual height of the reference object;
A computer calculates a flood height, which is a distance from the floor to the flood line, from the number of pixels from the floor to the flood line in the image data and the unit height.

The inundation height calculation program according to the present disclosure is
Detection processing to detect reference objects from image data including flood lines on walls,
The unit height, which is the height per unit pixel, is calculated from the number of pixels in the height direction in the image data of the reference object detected by the detection process and the actual height, which is the actual height of the reference object. a unit height calculation process to be calculated;
calculating a flood height, which is a distance from the floor surface to the flood line, from the number of pixels from the floor surface to the flood line in the image data and the unit height calculated by the unit height calculation process; The computer functions as an inundation height calculation system that performs high calculation processing.

In the present disclosure, the flood height is calculated based on the fiducials detected from the image data. This makes it possible to easily measure the flood height.

1 is a configuration diagram of a flood height calculation system 100 according to Embodiment 1. FIG. 1 is a configuration diagram of a user terminal 10 according to Embodiment 1; FIG. 1 is a configuration diagram of a flood height calculation device 20 according to Embodiment 1. FIG. 4 is a flowchart of overall processing of the inundation height calculation system 100 according to Embodiment 1; 4 is a flowchart of imaging processing according to Embodiment 1; FIG. 5 is an explanatory diagram of a flood line designation process according to the first embodiment; FIG. 5 is an explanatory diagram of unit height calculation processing according to the first embodiment; FIG. 2 is a configuration diagram of a user terminal 10 according to modification 1; FIG. 4 is a configuration diagram of a flood height calculation device 20 according to Modification 1; FIG. 2 is a configuration diagram of a flood height calculation device 20 according to Embodiment 2; FIG. 9 is an explanatory diagram of how a reference object is reflected according to the second embodiment; 9 is a flowchart of unit height calculation processing according to the second embodiment; FIG. 9 is an explanatory diagram of wall bottom position specifying processing according to the second embodiment; FIG. 9 is an explanatory diagram of wall bottom position specifying processing according to the second embodiment; FIG. 9 is an explanatory diagram of wall bottom position specifying processing according to the second embodiment; FIG. 11 is an explanatory diagram of on-wall position specifying processing according to the second embodiment; FIG. 9 is an explanatory diagram of height calculation processing according to the second embodiment; FIG. 10 is a configuration diagram of a user terminal 10 according to Embodiment 3; 10 is a flowchart of imaging processing according to Embodiment 3; FIG. 11 is an explanatory diagram of guide selection processing according to the third embodiment; FIG. 11 is an explanatory diagram of image acquisition processing according to the third embodiment; FIG. 11 is an explanatory diagram of detection processing according to the fourth embodiment; FIG. 11 is a configuration diagram of a flood height calculation device 20 according to Embodiment 5; FIG. 11 is an explanatory diagram of types of reference objects according to Embodiment 5; 11 is a flowchart of unit height calculation processing according to Embodiment 5; FIG. 11 is a configuration diagram of a flood height calculation device 20 according to Embodiment 6; FIG. 12 is a flowchart of inundation height calculation processing according to Embodiment 6; FIG. FIG. 11 is an explanatory diagram of correction processing according to Embodiment 6; FIG. 11 is an explanatory diagram of correction processing according to Embodiment 6; FIG. 11 is an explanatory diagram of correction processing according to Embodiment 6; FIG. 11 is a configuration diagram of a flood height calculation device 20 according to Embodiment 7; FIG. 12 is a flowchart of inundation height calculation processing according to Embodiment 7; FIG.

Embodiment 1.
*** Configuration description ***
The configuration of a flood height calculation system 100 according to Embodiment 1 will be described with reference to FIG.
The inundation height calculation system 100 includes a user terminal 10 and an inundation height calculation device 20 . The user terminal 10 and the inundation height calculation device 20 are connected via a transmission line 90 .
A user terminal 10 is a computer such as a smart phone or a tablet terminal used by a user. The user terminal 10 is a computer for capturing image data of a flooded place. The inundation height calculation device 20 is a computer such as a server in a cloud system. The inundation height calculation device 20 is a computer that calculates the inundation height based on the image data acquired by the user terminal 10 . A specific example of the transmission path 90 is the Internet.
The inundation height calculator 20 is connected via a transmission line 91 to the insurance company's server. A specific example of the transmission line 91 is the Internet.

Embodiment 1 will be described assuming the configuration shown in FIG. However, the user terminal 10 may have the functions provided by the inundation height calculation device 20 . In this case, the inundation height calculation system 100 does not include the inundation height calculation device 20 but only the user terminal 10 .

The configuration of the user terminal 10 according to Embodiment 1 will be described with reference to FIG.
The user terminal 10 includes hardware including a processor 11 , a memory 12 , a storage 13 and a communication interface 14 . The processor 11 is connected to other hardware via signal lines and controls these other hardware. The user terminal 10 is connected with the camera 141 via the communication interface 14 . Alternatively, camera 141 is internally connected and integrated with user terminal 10 .

The user terminal 10 includes an image acquisition unit 111, a flood line setting unit 112, and an image transmission unit 113 as functional components. The function of each functional component of the user terminal 10 is realized by software.
The storage 13 stores a program that implements the function of each functional component of the user terminal 10 . This program is read into the memory 12 by the processor 11 and executed by the processor 11 . Thereby, the function of each functional component of the user terminal 10 is realized.

The configuration of the inundation height calculation device 20 according to the first embodiment will be described with reference to FIG.
The inundation height calculation device 20 includes hardware including a processor 21 , a memory 22 , a storage 23 , and a communication interface 24 . The processor 21 is connected to other hardware via signal lines and controls these other hardware.

The inundation height calculation device 20 includes a detection unit 211, a unit height calculation unit 212, a inundation height calculation unit 213, and a data transmission unit 214 as functional components. The function of each functional component of the inundation height calculation device 20 is implemented by software.
The storage 23 stores a program that implements the function of each functional component of the inundation height calculation device 20 . This program is read into the memory 22 by the processor 21 and executed by the processor 21 . Thereby, the function of each functional component of the inundation height calculation device 20 is realized.

The processors 11 and 21 are ICs that perform processing. IC is an abbreviation for Integrated Circuit. Specific examples of the processors 11 and 21 are CPU, DSP, and GPU. CPU is an abbreviation for Central Processing Unit. DSP is an abbreviation for Digital Signal Processor. GPU is an abbreviation for Graphics Processing Unit.

Memories 12 and 22 are storage devices that temporarily store data. Specific examples of the memories 12 and 22 are SRAM and DRAM. SRAM is an abbreviation for Static Random Access Memory. DRAM is an abbreviation for Dynamic Random Access Memory.

The storages 13 and 23 are storage devices that store data. The storages 13 and 23 are HDDs as specific examples. HDD is an abbreviation for Hard Disk Drive. The storages 13 and 23 are portable recording media such as SD (registered trademark) memory cards, CompactFlash (registered trademark), NAND flash, flexible disks, optical disks, compact disks, Blu-ray (registered trademark) disks, and DVDs. may SD is an abbreviation for Secure Digital. DVD is an abbreviation for Digital Versatile Disk.

Communication interfaces 14 and 24 are interfaces for communicating with external devices. Specific examples of the communication interfaces 14 and 24 are Ethernet (registered trademark), USB, and HDMI (registered trademark) ports. USB is an abbreviation for Universal Serial Bus. HDMI is an abbreviation for High-Definition Multimedia Interface.

Only one processor 11 was shown in FIG. However, there may be a plurality of processors 11, and the plurality of processors 11 may cooperate to execute programs that implement each function. Similarly, only one processor 21 was shown in FIG. However, there may be a plurality of processors 21, and the plurality of processors 21 may cooperatively execute programs that implement each function.

***Description of operation***
The operation of the flood height calculation system 100 according to the first embodiment will be described with reference to FIGS. 4 to 7. FIG.
The operation procedure of the flood height calculation system 100 according to the first embodiment corresponds to the flood height calculation method according to the first embodiment. Also, a program that realizes the operation of the inundation height calculation system 100 according to the first embodiment corresponds to the inundation height calculation program according to the first embodiment.

Referring to FIG. 4, the overall processing flow of flood height calculation system 100 according to the first embodiment will be described.
(Step S1: shooting process)
The image acquisition unit 111 of the user terminal 10 acquires image data including the flood line on the wall surface. The inundation line is the trace of water left on the wall due to flood damage. The inundation line indicates the upper limit position of the inundation.
At this time, the image acquisition unit 111 acquires the image data so as to include the reference object. A reference object is a pre-determined object whose size is identifiable. It is desirable that the reference object is easily available and has a standardized size. As specific examples, the reference objects are bottles such as PET bottles or beer bottles, paper packs such as toilet paper and milk cartons, and aluminum cans such as 350 ml. Alternatively, the reference may be a box or the like previously sent to the policyholder by the insurance company.

The photographing process according to the first embodiment will be described with reference to FIG.
As a premise, an application program for calculating the flood height is executed. As a result, the functions of the image acquisition unit 111, the flood line setting unit 112, and the image transmission unit 113 are activated. Also, the camera 141 included in the user terminal 10 is activated via the application program.

(Step S11: Image Acquisition Processing)
The image acquisition unit 111 acquires image data by photographing the inundation line and the reference object simultaneously with the camera 141 . Here, the reference object is placed on the floor.

(Step S12: Inundation Line Designation Processing)
The inundation line setting unit 112 sets the position of the inundation line in the image data acquired in step S11. Specifically, as shown in FIG. 6, the inundation line setting unit 112 sets the position of the designated inundation line according to the user's operation. For example, the position of the inundation line is specified by dragging and moving the line for setting the inundation line on the image data acquired in step S11.

(Step S13: data transmission process)
The image transmission unit 113 transmits the image data acquired in step S11 and the positional information of the inundation line set in step S12 to the inundation height calculation device 20 . At this time, in step S13, the image transmission unit 113 transmits information that can identify the insurance contract, such as the identification information of the policyholder, together with the image data and the like.

(Step S2: detection processing)
The detection unit 211 of the inundation height calculation device 20 detects a reference object from the image data. Specifically, the detection unit 211 inputs the image data transmitted in step S13 to the object detection model to detect the reference object. The object detection model is a model constructed using a neural network or the like.

(Step S3: unit height calculation process)
The unit height calculator 212 of the flooded height calculator 20 identifies the number of pixels in the height direction in the image data of the reference object detected in step S2. As shown in FIG. 7, the number of pixels in the height direction of the reference object is the number of pixels from the lower end to the upper end of the reference object. For example, when a detection frame surrounding the detected reference object is obtained in step S2, the number of pixels in the height direction of the reference object is the number of pixels from the lower side to the upper side of the detection frame.
The unit height calculator 212 calculates the unit height, which is the height per unit pixel, from the number of pixels in the height direction and the actual height of the reference object. The actual height of the reference is known, since the reference is of an identifiable size.
In Embodiment 1, the unit height calculation unit 212 calculates the unit height, which is the height per pixel, by dividing the actual height by the number of pixels as shown in Equation (1).
<Formula 1>
Unit height (cm) = actual height (cm) / number of pixels

(Step S4: Inundation height calculation processing)
The inundation height calculation unit 213 of the inundation height calculation device 20 specifies the number of pixels from the floor surface to the inundation line in the image data. In Embodiment 1, as shown in FIG. 7, the position of the floor surface is the lower end of the reference object. The inundation height calculator 213 calculates the inundation height, which is the distance from the floor surface to the inundation line, from the specified number of pixels and the unit height calculated in step S3.
Specifically, the inundation height calculation unit 213 calculates the inundation height by multiplying the number of pixels from the floor surface to the inundation line by the unit height as shown in Equation (2).
<Formula 2>
Inundation height (cm) = number of pixels × unit height (cm)

(Step S5: data transmission processing)
The data transmission unit 214 of the inundation height calculation device 20 transmits the inundation height calculated in step S4 and the policyholder identification information received in step S13 to the server of the insurance company.

There may be multiple types of references. In this case, in step S1, the user is allowed to specify which reference object is to be used. Alternatively, in step S2, it is determined which fiducials have been detected. Then, in step S3, the actual height corresponding to the type of reference object used is used.
The user terminal 10 is configured to be directly connected to the server of the insurance company via the transmission line 90, and when the application program is started, the identification information of the policyholder and the like are transmitted to the server of the insurance company. 20 may be configured to transmit only the inundation height to the server of the insurance company. In this case, the server of the insurance company compares the inundation height received in step S5 with the insurance policyholder's identification information received in advance.
In step S13, the user terminal 10 designates the server of the insurance company as the transmission destination of the image data and the like and the identification information of the insurance policyholder, and sets the inundation height calculation device 20 to receive the image data and the like from the server of the insurance company. can be configured to The inundation height calculation device 20 executes the processes after step S2 as described above.

*** Effect of Embodiment 1 ***
As described above, the inundation height calculation system 100 according to Embodiment 1 acquires image data including reference objects together with inundation lines. The inundation height calculation system 100 identifies a unit height based on a reference object and calculates the inundation height from the unit height. This makes it possible to easily measure the inundation height.

***Other Configurations***
<Modification 1>
In Embodiment 1, each functional component is realized by software. However, as Modification 1, each functional component may be implemented by hardware. Differences between the first modification and the first embodiment will be described.

A configuration of the user terminal 10 according to Modification 1 will be described with reference to FIG.
When each functional component is implemented by hardware, the user terminal 10 includes an electronic circuit 15 instead of the processor 11, memory 12 and storage 13. FIG. The electronic circuit 15 is a dedicated circuit that realizes the functions of each functional component, memory 12 and storage 13 .

The configuration of the inundation height calculation device 20 according to Modification 1 will be described with reference to FIG.
When each functional component is implemented by hardware, the inundation height calculation device 20 includes an electronic circuit 25 instead of the processor 21 , memory 22 and storage 23 . The electronic circuit 25 is a dedicated circuit that realizes the functions of each functional component, memory 22 and storage 23 .

Electronic circuit 15 may be a single circuit, multiple circuits, programmed processors, parallel programmed processors, logic ICs, GAs, ASICs, FPGAs. GA is an abbreviation for Gate Array. ASIC is an abbreviation for Application Specific Integrated Circuit. FPGA is an abbreviation for Field-Programmable Gate Array.
Each functional component may be implemented by one electronic circuit 15, or each functional component may be implemented by being distributed among a plurality of electronic circuits 15. FIG.

<Modification 2>
As a modification 2, some functional components may be implemented by hardware and other functional components may be implemented by software.

The processor 11, the memory 12, the storage 13 and the electronic circuit 15 are called a processing circuit. That is, the function of each functional component is realized by the processing circuit.

Embodiment 2.
Embodiment 2 differs from Embodiment 1 in that the unit height is calculated by specifying the position of the reference object on the wall surface. In the second embodiment, this different point will be explained, and the explanation of the same point will be omitted.

*** Configuration description ***
The configuration of a flood height calculation device 20 according to the second embodiment will be described with reference to FIG.
The inundation height calculation device 20 differs from the inundation height calculation device 20 shown in FIG. 3 in that a wall position specifying unit 215 is provided as a functional component. The function of the wall position specifying unit 215 is realized by software or hardware, like other functional components.

***Description of operation***
The operation of the flood height calculation system 100 according to the second embodiment will be described with reference to FIGS. 11 to 17. FIG.
The operation procedure of the flood height calculation system 100 according to the second embodiment corresponds to the flood height calculation method according to the second embodiment. A program that realizes the operation of the flood height calculation system 100 according to the second embodiment corresponds to the flood height calculation program according to the second embodiment.

Embodiment 2 will be described assuming that the reference object is a bottle. In the second embodiment, it is assumed that the reference object is a PET bottle of a specific size. In the second embodiment, it is assumed that the PET bottle is placed on the floor in contact with the wall surface.
Since the reference object is a PET bottle, the reference object has thickness in the depth direction. Therefore, as shown in FIG. 11, in image data obtained by photographing the reference object obliquely from above, the distance from the lower end to the upper end of the reference object is affected by the thickness of the reference object. That is, the distance from the bottom edge to the top edge of the reference does not accurately represent the height of the reference. Therefore, in the second embodiment, the inundation height calculation system 100 divides the wall bottom position 31, which is the position on the wall surface corresponding to the bottom of the reference object, and the wall top position 32, which is the position on the wall surface corresponding to the upper part of the reference object. Identify. Then, the flooded height calculation system 100 calculates the unit height from the positions of the bottom and top of the wall surface.

In Embodiment 2, it is assumed that the general photographing angle of the reference object is determined.

The unit height calculation process (step S3 in FIG. 4) according to the second embodiment will be described with reference to FIG.
(Step S31: wall bottom position specifying process)
The wall position specifying unit 215 of the inundation height calculation device 20 specifies the wall bottom position 31 .
There are two methods 1 and 2 for specifying the wall bottom position 31 .

<Method 1>
Method 1 is a method based on geometric estimation.
A PET bottle, which is a reference object, is placed on the floor in contact with the wall. Therefore, as shown in FIG. 13, the upper end position 33 of the bottom surface of the PET bottle becomes the wall bottom position 31 . However, the image data does not show the upper end position 33 of the bottom surface of the PET bottle. Therefore, the wall position specifying unit 215 geometrically estimates the upper end position 33 of the bottom surface of the PET bottle and specifies the wall bottom position 31 . Specifically, the wall position specifying unit 215 determines the position where the lower end 35 of the PET bottle in the image data is shifted upward by the bottom image depth 34, which is the length in the depth direction of the bottom surface of the PET bottle in the image data, as the wall bottom. Identify as position 31 .

As shown in FIG. 14, the image data can be generally regarded as a parallel projection image. Therefore, as described above, the actual image ratio, which is the ratio between the actual size of the lid portion and the size in the image data, is approximately equal to the ratio between the actual size of the bottom portion and the size in the image data. Therefore, the wall position specifying unit 215 uses this relationship to calculate the bottom image depth 34 and specifies the wall bottom position 31 .

Specifically, as shown in FIG. 14, the wall position specifying unit 215 divides the lid image depth 36 by the lid actual depth 37 to calculate the actual image ratio. The lid image depth 36 is the length in the depth direction of the upper surface of the lid portion in the image data. A method for specifying the lid image depth 36 will be described later. The actual lid depth 37 is the actual length in the depth direction of the upper surface of the lid portion of the PET bottle. Since the reference object is an object whose size can be specified, the actual lid depth 37 is known.
The wall position specifying unit 215 calculates the bottom image depth 34 by multiplying the actual bottom depth 38, which is the actual length of the bottom surface of the bottle in the depth direction, by the actual image ratio. That is, the wall position specifying unit 215 calculates the bottom image depth 34 as shown in Equation (3).
<Formula 3>
Bottom image depth 34 = bottom actual depth 38 x lid image depth 36 / lid actual depth 37
Then, the wall position specifying unit 215 specifies, as the wall bottom position 31 , the position where the lower end 35 of the PET bottle in the image data is shifted upward by the bottom image depth 34 .

A method for specifying the lid image depth 36 will be described.
It is possible to detect the lid portion from the image data by using an object detection model or the like. However, it may be difficult to identify only the top surface of the lid portion. Therefore, as shown in FIG. 15, the wall position specifying unit 215 multiplies the lid vertical width 39, which is the vertical width of the entire lid portion, by the top surface ratio representing the ratio of the top surface portion to the entire lid portion, and obtains the lid image. Calculate the depth 36 . That is, the wall position specifying unit 215 calculates the lid image depth 36 as shown in Equation (4).
<Formula 4>
Lid image depth 36 = Lid vertical width 39 x top surface ratio

The wall position specifying unit 215 calculates the upper surface ratio from the ratio of the lid vertical width 39 and the lid width 40, which is the width of the lid portion in the horizontal direction, using a regression line. Specifically, the wall position specifying unit 215 calculates the top surface ratio as shown in Equation (5). Here, the slope and the intercept are set in advance by performing a simulation or the like.
<Formula 5>
Upper surface ratio = Inclination x (cover length 39/cover width 40) + intercept

Note that the wall position specifying unit 215 may set the top surface ratio in advance. If the imaging angle of the reference object is approximately fixed, the upper surface ratio is also approximately fixed. Therefore, it is possible to specify and set the upper surface ratio in advance.

<Method 2>
Method 2 is a method based on statistical estimation.
If the photographing angle of the reference object is approximately fixed, the depth ratio, which is the ratio between the height in the image data of the PET bottle and the bottom image depth 34, is also approximately fixed. The height in the image data of the PET bottle is the length from the lower end to the upper end of the PET bottle. That is, the height in the image data of the PET bottle is the number of pixels in the height direction of the reference object described in the first embodiment.
Therefore, the wall position specifying unit 215 sets the depth ratio in advance on the premise that the imaging angle of the reference object is approximately fixed. The wall position specifying unit 215 calculates the bottom image depth 34 by multiplying the height in the image data of the PET bottle by the depth ratio. Then, the wall position specifying unit 215 specifies, as the wall bottom position 31 , the position where the lower end 35 of the PET bottle in the image data is shifted upward by the bottom image depth 34 .

(Step S32: On-wall position specifying process)
The wall position specifying unit 215 of the inundation height calculation device 20 specifies the position 32 on the wall.
Specifically, the wall position specifying unit 215 specifies the wall position 32 by statistical estimation, as in method 2 of step S31. As shown in FIG. 16, if the photographing angle of the reference object is approximately fixed, the deviation ratio, which is the ratio between the height in the image data of the PET bottle and the deviation amount 41, is also approximately determined. The amount of displacement 41 is the distance between the upper end 42 of the PET bottle and the position 32 on the wall.
Therefore, the wall position specifying unit 215 sets the deviation ratio in advance on the premise that the imaging angle of the reference object is approximately fixed. The wall position specifying unit 215 calculates the displacement amount 41 by multiplying the height in the image data of the PET bottle by the displacement ratio. Then, the wall position specifying unit 215 specifies the position where the upper end 42 of the PET bottle in the image data is shifted upward by the shift amount 41 as the wall top position 32 .

(Step S33: Height calculation processing)
As shown in FIG. 17, the unit height calculator 212 of the inundation height calculator 20 calculates the height in the image data from the wall bottom position 31 identified in step S31 to the wall top position 32 identified in step S32. Specifies the number of pixels in the direction. The unit height calculator 212 calculates the unit height, which is the height per unit pixel, from the number of pixels in the height direction and the actual height of the reference object.

In the inundation height calculation process (step S4 in FIG. 4), the inundation height calculation unit 213 of the inundation height calculation device 20 calculates the distance from the floor to the inundation line using the wall bottom position 31 specified in step S31 as the position of the floor. Specify the number of pixels. Then, the inundation height calculator 213 calculates the inundation height, which is the distance from the floor surface to the inundation line, from the specified number of pixels and the unit height calculated in step S3.

*** Effect of Embodiment 2 ***
As described above, the flooded height calculation system 100 according to Embodiment 2 identifies the position of the reference object on the wall surface and calculates the unit height. Thereby, the unit height can be calculated with high accuracy. As a result, the inundation height can be calculated with high accuracy.

Also, the flood height calculation system 100 according to the second embodiment accurately specifies the position of the bottom surface. As a result, the inundation height can be calculated with high accuracy.

***Other Configurations***
<Modification 3>
In the second embodiment, the wall bottom position 31 is specified by calculation. However, the wall bottom position 31 may be designated by the user. In this case, in step S1 of FIG. 4, the wall bottom position 31 is set along with the flood line. The wall bottom position 31 is also transmitted to the flood height calculation device 20 together with the image data and the like.

Similarly, in the second embodiment, the on-wall position 32 is specified by calculation. However, the wall position 32 may be specified by the user. In this case, in step S1 of FIG. 4, the wall position 32 is set along with the flood line. The wall position 32 is also transmitted to the flood height calculation device 20 together with the image data and the like.

The inundation height calculation device 20 may determine whether or not the wall bottom position 31 set by the user is appropriate. Specifically, wall position specifying unit 215 specifies wall bottom position 31 by the method described in the second embodiment. Then, the wall position specifying unit 215 determines whether or not the difference between the wall bottom position 31 set by the user and the specified wall bottom position 31 is within a threshold. If the difference is within the threshold, the wall position specifying unit 215 determines that the wall bottom position 31 set by the user is appropriate. On the other hand, when the difference exceeds the threshold, the wall position specifying unit 215 determines that the wall bottom position 31 set by the user is not appropriate. The inundation height calculation device 20 may request resetting of the wall bottom position 31 when it is determined to be inappropriate.
The inundation height calculation device 20 may similarly determine whether or not the on-wall position 32 set by the user is appropriate. Then, the inundation height calculation device 20 may request resetting of the on-wall position 32 when it is determined to be inappropriate.

Embodiment 3.
Embodiment 3 differs from Embodiments 1 and 2 in that a camera image obtained by photographing with camera 141 in a state where photographing conditions are satisfied is acquired as image data. The shooting condition is a condition of the camera position for shooting. In the third embodiment, this different point will be explained, and the explanation of the same point will be omitted.
Embodiment 3 describes a case where Embodiment 1 is modified. However, it is also possible to add changes to the second embodiment.

*** Configuration description ***
The configuration of the user terminal 10 according to Embodiment 3 will be described with reference to FIG.
The user terminal 10 differs from the user terminal 10 shown in FIG. 2 in that it includes a guide display unit 114 as a functional component. The functions of the guide display unit 114 are realized by software or hardware, like other functional components.

***Description of operation***
The operation of the flood height calculation system 100 according to the third embodiment will be described with reference to FIGS. 19 to 21. FIG.
The operation procedure of the flood height calculation system 100 according to the third embodiment corresponds to the flood height calculation method according to the third embodiment. A program that realizes the operation of the flood height calculation system 100 according to the third embodiment corresponds to the flood height calculation program according to the third embodiment.

The photographing process (step S1 in FIG. 4) according to the third embodiment will be described with reference to FIG.
As in the first embodiment, it is assumed that an application program for calculating the flood height is executed.

(Step S11A: guide selection process)
As shown in FIG. 20 , the guide display unit 114 displays the guide 51 superimposed on the camera image obtained by the camera 141 . In Embodiment 3, the guide 51 indicates an upper limit position 52 and a lower limit position 53 in the height direction.
The guide display unit 114 prepares a plurality of guides 51 with different distances between the upper limit position 52 and the lower limit position 53 . Then, the guide display unit 114 allows the user to select the guide 51 to be used. Specifically, the guide 51 to be used is selected according to the height of the flood line and the like. The guide display unit 114 displays the selected guide 51 superimposed on the camera image. For example, when the flood line is at a high position, there are cases where the reference object placed on the floor can only be displayed in a small size.

(Step S12A: image acquisition processing)
The image acquisition unit 111 acquires, as image data, a camera image in which the flood line on the wall surface is captured with the reference object following the guide 51 . Specifically, when the reference object follows the guide 51, the image acquisition unit 111 automatically acquires the camera image as image data. Alternatively, the image acquisition unit 111 enables the shutter button to be pressed when the reference object follows the guide 51, and acquires the camera image as image data when the shutter button is pressed.

In Embodiment 3, the guide 51 indicates an upper limit position 52 and a lower limit position 53 in the height direction. Therefore, the image acquisition unit 111 acquires, as image data, a camera image showing the flood line on the wall surface with the reference object placed between the upper limit position 52 and the lower limit position 53 .
At this time, it is desirable that the upper end of the reference object is close to the upper limit position 52 and the lower end of the reference object is close to the lower limit position 53 . By doing so, image data in an intended state can be obtained. Therefore, it is necessary to select an appropriate guide 51 in step S11A.

At this time, the image acquisition unit 111 acquires the image data also considering the shooting angle. Specifically, the image acquisition unit 111 acquires image data when the angle of the camera 141 with respect to the wall surface is the designated angle. The designated angle is a preset angle. Pitch, roll, and yaw are set as the specified angles. The designated angle may have a certain range such as 43 degrees to 47 degrees. That is, when the reference object follows the guide 51 and the angle of the camera 141 with respect to the wall surface reaches the designated angle, the image acquisition unit 111 automatically acquires the camera image as image data. Alternatively, when the above state is reached, the image acquisition unit 111 enables the shutter button to be pressed, and acquires the camera image as image data when the shutter button is pressed.
As shown in FIG. 20, the guide display unit 114 may display a level 54 to indicate the angle of the camera 141 and the designated angle. This makes it easier for the user to adjust the angle of the camera 141 to the specified angle.

Alternatively, as shown in FIG. 21 , the image acquisition unit 111 may acquire image data using only a certain area on the center side of the imaging range of the camera 141 . In other words, the image acquisition unit 111 may acquire only a certain area on the center side of the shooting range of the camera image as image data.
This is because distortion increases outside the photographing range of the camera 141, making it difficult to calculate an accurate flood height.

The processing from step S13A to step S14A is the same as the processing from step S12 to step S13 in FIG.

*** Effect of Embodiment 3 ***
As described above, in the inundation height calculation system 100 according to Embodiment 3, a camera image obtained by photographing with the camera 141 in a state where the photographing conditions are satisfied is acquired as image data. As a result, image data is obtained in which the reference object is photographed at a generally determined photographing angle. As a result, the inundation height can be calculated with high accuracy.

Image data acquisition is performed by a policyholder user. As a result, image data may not be properly acquired, and there is a risk that an inundation height different from the actual one may be calculated.

In particular, by combining the method described in Embodiment 3 with the method described in Embodiment 2 for specifying the position on the wall surface of the reference object and calculating the unit height, the inundation height can be accurately calculated. can do.

***Other Configurations***
<Modification 4>
In Embodiment 3, the guide 51 shows the upper limit position 52 and the lower limit position 53 . The guide 51 is not limited to this, and may indicate an upper limit and a lower limit with respect to the position of the upper end of the reference object and an upper limit and a lower limit with respect to the lower end of the reference object. Then, when the upper end of the reference object is between the upper limit and the lower limit regarding the position of the upper end and the lower end of the reference object is between the upper limit and the lower limit regarding the lower end, the reference object follows the guide 51. state.

Further, the guide 51 may indicate not only the vertical direction but also the horizontal direction.

Embodiment 4.
The fourth embodiment differs from the third embodiment in that the range indicated by the guide 51 is expanded to detect the reference object. In the fourth embodiment, this different point will be explained, and the explanation of the same point will be omitted.

***Description of operation***
The operation of the inundation height calculation system 100 according to the fourth embodiment will be described with reference to FIG.
The operation procedure of the flood height calculation system 100 according to the fourth embodiment corresponds to the flood height calculation method according to the fourth embodiment. A program for realizing the operation of the flood height calculation system 100 according to the fourth embodiment corresponds to the flood height calculation program according to the fourth embodiment.

In step S2 of FIG. 4, the detection unit 211 of the flood height calculation device 20 generates an enlarged image 55 by enlarging the range indicated by the guide 51 in the image data, as shown in FIG. Then, the detection unit 211 detects the reference object from the enlarged image 55 . Specifically, the detection unit 211 inputs the enlarged image 55 to the object detection model to detect the reference object.

Note that the detection unit 211 may generate an enlarged image 55 in which the range indicated by the guide 51 is slightly expanded.

*** Effect of Embodiment 4 ***
As described above, the flooded height calculation system 100 according to the fourth embodiment expands the range indicated by the guide 51 to detect the reference object.
In object detection in image recognition, detection accuracy tends to be low when the size of the reference object in the image data is small compared to the size of the entire image data. In addition, if the size of the reference object is small, the area in which the reference object is not shown in the image data becomes large, increasing the possibility of erroneously detecting an object other than the reference object as the reference object. However, in the flooded height calculation system 100 according to the fourth embodiment, the reference object is detected from the enlarged image 55 in which the range in which the reference object is located is enlarged. Therefore, it is possible to prevent a decrease in detection accuracy and an erroneous detection.

***Other Configurations***
<Modification 5>
When using the method described in Embodiment 2, it is necessary to detect the lid portion of the PET bottle. In this case, the detection unit 211 cuts out and enlarges the center portion in the left-right direction on the upper end side of the range in which the PET bottle, which is the reference object, was detected in step S2 of FIG. Then, the detection unit 211 may detect the lid portion from the enlarged image data. It is assumed that the lid portion is positioned at the center portion in the left-right direction on the upper end side.

Embodiment 5.
Embodiment 5 differs from Embodiment 2 in that there are a plurality of types of bottles that serve as reference objects. In the fifth embodiment, this different point will be explained, and the explanation of the same point will be omitted.

*** Configuration description ***
The configuration of the inundation height calculation device 20 according to the fifth embodiment will be described with reference to FIG.
The inundation height calculation device 20 differs from the inundation height calculation device 20 shown in FIG. 10 in that it includes a type identification unit 216 as a functional component. The function of the type identification unit 216 is realized by software or hardware, like other functional components.

***Description of operation***
The operation of the flood height calculation system 100 according to the fifth embodiment will be described with reference to FIGS. 24 and 25. FIG.
The operation procedure of the flood height calculation system 100 according to the fifth embodiment corresponds to the flood height calculation method according to the fifth embodiment. A program that realizes the operation of the flood height calculation system 100 according to the fifth embodiment corresponds to the flood height calculation program according to the fifth embodiment.

In the fifth embodiment, as in the second embodiment, the reference object is a PET bottle.
As shown in FIG. 24, there are a plurality of types of PET bottles, such as those with a capacity of 500 mL (milliliters) and those with a capacity of 2 L (liters). And the size differs for each type. Therefore, in order to calculate the flooded height, it is necessary to specify the type of the PET bottle used as the reference object. Here, it is assumed that either a PET bottle with a capacity of 500 mL or a PET bottle with a capacity of 2 L is used as the reference object.

Unit height calculation processing according to the fifth embodiment will be described with reference to FIG.
(Step S31A: Type identification process)
The type identification unit 216 of the inundation height calculation device 20 identifies the type of the reference object.
In Embodiment 5, the type identification unit 216 identifies the type of PET bottle based on the size of the lid portion of the PET bottle detected in step S2 in FIG. 4 and the size of the body of the PET bottle.

Specifically, the type identification unit 216 identifies the type of PET bottle based on the ratio between the width of the lid portion and the width of the body portion.
As a specific example, the type identification unit 216 determines that the bottle is a 500 mL PET bottle when the ratio value obtained by dividing the width of the lid portion by the width of the body portion is larger than the threshold A. On the other hand, when the ratio value is equal to or less than the threshold value A, the type identification unit 216 determines that the bottle is a 2L PET bottle.

If the ratio value is greater than the threshold value B or smaller than the threshold value C, the type identification unit 216 may detect an error and interrupt the process. Here, the threshold B is greater than the threshold A, and the threshold C is less than the threshold A. This makes it possible to interrupt the processing as an error when a 1 L PET bottle or the like is used.

The processing from step S32A to step S34A is the same as the processing from step S31 to step S33 in FIG. However, as the actual size of the PET bottle, the size corresponding to the type specified in step S31A is used. Specifically, for the actual lid depth 37, the actual bottom depth 38, and the actual height, sizes corresponding to the type specified in step S31A are used. Also, the inclination and the intercept, or the upper surface ratio, which are used when calculating the lid image depth 36, are also values corresponding to the type specified in step S31A.

*** Effect of Embodiment 5 ***
As described above, the flood height calculation system 100 according to Embodiment 5 identifies the type of reference object. As a result, the inundation height can be calculated using any one of a plurality of types of reference objects. In the event of a flood, it may be difficult to obtain the specified reference materials. Therefore, it is possible to improve convenience by being able to calculate the inundation height using one of a plurality of types of reference objects.

Embodiment 6.
Embodiment 6 differs from Embodiments 1 to 5 in that the calculated flooded height is corrected. In Embodiment 6, this different point will be explained, and the explanation of the same point will be omitted.
Embodiment 6 describes a case where Embodiment 1 is modified. However, it is also possible to add modifications to the second to fifth embodiments.

*** Configuration description ***
The configuration of the inundation height calculation device 20 according to the sixth embodiment will be described with reference to FIG.
The inundation height calculation device 20 differs from the inundation height calculation device 20 shown in FIG. 3 in that it includes a correction unit 217 as a functional component. The functions of the correction unit 217 are realized by software or hardware, like other functional components.

***Description of operation***
The operation of the flood height calculation system 100 according to the sixth embodiment will be described with reference to FIGS. 27 to 30. FIG.
The operation procedure of the flood height calculation system 100 according to the sixth embodiment corresponds to the flood height calculation method according to the sixth embodiment. A program that realizes the operation of the flood height calculation system 100 according to the sixth embodiment corresponds to the flood height calculation program according to the sixth embodiment.

The inundation height calculation process (step S4 in FIG. 4) according to the sixth embodiment will be described with reference to FIG.
(Step S41: Height calculation processing)
The inundation height calculator 213 calculates the inundation height as described in the first embodiment.

(Step S42: correction processing)
The correction unit 217 of the inundation height calculation device 20 corrects the inundation height calculated in step S41 by a correction amount corresponding to the inundation height calculated in step S41.
As shown in FIG. 28, in the image data obtained by the camera 141, the image appears larger toward the center. That is, the closer the distance to the camera 141 is, the larger the image appears. Therefore, even if the distance is the same, the number of pixels increases toward the center of the image data. Therefore, as shown in FIG. 29, a general deviation for each flood height is recorded statistically in advance as a correction amount. In FIG. 29, the correction amount is recorded every 10 centimeters.
The correction unit 217 reads out a correction amount corresponding to the flood height calculated in step S41. Then, the flood height calculated in step S41 is corrected by the read correction amount.

In FIG. 29, the correction amount is a specific distance. However, as shown in FIG. 30, the correction amount may be a ratio to the inundation height. This enables more appropriate correction.

*** Effect of Embodiment 6 ***
As described above, the inundation height calculation system 100 according to Embodiment 6 corrects the calculated inundation height by a correction amount corresponding to the calculated inundation height. As a result, the inundation height can be calculated with high accuracy.

Embodiment 7.
Embodiment 7 differs from Embodiments 1 to 6 in that the reliability of the calculated inundation height is calculated. In Embodiment 7, this different point will be explained, and the explanation of the same point will be omitted.
Embodiment 7 describes a case where Embodiment 1 is modified. However, it is also possible to add modifications to the second to sixth embodiments.

*** Configuration description ***
The configuration of a flood height calculation device 20 according to Embodiment 7 will be described with reference to FIG.
The inundation height calculation device 20 differs from the inundation height calculation device 20 shown in FIG. 3 in that it includes a reliability calculation unit 218 as a functional component. The functions of the correction unit 217 are realized by software or hardware, like other functional components.

***Description of operation***
The operation of the flood height calculation system 100 according to the seventh embodiment will be described with reference to FIG.
The operation procedure of the flood height calculation system 100 according to the seventh embodiment corresponds to the flood height calculation method according to the seventh embodiment. A program that realizes the operation of the flood height calculation system 100 according to the seventh embodiment corresponds to the flood height calculation program according to the seventh embodiment.

The flood height calculation process (step S4 in FIG. 4) according to the seventh embodiment will be described with reference to FIG.
(Step S41A: height calculation processing)
The inundation height calculator 213 calculates the inundation height as described in the first embodiment.

(Step S42A: Reliability calculation process)
The reliability calculation unit 218 of the inundation height calculation device 20 calculates the reliability of the inundation height calculated in step S41.
Specifically, the reliability calculation unit 218 calculates the reliability based on the imaging angle of the image data and the information regarding the calculation accuracy of the unit height such as the state of the reference object placed or the flood height. At this time, the reliability calculator 218 may calculate the error range of the inundation height according to the reliability. The margin of error is larger for lower confidence.

A specific example of a reliability calculation method will be described.
Assume that the guide 51 is displayed and the image data is obtained as described in the third embodiment. In this case, the reliability calculator 218 calculates the reliability according to the extent to which the reference object follows the guide 51 . For example, the reliability calculator 218 calculates the reliability according to the distance between the upper end of the reference object and the upper limit position 52 and the distance between the lower end of the reference object and the lower limit position 53 . The reliability calculation unit 218 increases the reliability as the total of these distances becomes shorter.

Assume that at least one of the wall bottom position 31 and the wall top position 32 is designated as described in the third modification. In this case, the reliability calculation unit 218 calculates the reliability according to the difference between the specified wall bottom position 31 and the wall bottom position 31 calculated by the method described in the second embodiment. . Further, the reliability calculation unit 218 calculates the reliability according to the difference between the specified wall position 32 and the wall position 32 calculated by the method described in the second embodiment. The reliability calculation unit 218 increases the reliability as the difference is smaller.
Note that the reliability calculation unit 218 may significantly lower the reliability when the wall bottom position 31 is not between the lower end and the upper end of the reference object. This is because the wall bottom position 31 should be between the lower end and the upper end of the reference object.

Assume that the type of the reference object is determined as described in the fifth embodiment. In this case, the reliability calculator 218 calculates the reliability according to the determination accuracy. The reliability calculation unit 218 increases the reliability as the determination accuracy is higher.
For example, it is assumed that whether the bottle is a 500 mL PET bottle or a 2 L PET bottle is determined using a ratio value obtained by dividing the width of the lid portion by the width of the body portion. In this case, the accuracy of the determination result is set for each ratio value. This makes it possible to specify the accuracy of the determination result.

In step S5 of FIG. 4, the data transmission unit 214 transmits the reliability to the server of the insurance company together with the inundation height. When the error range is calculated, the data transmission unit 214 also transmits the error range to the insurance company's server.

*** Effect of Embodiment 7 ***
As described above, the inundation height calculation system 100 according to Embodiment 7 calculates the reliability of the inundation height. This helps insurers determine whether the calculated flood heights are reliable.
In flood damage insurance claims, if users use the system in unexpected ways, insurance claims may be calculated higher than they actually are. In addition, it is conceivable that a malicious user modifies the reference material and charges an unreasonably high insurance amount. An example of modifying the reference object is to use a PET bottle with a special shape when the reference object is a PET bottle. Therefore, for example, when the reliability is lower than the standard, it is conceivable to take measures such as visual confirmation by an insurance company employee.

Also, the inundation height calculation system 100 according to Embodiment 7 calculates the error range.
In some cases, insurance money for flood damage is determined for each range of flood height. Therefore, for example, the insurance company may take the following measures. If the insurance money does not change even after considering the margin of error, the calculated inundation height is adopted. If there is a risk that the insurance money will change if the margin of error is taken into account, a visual check will be carried out.

Note that "unit" in the above description may be read as "circuit", "process", "procedure", "process", or "processing circuit".

The embodiments and modifications of the present disclosure have been described above. Some of these embodiments and modifications may be combined and implemented. Also, any one or some may be partially implemented. It should be noted that the present disclosure is not limited to the above embodiments and modifications, and various modifications are possible as necessary.

100 inundation height calculation system 10 user terminal 11 processor 12 memory 13 storage 14 communication interface 15 electronic circuit 111 image acquisition unit 112 inundation line setting unit 113 image transmission unit 114 guide display unit 141 camera , 20 inundation height calculation device, 21 processor, 22 memory, 23 storage, 24 communication interface, 25 electronic circuit, 211 detection unit, 212 unit height calculation unit, 213 inundation height calculation unit, 214 data transmission unit, 215 wall position identification 216 type identification unit 217 correction unit 218 reliability calculation unit 31 wall bottom position 32 wall top position 33 top end position 34 bottom image depth 35 bottom end 36 lid image depth 37 lid actual depth 38 Bottom actual depth 39 Lid vertical width 40 Lid lateral width 41 Deviation amount 42 Upper end 51 Guide 52 Upper limit position 53 Lower limit position 54 Spirit level 55 Enlarged image 90 Transmission path.

Claims (5)

a detection unit that detects a reference object from image data including a flood line on a wall surface;
The unit height, which is the height per unit pixel, is calculated from the number of pixels in the height direction in the image data of the reference object detected by the detection unit and the actual height, which is the actual height of the reference object. a unit height calculator for calculating;
calculating a flood height, which is a distance from the floor surface to the flood line, from the number of pixels from the floor surface to the flood line in the image data and the unit height calculated by the unit height calculation unit; a flood height calculation system comprising a height calculation unit; The inundation height calculation system further includes:
A flood line setting unit that receives designation of the position of the flood line,
2. The inundation height calculation system according to claim 1, wherein the inundation height calculation unit calculates the inundation height using the position received by the inundation line setting unit as the inundation line. 3. The inundation height calculation system according to claim 1, wherein the inundation height calculation unit calculates the inundation height using the lower end of the reference object as the floor surface. A computer detects a reference object from the image data including the flood line on the wall surface,
a computer calculates a unit height, which is the height per unit pixel, from the number of pixels in the height direction in the image data of the reference object and the actual height, which is the actual height of the reference object;
A flood height calculation method in which a computer calculates a flood height, which is a distance from the floor surface to the flood line, from the number of pixels from the floor surface to the flood line in the image data and the unit height. Detection processing to detect reference objects from image data including flood lines on walls,
The unit height, which is the height per unit pixel, is calculated from the number of pixels in the height direction in the image data of the reference object detected by the detection process and the actual height, which is the actual height of the reference object. a unit height calculation process to be calculated;
calculating a flood height, which is a distance from the floor surface to the flood line, from the number of pixels from the floor surface to the flood line in the image data and the unit height calculated by the unit height calculation process; A flood height calculation program that causes a computer to function as a flood height calculation system that performs high calculation processing.

Images