JP2021060887A - Inspection device of utility work, inspection method of utility work, and program - Google Patents

Abstract

To accurately inspect a construction state in which a plurality of members are used.SOLUTION: An inspection device of utility work according to one embodiment of the present invention comprises: an acquisition part for acquiring inspection image in which a support member of an electric pole is imaged and inspection item information indicating that an inspection item is the support member of the electric pole from a terminal device; a recognition part for calculating the certainty level indicating the certainty of the support member and an inspection object around the support member from the inspection image and determining whether the support member and the inspection object are included in the inspection image based on the certainty level; an inspection part for performing an inspection of utility work using the support member based on a position relation between the support member and the inspection object when the support member and the inspection object are included in the inspection image; and a notification part for notifying the terminal device of a result of the inspection performed by the inspection part.SELECTED DRAWING: Figure 1

Description

The present invention relates to an inspection device for equipment construction, an inspection method for equipment construction, and a program.

Conventionally, a technique for detecting the state of a utility pole has been known. This type of technique is described, for example, in Patent Documents 1-3 below. The utility pole position inspection device described in Patent Document 1 includes a utility pole detection unit that detects a utility pole from an image taken by a camera, and whether or not the utility pole is outside the construction limit based on the image captured by the camera. Inspect. In the inspection system described in Patent Document 2, the information terminal identifies the utility pole number of the utility pole to be passed by using the image of the 360-degree camera and the GPS function during patrol, and is installed on the utility pole. The equipment to be inspected is automatically identified from the image, and the presence or absence of an abnormality is determined by the abnormality detection sensor. The support inclination abnormality determination device described in Patent Document 3 creates three-dimensional position information of a predetermined position of a support such as a utility pole, compares the three-dimensional position information with time, and uses the fluctuation amount as a determination value. It is set, and when the judgment value is equal to or more than a predetermined value, the inclination abnormality of the support is judged.

Further, conventionally, a technique for performing an inspection or the like based on an image captured at a construction site or the like has been known. This type of technique is described, for example, in Patent Document 4-6 below. In the construction site photography system described in Patent Document 4, when the work of each process is completed, a construction site photograph showing the performance of the work is taken by a mobile terminal, and the construction site image data and the process are taken by the mobile terminal. It is sent to the server in association with work data showing the result of each work. The construction status inspection system described in Patent Document 5 specifies which construction inspection image is used when transmitting image data indicating an inspection image of the construction status in construction. The piping construction management system described in Patent Document 6 is an evaluation that evaluates whether or not the joint portion is properly joined based on the inspection information input unit that inputs the inspection information corresponding to the inspection item and the inspection information. It has a department and sends construction management information to the outside only when it is evaluated as appropriate. The piping construction management system further includes an image processing unit that evaluates whether or not the joint portion has been properly joined based on the image data of the joint portion taken by the imaging unit.

Japanese Unexamined Patent Publication No. 2015-116916 Japanese Unexamined Patent Publication No. 2019-032684 Japanese Unexamined Patent Publication No. 2018-0877998 Japanese Unexamined Patent Publication No. 2017-091495 Japanese Unexamined Patent Publication No. 2014-197387 Japanese Unexamined Patent Publication No. 2012-123589

However, the technique for detecting the state of utility poles described in Patent Documents 1-3 described above detects the state of utility poles for which construction has already been completed, so that there is a problem that it is not possible to inspect the state of execution of utility poles. There is. Further, although the technique described in Patent Document 4-5 described above transmits image data, there is a problem that manpower is required for inspection of construction. Further, the technique described in Patent Document 6 described above may not be able to evaluate with high accuracy when applied to inspection of a process including a large number of members.

The present invention has been made in view of the above problems, and provides an inspection device for equipment construction, an inspection method for equipment construction, and a program capable of inspecting a construction state using a plurality of members with high accuracy. The purpose is to do.

(1) One aspect of the present invention is an acquisition unit that acquires an inspection image obtained by imaging a support member of an electric pole from a terminal device, and inspection item information indicating that the inspection item is a support member of the electric pole, and the inspection image. The certainty indicating the certainty of the support member and the inspection object around the support member is calculated from the above, and based on the certainty, whether or not the support member and the inspection object are included in the inspection image is determined. When the recognition unit to be determined and the inspection image include the support member and the inspection object, an inspection of equipment work using the support member is carried out based on the positional relationship between the support member and the inspection object. It is an inspection device for equipment work, including an inspection unit for performing inspection and a notification unit for notifying the terminal device of the result of the inspection performed by the inspection unit.

(2) One aspect of the present invention is the above-mentioned equipment construction inspection device, and the recognition unit is a recognition model learned using a learning image including a normal inspection object, and is a normal inspection. A recognition model in which the processing parameters are trained so as to recognize that the inspection object exists when the inspection image including the object is input may be used.

(3) One aspect of the present invention is the above-mentioned equipment construction inspection device, in which the recognition unit recognizes a virtual cross section of a utility pole supported by the support member as the inspection object, and the above-mentioned. The inspection unit may perform the inspection based on the positional relationship between the position of the support member and the virtual point based on the area occupied by the virtual cross section.

(4) One aspect of the present invention is the inspection device for the above-mentioned equipment work, and the recognition unit recognizes an arrow indicating the pulling direction of the utility pole from the inspection image as the inspection object, and the above-mentioned The inspection unit may perform the inspection based on the relationship between the position of the support member, the virtual point based on the area occupied by the virtual cross section, and the direction indicated by the arrow.

(5) One aspect of the present invention is the inspection device for the above-mentioned equipment work, and the inspection unit has the position of the center of gravity of the support member and the position of the center of gravity of the utility pole based on the area occupied by the virtual cross section. , The inspection may be carried out based on the relationship with the direction indicated by the arrow.

(6) One aspect of the present invention is the above-mentioned equipment construction inspection device, and when the utility pole is the first type, the inspection unit has a longitudinal direction of the support member and a direction of the arrow. Whether or not the angle is within the first angle is determined, and when the utility pole is of the second type, whether or not the angle between the longitudinal direction of the support member and the direction of the arrow is within the second angle. May be determined.

(7) One aspect of the present invention is a step of acquiring an inspection image of an image of a support member of an electric pole from a terminal device, an inspection item information indicating that the inspection item is a support member of the electric pole, and the inspection image. A step of calculating the certainty indicating the certainty of the support member and the inspection object around the support member, and whether or not the support member and the inspection object are included in the inspection image based on the certainty. And when the inspection image includes the support member and the inspection object, an inspection of equipment work using the support member is carried out based on the positional relationship between the support member and the inspection object. It is an inspection method of equipment construction including a step of performing an inspection and a step of notifying the terminal device of the inspection result.

(8) One aspect of the present invention includes a step of acquiring an inspection image of an image of a support member of an electric pole and an inspection item information indicating that the inspection item is a support member of the electric pole from a terminal device to a computer. The step of calculating the certainty indicating the certainty of the support member and the inspection object around the support member from the inspection image, and the inspection image include the support member and the inspection object based on the certainty. In the step of determining whether or not, and when the inspection image includes the support member and the inspection object, the equipment work using the support member based on the positional relationship between the support member and the inspection object. It is a program that executes a step of performing an inspection and a step of notifying the terminal device of the result of the inspection.

According to one aspect of the present invention, it is possible to inspect the construction state using a plurality of members with high accuracy.

It is a block diagram which shows one configuration example of the equipment construction inspection system of embodiment. It is a block diagram which shows an example of the inspection object recognition part. It is a figure which shows an example of the construction site in the construction of a utility pole. It is a figure which shows an example of the operation screen for construction inspection in a user terminal apparatus. It is a figure which shows an example of a guide image. It is a figure which shows another example of a guide image. It is a flowchart which shows an example of the inspection process of the facility construction in the construction inspection server apparatus. It is a figure which shows the relationship between the inspection image, the construction members a to e included in the inspection image, and the degree of certainty. It is a figure which shows an example of the inspection image including the hardware for a wire dividing line. It is a figure which shows the construction member, the tag name, and the recognition condition in the installation work of the wire wire metal fitting. It is a figure which shows an example of the partial area in the metal part for a branch line. It is a figure which shows an example of the inspection image including the root skein. It is a figure which shows the construction member, a tag name and recognition condition in the root skein installation work. It is a figure which shows the process of detecting the height of a horizontal bar or a horizontal measure in the inspection of the root skein installation work. It is a figure which shows the positional relationship between the electric pole cross section, the root stake and the drawing board which shows the tension direction. It is a figure which shows an example of the inspection image including the lower part of a branch line. It is a figure which shows the construction member, the tag name, and the recognition condition in the installation work of the lower part of a branch line. It is a figure which shows the process of calculating the burial depth of a branch line in the inspection of the lower part of a branch line. It is a figure for demonstrating an example of calculating the burial depth of the lower part of a branch line. It is a figure which shows an example of the inspection image including the lower part of a utility pole. It is a figure which shows the construction member, the tag name and recognition condition in the construction of the lower part of a utility pole. It is a figure for demonstrating the process of inspecting the height of a scaffold. It is a figure for demonstrating the process of inspecting the height of the sign board of a utility pole. It is a figure which shows an example of the inspection image including an insulator. It is a figure which shows the construction member, a tag name and recognition condition in the installation work of an insulator. It is a figure for demonstrating the process of inspecting the height of an insulator. It is a figure which shows an example of the photographed image which includes a branch line and a protractor for measuring a branch line angle. It is a figure which shows the member name, tag name and recognition condition of a protractor. It is a figure for demonstrating the process of inspecting a branch line angle. It is a figure which shows an example of the photographed image including the winding grip. It is a figure which shows the member name, the tag name, and the recognition condition in the installation work of a winding grip. It is a figure which shows an example of the inspection image including a geta. It is a figure which shows the member name, tag name and recognition condition in the clogs installation work. It is a figure which shows an example of the inspection image including a branch line protection and an insulator. It is a figure which shows the member name, tag name and recognition condition in branch line protection and insulator installation work. It is a figure which shows an example of the inspection image including an insulator. It is a figure which shows the member name, the tag name and recognition condition in the installation work of an insulator. It is a figure which shows an example of the inspection image including a fastener. It is a figure which shows the member name, the tag name and recognition condition in the attachment work of a fastener.

Hereinafter, an inspection device for equipment construction, an inspection method for equipment construction, and a program to which the present invention is applied will be described with reference to the drawings.

The facility construction inspection system of the embodiment inspects the facility construction using images captured by field workers of the facility construction of utility poles. In the equipment construction inspection system of the embodiment, whether or not the image captured by the field worker is suitable for inspection, whether or not the construction member to be inspected exists in the image, and whether or not the construction member is appropriate. By determining, the construction state using a plurality of construction members is inspected with high accuracy. In addition, the equipment construction inspection system of the embodiment presents the determination results (image determination result, construction member determination result, and inspection result) to the on-site worker, so that the on-site worker can take time and effort to take an image and the equipment. It is possible to reduce the labor of inspection by the construction inspector and the labor of re-construction when there is a defect in the equipment construction.

FIG. 1 is a block diagram showing a configuration example of the equipment construction inspection system of the embodiment. The equipment construction inspection system includes, for example, one or more user terminal devices 100, a construction inspection server device 200, and a management terminal 300. The user terminal device 100, the construction inspection server device 200, and the management terminal 300 are connected to, for example, the communication network NW. Each device connected to the communication network NW is provided with a communication interface such as a NIC (Network Interface Card) or a wireless communication module (not shown in FIG. 1). The communication network NW includes, for example, the Internet, a WAN (Wide Area Network), a LAN (Local Area Network), a cellular network, and the like.

The user terminal device 100 is a portable terminal device provided with a camera device such as a smartphone or a tablet terminal. The user terminal device 100 is activated by a UA (User Agent) such as a browser or an application program. The UA is, for example, an application for communicating with the construction inspection server device 200. The user terminal device 100 uses the construction inspection application as a UA, and performs display processing, operation acceptance processing, and the like using the contents received from the construction inspection server device 200. Further, the user terminal device 100 provides the construction inspection server device 200 with operation information, a photographed image, and the like based on the user's operation by using the construction inspection application.

The construction inspection server device 200 is an information processing device that accepts inspection requests for equipment construction and provides inspection results for equipment construction. The construction inspection server device 200 includes, for example, a cooperation API (Application Programming Interface) unit 210 and an inspection target recognition unit 220. Functional units such as the linked API unit 210 and the inspection target recognition unit 220 are realized by, for example, a processor such as a CPU (Central Processing Unit) executing a program stored in the program memory. In addition, some or all of these functional units may be realized by hardware such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), or FPGA (Field-Programmable Gate Array). It may be realized by the cooperation of software and hardware.

The cooperation API unit 210 includes, for example, an API unit 212, an image processing unit 214, an inspection unit 216, and a control unit 218. The API unit 212 performs a process of receiving various information from the user terminal device 100, a process of providing contents to the user terminal device 100, and the like. The image processing unit 214 performs predetermined image processing on the image data acquired from the user terminal device 100. Hereinafter, the image used for the inspection will be referred to as an inspection image. The inspection unit 216 performs inspection processing of equipment construction using the inspection image acquired by the API unit 212 and / or the inspection image processed by the image processing unit 214. The control unit 218 controls the start of the image recognition engine in the inspection target recognition unit 220 and the like.

The inspection target recognition unit 220 includes, for example, a plurality of image recognition engines 222A, 222B, ... 222N (N is a natural number). When a plurality of image recognition engines are generically referred to, they are simply referred to as an image recognition engine 222. Each image recognition engine 222 corresponds to each inspection item among a plurality of inspection items. The image recognition engine 222 performs a recognition process for recognizing a construction member as an inspection target in an inspection item.

FIG. 2 is a block diagram showing an example of the inspection target recognition unit. The inspection target recognition unit 220 includes, for example, a learning image database 230, a learning processing unit 232, a recognition processing unit 234, and a result output unit 236.

The learning image database 230 is a database that stores, for example, an image acquired from the management terminal 300 as a learning image. The learning image database 230 stores, for example, a regular image as a learning image. The normal image is an image obtained by capturing an object in a normal state. The positive example image is, for example, an image of an image of construction members (utility poles, rooting stakes, wire shunt hardware, measures, etc.) used in the construction of utility poles. The positive example image is associated with the tag information including the construction member name. Information indicating, for example, a process name and an inspection item name may be associated with the normal image. The learning image database 230 may store not only regular images but also images of objects (objects in an abnormal state or defective products) different from the construction members as learning images.

The learning image is supplied to the learning processing unit 232 from the learning image database 230. The learning processing unit 232 performs recognition processing using the learning image and obtains a determination result. The learning processing unit 232 learns the processing parameters of the recognition processing unit 234 (recognition model 234A) so as to obtain a determination result that the construction member has been detected, and generates learning result data. The processing parameters of the recognition processing unit 234 (recognition model 234A) are, for example, filters (also referred to as weights and biases) included in the neural network. The learning result data is stored in the learning result data storage unit 2341.

The recognition processing unit 234 has, for example, a learning result data storage unit 2341 and a determination unit 2342. The learning result data storage unit 2341 stores the processing parameters of the recognition processing unit 234 as the learning result, and the processing parameters of the recognition processing unit 234 are updated by the learning processing unit 232. When the inspection image is acquired, the recognition processing unit 234 extracts the feature amount using the recognition model 234A based on the processing parameters of the recognition processing unit 234. The determination unit 2342 detects the construction member based on the extracted feature amount. The recognition processing unit 234 outputs the determination result by the determination unit 2342 as the recognition result.

Hereinafter, the inspection process in the construction of utility poles in the above-mentioned equipment construction inspection system will be described.
FIG. 3 is a diagram showing an example of a construction site in the construction of utility poles. Equipment work to be inspected in utility pole construction includes, for example, branch line construction using metal for branching (A1), utility pole burying construction (A2), branch line installation construction (A3), and branch line construction. Insulator installation work (A4), protective cover installation work on branch lines (A5), branch line burial work (A6), and utility pole sign board installation work (A7) are included. Note that A1 to A7 in FIG. 3 indicate areas to be imaged for inspection of each construction work.

When requesting an inspection of equipment construction, the user terminal device 100 activates a construction inspection application and displays an operation screen for equipment inspection. FIG. 4 is a diagram showing an example of a construction inspection operation screen in the user terminal device. As shown in FIG. 4A, the operation screen for construction inspection includes icon images corresponding to inspection items in equipment construction. The user terminal device 100 activates the camera device when the icon image is selected based on the user operation. When the icon image of "rooting" is selected, the user terminal device 100 has a screen including an image captured by the camera device and a guidance message for designating a construction member to be photographed, as shown in FIG. 4 (B). Is displayed.

FIG. 5 is a diagram showing an example of a guide image. The user terminal device 100 superimposes a guide image on the image 110 captured by the camera device by the construction inspection application. The guide image is an image that supports the user terminal device 100 to take a picture so that the construction member is included in a predetermined range in the image. The guide image includes, for example, a guide frame image 120 and a mask image 122. The guide frame image 120 shows an area where it is desirable that the construction member to be inspected is included. The mask image 122 shows a region that the construction inspection server device 200 does not recognize as a region including the construction member.

It is desirable that the region indicated by the guide frame image 120 and the region indicated by the mask image 122 be determined based on the learning image. For example, when many of the regular images (learning images) obtained by capturing the sign plate of the electric pole include the sign plate of the electric pillar in the center of the image, the guide frame image 120 is a region substantially in the center in the left-right direction in the image. Therefore, it is desirable that the area extending between the edges in the vertical direction in the image is shown, and the mask image 122 shows a region other than the area shown by the guide frame image 120. As a result, the construction inspection server device 200 can inspect with high accuracy. The guide frame image 120 may be changed by a setting file. As a result, the user terminal device 100 can flexibly change the area indicated by the guide frame image 120 based on the settings of the camera device and the display device, and can take an image in which the construction member is appropriately included.

FIG. 6 is a diagram showing another example of the guide image. The user terminal device 100 may acquire an image including a circular area (operation area) centered on the user's operation position from the captured image and transmit it to the construction inspection server device 200. In addition, the user terminal device 100 may acquire an image including an operation area in which a finger is slid along an elongated branch line protective cover. The user terminal device 100 may generate coordinate information indicating that the user's operation area is an image area including a construction member. The user terminal device 100 can transmit the photographed image and the coordinate information to the construction inspection server device 200. For example, when the captured image includes an insulator and a branch line protective cover, the user terminal device 100 determines the coordinate information of the image area including the insulator and the coordinates of the image area including the branch line protective cover based on the operation position of the user. Generate information.

In this way, the user terminal device 100 generates a captured image corresponding to the inspection item name based on the user's operation. As shown in FIG. 3, in the demarcation work using the demarcation hardware, the user terminal device 100 transmits an image of the area A1 including the demarcation hardware to the construction inspection server device 200. In the utility pole burying work, the user terminal device 100 transmits an image of the area A2 including the utility pole and the support member to the construction inspection server device 200. In the installation work of the branch line, the user terminal device 100 transmits an image of the area A3 including the protractor to the construction inspection server device 200. In the insulator installation work on the branch line, the user terminal device 100 transmits an image of the region A4 including the branch line and the insulator to the construction inspection server device 200. In the work of attaching the protective cover to the branch line, the user terminal device 100 transmits an image of the area A5 including the protective cover to the construction inspection server device 200. In the burial work of the branch line, the user terminal device 100 transmits an image of the area A6 including the burial site to the construction inspection server device 200. In the installation work of the utility pole sign plate, the user terminal device 100 transmits an image of the area A7 including the utility pole sign plate to the construction inspection server device 200.

FIG. 7 is a flowchart showing an example of inspection processing of equipment construction in the construction inspection server device. First, the cooperation API unit 210 acquires the inspection item name in the equipment construction based on the information received from the user terminal device 100 (step S100). The cooperation API unit 210 acquires the activation list of the inspection target recognition unit 220 when the inspection item name is acquired. The cooperation API unit 210 compares the inspection item name acquired in step S100 with the start list (step S104), and determines whether or not the image recognition engine 222 corresponding to the acquired inspection item name is running (step S104). S106). When the image recognition engine 222 corresponding to the inspection item name is not started (step S106: NO), the cooperation API unit 210 controls to start the image recognition engine 222 corresponding to the inspection item name (step S108).

The linked API unit 210 starts the image recognition engine 222 corresponding to the inspection item name (step S106: YES), or after starting the image recognition engine 222 corresponding to the inspection item name in step S108, the image file. And the inspection information file is acquired (step S110). Next, the cooperation API unit 210 performs predetermined image processing on the inspection image included in the acquired image file (step S112). The predetermined image processing includes, for example, edge sharpening (sharpening) processing, brightness correction processing, and the like. The user terminal device 100 delivers the inspection image subjected to the predetermined image processing to the image recognition engine 222 corresponding to the inspection item name.

The image recognition engine 222 performs a recognition process for determining whether or not there is a construction member (inspection target) corresponding to the inspection item name based on the image acquired from the linked API unit 210 (step S114). At this time, the image recognition engine 222 calculates the certainty for each construction member. Further, the image recognition engine 222 calculates the certainty of the construction member for each image processing. The image recognition engine 222 determines that the construction member exists when the certainty of the construction member is equal to or higher than a predetermined value. When the image recognition engine 222 recognizes that the construction member exists (step S116: YES), the image recognition engine 222 proceeds to the process in step S120. When the image recognition engine 222 recognizes that the construction member does not exist (step S116: NO), the image recognition engine 222 reacquires the inspection image (step S118). When the construction inspection server device 200 reacquires the inspection image, the construction inspection server device 200 transmits a request for re-shooting the image to the user terminal device 100.

The cooperation API unit 210 compares the certainty of the construction member calculated by the image recognition engine 222 (step S120). FIG. 8 is a diagram showing the relationship between the inspection image, the construction members a to e included in the inspection image, and the degree of certainty. When the inspection image includes the members a to e, the cooperation API unit 210 calculates the certainty Ca1 to Ce1 for each of the members a to e included in the inspection image, and calculates the total value C1 of the certainty Ca1 to Ce1. .. The cooperation API unit 210 also calculates the certainty Ca2 to Ce2 for each of the members a to e for the image obtained by performing edge processing on the inspection image, and calculates the total value C2 of the certainty Ca2 to Ce2. The cooperation API unit 210 also calculates the confidence levels Ca3 to Ce3 for each of the members a to e, and calculates the total value C3 of the confidence levels Ca3 to Ce3 for the image obtained by subjecting the inspection image to the brightness correction process.

The cooperation API unit 210 performs the inspection item determination process using the image corresponding to the highest total value among the plurality of total values (step S122). The inspection item determination process will be described later. The cooperation API unit 210 transmits the inspection result to the user terminal device 100 as a result of the determination processing of the inspection item (step S124).

The inspection process will be described below.
(Installation work of hardware for branch line)
FIG. 9 is an example of an inspection image including the wire shunt metal fitting, and FIG. 10 is a diagram showing a construction member, a tag name, and recognition conditions in the installation work of the shunt wire hardware.
The cooperation API unit 210 acquires an inspection image including a wire shunt hardware (item No. 1), a stopper (item No. 2), and two fasteners (item No. 3) as construction members. The image recognition engine 222 corresponding to the wire dividing hardware as the inspection item name determines whether or not the wire dividing hardware, the stopper, and the fastener are present in the inspection image as the construction member. When the image recognition engine 222 includes a construction member recognized as a wire dividing hardware in the inspection image, the image recognition engine 222 determines that the wire dividing hardware is present in the inspection image, and determines that the inspection image includes the wire dividing hardware. Is given the tag information corresponding to the hardware for the branch line. When the certainty of the object recognized as the stopper in the inspection image is equal to or higher than a predetermined value, the image recognition engine 222 determines that the stopper is present in the inspection image, and uses the stopper in the inspection image. Tag information corresponding to the stopper is added to the included area. When the certainty of the object recognized as the fastener in the inspection image is equal to or higher than a predetermined value, the image recognition engine 222 determines that the fastener is present in the inspection image, and determines that the fastener is present in the inspection image. Tag information corresponding to the fastener is added to the area including.

The tag information includes a tag name as a recognition result of the image recognition engine 222. The tag name is information indicating a construction member. The tag information may include coordinate information in the inspection image in addition to the tag name. The process of assigning tag information includes, for example, a process of associating a tag with an area in an inspection image. That is, the image recognition engine 222 may generate information representing the correspondence between the coordinates representing the area in the inspection image and the tag information, and creates a table showing the correspondence between the coordinates representing the region in the inspection image and the tag information. You may update it.

The tag information includes at least the tag name. The tag information may include coordinate information indicating the position in the image of the recognized construction member. That is, the tag information may include the position information in the image of the construction member recognized by the recognition process. The position information in the image may be information indicating an area (coordinate value, highest point, lowest point, shape, etc.) occupied by the construction member in the image.

FIG. 11 is a diagram showing an example of a partial region in the wire dividing hardware. In the inspection of the demarcation hardware, the cooperation API unit 210 rotates the inspection image so that the straight portion of the demarcation hardware approaches the horizontal direction in the image. The cooperation API unit 210 extracts a region including a wire dividing hardware as shown in FIG. The cooperation API unit 210 may rotate the inspection image after recognizing the existence of the wire dividing hardware. The cooperation API unit 210 divides the area including the wire dividing hardware into eight partial areas (1) to (8). In the cooperation API unit 210, the wire dividing hardware is present over the partial regions (1) to (8), the stopper is present in the partial region (3), and one of the two fasteners is a portion. It is recognized that it exists over the regions (4) and (5) and one of the two fasteners is present in the partial region (7).

As described above, in the construction inspection server device 200, in the installation work of the wire shunting hardware, the condition 1: the wire shunting hardware, the disconnection stopper and a plurality of fasteners are present, and the condition 2: the conviction of the disconnection stopper. The inspection result is passed when the three conditions are satisfied: the degree is equal to or higher than the specified value, and condition 3: the range in which multiple fasteners exist is present in the specified number of the specified part of the wire dividing hardware. Judge that there is.

The user terminal device 100 may display a screen for inputting the total number of fasteners installed, and may transmit information indicating the total number of fasteners installed to the construction inspection server device 200 based on the user's operation. The construction inspection server device 200 determines that the inspection result is acceptable, provided that the total number of fasteners based on the information received from the user terminal device 100 matches the total number of fasteners recognized by the image recognition engine 222. judge. Thereby, the accuracy of the inspection result can be further improved. The equipment construction inspection system compares not only the number of fasteners but also the number of installations of other construction members with the number of installations based on the user's operation and the number of installations recognized by the image recognition engine 222. You may.

(Installation work of root skein)
FIG. 12 is an example of an inspection image including a root skein, and FIG. 13 is a diagram showing a construction member, a tag name, and recognition conditions in the root skein mounting work.
The cooperation API unit 210 acquires an inspection image. The image recognition engine 222 corresponding to the rooting as an inspection item name shows the inspection image as a construction member, a measure, a vertical measure outer shell, a horizontal major outer shell, a horizontal bar outer shell, a rooting, a utility pole cross section, a utility pole, and tension. It is determined whether or not a drawing board indicating the direction is included. The image recognition engine 222 determines whether or not one measure exists as a specific number of construction members including a measure indicating each centimeter. The image recognition engine 222 calculates the degree of certainty for each construction member. When the certainty of the construction member exceeds a predetermined value, the image recognition engine 222 determines that the construction member exists in the inspection image, and displays tag information corresponding to the construction member in the area including the construction member in the inspection image. Give. Although FIG. 12 shows an example in which a horizontal bar exists instead of a horizontal measure, the image recognition engine 222 recognizes the existence of at least one of the horizontal measure and the horizontal bar as a reference member for the depth. And.

FIG. 14 is a diagram showing a process of detecting the height of a horizontal bar or a horizontal measure in an inspection of a root skein installation work. The cooperation API unit 210 detects the height of the horizontal bar or the horizontal measure for measuring the buried depth of the utility pole. As a prerequisite for detecting the height of the horizontal bar or horizontal measure, the image recognition engine 222 detects (condition 1) all the numerical values displayed as tag information corresponding to the measure, and (condition 2) the outer shell of the horizontal measure. It is assumed that the tag information of either one of the outer shell of the horizontal bar and the outer shell of the horizontal bar is detected.

As shown in FIG. 14, the vertical measure may be imaged at an angle with respect to the horizontal direction (X direction) in the image. The cooperation API unit 210 calculates the proportional calculation between the distance a from the intersection coordinate position between the horizontal bar and the measure to the upper end of the vertical measure area and the distance b from the intersection coordinate position between the horizontal bar and the measure to the lower end of the vertical measure area. The height of the horizontal bar is calculated by.

FIG. 15 is a diagram showing the positional relationship between the cross section of the utility pole and the drawing plate showing the rooting and the tension direction. The cooperation API unit 210 inspects the equipment work using the root skein based on the positional relationship between the root skein (support member), the utility pole, and the drawing board indicating the tension direction (inspection unit). Specifically, the cooperation API unit 210 determines whether or not the center of gravity of the cross section of the utility pole and the center of gravity of the root skein are arranged in the order indicated by the drawing plate indicating the tension direction. The cooperation API unit 210 determines that the inspection result is acceptable if the root skein is correctly installed so as to resist the tension applied to the utility pole, and if not, the inspection result of the root skein installation work is unacceptable. judge.

Further, the cooperation API unit 210 determines the direction of the arrow. When a drawing plate indicating the rooting and tension directions is detected, the cooperation API unit 210 rotates the inspection image so that the longitudinal direction of the rooting is parallel to the horizontal direction in the image. The cooperation API unit 210 calculates the angle formed by the longitudinal direction of the root skein and the arrow direction indicated by the drawing plate indicating the tension direction. If the calculated angle is within a predetermined range (for example, 80 degrees to 100 degrees), the cooperation API unit 210 determines that the inspection result of the root skein installation work is acceptable, and if not, the root skein Judge that the inspection result of the installation work is unacceptable.

(Installation work at the bottom of the branch line)
FIG. 16 is an example of an inspection image including the lower part of the branch line, and FIG. 17 is a diagram showing a construction member, a tag name, and recognition conditions in the installation work of the lower part of the branch line.
The cooperation API unit 210 acquires an inspection image. The image recognition engine 222 corresponding to the lower part of the branch line as the inspection item name shows the inspection image as a vertical measure, a horizontal measure, a centimeter measure indicating each height, and an anchor color (for example, black, red, brown and orange). It is determined whether or not the color) is included. FIG. 16 shows a case where the anchor color corresponding to any of the item numbers 3 to 6 corresponding to the construction member is recognized. The image recognition engine 222 calculates the degree of certainty for each construction member. When the certainty of the construction member exceeds a predetermined value, the image recognition engine 222 determines that the construction member exists in the inspection image, and displays tag information corresponding to the construction member in the area including the construction member in the inspection image. Give.

FIG. 18 is a diagram showing a process of calculating the burial depth of the branch line in the inspection of the lower part of the branch line. The cooperation API unit 210 calculates the intersection of the area to which the tag of the vertical measure is added and the area to which the tag of the horizontal measure is added. The cooperation API unit 210 calculates the calculated position of the intersection in the Y direction as the burial depth of the lower part of the branch line. The cooperation API unit 210 calculates the position of the intersection in the Y direction in the image based on the tag information of the area including the intersection. The cooperation API unit 210 determines that the inspection result of the lower part of the branch line is acceptable when the burial depth of the lower part of the branch line is appropriate, and that the inspection result of the lower part of the branch line is unacceptable otherwise.

FIG. 19 is a diagram for explaining an example of calculating the burial depth of the lower part of the branch line. When calculating the burial depth of the lower part of the branch line, the cooperation API unit 210 first obtains an area where the vertical measure area and the horizontal measure area intersect, as shown in FIG. 19A. Next, the cooperation API unit 210 acquires the position where the scale is 0 in the area of the vertical measure as the minimum value of the burial depth in the Y direction in the image. Next, the cooperation API unit 210 acquires the minimum value of the intersection region in the Y direction in the image as the maximum value of the burial depth in the Y direction. Next, the cooperation API unit 210 calculates the in-image distance between the minimum value and the maximum value at the burial depth. Next, as shown in FIG. 19B, the linked API unit 210 has the minimum in-image distance (a pixel) and burial depth from the position indicating 10 cm to the position indicating 20 cm in the area of the vertical measure. From the ratio of the value to the maximum value in the image (b pixels), the actual length indicated by the in-image distance between the minimum value and the maximum value at the burial depth is calculated. That is, the cooperation API unit 210 calculates the burial depth of the branch line by obtaining the value of x at 10 (cm): x (cm) = a (pixel): b (pixel).

In addition, when the upper branch line or the soil classification is selected as the inspection item name and a plurality of anchor color tags are detected, the cooperation API unit 210 has the highest certainty among black, red, brown, and orange. Detect color. The cooperation API unit 210 may collate the detected color with the anchor color of the lower branch line depending on the ground conditions of the facility location, economic efficiency, etc., and determine whether or not the anchor color is appropriate.

(Construction of the lower part of the utility pole)
FIG. 20 is an example of an inspection image including the lower part of the utility pole, and FIG. 21 is a diagram showing a construction member, a tag name, and recognition conditions in the construction of the lower part of the utility pole.
The cooperation API unit 210 acquires an inspection image. The image recognition engine 222 corresponding to the lower part of the utility pole as an inspection item name is used to determine whether or not the inspection image includes a scaffolding, a utility pole sign plate, and a measure as construction members. Of the members, the certainty of the sign board of the utility pole and the certainty of the measure are calculated. When each certainty degree exceeds a predetermined value, the image recognition engine 222 determines that the construction member exists in the inspection image, and adds tag information corresponding to the construction member to the area including the construction member in the inspection image. .. The image recognition engine 222 adopts the scaffold having the lowest installation position among the construction members recognized as the scaffold.

FIG. 22 is a diagram for explaining a process of inspecting the height of the scaffold. The cooperation API unit 210 recognizes the measure as the distance from the lowest point of the measure recognized by the image recognition engine 222 to the highest point of the measure, and detects the tag information indicating the scaffolding existing at the lowest position. Based on the detected scaffold tag information, the linked API unit 210 determines that the scaffold height inspection result is acceptable when the scaffold existing at the lowest position is higher than a certain height from the measure, and is not. If so, it is determined that the inspection result is unacceptable.

FIG. 23 is a diagram for explaining a process of inspecting the height of the sign plate of the utility pole. The cooperation API unit 210 recognizes the height of the tape measure as the distance from the lowest point of the tape measure to the highest point of the tape measure recognized by the image recognition engine 222, and detects the tag information indicating the sign board of the utility pole. Based on the tag information of the utility pole sign board, the cooperation API unit 210 determines that the inspection result of the height of the utility pole sign board is acceptable when the height of the upper end of the utility pole sign board is lower than a certain height. If not, it is determined that the test result is unacceptable. The cooperation API unit 210 may determine that the inspection result of the height of the utility pole sign plate is acceptable when, for example, the heights of the upper end and the lower end of the utility pole sign plate satisfy a certain height.

(Insulator installation work)
FIG. 24 is an example of an inspection image including an insulator, and FIG. 25 is a diagram showing a construction member, a tag name, and recognition conditions in the installation work of the insulator.
The cooperation API unit 210 acquires an inspection image. The image recognition engine 222 corresponding to the insulator as the inspection item name determines whether or not the inspection image includes the insulator and the measure as the construction member. The image recognition engine 222 calculates the certainty of the insulator and the measure. When each certainty exceeds a predetermined value, the image recognition engine 222 determines that an insulator and a tape measure are present in the inspection image, and adds tag information corresponding to the construction member to the area including the construction member in the inspection image. To do. The image recognition engine 222 employs an insulator included in a predetermined area including a position specified by the user. The image recognition engine 222 adopts the insulator when there is a construction member recognized as an insulator in a predetermined region including the detection position of the user operation on the display unit of the user terminal device 100.

FIG. 26 is a diagram for explaining a process of inspecting the height of the insulator. The cooperation API unit 210 recognizes the height having the measure as the distance from the lowest point of the measure recognized by the image recognition engine 222 to the highest point of the measure, and detects the tag information indicating the insulator. Based on the detected tag information of the insulator, the cooperation API unit 210 determines that the inspection result of the height of the insulator is acceptable when the insulator is higher than a certain height, and if not, the inspection result is Judge as a failure.

(Installation work of branch line)
FIG. 27 is an example of a photographed image including a branch line and a protractor for measuring the branch line angle, and FIG. 28 is a diagram showing a member name, a tag name, and a recognition condition of the protractor.
The cooperation API unit 210 acquires an inspection image. The image recognition engine 222 corresponding to the branch line angle as the inspection item name displays the inspection image with a needle as a member of the protractor and an angle display (0 degree, 10 degree, 20 degree, 30 degree, 40 degree, 50 degree, 60 degree). , 70 degrees, 80 degrees, and 90 degrees) are included. The image recognition engine 222 determines whether or not an image indicating the accuracy value is included in the inspection image for each angle value of the angle display. The image recognition engine 222 calculates the certainty of the needle and the certainty of the angle display (for each angle value). When each certainty degree exceeds a predetermined value, the image recognition engine 222 determines that the inspection image has a needle and an angle display (for each angle value), and the protractor determines that the inspection image includes the needle and the angle display. Add tag information corresponding to the needle and angle display (for each angle value).

FIG. 29 is a diagram for explaining a process of inspecting the branch line angle. The cooperation API unit 210 sets the intermediate position between the half position and the tip position in the region from the half position to the tip position of the needle recognized by the image recognition engine 222 as the reference coordinates of the needle. The cooperation API unit 210 acquires the tag information of the angle display (50 degrees and 30 degrees) of the upper two places close to the reference coordinates of the needle. The cooperation API unit 210 calculates the distance (number of pixels) between the acquired images of the two angle displays, and divides the calculated number of pixels by the angle difference (20 degrees) of the two angle displays to obtain pixels around 1 degree. Calculate the number. The cooperation API unit 210 calculates the distance between the centers of gravity of the regions including the angle values (horizontal direction in the image), although the tag information for each angle value includes the region information including the angle values. The cooperation API unit 210 calculates the angle (branch line angle) indicated by the needle based on the number of pixels between the needle and the angle display (30 degrees) in the horizontal direction in the image and the angle (30 degrees) indicated by the angle display. To do. If the branch line angle is within a predetermined range, the cooperation API unit 210 determines that the inspection result of the branch line angle is acceptable, and if not, determines that the inspection result is unacceptable.

(Installation work of winding grip)
FIG. 30 is an example of a photographed image including the winding grip, and FIG. 31 is a diagram showing a member name, a tag name, and recognition conditions in the installation work of the winding grip.
The cooperation API unit 210 acquires an inspection image. The image recognition engine 222 corresponding to the winding grip as the inspection item name determines whether or not the captured image includes red tape, purple tape, brown tape, orange tape, and thimble as construction members. The image recognition engine 222 calculates the certainty of the construction member for each construction member. When each certainty degree exceeds a predetermined value, the image recognition engine 222 determines that the construction member exists in the inspection image, and adds tag information corresponding to the construction member to the area including the construction member in the inspection image.

The cooperation API unit 210 adopts the color with the highest degree of certainty among the colors of the tape. The cooperation API unit 210 collates the color of the adopted tape with the color of the tape corresponding to the local conditions of the facility location, economic efficiency, and the like. The cooperation API unit 210 determines that the inspection result of the tape color is acceptable when the colors match each other, and determines that the inspection result is unacceptable when the colors are not the same. The cooperation API unit 210 may perform the tape color inspection when the user's operation is accepted and the upper part of the branch line in the inspection image is selected.

The cooperation API unit 210 determines whether or not the tag information corresponding to the thimble is attached to the inspection image, and if the tag information corresponding to the thimble is attached, the inspection result for the thimble is passed. Judgment is made, and if not, it is judged that the inspection result is unacceptable. The cooperation API unit 210 determines that the inspection result of the construction of the winding grip is passed when the inspection result is passed for all the inspections of the construction members.

(Geta installation work)
FIG. 32 is an example of an inspection image including a geta, and FIG. 33 is a diagram showing a member name, a tag name, and a recognition condition in the installation work of the geta.
The cooperation API unit 210 acquires an inspection image. The image recognition engine 222 corresponding to geta as an inspection item name determines whether or not the inspection image includes geta as a construction member. When the image recognition engine 222 includes geta, the image recognition engine 222 adds tag information corresponding to the geta to the area including the geta in the inspection image. The cooperation API unit 210 determines that the inspection result is acceptable when the area in the inspection image selected by the user includes a geta tag, and determines that the inspection result is unacceptable otherwise.

(Branch line protection and insulator installation work)
FIG. 34 is an example of an inspection image including the branch line protection and the insulator, and FIG. 35 is a diagram showing a member name, a tag name, and a recognition condition in the branch line protection and the installation work of the insulator.
The cooperation API unit 210 acquires an inspection image. The image recognition engine 222 corresponding to the branch line protection and the insulator as the inspection item name determines whether or not the inspection image includes the branch line protection and the insulator as the construction member. When the construction member is included, the image recognition engine 222 adds tag information corresponding to the construction member to the area including the construction member in the inspection image. The cooperation API unit 210 determines that the inspection result is acceptable when the area in the inspection image selected by the user includes the tag of branch line protection, and determines that the inspection result is unacceptable otherwise. .. The cooperation API unit 210 determines that the inspection result is acceptable if the region in the inspection image selected by the user includes an insulator tag, and determines that the inspection result is unacceptable otherwise. ..

(Insulator installation work)
FIG. 36 is an example of an inspection image including an insulator, and FIG. 37 is a diagram showing a member name, a tag name, and recognition conditions in the installation work of the insulator. The insulator is an insulator attached to a line (power line, communication line, etc.) connected to a utility pole.
The cooperation API unit 210 acquires an inspection image. The image recognition engine 222 corresponding to the insulator as the inspection item name determines whether or not the inspection image includes the insulator as the construction member. When the image recognition engine 222 includes an insulator, the image recognition engine 222 adds tag information corresponding to the insulator to the region including the insulator in the inspection image. The cooperation API unit 210 determines that the inspection result is acceptable if the region in the inspection image selected by the user includes an insulator tag, and determines that the inspection result is unacceptable otherwise. ..

(Fastener installation work)
FIG. 38 is an example of an inspection image including the fastener, and FIG. 39 is a diagram showing a member name, a tag name, and a recognition condition in the attachment work of the fastener. The fastener is a construction member for drawing a line (power line, communication line, etc.) connected to a utility pole into the house.
The cooperation API unit 210 acquires an inspection image. The image recognition engine 222 corresponding to the fastener as the inspection item name determines whether or not the inspection image includes the fastener as a construction member. When the fastener is included, the image recognition engine 222 adds tag information corresponding to the fastener to the area including the fastener in the inspection image. The cooperation API unit 210 determines that the inspection result is acceptable when the area in the inspection image selected by the user includes the tag of the fastener, and determines that the inspection result is unacceptable otherwise. ..

According to the equipment construction inspection system of the embodiment described above, the inspection image obtained by capturing the image of the shunting hardware and the inspection item information indicating that the inspection item is the shunting hardware are acquired from the user terminal device 100. When the certainty level indicating the certainty of the inspection object is calculated based on the inspection image, whether or not the inspection object is included in the inspection image is recognized based on the certainty, and the inspection object is included in the inspection image. In addition, based on the positional relationship of the inspection target, the inspection of the equipment work using the wire branching hardware is carried out, and the result of the inspection carried out by the inspection department is notified to the terminal device. According to this equipment construction inspection system, in the inspection of hardware for demarcation, the inspection is carried out based on the positional relationship of the inspection target, so that the construction state using a plurality of members can be inspected with high accuracy.

Further, according to the equipment construction inspection system of the embodiment, an inspection image obtained by imaging the support member of the electric pole and inspection item information indicating that the inspection item is the support member of the electric pole are acquired from the terminal device, and the inspection item information is obtained from the inspection image. The certainty that indicates the certainty of the support member and the inspection object around the support member is calculated, and based on the certainty, it is determined whether or not the support member and the inspection object are included in the inspection image, and the inspection image is supported. When a member and an inspection object are included, an inspection of equipment work using the support member is carried out based on the positional relationship between the support member and the inspection object, and the result of the inspection carried out by the inspection department is notified to the terminal device. To do. According to this equipment construction inspection system, in the inspection of the support member of the utility pole, the inspection is carried out based on the positional relationship of the inspection object, so that the construction state using a plurality of members can be inspected with high accuracy.

Further, according to the equipment construction inspection system of the embodiment, the terminal device presents a plurality of icons corresponding to a plurality of inspection items included in the equipment construction, and the icon is selected from the plurality of icons based on the user's operation. In response to this, the camera device of the terminal device is activated, and the guide frame of the inspection target in the search item corresponding to the selected icon and the mask indicating the area not recognized as the inspection target are displayed on the terminal device. , The inspection image captured by the camera device, and the inspection item information corresponding to the selected icon are transmitted from the terminal device to the information processing device, and the recognition unit transmits the inspection image included in the inspection image transmitted from the terminal device. The certainty level indicating the certainty of the object is calculated, it is determined whether or not the inspection target object is included based on the certainty level, and when the recognition unit determines that the inspection target object is included, the information processing device. The inspection department of the above will perform inspections corresponding to the inspection items based on the positional relationship of the inspection objects. According to this equipment construction inspection system, an appropriate inspection image can be obtained by displaying a guide frame and a mask when imaging an inspection object, and the construction state using a plurality of members can be inspected with high accuracy. can do.

Although each embodiment and modification have been described, the present invention is not limited to these, and is not limited to these. For example, one of each embodiment or each modification, a part of each embodiment, or one of each modification. The unit may be combined with another one or more embodiments or other one or more modifications to realize one aspect of the invention.

A program for executing each process of the user terminal device 100 and the construction inspection server device 200 in the present embodiment is recorded on a computer-readable recording medium, and the program recorded on the recording medium is stored in the computer system. By reading and executing, the above-mentioned various processes related to the user terminal device 100 and the construction inspection server device 200 may be performed.

The "computer system" referred to here may include hardware such as an OS and peripheral devices. Further, the "computer system" includes a homepage providing environment (or a display environment) if a WWW system is used. The "computer-readable recording medium" includes a flexible disk, a magneto-optical disk, a ROM, a writable non-volatile memory such as a flash memory, a portable medium such as a CD-ROM, and a hard disk built in a computer system. It refers to the storage device of.

Furthermore, the "computer-readable recording medium" is a volatile memory inside a computer system that serves as a server or client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line (for example, DRAM (Dynamic)).
It also includes those that hold the program for a certain period of time, such as Random Access Memory)). Further, the program may be transmitted from a computer system in which this program is stored in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium.

Here, the "transmission medium" for transmitting a program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. Further, the above program may be for realizing a part of the above-mentioned functions. Further, it may be a so-called difference file (difference program) that can realize the above-mentioned function in combination with a program already recorded in the computer system.

Although the embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and the design within a range not deviating from the gist of the present invention is also included. For example, as an embodiment of the present invention, it may be composed only of the user terminal device 100.

100 User terminal device 120 Guide frame image 122 Mask image 200 Construction inspection server device 210 Linked API unit 212 API unit 214 Image processing unit 216 Inspection unit 218 Control unit 220 Inspection target recognition unit 222 Image recognition engine

Claims (8)

An acquisition unit that acquires an inspection image of a utility pole support member from a terminal device and inspection item information indicating that the inspection item is a utility pole support member.
From the inspection image, the certainty indicating the certainty of the support member and the inspection object around the support member is calculated, and based on the certainty, whether the inspection image includes the support member and the inspection object. A recognition unit that determines whether or not
When the support member and the inspection object are included in the inspection image, an inspection unit that inspects equipment work using the support member based on the positional relationship between the support member and the inspection object, and an inspection unit.
A notification unit that notifies the terminal device of the result of the inspection performed by the inspection unit, and
Equipment construction inspection equipment equipped with. The recognition unit is a recognition model learned using a learning image including a normal inspection object, and recognizes that the inspection object exists when an inspection image including a normal inspection object is input. Using a recognition model in which the processing parameters are trained,
The inspection device for equipment construction according to claim 1. The recognition unit recognizes a virtual cross section of a utility pole supported by the support member as the inspection object, and recognizes the virtual cross section of the utility pole.
The inspection unit performs inspection based on the positional relationship between the position of the support member and the virtual point based on the area occupied by the virtual cross section.
The equipment construction inspection device according to claim 1 or 2. The recognition unit recognizes an arrow indicating the pulling direction of the utility pole from the inspection image as the inspection object.
The inspection unit performs the inspection based on the relationship between the position of the support member, the virtual point based on the area occupied by the virtual cross section, and the direction indicated by the arrow.
The inspection device for equipment work according to claim 3. The inspection unit performs inspection based on the relationship between the position of the center of gravity of the support member, the position of the center of gravity of the utility pole based on the area occupied by the virtual cross section, and the direction indicated by the arrow.
The inspection device for equipment construction according to claim 4. When the electric pole is of the first type, the inspection unit determines whether or not the angle between the longitudinal direction of the support member and the direction of the arrow is within the first angle, and the electric pole is the second type. In the case of the type, it is determined whether or not the angle between the longitudinal direction of the support member and the direction of the arrow is within the second angle.
The equipment construction inspection device according to claim 4 or 5. A step of acquiring an inspection image of an image of a utility pole support member and inspection item information indicating that the inspection item is a utility pole support member from a terminal device.
A step of calculating the certainty indicating the certainty of the support member and the inspection target around the support member from the inspection image, and
A step of determining whether or not the support member and the inspection object are included in the inspection image based on the certainty.
When the inspection image includes the support member and the inspection object, a step of inspecting equipment work using the support member based on the positional relationship between the support member and the inspection object, and
The step of notifying the terminal device of the inspection result and
An inspection method for equipment construction. On the computer
A step of acquiring an inspection image of an image of a utility pole support member and inspection item information indicating that the inspection item is a utility pole support member from a terminal device.
A step of calculating the certainty indicating the certainty of the support member and the inspection target around the support member from the inspection image, and
A step of determining whether or not the support member and the inspection object are included in the inspection image based on the certainty.
When the inspection image includes the support member and the inspection object, a step of inspecting equipment work using the support member based on the positional relationship between the support member and the inspection object, and
The step of notifying the terminal device of the inspection result and
A program that runs.

Images