JP6747692B2 - External wall inspection device - Google Patents

Description

TECHNICAL FIELD The present invention relates to a device for inspecting an outer wall of a building in which an outer wall material is fixed by a plurality of screws.

In many buildings such as station buildings, the outer wall is often made of a plate-shaped outer wall material such as a flexible board. When fixing such an outer wall material to the frame of a building, it is common to use a screw. That is, the screws are inserted from the outer surface side of the outer wall material, and the outer wall material is fixed by being screwed into the framework behind.
However, the screws may loosen their tightening over time, and the head may float up or fall off in a severe case. If the screws rise or fall off, the outer wall material cannot be supported only by the remaining screws, and the outer wall material may fall.

In order to prevent the outer wall material from falling, it is important to check the condition of the screws on a daily basis. Conventionally, the screw was visually confirmed. In particular, the screws at high places in the building were viewed by approaching them with scaffolding, or by looking at the wall surface from a distance by enlarging the wall surface.
Further, in recent years, an outer wall inspection device including a pole, an image pickup unit attached to the tip of the pole, an image display unit such as a personal computer, and a video transmission unit connecting the image pickup unit and the image display unit is used. Another inspection method (see Patent Document 1) has also been proposed. Specifically, a worker takes a picture of the state of the outer wall while moving the imaging unit attached to the tip of the pole along the wall surface, and another worker inspects it while looking at the image display unit, That is.

Japanese Unexamined Patent Application Publication No. 2005-061224

Use of the inspection method described in Patent Document 1 solves the problems that it takes time to assemble a scaffold when inspecting a screw at a high place, and that the target screw is lost when the binoculars are moved. It is possible.
However, in the inspection method described in Patent Document 1, it is still necessary to photograph and inspect each and every screw one by one, so that it also takes a lot of trouble.
In addition, since the length of the pole is limited, when inspecting the outer wall of a building that has a track at a lower position like a bridge station building and is quite high, a scaffolding is also required, which is troublesome. It will take.

The present invention has been made to solve the above problems, and an outer wall inspection device capable of significantly reducing the time and effort required when inspecting the outer wall of a building in which the outer wall material is fixed by a plurality of screws. The purpose is to provide.

In order to solve the above problems, the present invention captures an outer wall of a building, and an imaging device capable of outputting a wall image of the captured outer wall, and a wall image output from the imaging device is read and read. An outer wall inspection device that is capable of inspecting the condition of the outer wall of a building in which the outer wall material is fixed by a plurality of screws Then, the image processing device, a filling means for changing the pixels forming the image of the plurality of screws reflected in the wall surface image to a specific color, and the filling means for the specific color by the filling means A roundness calculating means for calculating the roundness of each of the plurality of screw images, and a result display means for displaying a list of the roundnesses of the plurality of screw images calculated by the roundness calculating means. It is characterized by being provided.

According to the present invention, a list of roundnesses of images of a plurality of screws is displayed by shooting a plurality of screws at once and processing the images. Then, by searching for a relatively large value in the list and checking the image of the corresponding screw on the wall surface image, it is possible to determine with high probability whether or not the head is floating. On the other hand, in the roundness list, a small value means that the head does not float, or the degree of the float is so small that there is no problem, so that it is possible to omit confirmation in the image. In other words, you can focus on the screws that are suspected to lift your head. Therefore, as compared with the related art in which each screw is sequentially inspected regardless of whether or not the head is lifted, it is possible to greatly reduce the time and labor required to inspect the state of the screw.
In addition, since it is possible to perform inspections using wall images taken from locations that are far enough to allow multiple screws to be imaged, conventional inspections must be performed unless a scaffold is provided because the outer wall is at a high position. The outer wall, which was not possible, can be easily inspected without building scaffolding.

Note that in the above invention, the filling unit includes a contour extraction unit that extracts a contour pixel that forms a contour of the image of the plurality of screws reflected in the wall surface image, based on a brightness difference with surrounding pixels, and The contour pixel extracted by the contour extracting means and the pixel surrounded by the contour pixel are changed to a specific color, and the pixels outside the contour pixel are changed to another color different from the specific color. It may be provided with a color-coding means.
By doing so, it is possible to extract the pixels forming the screw image from the wall surface image with higher probability and to calculate the roundness more accurately, as compared with a method such as filling by binarization. ..

Further, in the above invention, the image processing device includes a filtering unit that selects a roundness of a plurality of images of the screws calculated by the roundness calculating unit that is equal to or more than a predetermined threshold, and the result display. The means may include a selection display processing means for displaying the image of the screw corresponding to the roundness selected by the filter means in a state of being filled with the specific color.
In this way, by setting the threshold value to a value greater than 0, which indicates that the head is not lifted, the majority of the images of the screws in which the head is not lifted and the roundness are not displayed. Can be omitted. Further, if the threshold value is increased, the image of the screw and the roundness of which the degree of floating of the head is small (which does not need to be dealt with urgently) are not displayed. In this way, the inspection range can be set to an arbitrary width by adjusting the threshold value.

Further, in the above invention, the image processing apparatus is configured such that a size setting unit capable of setting a size of a region projected on the wall surface image on the outer wall of the building and a size of the region are set by the size setting unit. Area calculation means for calculating the area of the image of the plurality of screws painted in the specific color by the paint processing means when the size is set, and the area calculation means calculates the result display means. The area of the image of each screw may be displayed as a list.
The size of the screw is limited regardless of the degree of floating, so for example, a value that exceeds the area when the entire screw is seen from the side (completely removed) is displayed. In other words, it is highly possible that something other than screws (for example, scratches or stains on the outer wall) was erroneously detected. For this reason, it is possible to omit confirmation for an image having an extremely large area, and thus it is possible to perform inspection more easily.

ADVANTAGE OF THE INVENTION According to this invention, the effort at the time of inspecting the outer wall of the building in which the outer wall material is being fixed by the some screw can be reduced significantly.

It is a block diagram of an outer wall inspection device concerning an embodiment of the present invention. FIG. 3 is a diagram showing an example of a screen displayed on the display unit of the image processing apparatus of FIG. 1. 6 is a flowchart showing a screw floating inspection process executed by a control unit of the image processing apparatus that constitutes the outer wall inspection apparatus of the first embodiment. (A) is a schematic diagram showing the positional relationship between the wall surface to be inspected and the imaging device, and (b) to (d) are graphs showing the relationship between the photographing angle and the success rate of screw float detection.

Hereinafter, a schematic configuration of an outer wall inspection device 1 according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram of the outer wall inspection device 1.
As shown in FIG. 1, the outer wall inspection device 1 of the present embodiment includes an imaging device 2 and an image processing device 3.

The image pickup apparatus 2 is, for example, a digital still camera, and includes an image pickup unit 21, an output unit 22 connected to the image pickup unit 21, and the like.
The image pickup unit 21 includes a lens, an image pickup device, and the like. It is preferable that the number of pixels of the image pickup element is equal to or larger than a predetermined number.
The output unit 22 is connected to the image processing apparatus 3 in a wired or wireless manner, and is an interface capable of transmitting various data including captured image data, or writing capable of writing various data in a medium such as a memory card. It is composed of means and the like.

The image processing device 3 is, for example, a personal computer independent of the imaging device 2 or a tablet terminal integrated with the imaging device 2. The image processing device 3 includes a control unit 31, an input unit 32, a storage unit 33, a display unit 34, an operation unit 35, and the like, and the units 31 to 35 are connected by a bus 36.
The control unit 31 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), and the like, executes various processes in cooperation with various programs stored in the storage unit 33, and operates the image processing apparatus 3. It is configured to control in a centralized manner.

The input unit 32 is connected to the imaging device 2 in a wired or wireless manner, and includes an interface capable of receiving various data, or a reading unit capable of reading various data from a medium in which various data are stored. ing. If the image processing device 3 is integrated with the image pickup device 2, the input unit 32 and the output unit 22 of the image pickup device 2 are not necessary.
The storage unit 33 includes, for example, an HDD (Hard Disk Drive), a semiconductor non-volatile memory, and the like, and stores various programs and various data. The storage unit 33 is also configured to be able to store the image data captured from the imaging device 2.

The display unit 34 is, for example, a liquid crystal display (LCD) or the like, and displays various images including a captured image captured as data from the imaging device 2 based on a control signal input from the control unit 31. Functions as a display means.
The operation unit 35 is a touch panel that is provided on the display unit 34 when the image processing apparatus 3 is composed of a personal computer and is composed of a keyboard, a mouse, and a tablet terminal.

Next, the operation of the image processing device 3 will be described. FIG. 2 is a diagram showing an example of a display screen displayed by the image processing apparatus 3, and FIG. 3 is a flowchart showing a screw floating inspection process executed by the image processing apparatus 3.
In the image processing apparatus 3, the control unit 31 executes the image processing program stored in the storage unit 33 to display the setting input screen as shown in FIG. The screw floating inspection process as shown is executed.

When the image processing device 3 is activated, the control unit 31 first causes the display unit 34 to display the main screen. As the main screen, for example, as shown in FIG. 2A, a photograph display unit 34a for displaying the read wall surface image, an inspection start button 34b for starting the screw floating inspection process, and a setting screen for calling A set button 34c, an inspection target display section 34d for displaying a storage destination of an image to be inspected (displayed on the photo display section 34a), a result display section 34e for displaying a processing result, and the like are displayed. To do so.

When the main screen is displayed, the image processing apparatus 3 is in a state in which it is possible to read wall surface image data from the image pickup apparatus 2 or a state in which it can read wall surface image data stored in the storage unit 33. ..
When the wall surface image data is read, the control unit 31 displays the wall surface image obtained by imaging the read wall surface image data on the photograph display unit 34a of the display unit 34.

Further, when the control unit 31 detects an instruction to call the setting screen (click or tap of the setting button 34c), the control unit 31 causes the display unit 34 to display the setting screen. As the setting screen, for example, as shown in FIG. 2B, in addition to the same photo display unit 34a as the main screen, a coordinate display unit 34f for displaying the coordinates of each screw and a threshold value for filtering are displayed. A threshold display unit 34g, a size display unit 34h that displays the size (vertical and horizontal lengths, hereinafter referred to as wall size) of the area of the wall surface to be inspected, which is displayed on the wall image, and the setting contents (threshold value displayed on the threshold display unit 34g and A registration button 34i for registering the wall surface size or the like displayed on the size display portion 34h, a close button 34j for returning to the main screen, and the like are displayed.

When the setting screen is displayed, the image processing device 3 is in a state in which various numerical values used in the screw floating inspection process can be input. Specifically, operations such as inputting various thresholds to the threshold display unit 34g and inputting wall surface sizes to the size display unit 34h are possible. That is, the image processing device 3 functions as the size setting means in the present invention.
When the instruction to end the setting (click or tap of the close button 34j) is detected, the control unit 31 returns the display of the display unit 34 to the main screen.

Further, when the control unit 31 detects an inspection start instruction (click or tap of the inspection start button 34b), the control unit 31 executes the screw floating inspection process. In the screw float inspection processing, as shown in FIG. 3, first, edge processing (step S1) is performed. In the edge processing, a pixel having a large brightness difference with an adjacent pixel is extracted from the pixels forming the read wall surface image. Since the screws appear darker than the outer wall material (the brightness is low), by doing this, from the wall surface image, the outline of the screws (only the head when the head is not lifted, the head and the axis when the head is lifted) Pixels (hereinafter referred to as contour pixels) corresponding to (part) are extracted with high probability.

Next, color classification processing (step S2) is performed. In the color classification processing, the contour pixels extracted in step S1 are changed to a specific color (for example, red), and the pixels other than the contour pixels are changed to a color other than the specific color (for example, black: other colors below).
Next, a closing process (step S3) is performed. In the closing process, when the contour pixels are not connected in a ring shape, the interrupted points are connected (a pixel of another color between the contour pixel forming one end of the interrupted contour line and the contour pixel forming the other end thereof). To change to a specific color), and close the interrupted contours by joining them together.

Next, a filling process (step S4) is performed. In the filling process, all pixels surrounded by the contour pixels among the pixels having the other colors even after step S3 are changed to the specific color. That is, the inside of the outline of the screw image is filled with the same color as the outline.
By executing the processes of steps S1 to S4, the wall surface image displayed on the photo display unit 34a becomes only the image of the screw painted with the specific color. That is, the image processing device 3 that executes the processing of steps S1 to S4 functions as the contour extracting means, the color dividing means, and the filling means in the present invention.
Note that the screws may be painted black by binarizing the wall surface image using the intermediate value between the brightness of the screws and the brightness of the outer wall material as a threshold value.

When the wall surface size is set in advance on the setting screen, the area calculation process (step S5) is performed after step S4. In the area calculation process, the area of the image of each screw painted in a specific color is calculated. Specifically, from the set wall size, determine how much area one pixel will occupy on the actual wall surface, and then calculate the number of pixels filled with a specific color that forms the image of the screw. The area of the image of the screw is calculated by counting. By doing so, the area of the screw can be accurately calculated even if the size of the screw displayed on the wall surface image varies depending on the shooting magnification and the shooting location.

Next, roundness calculation processing (step S6) is performed. In the roundness calculation processing, the roundness of the image of each screw, that is, when the contour line of the image of the screw is sandwiched by two concentric geometric circles from the inside and the outside, the interval between the concentric circles is minimized. In this case, the difference between the radii of two circles is calculated. The process of step S6 may be performed before the process of step S5.
Then, the area and roundness of the screw image calculated in steps S5 and S6 are displayed in a list on the result display unit 34e (step S7).
By executing the processing of steps S5 to S7, the image processing apparatus 3 functions as the roundness calculation means, the area calculation means, and the result display means in the present invention.

When the threshold value is set in advance on the setting screen, data filtering is performed between the processes of steps S6 and S7. Specifically, of the area calculated in step S5 and the roundness calculated in step S6, a value equal to or larger than the input threshold value is selected and displayed on the result display unit 34e, and also selected on the photograph display unit 34a. The process of displaying the image of the screw corresponding to the specified numerical value in a state of being filled with a predetermined color is performed. By performing this processing, the image processing device 3 functions as the filter means in the present invention.

The screw image shows a shape closer to a perfect circle as the head is less lifted (the shaft is exposed) (the roundness approaches 0). In other words, the larger the roundness of the image, the higher the possibility that the head has a large lift. Therefore, if the lower limit of the roundness threshold value is set to a value larger than 0, the roundness and images of the screws with the majority of the heads not displayed, and the heads are suspected to be floating. The roundness of the screw and the image will be displayed. Further, if the threshold value is increased, the image of the screw and the roundness of which the degree of floating of the head is small (which does not need to be dealt with urgently) are not displayed. In this way, the inspection range can be set to an arbitrary width by adjusting the threshold value.

In addition, the size of the screw is small, and the size of the area is limited no matter how large the head floats. Therefore, for example, the area when the screw is viewed from the side (completely removed) is the upper limit of the threshold. If it is set as, there is a high possibility that an image exceeding the threshold value is not a screw (scratches or stains on the outer wall), so it is possible to further narrow down the images to be inspected.
Further, when the area is smaller than that of the screw that is normally tightened (the head is not lifted), it is possible that the screw has already come off and the hole that the screw has penetrated is copied. Therefore, by setting the upper limit of the threshold value of the area to be smaller than that of the screw that is normally tightened, it is possible to check the place where the screw has already come off.

Next, an outer wall inspection method using the outer wall inspection device 1 described above will be described. FIG. 4A is a schematic diagram showing the positional relationship between the wall surface W to be inspected and the image pickup device 2, and FIGS. 4B to 4D show the relationship between the photographing angle and the success rate of screw float detection. It is the graph shown.
First, as shown in FIG. 4A, the inspector uses the imaging device 2 to photograph the wall surface W of the outer wall to be inspected so that a plurality of screws are imaged.

At the time of shooting, if the shooting range is too wide, the screws become too small and it becomes difficult to perform image processing. On the other hand, if the imaging range is too narrow, the wall surface that can be inspected at one time becomes small, and it becomes necessary to inspect many times. If the width and height of the shooting range are not known in advance, the area of the screw image will vary depending on the size actually displayed on the photo display unit 34a. Therefore, when shooting a wall surface image, the shooting position and shooting magnification are adjusted so that the size of the area (vertical and horizontal lengths) projected in the wall surface image becomes a predetermined length. Good to do.
As a result of examination by the inventor of the present invention, it was found that it is preferable to set the lateral width of the outer wall to be imprinted to about 6500 mm from the viewpoint of work efficiency and image quality of the wall surface image.

Further, the screw fixing the outer wall material can see only the head when viewed from the front (toward the direction in which the shaft portion penetrates), and therefore, in the wall surface image taken from the direction orthogonal to the wall surface W, the screw floats. Can't be inspected. Therefore, when capturing the wall surface image, it is necessary to capture the wall surface W to be inspected from a position forming a predetermined angle.

The inventor of the present invention conducted a test for obtaining an optimal wall surface image to be processed by the image processing device 3 of the present embodiment. Specifically, as shown in FIG. 4A, on the side surface of the wall surface W to be inspected, which is on a plane forming an angle of 15°, 30°, 45° with the wall surface W (the shooting height is The image of the wall surface W was taken by disposing the image pickup device 2 on the same surface as the wall surface W or above or below the wall surface W. Then, each of the obtained wall surface images was processed by the image processing device 3, and it was examined whether or not a screw whose head is lifted up by more than a few mm can surely be detected. 4B, 4C, and 4D show the results when the angles are 15°, 30°, and 45°, respectively. According to the result, when the photographing angle is 30°, 45° or more, 100% can be detected when the screw float is 4 mm or more, whereas when the angle is 15°, 100% cannot be detected until the screw floats 7 mm or more. I was able to detect it. Since it is better that the floating of the screw can be detected while it is as small as possible, it is preferable to incline the photographing angle with respect to the wall surface W by about 30° to 45°.

Further, depending on the time of shooting and the weather, the shadow of the screw may be greatly extended, or the brightness difference between the screw and the wall surface W may be reduced.
When the shadow extends, the roundness of the screw that is normally tightened is also calculated to be large. Therefore, it is preferable to photograph the outer wall at a time when the shadow does not extend as much as possible.
Further, when the brightness difference between the screw and the wall surface W becomes small, it is difficult to detect the outline of the screw, and there is a risk of erroneously determining that there is no screw. Preferably.

After photographing the outer wall, the wall surface image data is taken into the image processing device 3. Then, various thresholds for filtering and the size of the wall surface for calculating the area are set. Then, when the inspection is started (clicking or tapping the inspection start button 34b), the roundness and the area of the images of the plurality of screws are displayed on the result display unit 34e of the display unit 34. Lists of larger areas with areas between the upper and lower thresholds are displayed. Next, the inspector confirms the image corresponding to the displayed circularity and area on the photograph display unit 34a. At that time, once you cancel the state of being painted with a specific color, check whether it is really a screw image, and if it is a screw, check whether it really floats. ..

When the outer wall inspection device 1 of the present embodiment is used to perform the inspection as described above, the state of a large number of screws actually attached over a wide range can be confirmed on the display unit 34. Inspection work can be performed more easily than in the conventional case where each screw was checked.
In addition, since it is possible to perform inspections using wall images taken from locations that are far enough to allow multiple screws to be imaged, conventional inspections must be performed unless a scaffold is provided because the outer wall is at a high position. The outer wall, which was not possible, can be easily inspected without building scaffolding.
In addition, by setting a threshold value, the circularity is larger than the lower limit of the predetermined threshold, and the area is between the upper limit and the lower limit of the threshold to be inspected. Moreover, it is possible to omit the confirmation of the image of scratches and stains on the outer wall, and to focus on the screws that are suspected to have a large floating head, so it is easier to perform the inspection work. be able to.

Although the present invention has been specifically described above based on the embodiment, the present invention is not limited to the above embodiment and can be modified without departing from the scope of the invention.
For example, in the above-described embodiment, the wall size of the area of the wall surface to be photographed is determined in advance. However, after the image is photographed without determining the wall size, the distance between the two points corresponding to both ends of the wall image on the actual wall is determined. The distance may be actually measured later and the measured value may be input.

1 Outer Wall Inspection Device 2 Imaging Device 21 Imaging Unit 22 Output Unit 3 Image Processing Device (Filling Means (Contour Extraction Means, Color Classification Means), Roundness Calculation Means, Result Display Means, Filter Means, Size Setting Means, Area Calculation Means)
31 control unit 32 input unit 33 storage unit 34 display unit 34a photograph display unit 34b inspection start button 34c setting button 34d inspection target display unit 34e result display unit 34f coordinate display unit 34g threshold value display unit 34h size display unit 34i registration button 34j close button 35 Operation part 36 Bus W wall

Claims (4)

An imaging device capable of photographing the outer wall of the building and outputting a photographed wall surface image of the outer wall,
An image processing device capable of reading a wall surface image output from the imaging device, processing the read wall surface image, and displaying the processed wall surface image on a display unit,
An outer wall inspection device capable of inspecting a condition of an outer wall of a building, wherein outer wall materials are fixed by a plurality of screws,
The image processing device,
Filling means for changing the pixels forming the image of the plurality of screws reflected in the wall surface image to a specific color,
Roundness calculating means for calculating the roundness of the images of the plurality of screws painted in the specific color by the painting means, respectively,
An outer wall inspection device, comprising: result display means for displaying a list of roundnesses of the images of the plurality of screws calculated by the roundness calculation means. The filling means is
Contour extraction means for extracting a contour pixel forming a contour of the image of the plurality of screws reflected in the wall surface image, based on a brightness difference with surrounding pixels,
The contour pixel extracted by the contour extraction unit and the pixel surrounded by the contour pixel are changed to a specific color, and the pixels outside the contour pixel are changed to another color different from the specific color. The outer wall inspection device according to claim 1, further comprising: The image processing device,
Filter means for selecting ones having a predetermined threshold value or more among the roundnesses of the images of the plurality of screws calculated by the roundness calculation means,
The selection display processing means for displaying the image of the screw corresponding to the roundness selected by the filter means in a state of being filled with the specific color in the result display means, The outer wall inspection device according to 1 or 2. The image processing device,
Size setting means capable of setting the size of the area projected on the wall surface image in the outer wall of the building,
When the size of the area is set to the size set by the size setting means, an area calculating means for calculating the area of the image of the plurality of screws painted in a specific color by the filling processing means,
The outer wall inspection device according to any one of claims 1 to 3, wherein the result display means displays a list of the areas of the images of the respective screws calculated by the area calculation means.

Images