JP2022176822A - Structure display device and structure display method - Google Patents

Abstract

To efficiently create management information that is useful for displaying an image captured in such a manner that a structure is divided into plural pieces.SOLUTION: A structure display device 100 being the structure display device 100 that displays a division image 33 captured in such a manner that a structure is divided by a plurality of imaging ranges comprises: a storage unit 30 which applies identification information 31 to each division image 33 and associates one or more pieces of management information 32 with the identification information 31 for management; and a control unit 20 which receives input of an extraction condition for the identification information 31 or in which the identification information 31 and the management information 32 are combined and extracts the division image 33 matching the extraction condition from the storage unit 30 to display the image on a display unit 40.SELECTED DRAWING: Figure 1

Description

The present invention relates to a structure display device and a structure display method.

Patent Literature 1 discloses a report creation device capable of efficiently creating an inspection report for wind power generation equipment. Further, paragraph 0079 of Patent Document 1 includes the following description.
"In the wind power generation facility inspection system 1, the report creation device 6 acquires an image captured by the camera 3 attached to the unmanned aircraft 2 in close proximity to the wind power generation facility 4, and records the flight record of the unmanned aircraft 2. The flight position information is acquired from the data, and the image and the flight position information are associated to generate collected data 73. Further, when an image including an observation target such as damage is selected, it is associated with the selected image. Based on the obtained flight position information, the observation target position, which is the position information of the damage (observation target), is obtained, and an inspection report 75 containing at least the image and information on the observation target position of the damage (observation target) included in the image is generated. Create and print."

JP 2018-181235 A

In the process of inspecting the wind power generation facility (site), the blades of the wind turbine are approached and photographed, and the damaged portion is inspected from the photographed image. Since many windmills are in operation at each site, there are many images taken, and it takes time to organize them and create reports.
Therefore, it is required to organize a large number of photographed images and utilize them for display for efficiently grasping the state of the blade.

Patent Literature 1 describes that a report creation device creates collected data in which an image and a flight position of an unmanned air vehicle are associated with each other based on time information. This collected data includes data items such as blade number, blade surface, image ID, image capturing position (flight position), capturing time, distance from the route (observation target position), damage number (damage ID), and the like.

However, the collected data of Patent Literature 1 is generated for the purpose of being written as character information in the inspection report as it is. On the other hand, effective management information for displaying a desired photographed image on a display screen that is useful for inspection by an inspector has not been created. For example, it is not possible to grasp which part of the entire blade the image of interest is by simply displaying a list of images in order of photographing time.

Accordingly, a main object of the present invention is to efficiently create management information useful for displaying images obtained by dividing a structure into a plurality of images.

In order to solve the above problems, the structure display device of the present invention has the following features.
The present invention is a structure display device for displaying divided images obtained by dividing a structure into a plurality of photographing ranges,
a storage unit that assigns identification information to each of the divided images and manages the identification information in association with one or more pieces of management information;
a control unit that receives an input of the identification information or an extraction condition combining the identification information and the management information, extracts the divided image that matches the extraction condition from the storage unit, and displays the split image on a display unit; characterized by
Other means will be described later.

According to the present invention, it is possible to efficiently create management information useful for displaying images obtained by dividing a structure into a plurality of images.

It is a block diagram which shows the structure display apparatus regarding this embodiment. FIG. 2 is an explanatory diagram of the content of messages exchanged within the structure display device of FIG. 1 relating to the present embodiment; It is a flowchart which shows the update procedure of the database regarding this embodiment. 4 is a flow chart showing a procedure for displaying divided images according to the embodiment; FIG. 3 is a three-dimensional view showing a wind turbine to be inspected according to the present embodiment; FIG. 3 is a three-dimensional view showing a coordinate system defined around a blade according to the embodiment; FIG. 3 is a three-dimensional view showing movement of the flight route of the unmanned air vehicle along the R-axis of the blade according to the present embodiment; FIG. 8 is a cross-sectional view taken along line R of FIG. 7 relating to the present embodiment; It is a modification of R sectional drawing of FIG. 8 regarding this embodiment. FIG. 3 is a three-dimensional view showing a spiral flight route according to the present embodiment; It is a table which shows the structure information regarding this embodiment. 4 is a table showing shooting information related to the present embodiment; It is a table which shows the inspection information regarding this embodiment. It is a table which shows the order information regarding this embodiment. It is a 1st display screen figure regarding this embodiment. It is a 2nd display screen figure regarding this embodiment. It is a 3rd display screen figure regarding this embodiment. It is a block diagram which shows the modification of the structure display apparatus of FIG. 1 regarding this embodiment. It is a 4th display screen figure regarding this embodiment. FIG. 10 is a display screen diagram when distinguishing between normal and abnormal inspection results according to the present embodiment.

An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a configuration diagram showing a structure display device 100. As shown in FIG.
The structure display device 100 has an input unit 10 , a control unit 20 , a storage unit 30 and a display unit 40 .
The storage unit 30 stores identification information 31 , management information 32 and divided images 33 . The display unit 40 refers to the identification information 31 and the management information 32 and displays a divided image 33 of the structure. The management information 32 is information input by the administrator, and includes, for example, the following information.
The structural information 32a (installation conditions including site information and machine number information, etc.) will be described later with reference to FIG.
The shooting information 32b (shooting date and time, etc.) will be described later with reference to FIG.
- Inspection information 32c (damage level, damaged location, etc.) will be described later in FIG.
The order information 32d (shooting order, etc.) will be described later with reference to FIG.

Hereinafter, blades 73 ( FIG. 5 ) of a windmill 70 captured by an unmanned flying vehicle are exemplified as a structure to be displayed by the structure display device 100 , but the structure is not limited to the blades 73 . If a large number of structures are installed and the structures have the same shape, they can be displayed by the structure display device 100 . For example, even a gas tank that stores liquefied natural gas can be used as a display object.

The input section 10 has a rule input section 11 and a divided image input section 12 .
The divided image input unit 12 receives input of the divided image 33 and its identification information 31 . The divided images 33 are individual images captured by dividing one blade 73 into a plurality of imaging ranges (imaging positions, imaging planes). The identification information 31 is information determined on a one-to-one basis with respect to one piece of image information (information of the divided image 33), and for example, is assigned a serial number to the image information.

The rule input unit 11 receives inputs of management information 32, extraction conditions, and screen display rules.
The extraction condition is a condition for extracting the split image 33 to be displayed this time from the set of split images 33 stored in the storage unit 30 . The screen display rule is a rule for displaying the blade 73 on the display unit 40 .
Instead of using the input unit 10 included in the structure display device 100, the structure display device 100 receives various input information such as extraction conditions from an external device connected to the structure display device 100 via a network. may be obtained.

The control unit 20 has an extraction unit 21 , a database update unit 22 , a rule setting unit 23 and a display control unit 24 .
The extraction unit 21 extracts the divided image 33 from the storage unit 30 .
The database updating section 22 updates the database stored in the storage section 30 .
The rule setting unit 23 sets screen display rules for displaying the blade 73 on the display unit 40 .
The display control unit 24 controls display contents on the display unit 40, such as the split image 33 of the blade 73, based on screen display rules.

FIG. 2 is an explanatory diagram of the content of messages exchanged within the structure display device 100 of FIG. The contents of the messages M1 to M7 will be clarified below along the flow charts of FIGS. 3 and 4. FIG.

FIG. 3 is a flow chart showing the procedure for updating the database.
The divided image input unit 12 transmits the divided image 33 and its shooting date and time to the control unit 20 (message M1). The database updating unit 22 receives the message M1 including the divided image 33 (S11).
The rule setting unit 23 receives the identification information 31 and the management information 32 corresponding to the divided image 33 of the message M1 from the rule input unit 11 as the message M2 (S12). The management information 32 of the message M2 is, for example, the structural information 32a (site name, device number, blade number, imaging plane) in FIG.

The database update unit 22 associates the divided image 33 and the shooting date and time of the message M1 with the identification information 31 and the management information 32 of the message M2 (S13). Then, the database updating unit 22 updates the database by notifying the storage unit 30 of the message M3 including the information associated in S13 (S14).

Note that the updating process of S14 includes a process of adding the identification information 31 to the structure information 32a stored in the storage unit 30. FIG.
For example, the identification information 31 corresponding to the 10 divided images 33 photographed for the photographing surface a of blade No. 1 provided in machine No. 1 of the A site is collectively added to the structure information 32a.
Also, if there are 5 wind turbines per site, 3 blades per wind turbine, and each blade is divided into 10 sections from the 4 directions, 5 x 3 ×4×10=600 divided images 33 are taken. In that case, there are 600 pieces of identification information 31 .

FIG. 4 is a flow chart showing the procedure for displaying divided images.
The rule setting unit 23 receives, from the set of divided images 33 stored in the storage unit 30, an extraction condition for extracting the divided image 33 to be displayed this time from the rule input unit 11 as a message M4. The extraction conditions include any of the following.
- The identification information 31 to be displayed is specified alone.
- In addition to the identification information 31 to be displayed, management information 32 (for example, site name, unit number) as a narrowing condition (AND condition) is specified. Selection of the management information 32 is exemplified by an input method in which candidates are displayed in a pull-down menu and the user selects one of the candidates.
- The management information 32 to be displayed is specified independently.

For example, the control unit 20 designates the following extraction conditions from the management information 32.
・From the structure information 32a of the management information 32, specify “Site name=A site”, “Unit No.=1 machine”, and “Blade No.=No.1” ・From the shooting information 32b of the management information 32, =June 10, 2017” The rule setting unit 23 instructs the extraction unit 21 to read out (the divided image 33 of) the corresponding identification information 31 from the storage unit 30 using the specified extraction condition as a search key. Send extraction conditions.

The extraction unit 21 notifies the storage unit 30 of the extraction condition as a message M5, and extracts the divided image 33 that meets the extraction condition as a message M6 (S21). Note that the message M5 may be specified by combining not only the identification information 31 of the extraction condition but also the order information 32d.
The display control unit 24 generates a screen using the divided image 33 received as the message M6 from the extraction unit 21 as a display image (S22). Then, the display control unit 24 causes the display unit 40 to display the extracted divided image 33 as a message M7 according to the screen display rule separately input from the rule input unit 11 .

The outline of the processing of the structure display device 100 has been described above with reference to FIGS. In the following, the management information 32 of the extraction conditions and the details of the display screen according to the screen display rule will be described. First, the shape of the windmill 70 to be inspected will be described in order to clarify the photographing surface included in the identification information 31 and the management information 32. FIG.

FIG. 5 is a three-dimensional view showing a wind turbine 70 to be inspected. The windmill 70 is composed of a nacelle 72 provided on a tower 71 and blades 73 fixed to the nacelle 72 . Each blade 73 receives the wind force and rotates along the rotation direction θ, and this rotational force is used to generate power.
Also, for the purpose of the following description, an R-axis is defined along the longitudinal direction of the blade 73 from the root of the nacelle 72 to the tip of the blade 73 .

FIG. 6 is a three-dimensional diagram showing a coordinate system defined around the blade 73. As shown in FIG.
The “R-axis” is the axis along the longitudinal direction of the blade 73 as explained in FIG. The R-axis is defined so as to follow the rotation direction θ regardless of which direction the rotation direction θ is directed (upward, horizontal, or ground).
The “R cross section” is a plane perpendicular to the R axis, and for the sake of convenience, one axis thereof is the X axis and the other axis is the Y axis.

The “image plane” defines from which direction of the R section the blade 73 is imaged.
For example, in FIG. 6, an imaging plane a for imaging the blade 73 with the angle of view directed in the positive Y-axis direction, an imaging plane b for imaging the blade 73 with the angle of view directed in the negative X-axis direction, and an imaging plane b for imaging the blade 73 with the angle of view directed in the negative X-axis direction. A total of 4 planes: the shooting plane c (not shown because it was hidden behind the shooting planes a and b) and the shooting plane d in the negative direction of the Y axis (not shown because it was hidden behind the shooting planes a and b) is shown as an example of the shooting surface of
Incidentally, the imaging planes around the blade may be provided four as shown in FIG. 6, or may be provided without being limited to four such as five. In any case, by photographing the blade 73 from a plurality of directions, it is possible to prevent occurrence of unphotographed portions.

FIG. 7 is a three-dimensional view showing movement of the flight route of the unmanned air vehicle (F1 during forward movement, F2 during return movement) along the R-axis of the blade 73. As shown in FIG. The unmanned flying object that has moved to the vicinity of the nacelle 72 moves to a reference position (r=1) near the nacelle 72 that is the first end of the blade 73 . This reference position is the starting point of the flight route F1.
Two pieces of information (No. 1, r=1, etc.) are added to one divided image 33 . First, the first additional information (No. 1, No. 2, . . . No. 20) is identification information 31 that is unique for each image shot at that shooting position. In other words, it can be said that the identification information 31 is information numbered according to the order in which images are captured.

On the other hand, the second additional information (r=1, 2, . This is position specific information. A smaller value of r indicates a position closer to the nacelle 72 , and a larger value of r indicates a position closer to the tip of the blade 73 .
That is, even at the same shooting position r=1, the identification information 31 (No. 1) is added when shooting the shooting plane a along the flight route F1, and the identification information 31 (No. 1) is added when shooting the shooting plane b along the flight route F2. (No.20) is attached.

As a result, by adding the shooting position information for each blade to the split image 33, even when the drone reciprocates, the entire blade can be correctly displayed on the screen. For example, two images (identification information 31=No. 1 and No. 20) with the same shooting position r=1 are displayed side by side.

The unmanned air vehicle that has reached the tip of the blade 73 similarly starts photographing along the return flight route F2 on the photographing surface b, which is different from the photographing surface a that has been photographed so far. That is, the unmanned flying object moves in a direction returning from the second end (No. 11 at the tip of the blade 73) far from the reference position to the first end (No. 20 at the base of the nacelle 72), and Take pictures at intervals.

8 is a cross-sectional view taken along the line R in FIG. 7. FIG.
The blade section (a straight line passing through points Px, P0, and Py) is positioned perpendicular to the rotation direction θ (a straight line passing through points Pu, P0, and Pd) of the blade 73, and the unmanned air vehicle rotates The blade is photographed from a position symmetrical with the direction θ (points P1 and P2 are line symmetric, points P3 and P4 are line symmetric).

In the description of FIG. 7, the flight route F1 is illustrated in which the same imaging plane a is continuously photographed while moving from the first end (r=1) to the second end (r=10). On the other hand, in FIG. 8, for the same R-axis imaging position (for example, r=3), by turning around the blade 73 along the R cross-section, images of imaging planes in four directions are acquired by imaging four times. A spiral flight route F (a three-dimensional view will be described later in FIG. 10) is shown. That is, photographing is performed in the order of position P1 for photographing surface a→position P2 for photographing surface b→position P3 for photographing surface c→position P4 for photographing surface d.

In the R sectional view, the blade 73 is approximated as a streamlined plate having a front surface and a back surface. Therefore, the unmanned flying object can photograph both surfaces by photographing the front surface of the blade 73 at positions P1 and P2 and photographing the rear surface of the blade 73 at positions P3 and P4.
Note that the surface of the blade 73 may be photographed at the position Pu instead of at the positions P1 and P2. Similarly, instead of photographing the back surface of the blade 73 at positions P3 and P4, it may be photographed at position Pd. As a result, the number of shots can be reduced from four to two.

However, if the unmanned flying object is moved to the position Pu, the position Pu is on the trajectory of the blade 73 (on a straight line in the rotation direction θ), so the position of the blade 73 will rotate from the current position P0 to the position Pu. And there is concern that it will collide with an unmanned aerial vehicle.
Normally, the blade 73 can be prevented from rotating by fixing the rotation direction θ of the blade 73 with a hydraulic brake during inspection work. However, if power supply to the hydraulic brake is interrupted when power is lost, unintended rotation of the blade 73 may not be suppressed.

Therefore, in FIG. 8, the circumferential direction θ of the blade 73 (a line passing through points Pu, P0, and Pd) and the longitudinal direction of the surface of the blade 73 in the R cross-sectional view (a line passing through points Px, P0, and Py) are perpendicular to each other at 90°, the imaging positions P1, P2, P3, and P4 are set so as to be about 45° from the perpendicular. In other words, the control device 21 sets the movement range (shooting position) of the unmanned flying object outside the range of the rotational direction θ of the blade 73 .
As a result, even if the current position of the blade 73 moves from P0 to Pu or Pd, collision of the blade 73 at the photographing position can be avoided.

FIG. 9 is a modification of the R cross-sectional view of FIG.
In FIG. 9, the cross section of the blade 73 is shifted from perpendicular to the rotation direction θ of the blade 73 . Also, the unmanned flying object photographs the blade from a position asymmetric with respect to the rotation direction θ.
Therefore, the observer of the wind turbine 70 sets the fixed angle of the blades 73 with respect to the nacelle 72 (the line passing through the points Px, P0, and Py) from the time of normal operation (perpendicular to the rotation direction θ) in FIG. so that it is shifted before inspection. Then, the unmanned flying object photographs the front surface of the blade 73 at the position P5 and the rear surface of the blade 73 at the position P6.
As a result, although it takes time to adjust the angle of the blade 73 before and after inspection, it is possible to avoid collision between the unmanned flying object and the blade 73 at the shooting position, and reduce the number of shots from four to two. can.

FIG. 10 is a three-dimensional view showing a spiral flight route F. FIG.
The unmanned air vehicle may traverse a flight route F gradually progressing along the R-axis from the root of the nacelle 72 to the tip of the blade 73 while spiraling around the blade 73 . As described with reference to FIG. 8, at the same imaging position (r=3, etc.), images of imaging planes in four directions are obtained by imaging a total of four times at positions P1, P2, P3, and P4.
As above, the flight route that reciprocates along the R-axis and the flight route that spirals around the R-axis have been described with reference to FIGS. The management information 32 will be described below with reference to FIGS. 11 to 14. FIG.

FIG. 11 is a table showing the structure information 32a. In the structure information 32a, the site name, machine number, blade number, photographing surface and identification information 31 are recorded in association with each other.
For example, on the premises of a certain wind power plant X, there are five windmills, each of which has three blades. In the structure information 32a in this case, the site name=wind farm X, unit number=1 to 5, and blade number=1 to 3.
In the database updating process (S14 in FIG. 3), the database updating unit 22 identifies ten divided images 33 captured for the imaging plane a of blade No. 1 provided in the first machine of the A site, for example. The information 31 (00001 to 00010) is collectively added to the identification information string of the structure information 32a.

FIG. 12 is a table showing the shooting information 32b. The shooting information 32b is information that associates the identification information 31 assigned to each divided image 33 with the shooting date and time input in S11 of FIG.
FIG. 13 is a table showing inspection information 32c.
The inspection information 32c is information that associates, for each identification information 31, the type of damage, the level of damage, and the location of damage displayed in the divided image 33 thereof.

FIG. 14 is a table showing the order information 32d.
The order information 32d is information that associates the imaging surface, the imaging order (No. 1 to No. 20 in FIG. 7), and the imaging position (r=1 to r=10 in FIG. 7). As a result, as shown in the flight route in FIG. 7 (F1 for forward movement, F2 for backward movement), even if the imaging plane of the blade is the same, even if the imaging order differs depending on the direction of the flight route, even if the imaging position is the same, the imaging plane a , b, the divided images 33 at the same photographing position can be extracted, and the structure can be displayed in the correct photographing order.

The display screen will be described below with reference to FIG.
FIG. 15 is a diagram of the first display screen.
In the extraction condition 201 of the screen 200, as the management information 32, a set of images of blade No. 1 of machine No. 1 at site A taken at the shooting date and time "June 10, 2017" is specified as a display target. This extraction condition 201 is also displayed inside the screen 200 .
In the screen display rule of the screen 200, the following is specified as the display layout of the image set. The X-axis is the horizontal axis and the Y-axis is the vertical axis.
・X-axis: Shooting plane (X-axis display interval: 15mm)
・Y-axis: Shooting position (Y-axis display interval: 0mm)

According to such a screen display rule, the display unit 40 divides the split image 33 of blade No. 1 that meets the extraction condition into four imaging planes and displays them in one screen 200 . That is, the display unit 40 arranges the divided images 33 of the imaging planes a to d in the X-axis direction in the screen 200, and arranges the divided images 33 in the Y-axis direction for each imaging position (r=1, 2, . . . , 10) of the blade 73. The divided divided images 33 are arranged. In order to arrange the divided images 33 regularly along the X-axis and the Y-axis in this way, the order information 32d is referred to (the same applies to FIG. 16 and subsequent figures).
An inspector viewing this screen 200 can easily grasp the degree of damage to the entire blade.

FIG. 16 is a diagram of the second display screen.
The extraction condition 211 on the screen 210 is that, as the management information 32, a set of images taken at the shooting position r=1 of blade No. 1 of Unit 1 at each site at the shooting date and time "June 10, 2017" is displayed. specified.
The screen display rule of the screen 210 specifies the following as the display layout of the image set.
・X-axis: Shooting plane (X-axis display interval: 15mm)
・Y-axis: Sight (Y-axis display interval: 10mm)
According to such a screen display rule, the display unit 40 divides the image information of the same shooting position for each site into one screen and displays it on the screen 210 . As a result, the inspector can easily confirm the relationship between the location of the wind turbine and the state of damage to the blades.

FIG. 17 is a diagram of a third display screen.
In the extraction condition 221 of the screen 220, as the management information 32, a set of images of blade No. 1 of the first machine at the site A photographed on the photographing surface a is specified as a display target.
The screen display rule of the screen 220 specifies the following as the display layout of the image set.
・X-axis: Shooting date and time (X-axis display interval: 15mm)
・Y-axis: Shooting position (Y-axis display interval: 0mm)

According to such a screen display rule, the display unit 40 divides and displays the image information of the imaging surface a having different imaging dates and times for the blade No. 1 in the first machine of the A site in one screen 220 . As a result, the inspector can easily confirm the process of blade damage, such as damage not occurring until June 10, 2019, but damage occurring on June 10, 2020.
Further, the display unit 40 may also display the damage description information 222 such as the degree of damage at level 2 together with the divided image 33 having the damaged portion 223 highlighted. This allows the inspector to grasp the effects of the damage.

FIG. 18 is a configuration diagram showing a modification of the structure display device 100 of FIG.
A structure display device 100 in FIG. 18 has a damage determination unit 25 added to the structure display device 100 in FIG.
The damage determination unit 25 determines the presence or absence of damage and the details of the damage with respect to the input divided image 33, and writes the determination result in the inspection information 32c. Therefore, the damage determination unit 25 compares the input divided image 33 with a normal image of the structure registered in advance in the storage unit 30 (a reference image indicating a normal state).
Based on this comparison result, the damage determination unit 25 determines the type of damage, the level of damage, and the damaged portion. The damaged portion is specified, for example, by the distance from the center of the nacelle 72 (imaging position r=1, 2, . . . , etc.).

FIG. 19 is a diagram of a fourth display screen.
The extraction condition 231 on the screen 230 designates, as the management information 32, a collection of images of the blade No. 1 of the first machine at the site A photographed on the photographing surface a as a display target.
The screen display rule of the screen 220 specifies the following as the display layout of the image set.
・X-axis: Normal image ・Captured image (X-axis display interval: 50mm)
・Y-axis: Shooting position (Y-axis display interval: 0mm)

According to such a screen display rule, the display unit 40 divides and displays the image information of the imaging surface a and the normal image for blade No. 1 in machine No. 1 at the A site within one screen. As a result, the inspector can easily check the damage state of the blade by comparing and displaying the image information and the normal image of the same imaging surface.
In addition, the display unit 40 may also display damage description information 232 such as the degree of damage at level 2 together with the divided image 33 having the damaged portion 233 highlighted. This allows the inspector to grasp the effects of the damage.

FIG. 20 is a display screen diagram for distinguishing between normal and abnormal inspection results.

The display control unit 24 displays, as a first display 241 in the screen 240, image information of the same imaging position of the same blade 73 taken at different times side by side. Under each display image, the shooting date such as April 1, 2018, the result of diagnostic processing (normal diagnostic result or abnormal diagnostic result), and the degree of damage in the case of abnormality are displayed.
In addition, the damage determination unit 25 may evaluate the diagnosis result and the degree of damage displayed on the screen 240 by a technique such as machine learning or AI as in the following procedure.
(Procedure 1) The damage determination unit 25 preliminarily stores a combination of past image information (divided image 33), diagnosis results and degree of damage (e.g., 100% evaluation, 5-level evaluation, etc.) as teacher data in a determination device. machine learning.
(Procedure 2) The damage determination unit 25 receives the divided image 33 to be determined this time, and inputs the divided image 33 to the determiner to evaluate the diagnosis result and the degree of damage corresponding to the divided image 33 .
Here, the blade 73, which was normal on April 1, 2018, suffered minor damage 241a on October 1, 2018, and progressed to severe damage 241b on April 1, 2019. is doing.

Therefore, the database update unit 22 stores the image information of the same imaging position in the storage unit 30 in chronological order for the image information determined as abnormal as the diagnosis result, and compares the divided images 33 of the same imaging position stored in the time series. The degree of progress of the damage state can be calculated. For example, if the damage state one year ago was 30% and the current damage state is 50%, the damage state in one year can be predicted to be 70%. Although an example of linear approximation is shown here as a method for evaluating the degree of progress of the damage state, other methods such as function approximation, machine learning, and AI may be used.

The display control unit 24 displays, as a second display 242 in the screen 240, image information obtained by photographing corresponding photographing positions (for example, r=5) of different blades 73 at the same time side by side.
Here, similar damage is found in the damage 242a of the A site Unit 1 and the damage 242b of the X site N unit. Thus, the first display 241 or the second display 242 makes it possible to easily grasp the damaged portion of the entire blade.

REFERENCE SIGNS LIST 10 input unit 11 rule input unit 12 divided image input unit 20 control unit 21 extraction unit 22 database update unit 23 rule setting unit 24 display control unit 25 damage determination unit 30 storage unit 31 identification information 32 management information 32a structure information 32b imaging information 32c Inspection information 32d Order information 33 Split image 40 Display unit 70 Windmill (wind power generation equipment)
71 tower 72 nacelle 73 blade 100 structure display device

In order to solve the above problems, the structure display device of the present invention has the following features.
The present invention is a structure display device for displaying divided images obtained by dividing a structure into a plurality of photographing ranges,
a storage unit that assigns identification information to each of the divided images and manages the identification information in association with one or more pieces of management information;
receiving an input of the identification information or an extraction condition combining the identification information and the management information, executing extraction processing for extracting the divided image that matches the extraction condition from the storage unit, and displaying the result of the extraction processing; and a control unit for displaying on the display unit ,
The extraction process includes
extracting the divided image corresponding to the identification information of the extraction condition when the management information is not included in the extraction condition;
When the management information is included in the extraction conditions, the divided images that match both the identification information of the extraction conditions and the management information of the extraction conditions are extracted.
Other means will be described later.

Claims (15)

A structure display device for displaying divided images obtained by dividing a structure into a plurality of imaging ranges,
a storage unit that assigns identification information to each of the divided images and manages the identification information in association with one or more pieces of management information;
a control unit that receives an input of the identification information or an extraction condition combining the identification information and the management information, extracts the divided image that matches the extraction condition from the storage unit, and displays the split image on a display unit; A structure display device characterized by: The control unit
extracting the divided image corresponding to the identification information of the extraction condition when the management information is not included in the extraction condition;
2. The method according to claim 1, wherein when the management information is included in the extraction condition, the divided images that match both the identification information of the extraction condition and the management information of the extraction condition are extracted. structure display device. 3. The structure display device according to claim 2, wherein the management information includes order information indicating an imaging order and an imaging position of the divided images. 4. The structure display device according to claim 3, wherein the management information includes structural information for specifying the structure and a photographing plane for photographing the structure. The control unit
extracting a set of divided images that match the structural information specified by the extraction condition;
4. A screen display rule for arranging the extracted divided images on a display screen is received, and the extracted divided images are arranged on the display screen according to the screen display rule according to the order information. The structure display device according to . The structure is a blade of a wind power generation facility, and the divided images are images of the blade taken from a plurality of imaging planes,
The control unit
extracting a set of the divided images that match the specific blades of the specific wind power generation equipment as the structural information specified by the extraction condition;
Display of arranging the extracted divided images according to the screen display rule for arranging the extracted divided images on the display screen for each shooting position and for each shooting surface of the order information according to the screen display rule. The structure display device according to claim 5, wherein the structure display device is a screen. The structure is a blade of a wind power generation facility, and the divided images are images of the blade taken from a plurality of imaging planes,
The control unit
extracting, as the structural information specified by the extraction condition, a set of divided images that match the specific blades of each of the wind power generation facilities;
a display screen in which the extracted split images are arranged in accordance with the screen display rule for arranging the extracted split images on the display screen for each wind power generation facility and for each shooting surface; The structure display device according to claim 5, characterized in that: The structure is a blade of a wind power plant,
The control unit
extracting a set of the divided images that match the specific blades of the specific wind power generation equipment as the structural information specified by the extraction condition;
Display of arranging the extracted divided images in accordance with the screen display rule for arranging the extracted divided images on the display screen for each photographing position of the order information and for each photographing date and time. The structure display device according to claim 5, wherein the structure display device is a screen. The structure is a blade of a wind power generation facility, and the storage unit stores a reference image showing a normal state of the blade,
The control unit
receiving the screen display rule for arranging the extracted divided image and the reference image on a display screen by arranging the extracted divided images and the reference image for each photographing position having the same sequence information, and arranging the extracted divided images according to the screen display rule; The structure display device according to claim 5, wherein the structure display device is a display screen. The structure is a blade of a wind power plant,
The control unit
Based on machine learning using past image information and the degree of damage, the degree of damage of the divided images is evaluated, stored in the storage unit, and arranged on the display screen for each shooting position with the same order information. 6. The structure display device according to claim 5, wherein the display screen is arranged in accordance with the screen display rule and the divided images and the degree of damage extracted in accordance with the screen display rule. The structure is a blade of a wind power plant,
The control unit
For the divided images determined to be abnormal as a result of diagnosis, the divided images at the same photographing position are stored in the storage unit in time series, and the divided images at the same photographing position stored in time series are compared to determine the degree of progress of the damage state. The structure display device according to claim 5, wherein the calculation is performed. The structure display device according to any one of claims 6 to 11, wherein the control section highlights the damaged portion on the display screen. 2. The method according to claim 1, wherein the control unit acquires the extraction condition from an input unit included in the structure display device or an external device connected to the structure display device via a network. Structure display device. The control unit receives input of the divided image and its shooting date and time, receives input of the identification information of the divided image and the management information, and stores the input information in association with each other in the storage unit. The structure display device according to claim 1, characterized in that: A structure display device for displaying divided images obtained by dividing a structure into a plurality of imaging ranges includes a storage unit and a control unit,
The storage unit assigns identification information to each of the divided images, and manages the identification information in association with one or more pieces of management information,
The control unit receives an input of the identification information or an extraction condition combining the identification information and the management information, extracts the divided image that matches the extraction condition from the storage unit, and displays the divided image on the display unit. A structure display method characterized by:

Images