JP2021173595A - Structure determination system - Google Patents

Abstract

To properly determine a state of a structure such as a bridge.SOLUTION: A structure determination system 10 is a system for determining a state of a structure and includes: a displacement acquisition section 11 for acquiring information indicating time series displacement of the structure; an extraction section 12 that extracts information of preset time length to use for determining the state of the structure on the basis of the acquired information from the information acquired by the displacement acquisition section 11; and a determination section 13 for determining the state of the structure on the basis of the information extracted by the extraction section 12.SELECTED DRAWING: Figure 1

Description

The present invention relates to a structure determination system for determining the state of a structure.

Conventionally, it has been proposed to identify the vibration of a bridge by analyzing a continuous image of the bridge and to grasp the progress of deterioration of the bridge (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2017-20739

However, it is not always possible to determine the appropriate state of the structure such as deterioration of the bridge simply by using the vibration information obtained from the continuous image.

The present invention has been made in view of the above, and an object of the present invention is to provide a structure determination system capable of appropriately determining the state of a structure such as a bridge.

In order to achieve the above object, the structure determination system according to the present invention is a structure determination system that determines the state of a structure, and is a displacement acquisition unit that acquires information indicating the time-series displacement of the structure. An extraction unit that extracts information of a preset time length used for determining the state of the structure based on the information acquired by the displacement acquisition unit, and a structure based on the information extracted by the extraction unit. A determination unit for determining the state of an object is provided.

In the structure determination system according to the present invention, information of a preset time length used for determining the state of the structure is extracted from the information indicating the time-series displacement of the structure based on the information. The state of the structure is determined based on the information. Therefore, according to the structure determination system according to the present invention, the determination can be made based on the information appropriate for determining the state of the structure, and as a result, the state of the structure can be appropriately determined.

According to the present invention, the state of a structure such as a bridge can be appropriately determined.

It is a figure which shows the structure of the structure determination system which concerns on embodiment of this invention. It is a graph which shows the displacement amount of a structure in time series. It is a figure which shows typically the autoencoder used for the determination of a structure. It is a figure which shows typically the information after compression generated by an autoencoder. It is a figure for demonstrating the determination using the information after compression. It is a flowchart which shows the process executed by the structure determination system which concerns on embodiment of this invention. It is a figure which shows the hardware structure of the structure determination system which concerns on embodiment of this invention.

Hereinafter, embodiments of the structure determination system according to the present invention will be described in detail together with the drawings. In the description of the drawings, the same elements are designated by the same reference numerals, and duplicate description will be omitted.

FIG. 1 shows the structure determination system 10 according to the present embodiment. The structure determination system 10 is a system (device) that determines (estimates, detects, evaluates) the state of a structure. The structure to be determined is, for example, a bridge 30 as shown in FIG. However, the structure to be determined is not limited to the bridge 30, and may be any structure such as a building. The state of the structure to be determined is, for example, whether or not an abnormality has occurred in the structure (for example, whether or not deterioration has occurred). Further, when the structure determination system 10 determines that an abnormality has occurred in the structure, the structure determination system 10 may determine (estimate, detect, evaluate) the location where the abnormality has occurred (for example, the deteriorated portion). The result of the determination by the structure determination system 10 is used, for example, for determination of reinforcement or repair of the structure. In the following description, the structure to be determined will be described as the bridge 30.

The structure determination system 10 is realized by, for example, a server device, that is, a computer. Further, the structure determination system 10 may be realized by a plurality of server devices, that is, a computer system. The structure determination system 10 has a communication function and can transmit and receive information to and from other devices.

The structure determination system 10 determines the state of the bridge 30 using a moving image captured (photographed) by the camera 20. The camera 20 is an imaging device that captures an image of the bridge 30 to be determined and acquires a moving image of the bridge 30. The camera 20 is fixedly installed in advance at a position where the bridge 30 can be imaged (for example, a point several meters to several tens of meters away from the bridge 30). As the camera 20, a well-known camera capable of taking an image with a resolution that can be used for determining the state of the bridge 30 can be used. The structure determination system 10 and the camera 20 can transmit and receive information to and from each other via a wired, wireless, or both communication networks. The camera 20 images the bridge 30 at a preset frame rate (fps), and transmits the captured moving image to the structure determination system 10. The frame rate is, for example, 100 fps. Alternatively, the frame rate may be other than 100 fps, for example, 30 fps. The camera 20 may be a component of the structure determination system. That is, in this case, the structure determination system according to the present invention includes the structure determination system 10 and the camera 20 shown in FIG. Further, the structure determination system 10 and the camera 20 may be an integrated device (for example, a smartphone).

As shown in FIG. 1, the structure determination system 10 is functionally configured to include a displacement acquisition unit 11, an extraction unit 12, and a determination unit 13.

The displacement acquisition unit 11 is a functional unit that acquires information indicating the time-series displacement of the bridge 30, which is the structure to be determined. The displacement acquisition unit 11 may acquire information indicating time-series displacements of a plurality of locations of the bridge 30 which is a structure to be determined. The displacement acquisition unit 11 may acquire a moving image of the bridge 30 which is a structure to be determined, and calculate the time-series displacement of the structure based on the acquired moving image.

The determination of the state of the bridge 30 by the structure determination system 10 is performed based on the displacement (fluctuation) that occurs in the bridge 30. For example, when a vehicle 40 such as an automobile passes over a bridge 30, the bridge 30 vibrates according to the passage of the vehicle 40, causing displacement of the bridge 30. The state of the bridge 30 is determined based on the displacement of the bridge 30 due to the vibration. When an abnormality occurs in the bridge 30, it is assumed that the displacement of the location where the abnormality occurs changes. In the present embodiment, this change is detected and the state of the bridge 30 is determined. The displacement of the bridge 30 due to vibration is a minute change (about 3 mm when a large special vehicle is run), and it is difficult for the human eye to detect it. It should be noted that the factor causing the displacement of the bridge 30 does not necessarily have to be the passage of the vehicle 40. When the structure to be determined is something other than the bridge 30, the determination may be made based on the displacement of the structure caused by some factor.

The displacement acquisition unit 11 acquires information indicating the displacement as follows, for example. The displacement acquisition unit 11 receives and acquires a moving image of the bridge 30 transmitted from the camera 20. The displacement acquisition unit 11 may acquire information indicating the displacement by using only a part of the received moving image in a specific time zone. The time zone is, for example, a time zone in which one vehicle 40 passes over the bridge 30 and vibration occurs in the bridge 30, that is, when the vehicle 40 travels one way on the bridge 30. One time zone corresponds to one timing related to the displacement of the bridge 30. It should be noted that during the time period when the plurality of vehicles 40 pass over the bridge 30 at the same time, the vibration of the bridge 30 becomes complicated according to the passage of the plurality of vehicles 40, so that the information indicating the displacement is not used for acquisition. May be good. The time zone may be specified by the administrator of the structure determination system 10 or the like, or may be (automatically) specified by the structure determination system 10 based on a conventional technique such as object recognition.

The displacement acquisition unit 11 calculates a value indicating the displacement of the bridge 30 at a plurality of locations from the received moving image. The location (position, measurement point) of the bridge 30 for calculating the displacement is fixedly set in advance as the ROI (Region of Interest). As shown in FIG. 1, the displacements are calculated at a plurality of locations CH1, CH2, CH3, CH4 of the bridge girder at predetermined intervals (for example, even intervals) in the longitudinal direction of the bridge girder of the bridge 30. CH5 (more specifically, the lower end of the bridge girder). It should be noted that the locations for calculating the displacement do not necessarily have to be set as described above, and may be set at arbitrary locations in any number so that the state of the structure can be appropriately determined according to the structure. ..

Since the camera 20 is fixedly set, the locations CH1, CH2, CH3, CH4, and CH5 of the bridge 30 for calculating the displacement are generally corresponding to the locations CH1, CH2, CH3, CH4, and CH5 in the moving image. It appears in a specific position. The displacement acquisition unit 11 refers to a plurality of locations CH1, CH2, CH3, CH4, CH5 of the bridge 30 for detecting the displacement of each frame (image) constituting the moving image, and the displacement acquisition unit 11 is an image from the frame that is a reference for detecting the displacement. The displacement is calculated as a displacement amount (movement amount) which is information indicating displacement (value indicating displacement). The frame that serves as a reference for detecting the displacement is, for example, a frame in a time zone when the vehicle 40 is not passing. The displacement amount may be a displacement amount only in a specific direction used for determining the state, for example, in the case of the bridge 30 shown in FIG. 1, a displacement amount only in the vertical (vertical) direction with respect to the horizontal plane.

The displacement amount can be calculated in sub-pixel units by a conventional technique (for example, a block matching method or a digital image correlation method). When the displacement amount is calculated for each frame constituting the moving image, for example, the time-series displacement amount as shown in the graph of FIG. 2 can be obtained for each location CH1, CH2, CH3, CH4, CH5.

The displacement acquisition unit 11 calculates the moving average of the displacement amount in the time series for each time corresponding to each frame for each location CH1, CH2, CH3, CH4, CH5, and obtains the value of the moving average in the time series. It may be information indicating the time-series displacement of the bridge 30. That is, the low-pass filter may be applied to the displacement amount in the time series, and the displacement amount in the time series after the application of the low-pass filter may be used as the displacement amount used for determining the state. By applying the low-pass filter, the displacement amount of each location CH1, CH2, CH3, CH4, CH5 can be made a static displacement amount.

The displacement acquisition unit 11 may calculate the time-series displacement amount used for determining the state of each location CH1, CH2, CH3, CH4, CH5 for each passage of the vehicle 40. That is, the displacement acquisition unit 11 may calculate the amount of displacement in time series for each location CH1, CH2, CH3, CH4, CH5 for each time zone of a plurality of timings. For example, the displacement amount at a plurality of timings in a short period (for example, one day) for determining the state of the bridge 30 may be calculated. By using the displacement amounts of a plurality of timings, the determination can be made more accurately. The displacement acquisition unit 11 outputs the calculated time-series displacement amount of each location CH1, CH2, CH3, CH4, CH5 to the extraction unit 12 as information indicating the time-series displacement of the bridge 30.

The extraction unit 12 is a functional unit that extracts information of a preset time length used for determining the state of the bridge 30, which is the structure to be determined, from the information acquired by the displacement acquisition unit 11. be. The extraction unit 12 may extract information on a preset time length used for determining the state of the bridge 30 based on the time when the displacement is maximum and exceeds a predetermined threshold value.

In the structure determination system 10, a preset fixed number of continuous frame displacements, that is, a fixed length displacement amount is used to determine the state of the bridge 30. The extraction unit 12 inputs the time-series displacement amount for each location CH1, CH2, CH3, CH4, CH5 from the displacement acquisition unit 11, and the time-series displacement amount for each location CH1, CH2, CH3, CH4, CH5. From, the continuous displacement amount of the fixed length used for the determination is extracted.

The extraction unit 12 detects a peak value (for example, the displacement amount m in FIG. 2) in which the displacement amount is maximum and exceeds a predetermined threshold value among the time-series displacement amounts input from the displacement acquisition unit 11. The maximum displacement amount is, for example, a displacement amount that is differentiated to 0 and is larger than the front-back displacement amount. The threshold value is, for example, the third quartile of the displacement amount in the time series. However, other threshold values may be set. As shown in FIG. 2, the extraction unit 12 extracts the displacement amount of the range r for the front and rear N frames around the frame (time) of the detected peak value m as the continuous displacement amount of the fixed length used for the determination. .. N is, for example, about 1000. When N is about 1000 and the frame rate is 100 fps, the time-series displacement amount for about 20 seconds is extracted. Note that N does not necessarily have to be set as described above, and may be set according to the frame rate, the accuracy of discrimination, and the like.

The displacement amount m that becomes the above peak value usually applies the largest load to the locations CH1, CH2, CH3, CH4, and CH5, that is, directly above the locations CH1, CH2, CH3, CH4, and CH5. This is the amount of displacement when the vehicle 40 is positioned. In this case, the time at which the displacement amount m, which is the peak value, is calculated (measured) is slightly different for each location CH1, CH2, CH3, CH4, CH5 according to the movement of the vehicle 40. Therefore, the time in the range of the fixed length displacement amount to be extracted is slightly different for each location CH1, CH2, CH3, CH4, CH5. As shown in FIG. 3, the extraction unit 12 extracts a fixed-length displacement amount for each location CH1, CH2, CH3, CH4, CH5 for one time zone related to the moving image in this way.

When the displacement acquisition unit 11 calculates the time-series displacement amount for each passage of the vehicle 40, the extraction unit 12 has a fixed length displacement amount for each location CH1, CH2, CH3, CH4, CH5 each time the vehicle 40 passes. May be extracted. That is, the extraction unit 12 may extract a fixed-length displacement amount for each location CH1, CH2, CH3, CH4, CH5 at each of a plurality of timing time zones. For example, as described above, the displacement amounts of fixed lengths at a plurality of timings in a short period (for example, one day) for determining the state of the bridge 30 may be extracted. By using the displacement amounts of a plurality of timings, the determination can be made more accurately. The extraction unit 12 outputs the displacement amount of the fixed length extracted for each location CH1, CH2, CH3, CH4, CH5 to the determination unit 13.

The displacement acquisition unit 11 and the extraction unit 12 may calculate (extract) the displacement amount of the fixed length as a reference for the determination in advance by the time when the state of the bridge 30 is determined. The displacement amount of the fixed length for the judgment reference is, for example, a state in which the bridge 30 is not deteriorated and is normal (healthy) (for example, immediately after the bridge 30 is completed, or by a physical inspection of the bridge 30. Is the amount of displacement of the fixed length when it is determined to be normal). The displacement amount of the fixed length in the state where the bridge 30 is normal is also calculated (extracted) in the same manner as described above. That is, in that state, the bridge 30 is imaged by the camera 20, and the displacement amount of the fixed length of each location CH1, CH2, CH3, CH4, CH5 is calculated (extracted) from the moving image obtained by the imaging.

At this time (reference time), the bridge 30 and the location CH1, CH2, CH3, CH4, CH5 and the bridge 30 and the location CH1, CH2, CH3, CH4, CH5 at the time of determination are the same. However, the bridge 30 and the location CH1, CH2, CH3, CH4, CH5 at the time of reference may be different from the bridge 30 and the location CH1, CH2, CH3, CH4, CH5 at the time of determination. Further, also at the reference time, the displacement amount of the fixed length at a plurality of timings may be calculated. The extraction unit 12 also outputs the extracted information indicating the displacement amount of the fixed length for the determination reference to the determination unit 13. The state of the bridge 30 related to the displacement amount of the fixed length for the determination reference may be other than the normal state.

The determination unit 13 is a functional unit that determines the state of the bridge 30, which is the structure to be determined, based on the information extracted by the extraction unit 12. The determination unit 13 may compress the information extracted by the extraction unit 12 by the autoencoder and determine the state of the bridge 30 based on the compressed information. That is, the determination unit 13 may determine the state of the bridge 30 by AI (artificial intelligence). The determination unit 13 may determine the state of the bridge 30 by using a reference set in advance based on the information indicating the time-series displacement of the bridge 30 in the predetermined state of the bridge 30. The determination unit 13 inputs information used for determination from the extraction unit 12, and determines the state of the bridge 30 as follows using the input information.

The determination unit 13 determines, for example, based on the information indicating the displacement amount of the fixed length related to one timing extracted by the extraction unit 12. As shown in FIG. 3, when the information indicating the displacement amount of the fixed length is extracted at each of the five locations CH1, CH2, CH3, CH4, CH5 of the bridge 30, the information indicating the displacement amount of the five fixed lengths is extracted. Judgment is made based on.

The determination unit 13 compresses this information and determines the state of the bridge 30 based on the compressed information. As shown in FIG. 3, a dimensional compression technique using the autoencoder 100 is used for information compression. The autoencoder 100 is a neural network that is learned to input a fixed-length displacement amount and output the same fixed-length displacement amount. The autoencoder 100 may include a two-dimensional convolution layer. The autoencoder 100 includes an input layer 110, an intermediate layer 120, and an output layer 130. The input layer 110 is provided with neurons that input a fixed-length displacement amount. For example, in the input layer, the number of places CH1, CH2, CH3, CH4, CH5 where the displacement amount is calculated (5 (CH) in the example shown in FIG. 3) × the number of displacement amounts per place (time length, frame). (Number of) (a matrix that summarizes the fixed-length displacement vectors for each location CH1, CH2, CH3, CH4, CH5) is input, and the number of neurons corresponding to the elements of the vector is provided. The output layer 130 is provided with neurons that output a fixed-length displacement amount. Similar to the input layer 110, the output layer 130 is also provided with a number of neurons corresponding to the elements of the vector.

The intermediate layer 120 includes a layer 120a for acquiring compressed information. The layer 120a is provided with fewer neurons than the number of input layers 110 and output layers 130. For example, the number of neurons in the layer 120a may be 2, 3, 8 or 32. The value of the layer 120a is used as the information obtained by compressing the displacement amount of the fixed length. The compressed information becomes a vector consisting of elements of the number of neurons contained in the layer 120a. The intermediate layer 120 may include a plurality of layers. That is, the autoencoder 100 may be obtained by deep learning. Further, as the autoencoder 100 used for compressing information, a variational autoencoder (VAE: Variational Autoencoder) may be used instead of the above-mentioned one.

The determination unit 13 performs machine learning using the information input from the extraction unit 12 indicating the displacement amount of the fixed length for the determination reference to generate the autoencoder 100. The fixed-length displacement amount used for machine learning is not information related to all timings input from the extraction unit 12, but information related to some timings (for example, half of all timings). The determination unit 13 stores the generated autoencoder 100.

As the displacement amount of the fixed length for the determination reference used for the generation of the autoencoder 100, the one related to the moving image captured under various conditions may be used. For example, a fixed-length displacement amount for a determination in which at least one of the bridge 30 and the imaging condition is different may be used. Imaging conditions are, for example, season, weather and temperature. In this case, imaging by the camera 20 is also performed for each condition. By using the information under various conditions in this way, it is possible to determine the state of the bridge 30 that is robust to any bridge 30 or to imaging conditions such as any season, weather, and temperature.

The determination unit 13 uses the generated autoencoder 100 to generate compressed information for determination reference. The determination unit 13 uses the information input from the extraction unit 12 indicating the displacement amount of the fixed length for the determination reference that was not used for the generation of the autoencoder 100, and the compressed information for the determination reference. To generate. As shown in FIG. 4, the determination unit 13 inputs information indicating a fixed-length displacement amount for determination reference to the autoencoder 100, performs a calculation according to the autoencoder 100, and acquires compressed information. The value of the layer 120a for this is extracted and used as the compressed information for the judgment reference. As shown in FIG. 4, the compressed information RC becomes the coordinates (vector) of several dimensions of the neurons included in the layer 120a for acquiring the compressed information. That is, the compressed information RC is a mapping of a fixed-length displacement amount of the neurons contained in the layer 120a to several-dimensional coordinates. Information input to the autoencoder 100 that is similar to each other is mapped to close coordinates. When there is a plurality of information indicating the displacement amount of the fixed length for the judgment reference used for generating the information after compression, as shown in FIG. 5, after compression for each information indicating the displacement amount of the fixed length. Generate information RC. The determination unit 13 generates the compressed information RC for the determination reference in advance by the time the determination of the state of the bridge 30 is performed.

It should be noted that a plurality of autoencoders 100 having different numbers of neurons in the layer 120a for acquiring compressed information (for example, autoencoders 100 having the numbers 2, 3, 8 and 32) are generated, and one of them is generated. May be used as the autoencoder 100 used for the determination. For example, the autoencoder 100 in which the variation of the vector which is the information RC after a plurality of compressions is small may be used for the determination. The vector variation may be calculated by a conventional statistical method. This is because it is desirable that the maps corresponding to the normal state of the bridge 30 have coordinates close to each other.

Further, the determination unit 13 generates the compressed information at the time of determination by using the information indicating the displacement amount of the fixed length at the time of determination input from the generated autoencoder 100 and the extraction unit 12. Similar to the compressed information RC for the determination reference, as shown in FIG. 4, the determination unit 13 inputs information indicating the amount of displacement of the fixed length at the time of determination to the autoencoder 100, and inputs the information to the autoencoder 100. According to the calculation, the value of the layer 120a for acquiring the compressed information is extracted and used as the compressed information DC at the time of determination. As shown in FIG. 4, the compressed information DC at the time of determination also becomes the coordinates (vector) of several dimensions of the neurons included in the layer 120a for acquiring the compressed information. As shown in FIG. 5, the compressed information DC at the time of determination and the compressed information RC for determination reference are represented as points on the same coordinate axis.

The determination unit 13 makes a determination using these compressed information RC and DC. If the state of the bridge 30 at the time of reference and the state of the bridge 30 at the time of judgment are the same, that is, if the bridge 30 at the time of judgment is normal, the information RC after compression for the judgment reference and the compression at the time of judgment The latter information DC is located at close coordinates on the coordinate axes. On the other hand, if the state of the bridge 30 at the time of reference and the state of the bridge 30 at the time of judgment are different, that is, if there is an abnormality in the bridge 30 at the time of judgment, the compressed information RC for the judgment reference The compressed information DC at the time of determination is located at far coordinates on the coordinate axes.

The determination unit 13 determines the state of the bridge 30 by comparing the compressed information RC for determination reference with the compressed information DC at the time of determination. For example, the determination unit 13 calculates the average of the compressed information RC for a plurality of references, and calculates the distance on the coordinate axis between the calculated average and the compressed information DC at the time of determination. The distance corresponds to the degree of similarity of the vibration patterns of the bridge 30 between the reference time and the judgment time. The smaller the distance, the greater the similarity, and the larger the distance, the smaller the similarity. The determination unit 13 compares the calculated distance with the preset and stored threshold value. If the calculated distance is equal to or greater than the threshold value, the determination unit 13 determines that the bridge 30 has an abnormality. If the calculated distance is less than the threshold value, the determination unit 13 determines that the bridge 30 is normal, that is, that no abnormality has occurred in the bridge 30. That is, if the coordinates after mapping at the time of determination deviate from the cluster of coordinates after mapping as a reference, it is determined to be abnormal, and if it does not deviate, it is determined that it is not abnormal.

Further, when the information DC after compression at the time of determination at a plurality of timings (for example, a plurality of timings in a day for determining the state of the bridge 30) is calculated, the determination unit 13 determines the information DC after each compression. A comprehensive determination may be made from the above determination. For example, when the determination unit 13 determines that the bridge 30 has an abnormality in the information DCs after compression of a certain ratio or more or a certain number or more among the judgments for the information DCs after each compression, the comprehensive judgment result. It may be determined that the bridge 30 has an abnormality.

Further, when it is determined that an abnormality has occurred in the bridge 30, the determination unit 13 has a portion corresponding to the determined state of the bridge 30, that is, a portion where the abnormality of the bridge 30 has occurred (for example, a deteriorated portion). ) May be determined. For example, the determination unit 13 may determine the state of each location CH1, CH2, CH3, CH4, CH5 in the same manner as described above by using the displacement amount of the fixed length for each location CH1, CH2, CH3, CH4, CH5. .. Further, using the displacement amount of the fixed length for each of the locations CH1, CH2, CH3, CH4, and CH5, or using other information, the location corresponding to the state of the bridge 30 is determined by a method other than the above. May be good.

The determination unit 13 outputs information indicating the determination result. The determination result includes whether or not the bridge 30 has deteriorated. Further, when determining the deteriorated portion of the bridge 30, the determination result includes the deteriorated portion when the bridge 30 is deteriorated. The determination unit 13 transmits, for example, the information to a terminal connected to the structure determination system 10 and displays the information. The output by the determination unit 13 is referred to by the user, for example, and is used for determining reinforcement or repair of the structure as described above. The output by the determination unit 13 may be output to a device other than the above, or may be performed in a form other than the above. The above is the configuration of the structure determination system 10 according to the present embodiment.

Subsequently, the process executed by the structure determination system 10 according to the present embodiment (operation method performed by the structure determination system 10) will be described with reference to the flowchart of FIG. First, the moving image captured by the camera 20 is transmitted from the camera 20 to the structure determination system 10, and is received and acquired by the displacement acquisition unit 11 (S01). The acquired moving image includes a moving image at the time of normal, which is a reference timing, and a moving image at the time of determination. That is, the imaging in the normal state and the imaging in the determination time are performed at different timings. Subsequently, the displacement acquisition unit 11 calculates the time-series displacement amount of the bridge 30 based on the moving image (S02). Subsequently, the extraction unit 12 extracts a fixed-length displacement amount used for determining the state of the bridge 30 from the information indicating the time-series displacement amount (S03). The fixed-length displacement amount extracted here includes the one at the time of normal and the one at the time of determination. The extraction of the fixed-length displacement amount at the time of normal operation and the extraction of the fixed-length displacement amount at the time of determination may be performed at different timings. Further, it is not necessary to extract the displacement amount of the fixed length at the normal time every time, and it may be performed once before the determination.

Subsequently, the determination unit 13 determines the state of the bridge 30 based on the displacement amounts of these fixed lengths (S04). For the determination of the state of the bridge, as described above, the autoencoder 100 is generated based on the displacement amount of the fixed length for the determination reference, and the compressed information RC for the determination reference generated by the autoencoder 100. Is compared with the compressed information DC at the time of determination. It should be noted that the generation of the autoencoder 100 and the generation of the compressed information RC for the determination reference using the autoencoder 100 do not have to be performed every time, and may be performed once before the determination. Subsequently, the determination unit 13 outputs information indicating the determination result of the state of the bridge 30 (S05). The above is the process executed by the structure determination system 10 according to the present embodiment.

As described above, in the present embodiment, from the information indicating the time-series displacement amount of the bridge 30 which is the structure to be determined, the information indicating the displacement amount of the fixed length used for the determination is extracted based on the information. , The state of the bridge 30 is determined based on the extracted information. Therefore, according to the present embodiment, the determination can be made based on the information appropriate for determining the state of the bridge 30, and as a result, the state of the bridge 30 can be appropriately determined.

Specifically, by setting the information used for the determination as the displacement amount of the fixed length as described above, the information used for the determination can be collectively input to the autoencoder 100 at a time, and the information used for the determination can be appropriately input. It is possible to make a judgment in consideration. For example, it is possible to make a more appropriate determination as compared with a determination method in which the displacement amount in the time series is sequentially input to the determination model. Further, by inputting the information used for the determination together (for example, as described above, one matrix in which the vectors of the displacement amounts of the fixed lengths of the locations CH1, CH2, CH3, CH4, CH5 are input is input. In), the learning time of machine learning can be reduced and the possibility of learning convergence can be improved. In order to simply obtain a fixed-length displacement amount, for example, instead of extracting the time length used for determination based on the displacement amount, the time length of the moving image for calculating the displacement amount is set to a constant length. It is also possible to displace. However, in this case, there is a possibility that the displacement amount in the time series includes a displacement amount that is not suitable for the determination, and there is a possibility that an appropriate determination cannot be made.

Further, as in the present embodiment, information indicating the displacement amount of the fixed length may be extracted with reference to the time when the displacement amount is maximum and exceeds a predetermined threshold value. By extracting in this way, for example, when the displacement due to the passage of the vehicle 40 as described above is used, the displacement amount of the fixed length used for the determination can be made appropriate. However, the extraction of the displacement amount of the fixed length does not have to be performed as described above, and may be performed by any method depending on the structure to be determined and the displacement.

Further, as in the present embodiment, the determination may be made using the time-series displacement amounts for a plurality of locations of the structure. According to this configuration, more accurate determination can be made. However, it is not always necessary to use the displacement amounts at a plurality of locations, and the determination may be performed using the displacement amounts at one location.

Further, the determination may be performed using the information compressed by the autoencoder 100 as in the present embodiment. According to this configuration, for example, it is possible to determine a large amount of time-series displacement amount information of about 5 × 2000 as a vector having several to several tens of dimensions. Therefore, the processing load of the structure determination system 10 by the determination process does not become excessive, or the determination can be performed at high speed. However, the determination using the displacement amount of the fixed length may be performed by any method other than the method of compressing the information as described above.

Further, as in the present embodiment, for the determination of the structure, for example, a preset standard is used based on the information indicating the time-series displacement of the structure in a predetermined state such as normal time. It may be done. According to this configuration, it is possible to make an appropriate determination based on a predetermined state of the structure such as in a normal state. However, it is not always necessary to use a predetermined state as a reference.

Further, as in the present embodiment, the time-series displacement amount of the structure may be calculated based on the moving image of the structure to acquire the information indicating the time-series displacement of the structure. According to this configuration, information indicating the displacement in time series can be easily and surely obtained, and the state of the structure can be easily and surely determined. However, the displacement amount does not need to be calculated based on the moving image. For example, sensors (for example, displacement sensors or strain gauges) that detect the amount of displacement may be provided at a plurality of locations in the structure, and the amount of displacement detected by the sensors may be used. Alternatively, the structure determination system 10 may acquire the time-series displacement amount of the structure calculated by an apparatus other than the structure determination system 10 as information indicating the time-series displacement of the structure.

The block diagram used in the description of the above embodiment shows a block of functional units. These functional blocks (components) are realized by any combination of at least one of hardware and software. Further, the method of realizing each functional block is not particularly limited. That is, each functional block may be realized by using one physically or logically connected device, or directly or indirectly (for example, two or more physically or logically separated devices). , Wired, wireless, etc.) and may be realized using these plurality of devices. The functional block may be realized by combining the software with the one device or the plurality of devices.

Functions include judgment, decision, judgment, calculation, calculation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, solution, selection, selection, establishment, comparison, assumption, expectation, and assumption. Broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, assigning, etc., but limited to these I can't. For example, a functional block (constituent unit) for functioning transmission is called a transmitting unit or a transmitter. As described above, the method of realizing each of them is not particularly limited.

For example, the structure determination system 10 according to the embodiment of the present disclosure may function as a computer that performs information processing of the present disclosure. FIG. 7 is a diagram showing an example of the hardware configuration of the structure determination system 10 according to the embodiment of the present disclosure. The structure determination system 10 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

In the following description, the word "device" can be read as a circuit, a device, a unit, or the like. The hardware configuration of the structure determination system 10 may be configured to include one or more of the devices shown in the figure, or may be configured not to include some of the devices.

Each function in the structure determination system 10 is such that the processor 1001 performs an operation by loading predetermined software (program) on the hardware such as the processor 1001 and the memory 1002, and controls the communication by the communication device 1004. It is realized by controlling at least one of reading and writing of data in the memory 1002 and the storage 1003.

Processor 1001 operates, for example, an operating system to control the entire computer. The processor 1001 may be configured by a central processing unit (CPU) including an interface with a peripheral device, a control device, an arithmetic unit, a register, and the like. For example, each function in the structure determination system 10 described above may be realized by the processor 1001.

Further, the processor 1001 reads a program (program code), a software module, data, and the like from at least one of the storage 1003 and the communication device 1004 into the memory 1002, and executes various processes according to these. As the program, a program that causes a computer to execute at least a part of the operations described in the above-described embodiment is used. For example, each function in the structure determination system 10 may be realized by a control program stored in the memory 1002 and operating in the processor 1001. Although the above-mentioned various processes have been described as being executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. Processor 1001 may be implemented by one or more chips. The program may be transmitted from the network via a telecommunication line.

The memory 1002 is a computer-readable recording medium, and is composed of at least one such as a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and a RAM (Random Access Memory). May be done. The memory 1002 may be referred to as a register, a cache, a main memory (main storage device), or the like. The memory 1002 can store a program (program code), a software module, or the like that can be executed to perform information processing according to the embodiment of the present disclosure.

The storage 1003 is a computer-readable recording medium, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, an optical magnetic disk (for example, a compact disk, a digital versatile disk, a Blu-ray). It may consist of at least one (registered trademark) disk), smart card, flash memory (eg, card, stick, key drive), floppy (registered trademark) disk, magnetic strip, and the like. The storage 1003 may be referred to as an auxiliary storage device. The storage medium included in the structure determination system 10 may be, for example, a database, a server, or other suitable medium including at least one of the memory 1002 and the storage 1003.

The communication device 1004 is hardware (transmission / reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, or the like.

The input device 1005 is an input device (for example, a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that receives an input from the outside. The output device 1006 is an output device (for example, a display, a speaker, an LED lamp, etc.) that outputs to the outside. The input device 1005 and the output device 1006 may have an integrated configuration (for example, a touch panel).

Further, each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be configured by using a single bus, or may be configured by using a different bus for each device.

Further, the structure determination system 10 includes hardware such as a microprocessor, a digital signal processor (DSP: Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). It may be configured to include, and a part or all of each functional block may be realized by the hardware. For example, processor 1001 may be implemented using at least one of these hardware.

The order of the processing procedures, sequences, flowcharts, etc. of each aspect / embodiment described in the present disclosure may be changed as long as there is no contradiction. For example, the methods described in the present disclosure present elements of various steps using exemplary order, and are not limited to the particular order presented.

The input / output information and the like may be stored in a specific location (for example, a memory), or may be managed using a management table. Input / output information and the like can be overwritten, updated, or added. The output information and the like may be deleted. The input information or the like may be transmitted to another device.

The determination may be made by a value represented by 1 bit (0 or 1), by a boolean value (Boolean: true or false), or by comparing numerical values (for example, a predetermined value). It may be done by comparison with the value).

Each aspect / embodiment described in the present disclosure may be used alone, in combination, or switched with execution. Further, the notification of predetermined information (for example, the notification of "being X") is not limited to the explicit one, but is performed implicitly (for example, the notification of the predetermined information is not performed). May be good.

Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure may be implemented as an amendment or modification without departing from the purpose and scope of the present disclosure, which is determined by the description of the scope of claims. Therefore, the description of the present disclosure is for the purpose of exemplary explanation and does not have any limiting meaning to the present disclosure.

Software, whether referred to as software, firmware, middleware, microcode, hardware description language, or other names, is an instruction, instruction set, code, code segment, program code, program, subprogram, software module. , Applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc. should be broadly interpreted.

Further, software, instructions, information and the like may be transmitted and received via a transmission medium. For example, the software uses at least one of wired technology (coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), etc.) and wireless technology (infrared, microwave, etc.) on the website. When transmitted from a server, or other remote source, at least one of these wired and wireless technologies is included within the definition of transmission medium.

The terms "system" and "network" used in this disclosure are used interchangeably.

In addition, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, relative values from predetermined values, or using other corresponding information. It may be represented.

The terms "determining" and "determining" as used in this disclosure may include a wide variety of actions. "Judgment" and "decision" are, for example, judgment, calculation, computing, processing, deriving, investigating, looking up, search, inquiry. (For example, searching in a table, database or another data structure), ascertaining may be regarded as "judgment" or "decision". Also, "judgment" and "decision" are receiving (for example, receiving information), transmitting (for example, transmitting information), input (input), output (output), and access. (Accessing) (for example, accessing data in memory) may be regarded as "judgment" or "decision". In addition, "judgment" and "decision" mean that the things such as solving, selecting, choosing, establishing, and comparing are regarded as "judgment" and "decision". Can include. That is, "judgment" and "decision" may include considering some action as "judgment" and "decision". Further, "judgment (decision)" may be read as "assuming", "expecting", "considering" and the like.

The terms "connected", "coupled", or any variation thereof, mean any direct or indirect connection or connection between two or more elements, and each other. It can include the presence of one or more intermediate elements between two "connected" or "combined" elements. The connection or connection between the elements may be physical, logical, or a combination thereof. For example, "connection" may be read as "access". As used in the present disclosure, the two elements use at least one of one or more wires, cables and printed electrical connections, and, as some non-limiting and non-comprehensive examples, the radio frequency domain. Can be considered to be "connected" or "coupled" to each other using electromagnetic energy having wavelengths in the microwave and light (both visible and invisible) regions.

The phrase "based on" as used in this disclosure does not mean "based on" unless otherwise stated. In other words, the statement "based on" means both "based only" and "at least based on".

Any reference to elements using designations such as "first", "second" as used in this disclosure does not generally limit the quantity or order of those elements. These designations can be used in the present disclosure as a convenient way to distinguish between two or more elements. Thus, references to the first and second elements do not mean that only two elements can be adopted, or that the first element must somehow precede the second element.

When "include", "including" and variations thereof are used in the present disclosure, these terms are as comprehensive as the term "comprising". Is intended. Furthermore, the term "or" used in the present disclosure is intended not to be an exclusive OR.

In the present disclosure, if articles are added by translation, for example a, an and the in English, the disclosure may include the plural nouns following these articles.

In the present disclosure, the term "A and B are different" may mean "A and B are different from each other". The term may mean that "A and B are different from C". Terms such as "separate" and "combined" may be interpreted in the same way as "different".

10 ... Structure determination system, 11 ... Displacement acquisition unit, 12 ... Extraction unit, 13 ... Judgment unit, 20 ... Camera, 30 ... Bridge, 40 ... Vehicle, 1001 ... Processor, 1002 ... Memory, 1003 ... Storage, 1004 ... Communication Device, 1005 ... Input device, 1006 ... Output device, 1007 ... Bus.

Claims (6)

It is a structure judgment system that judges the state of a structure.
A displacement acquisition unit that acquires information indicating the time-series displacement of the structure, and
From the information acquired by the displacement acquisition unit, an extraction unit that extracts information of a preset time length used for determining the state of the structure based on the information, and an extraction unit.
A determination unit that determines the state of the structure based on the information extracted by the extraction unit, and a determination unit.
Structure judgment system including. The structure determination system according to claim 1, wherein the extraction unit extracts information of a preset time length used for determining the state of the structure based on a time when the displacement is maximum and exceeds a predetermined threshold value. The structure determination system according to claim 1 or 2, wherein the displacement acquisition unit acquires information indicating time-series displacements of a plurality of locations of the structure. The structure according to any one of claims 1 to 3, wherein the determination unit compresses the information extracted by the extraction unit by an autoencoder and determines the state of the structure based on the compressed information. Judgment system. Any of claims 1 to 4, wherein the determination unit determines the state of the structure using a preset standard based on information indicating the time-series displacement of the structure in a predetermined state of the structure. The structure determination system described in item 1. The structure according to any one of claims 1 to 5, wherein the displacement acquisition unit acquires a moving image of the structure and calculates the time-series displacement of the structure based on the acquired moving image. Object judgment system.

Images