JP6895269B2 - Measuring equipment, soundness judgment equipment, and building management system - Google Patents

Description

The present invention relates to a measuring device, a soundness determination device, and a building management system.

Conventionally, a technique for diagnosing a structure including a building is known. For example, a technique for diagnosing the safety of a building based on information obtained from a sensor in the building is known (see, for example, Patent Documents 1 to 5).

Further, a technique for diagnosing a structure based on the vibration of the structure is known. For example, there is a technique for diagnosing a structure according to vibration waveforms at a plurality of measurement points set on the structure (see, for example, Patent Document 6). Further, there is known a technique of obtaining the natural frequency of the target building from the data of the constant tremor of the target building and calculating the score of the seismic diagnosis according to the natural frequency (see, for example, Patent Document 7).

As a technique for acquiring the vibration of a structure, for example, a technique for identifying the vibration characteristics of the structure using a laser Doppler velocimeter (see, for example, Patent Document 8) is known. Further, a technique for calculating the vibration of a structure from a moving image is known (see, for example, Patent Documents 9 to 12 and Non-Patent Documents 1 and 2).

Japanese Unexamined Patent Publication No. 2013-254239 Japanese Unexamined Patent Publication No. 2016-105115 Japanese Patent No. 5975187 Japanese Unexamined Patent Publication No. 2016-105050 Japanese Unexamined Patent Publication No. 2016-65743 JP-A-2015-102363 Japanese Unexamined Patent Publication No. 2014-141873 Japanese Patent No. 4001806 Japanese Patent No. 4844844 Japanese Patent No. 3404302 U.S. Patent Application Publication No. 2014/0072190 U.S. Pat. No. 923405

Neal Wadhwa, Michael Rubinstein, Fredo Durand, William T. Freeman, "Phase-Based Video Motion Processing", ACM Trans.on Graphics, Vol.32, No.4 (2013) J.G. Chen, N. Wadhwa, F. Durand, W.T. Freeman, and O. Buyukozturk, “Video Camera-based Vibration Measurement for Condition Assessment of Civil Infrastracture”, International Symposium Non-Destractive Testing in Civil Engineering (2015)

However, in the techniques of Patent Documents 1 to 5, it is necessary to install at least one or more sensors in each building. Further, in the techniques of Patent Documents 6 to 12 and Non-Patent Documents 1 and 2, since it is necessary to continuously image a building from a fixed point, it is not possible to efficiently acquire vibrations of a plurality of buildings.

In view of the above facts, an object of the present invention is to provide a measuring device, a soundness determination device, and a building management system capable of efficiently acquiring the vibration of a single or a plurality of buildings.

In order to achieve the above object, the measuring device of the present invention includes an acquisition unit that acquires a moving image of a single or a plurality of buildings captured by an imaging device included in a moving body, and the moving image acquired by the acquisition unit. Vibration of a single or multiple buildings is generated from the image based on a removing unit that removes a moving component representing the movement of the imaging device and each frame image of the moving image from which the moving component has been removed by the removing unit. Includes a measuring unit to measure.

According to the measuring device of the present invention, the moving component representing the movement of the imaging device is removed from the moving image of the building captured by the imaging device included in the moving body, and each frame image of the moving image from which the moving component is removed is obtained. Based on this, measure the vibration of the building. This makes it possible to efficiently acquire the vibration of a single or a plurality of buildings.

Further, the removing unit of the present invention can remove the moving component and the vibration component caused by the image pickup device corresponding to the spatio-temporal frequency band different from the spatio-temporal frequency of the vibration of the building defined in advance. .. By removing the moving component and vibration component of the camera corresponding to the spatiotemporal frequency band different from the spatiotemporal frequency of the vibration of the building, it is possible to accurately acquire the vibration of a single or a plurality of buildings.

In addition, the soundness determination device of the present invention includes a determination unit for determining the soundness of the building based on the vibration of the building measured by the measuring device of the present invention for each of a single building or a plurality of buildings. .. Thereby, the soundness of a single building or a plurality of buildings can be efficiently determined based on the moving image of the building captured by the image pickup device mounted on the moving body.

The building management system of the present invention includes a soundness management device including a storage unit for storing information on the soundness of the building obtained by the soundness determination device of the present invention, and the building for each of a single building or a plurality of buildings. The public department that publishes information on whether or not the information on the soundness of the sound is acquired by the soundness determination device, the reception department that receives inquiry information including information on the specific building to be inquired about, and the reception department that receives the inquiry information. When the inquiry information satisfies a predetermined condition, the inquiry processing unit that acquires the information on the soundness of the building corresponding to the inquiry information stored in the storage unit of the soundness management device, and the inquiry processing. It has a data operation device including an output unit that outputs information on the soundness acquired by the unit. This makes it possible to properly manage information on the health of a single or multiple buildings.

The building management system of the present invention has a request information output unit that outputs request information indicating a request for permission to acquire information on the soundness of the specific building to a user who owns the specific building, and a request information output unit from the user. The approval information acquisition unit that acquires the approval information indicating the approval of the acquisition of the soundness of the specific building and the inquiry information including the approval information acquired by the approval information acquisition unit are output to the data operation device. It further has a management device including an approval information output unit for acquiring information about the soundness of the building corresponding to the inquiry information output from the data operation device, and the data operation. The reception unit of the device may receive the inquiry information output from the management device, and the output unit may output information on the soundness of the building corresponding to the inquiry information to the management device. .. This makes it possible to appropriately manage information on the health of a single building or a plurality of buildings by using the approval information of the user who owns the building.

In the building management system of the present invention, the reception unit of the data operation device receives request information for acquiring information on the soundness of a predetermined building, and the data operation device sends the request information to the soundness management device. The soundness management device further includes a request information output unit to be output, and the soundness management device corresponds to a request information reception unit that receives the request information output from the data operation device and the request information received by the request information reception unit. It is possible to further include a setting unit for setting to acquire information on the soundness of the building to be used. As a result, it is possible to appropriately request the acquisition of information on the soundness of the building.

According to the present invention, a moving component representing the movement of the image pickup device is removed from the moving image of the building captured by the imaging device included in the moving body, and the moving component is removed based on each frame image of the moving image. By measuring the vibration of a building, it is possible to efficiently acquire the vibration of a single or a plurality of buildings.

It is a block diagram which shows the schematic structure of the soundness determination system which concerns on 1st Embodiment. It is explanatory drawing for demonstrating the imaging method of the moving image of a building. It is a figure which shows an example of the information stored in each database of a soundness determination apparatus. It is a figure which shows an example of the display of the information about the soundness of a building. It is a figure which shows an example of the soundness processing routine in 1st Embodiment. It is a block diagram which shows the schematic structure of the building management system which concerns on 2nd Embodiment. It is a figure which shows an example of the information stored in each database of a building management system. It is a figure which shows an example of the sequence of the building management system which concerns on 2nd Embodiment. It is a block diagram which shows the schematic structure of the building management system which concerns on 3rd Embodiment. It is a figure which shows an example of the sequence of the building management system which concerns on 3rd Embodiment. It is a block diagram which shows the schematic structure of the building management system which concerns on 4th Embodiment. It is a figure which shows an example of the sequence of the building management system which concerns on 4th Embodiment. This is an example of a screen displayed on the display unit.

Hereinafter, embodiments of the present invention will be described in detail.

<Structure of the soundness determination system of the first embodiment>
FIG. 1 is a block diagram showing an example of the configuration of the soundness determination system according to the first embodiment. As shown in FIG. 1, the soundness determination system 10 includes a mounting device 12 and a soundness determination device 13.

The mounting device 12 is mounted on the moving body. Examples of the moving body include an airplane, a drone, which is an example of an unmanned aerial vehicle, a helicopter, an automobile, and the like. As shown in FIG. 1, the on-board device 12 can be represented by a configuration including a camera 14 and a computer 16. The camera 14 is an example of an imaging device.

The camera 14 acquires a moving image of the building captured from the position of the moving body. For example, when the on-board device 12 is mounted on a helicopter, which is an example of a moving body, as shown in FIG. 2, the camera 14 is a moving image including a single or a plurality of buildings 2B existing downward in the helicopter 2A. Take an image. Further, in order to stabilize the moving image captured by the camera 14, for example, a stabilizer 2C or the like may be provided.

The computer 16 includes a CPU (Central Processing Unit), a ROM (Read Only Memory) that stores programs for realizing each processing routine, a RAM (Random Access Memory) that temporarily stores data, and a memory as a storage means. , Network interface, etc. Functionally, the computer 16 can be represented by a configuration including a moving image storage unit 18 and a control unit 20 as shown in FIG.

The moving image storage unit 18 stores a moving image captured by the camera 14.

The control unit 20 outputs the moving image stored in the moving image storage unit 18 to the soundness determination device 13 in response to a predetermined control signal.

The soundness determination device 13 determines the soundness of the building included in the moving image based on the moving image captured by the camera 14 of the mounting device 12. As shown in FIG. 1, the soundness determination device 13 includes a computer 22 and a display unit 24. The display unit 24 is realized by, for example, a display or the like.

The computer 22 includes a CPU, a ROM that stores programs for realizing each processing routine, a RAM, a memory, a network interface, and the like. Functionally, as shown in FIG. 1, the computer 22 can be represented by a configuration including an analysis unit 25, a data storage unit 30, a determination unit 44, and a display control unit 46. The analysis unit 25 is an example of a measuring device.

The acquisition unit 26 acquires the moving image output from the mounting device 12 and stores it in the information storage unit 28. The moving image acquired by the acquisition unit 26 is stored in the information storage unit 28.

The data storage unit 30 includes a building information database 32, an analysis result database 34, and a determination result database 36.

In the building information database 32, for each of the plurality of buildings, for example, an ID representing the identification information of the building and information on the appearance of the building are stored in association with each other. For example, for each of the plurality of buildings, a feature point representing a characteristic part of the appearance of the building and a feature amount of the feature point are stored for each building as information on the appearance of the building. In addition, information such as the height of the building, the building area, and the structural type is also stored.

The analysis result database 34 stores the analysis results obtained by the measurement unit 42, which will be described later. In addition, the analysis result database 34 stores the past analysis results obtained by the previous processing for each building.

The determination result database 36 stores the determination results obtained by the determination unit 44, which will be described later. In addition, the determination result database 36 stores the past determination results obtained by the previous processing for each building.

The building identification unit 38 determines whether or not a plurality of buildings are included in each frame image of the moving image stored in the information storage unit 28. For example, the building identification unit 38 uses image processing technology to determine whether or not each frame image includes a plurality of buildings. Then, the building identification unit 38 divides the building area representing the area of the building included in each frame image of the moving image according to the determination result.

Next, the building identification unit 38 refers to the building information database 32 and identifies which building is stored in the building information database 32 in the building area of each frame image of the moving image. For example, the building identification unit 38 stores the feature points and feature quantities obtained from the building area of each frame image and the feature points for each building ID in the building information database 32 by using the technique related to the feature point tracking of the image processing technique. Correspondence is made between feature points and feature quantities. Then, the building identification unit 38 identifies the building in each frame image by specifying which building ID the building area corresponds to based on the association result. The building area may be separated and identified manually.

The removing unit 40 removes the moving component representing the movement of the camera 14 and the vibration component of the camera 14 from the moving image stored in the information storage unit 28 for each building area having the same building ID. Specifically, the removing unit 40 performs spatio-temporal frequency analysis on a building region having the same building ID in each frame image of the moving image, and based on the spatio-temporal frequency analysis result, the camera 14 is determined in advance. The movement component representing the movement and the vibration component of the camera 14 are removed.

The building is constantly trembling, and the natural frequency of the building can be obtained from the constant tremor. In addition, the soundness of the building can be determined based on the natural frequency of the building. Therefore, in the present embodiment, the constant tremor of the building is detected from the moving image captured by the camera 14 mounted on the moving body, and the soundness of the building is determined based on the natural frequency obtained from the constant tremor.

Further, the spatio-temporal frequency band of vibration related to the constant tremor of the building is different from the spatio-temporal frequency band of the moving component of the camera 14 and the spatio-temporal frequency band of the vibration component caused by the camera 14. Therefore, the removing unit 40 performs spatiotemporal frequency analysis on the building region having the same building ID in each frame image of the moving image, and removes the spatiotemporal frequency band different from the spatiotemporal frequency band of the vibration of the building. Filtering is performed on the spatiotemporal frequency analysis result so as to be performed. As filtering for the spatiotemporal frequency analysis result, the spatiotemporal frequency band component corresponding to the movement of the camera 14 and the spatiotemporal frequency band component corresponding to the vibration caused by the camera 14 are excluded from the moving image. For the spatial frequency analysis result, a threshold value for each spatiotemporal frequency band component is set in advance. As a result, the moving component representing the movement of the camera 14 and the vibration component of the camera 14 are removed from the moving image, and the vibration component of the building is extracted.

For example, when the technique of Non-Patent Document 1 is used, first, in each frame image of a moving image, a spatial differentiation is performed by using a complex orthogonal filter for each spatial resolution and directionality for a building region having the same building ID. Is performed and converted into data corresponding to the spatial phase / amplitude, and the spatial phase / amplitude data for each directionality and the spatial resolution of the building area of each frame image of the moving image is acquired. Then, for each spatial resolution of each frame image and spatial phase data of each directionality, a temporal change is obtained for each pixel, and a temporal frequency analysis is performed for the temporal change of each pixel of the spatial phase data. By doing so, the time-frequency spectrum data of the vibration decomposed for each spatial resolution and directionality is obtained. Each of these spectral data represents a set of vibration data containing information on various spatiotemporal frequencies and directions. Then, by selecting the spatial resolution and the directionality and further applying a temporal band path filter, vibration data representing the amount of movement corresponding to the movement of the camera 14 and vibration data corresponding to the vibration caused by the camera 14 are performed. To remove. As a result, the spatiotemporal frequency band different from the spatiotemporal frequency band of the vibration of the building is removed, and only the vibration data corresponding to the vibration of the building is extracted.

In each frame image of the moving image, feature point tracking is performed on a building area having the same building ID, vibration data of the building area representing the movement amount corresponding to the movement of the camera 14 is obtained, and this movement amount is obtained. By performing image conversion such as projection conversion on each frame image so as to remove the above, vibration data representing the amount of movement corresponding to the movement of the camera 14 may be removed.

The measuring unit 42 corresponds to the vibration of the building in each frame image of the moving image in which the moving component and the vibration component of the camera 14 are removed by the removing unit 40 for each of the buildings identified by the building identification unit 38. The vibration of the building is measured based on the vibration data.

Specifically, the measuring unit 42 has a natural frequency which is an example of the vibration of the building based on the vibration data of the building obtained by the removing unit 40 for each of the buildings identified by the building identification unit 38. To measure. Since the moving component and the vibration component of the camera 14 are removed from the vibration data of the building obtained by the removing unit 40, the natural frequency of each building included in each frame image of the moving image can be acquired. .. Further, the vibration mode may be measured together as an example of the vibration of the building.

Then, the measurement unit 42 stores the natural frequencies measured for each of the buildings identified by the building identification unit 38 in the analysis result database 34 in association with the building ID.

In the analysis result database 34, the building ID representing the building identification information and the vibration of the building measured by the measuring unit 42 are stored in association with each other. Further, the analysis result database 34 stores the natural frequency of each building measured based on the moving images captured in the past.

FIG. 3A shows an example of the analysis result stored in the analysis result database 34. In the analysis result database 34, for example, as shown in FIG. 3A, the building ID, the imaging date of the moving image, the natural frequency [Hz] of the building, the building area [m ² ] of the building, and the like are displayed. Are associated and stored. The natural frequency [Hz] indicates that the measurement was performed based on the moving image captured on the corresponding imaging date. Therefore, in the analysis result database 34, the natural frequencies measured based on the moving images captured in the past are stored in time series for each building. If detailed information on the building structure, ground structure, etc. exists, such information may also be stored.

The determination unit 44 determines the soundness of each building based on the vibration of each building stored in the analysis result database 34. Specifically, the determination unit 44 reads out the time series of the natural frequencies stored in the analysis result database 34 for each building. Next, the determination unit 44 calculates the rate of change of the natural frequency, which is an example of the soundness of the building, for each building. For example, the larger the absolute value of the rate of change of the natural frequency, the lower the soundness of the building, and the smaller the absolute value of the rate of change of the natural frequency, the higher the soundness of the building. Therefore, the determination unit 44 calculates a soundness score according to the rate of change of the natural frequency for each building. For example, the determination unit 44 increases the soundness score as the absolute value of the rate of change of the natural frequency increases, and increases the soundness score as the absolute value of the rate of change of the natural frequency decreases. Calculate the health score.

Further, the determination unit 44 determines the state of the building based on the soundness score and the preset threshold value for each building, and obtains the soundness determination result. Then, the determination unit 44 stores the soundness score and the soundness determination result for each building in the determination result database 36.

FIG. 3B shows an example of the determination result stored in the determination result database 36. As shown in FIG. 3B, for example, the determination result database 36 stores the building ID, the imaging date of the moving image, the soundness score, the soundness determination result, and the like in association with each other. Therefore, the determination result database 36 stores the soundness score and the soundness determination result measured based on the moving images captured in the past for each building in chronological order.

The display control unit 46 reads the information stored in the building information database 32, the analysis result database 34, and the determination result database 36, and controls the display unit 24 so as to display the soundness of each building. For example, as shown in FIG. 4, the display control unit 46 has an imaging date on which the moving image of the building is captured, a natural frequency calculated from the moving image captured on the imaging date, and a soundness determination result. Is associated with the frame image of the moving image and displayed on the display unit 24. In the example shown in FIG. 4, a "warning" is displayed as a soundness determination result in the building 4A, indicating that the soundness is low. In addition, "safety" is displayed on the building 4B as a soundness determination result, indicating that the soundness is good.

The user confirms the result displayed by the display unit 24. Based on the result displayed by the display unit 24, the user urges the inspector or the worker to conduct a detailed investigation when the soundness is suspected.

<Operation of soundness judgment device>
Next, the operation of the soundness determination device 13 will be described with reference to FIG. When a moving image of the building is captured by the camera 14 of the on-board device 12 provided on the moving body and input to the soundness determination device 13, the acquisition unit 26 of the soundness determination device 13 acquires the moving image and stores information. Store in unit 28. Then, when the soundness determination device 13 receives the control signal regarding the start of the soundness determination of the building, the soundness determination device 13 performs the soundness determination process according to the following flow.

In step S100, the building identification unit 38 acquires a moving image stored in the information storage unit 28.

In step S102, the building identification unit 38 recognizes the building area included in each frame image of the moving image by using the image processing technique.

In step S104, the building identification unit 38 determines whether or not each frame image of the moving image includes a plurality of building areas based on the recognition result of step S102. If each frame image of the moving image includes a plurality of building areas, the process proceeds to step S106. On the other hand, if each frame image of the moving image does not include a plurality of building areas, the process proceeds to step S107.

In step S106, the building identification unit 38 divides the building area included in each frame image of the moving image according to the determination result in step S104.

In step S107, the building identification unit 38 sets one building area out of the plurality of building areas carved in step S106. If it is determined in step S104 that only a single building area exists, the building area is set.

In step S108, the building identification unit 38 refers to the building information database 32 and identifies which building the building area set in step S107 corresponds to in the building information database 32.

In step S110, the removing unit 40 performs spatio-temporal frequency analysis on the moving image acquired in step S100 or the moving image region separated in step S106. Then, the removing unit 40 filters the spatiotemporal frequency analysis result so as to remove the spatiotemporal frequency band different from the spatiotemporal frequency band of the vibration of the building, and the moving component representing the movement of the camera 14 and the camera. 14 vibration components are removed.

In step S112, the measuring unit 42 measures the temporal natural frequency of the building identified in step S108 based on the spatiotemporal frequency analysis result obtained in step S110.

In step S114, the measuring unit 42 stores the natural frequency measured in step S112 in the analysis result database 34 in association with the building ID and the imaging date for the building identified in step S108.

In step S116, the determination unit 44 reads out the time series of the natural frequencies stored in the determination result database 36 for the building identified in step S108. Next, the determination unit 44 calculates the rate of change of the natural frequency of the building identified in step S108. Then, the determination unit 44 calculates the soundness score according to the rate of change of the natural frequency. Further, the determination unit 44 determines the state of the building identified in step S108 based on the soundness score and the preset threshold value, and obtains the soundness determination result.

In step S118, the determination unit 44 stores the soundness score and the soundness determination result calculated in step S116 in the determination result database 36.

In step S120, the determination unit 44 determines whether or not the processes of steps S107 to S118 have been executed for all of the plurality of building areas divided in step S106. When the processes of steps S107 to S118 are executed for all the building areas, the soundness determination process ends. On the other hand, if there is a building area in which the processes of steps S107 to S118 have not been executed, the process returns to step S107. If it is determined in step S104 that it is a single building area, the soundness determination process is terminated.

As described in detail above, in the first embodiment, the moving component representing the movement of the camera 14 is removed from the moving image of the building captured by the camera included in the moving body, and the moving component is removed. The vibration of the building is measured based on each frame image of. This makes it possible to efficiently acquire the vibration of a single or a plurality of buildings.

Further, by removing the moving component and the vibration component of the camera corresponding to the spatiotemporal frequency band different from the spatiotemporal frequency of the vibration of the building, the vibration of a single or a plurality of buildings can be accurately acquired. Then, the soundness of a single or a plurality of buildings can be efficiently determined based on the moving image of the building captured by the camera mounted on the moving body.

In the conventional soundness judgment system of a building, it is necessary to install a sensor for each building, so that only the building in which the soundness judgment system is introduced can judge the soundness. Therefore, for example, in the event of an earthquake, for buildings for which a soundness judgment system has not been introduced, it is necessary for the construction company or building management company, etc. to individually carry out the primary diagnosis work for the soundness of the building for each building. There is.

On the other hand, in the present embodiment, since the soundness of a plurality of buildings can be determined from the moving image captured by the camera, it is not necessary to install a sensor in each building, and the soundness of the building can be quickly and widely spread. Can be determined. As a result, for example, in the event of an earthquake, appropriate evacuation guidance can be provided for each individual building based on the soundness of the building required in a wide area, and human life due to the collapse of the building due to an aftermath, etc. Damage can be suppressed. In addition, in post-earthquake restoration and reconstruction plans, it will be possible to appropriately prioritize renovation or construction, etc., according to the degree of risk obtained from the soundness of the building.

Considering the situation such as road disruption after the earthquake, it is preferable that a helicopter, an unmanned aerial vehicle, or the like is used as the moving body, and a moving image is captured by aerial photography. When the moving object is a helicopter, an unmanned aerial vehicle, or the like, the soundness of an unspecified number of buildings can be obtained in the range of the city and the city level by capturing a moving image by aerial photography. Therefore, it can also be used for building life cycle management such as formulation of seismic repair plans based on information on building soundness collected by long-term monitoring.

<System configuration of the building management system of the second embodiment>
Next, the second embodiment will be described. The parts having the same configuration as that of the first embodiment are designated by the same reference numerals and the description thereof will be omitted.

The second embodiment is different from the first embodiment in that the soundness of the building obtained by the soundness determination system 10 of the first embodiment is managed.

FIG. 6 is a block diagram showing an example of the configuration of the building management system according to the second embodiment. Functionally, as shown in FIG. 6, the building management system 210 can be represented by a configuration including a soundness management device 50, a data operation device 60, and a user terminal 70. The soundness management device 50 and the data operation device 60 are composed of a computer including a CPU, a ROM, a RAM, a memory, a network interface, and the like.

The soundness management device 50 includes a soundness database 236, a control unit 52, and a communication unit 54. The health database 236 is an example of a storage unit.

The soundness database 236 stores the natural frequency, the soundness score, the soundness determination result, and the like, which are examples of information on the soundness of each building obtained by the soundness determination device 13 of the first embodiment. Has been done. For example, the health database 236 stores a table as shown in FIG. 7 (A). In the table shown in FIG. 7A, a building ID, a building name, an owner name, an imaging date, a natural frequency, a soundness score, a soundness determination result, and the like are stored in association with each other.

The control unit 52 acquires inquiry information including information about a specific building transmitted from the data operation device 60 described later. Information about a specific building includes, for example, a building ID and a building name. Then, the control unit 52 acquires information on the building ID, the building name, the soundness score, and the soundness determination result that match the inquiry information from the soundness database 236, and transfers the information to the data operation device 60 via the communication unit 54. Send. The communication unit 54 transmits / receives information to / from the data operation device 60.

As shown in FIG. 6, the data operation device 60 includes a communication unit 62, a public information database 64, a public unit 66, an authentication database 67, and a control unit 68. The control unit 68 is an example of a reception unit, an inquiry processing unit, and an output unit. The communication unit 62 transmits / receives information to / from the soundness management device 50 and the user terminal 70.

The public information database 64 contains public information representing information related to whether or not the soundness of a building is determined by the soundness determination device 13 of the first embodiment for each of a single building or a plurality of buildings. Stored. For example, in the public information database 64, information on whether or not the moving image of the building has been acquired, information on whether or not the natural frequency of the building has been acquired, and the soundness of the building have been determined. At least one of the information on whether or not it is stored as public information. Further, for each of the buildings corresponding to the building ID, the location information (for example, address, etc.) on the map of the building may be stored together.

The public unit 66 discloses the public information stored in the public information database 64 to the outside. For example, the public unit 66 associates the location information on the map of the building with the public information so that the user can view the public information.

Evidence information and building ID are stored in association with each other in the authentication database 67. For example, the authentication database 67 stores a table as shown in FIG. 7 (B).

The control unit 68 acquires inquiry information including information about a specific building to be inquired, which is transmitted from a user terminal 70 described later. Information about a particular building includes, for example, a building ID, a building name, an owner name, evidence information, and the like. Evidence information is, for example, information proving that the owner of the building is the owner (for example, real estate registration information, etc.).

The control unit 68 determines whether or not the inquiry information satisfies a predetermined condition. For example, the control unit 68 refers to the table stored in the authentication database 67, and determines whether or not the building ID and evidence information match each information in the table of the authentication database 67. Then, when the inquiry information and the table information match, the control unit 68 transmits the inquiry information to the soundness management device 50. By determining whether or not the evidence information corresponding to the building ID transmitted from the user terminal 70 and the evidence information corresponding to the building ID stored in the table of the authentication database 67 match, the owner of the building Only information on the soundness of the building will be disclosed. Then, the control unit 68 acquires the building ID and the soundness information transmitted from the soundness management device 50. Then, the control unit 68 outputs the acquired information regarding the soundness to the user terminal 70.

As shown in FIG. 6, the user terminal 70 includes a computer 72, an operation unit 74, and a display unit 76. Functionally, the computer 72 includes a control unit 78 and a communication unit 79, as shown in FIG. The operation unit 74 receives the user's operation information. Further, the display unit 76 displays the processing result or the like by the computer 72 in response to the control signal of the control unit 78 of the computer 72.

When the operation unit 74 receives the operation information from the user instructing to view the public information, the control unit 78 acquires the public information published by the public unit 66 and displays it on the display unit 76. Then, the user browses the public information displayed on the display unit 76. For example, if the public information indicates that the soundness of the building owned by the user is determined, and the user wants to acquire information on the soundness of the building, the user inputs inquiry information to the operation unit 74. To do.

Then, the control unit 78 transmits the inquiry information received by the operation unit 74 to the data operation device 60 via the communication unit 79. The data operation device 60 performs the authentication process, and when the authentication process is passed, the data operation device 60 acquires information on the soundness of the building from the soundness management device 50. Then, the data operation device 60 transmits information on the soundness of the building to the user terminal 70. The control unit 78 of the user terminal 70 causes the display unit 76 to display information on the soundness of the building. The user acquires information on the soundness of the building displayed on the display unit 76.

<Operation of building management system>
Next, the operation of the building management system 210 will be described with reference to FIG.

First, in step S200, when the operation unit 74 of the user terminal 70 receives the operation information from the user instructing to view the public information, the control unit 78 of the user terminal 70 is released by the public unit 66 of the data operation device 60. Get public information that has been published. Then, the control unit 78 of the user terminal 70 causes the display unit 76 to display the public information. Then, the user browses the public information displayed on the display unit 76.

When the public information indicates that the soundness of the building owned by the user has been determined as a result of browsing the public information acquired in step S200, and the user wants to acquire information on the soundness of the building. The user inputs inquiry information to the operation unit 74 of the user terminal 70.

In step S201, the control unit 78 of the user terminal 70 transmits the inquiry information received by the operation unit 74 to the data operation device 60 via the communication unit 79.

The control unit 68 of the data operation device 60 determines whether or not the inquiry information transmitted from the user terminal 70 in step S201 matches each information in the table of the authentication database 67.

Then, when the inquiry information matches each information in the table of the authentication database 67, the control unit 68 transmits the inquiry information to the soundness management device 50 in step S202.

In step S204, the control unit 52 of the soundness management device 50 transmits to the data operation device 60 information about the soundness corresponding to the building ID included in the inquiry information transmitted from the data operation device 60.

In step S206, the control unit 68 of the data operation device 60 transmits the soundness information transmitted from the soundness management device 50 in step S204 to the user terminal 70.

The control unit 78 of the user terminal 70 acquires the information on the soundness transmitted from the data operation device 60 in step S206, and causes the display unit 76 to display the information on the soundness. The user confirms the soundness information displayed on the display unit 76.

As described above, in the second embodiment, in the data operation device 60, when the inquiry information satisfies a predetermined condition, the soundness of the building is acquired and transmitted to the user terminal. As a result, information on the soundness of the building can be disclosed only to the user who owns the building. Therefore, information on the health of a single or multiple buildings can be managed appropriately.

<System configuration of the building management system of the third embodiment>
Next, a third embodiment will be described. The parts having the same configuration as that of the first or second embodiment are designated by the same reference numerals and the description thereof will be omitted.

In the third embodiment, when a third party (for example, a company that manages a building or a company that constructed a building) wants to obtain information on the soundness of the building, the owner of the building obtains approval. In the above, the point that information on the soundness of the building is acquired is different from the second embodiment.

FIG. 9 is a block diagram showing an example of the configuration of the building management system according to the third embodiment. Functionally, as shown in FIG. 9, the building management system 310 can be represented by a configuration including a soundness management device 50, a data operation device 60, a user terminal 70, and a management device 80.

As shown in FIG. 9, the management device 80 includes a computer 82, an operation unit 84, and a display unit 86. Functionally, the computer 82 includes a control unit 88 and a communication unit 89, as shown in FIG. The operation unit 84 receives the user's operation information. Further, the display unit 86 displays the processing result or the like by the computer 82 in response to the control signal of the control unit 88 of the computer 82. The control unit 88 is an example of a request information output unit, an approval information acquisition unit, an approval information output unit, and a soundness information acquisition unit.

The user of the management device 80 is, for example, a management company that manages the building, a construction company that constructs the building, or the like. When these companies want to acquire the soundness of a building managed by the company or a building constructed by the company, for example, a management user who is an employee of the company operates the management device 80 to relate to the soundness of a specific building. Get information.

The authentication database 67 of the data operation device 60 stores approval information indicating approval from a user who owns a specific building.

<Operation of building management system>
The operation of the building management system 310 will be described with reference to FIG.

In step S200, when the operation unit 84 of the management device 80 receives the operation information from the management user instructing to view the public information, the control unit 88 receives the public information published by the public unit 66 of the data operation device 60. Is acquired and displayed on the display unit 86. Then, the management user browses the public information displayed on the display unit 86.

Then, for example, when the public information indicates that the soundness of a specific building related to the company is determined and the management user wants to acquire information on the soundness of the building, the management user informs the operation unit 84. , Enter the request information. The request information represents a request for permission of the user who owns a specific building to acquire information on the soundness of the building.

In step S300, the control unit 88 of the management device 80 transmits the request information received by the operation unit 84 to the user terminal 70.

The control unit 78 of the user terminal 70 acquires the request information transmitted from the management device 80 and displays it on the display unit 76. The user confirms the request information displayed on the display unit 76, and determines whether or not to disclose the information on the soundness of the specific building owned by the user to the company that is the source of the request information. To do. Then, when the information regarding the soundness of a specific building owned by the user may be disclosed to the company that is the source of the request information, the user operates the approval information indicating the approval for the acquisition of the soundness of the specific building. Input to unit 74.

In step S301, the control unit 78 of the user terminal 70 transmits the approval information received by the operation unit 74 to the management device 80.

In step S201, the control unit 88 of the management device 80 acquires the approval information transmitted from the user terminal 70, and transmits the inquiry information including the approval information to the data operation device 60.

The control unit 68 of the data operation device 60 receives the inquiry information transmitted from the management device 80. Then, the control unit 68 of the data operation device 60 refers to the table stored in the authentication database 67, and includes the building ID and approval information included in the inquiry information, and the building ID and approval information of the table in the authentication database 67. Determine if they match.

Then, when the inquiry information and each information in the table match, the control unit 68 transmits the inquiry information to the soundness management device 50 in step S202.

In step S204, the control unit 52 of the soundness management device 50 transmits to the data operation device 60 information about the soundness corresponding to the building ID included in the inquiry information transmitted from the data operation device 60.

In step S206, the control unit 68 of the data operation device 60 transmits the soundness information transmitted from the soundness management device 50 in step S204 to the management device 80.

The control unit 88 of the management device 80 acquires the information on the soundness transmitted from the data operation device 60 in step S206, and causes the display unit 86 to display the information on the soundness. The management user confirms the information regarding the soundness displayed on the display unit 86.

As described above, in the third embodiment, information on the soundness of a single or a plurality of buildings can be appropriately managed by using the approval information of the user who owns the building. As a result, even a third party who is not the owner of the specific building can acquire information on the soundness of the specific building by using the approval information of the user who owns the building.

<System configuration of the building management system of the fourth embodiment>
Next, a third embodiment will be described. The parts having the same configuration as that of the first or second embodiment are designated by the same reference numerals and the description thereof will be omitted.

In the fourth embodiment, when the user browses the public information, if the information on the soundness of the predetermined building does not exist, the soundness management device 50 is requested to acquire the information on the soundness of the building. It is different from the first to third embodiments. In the present embodiment, as an example of the case where the information on the soundness of the predetermined building does not exist, the case where the moving image of the predetermined building is not captured will be described as an example.

FIG. 11 is a block diagram showing an example of the configuration of the building management system according to the fourth embodiment. Functionally, as shown in FIG. 11, the building management system 410 can be represented by a configuration including a soundness management device 450, a data operation device 60, and a user terminal 70.

The control unit 78 of the user terminal 70 causes the display unit 76 to display the public information. Then, the user browses the public information displayed on the display unit 76.

As a result of browsing the public information, if the moving image of the predetermined building has not been acquired and the user wants to acquire the information on the soundness of the building, the user sends the operation unit 74 of the user terminal 70 to the predetermined building. Enter the request information for capturing the moving image of the building.

The control unit 68 of the data operation device 60 acquires the request information for acquiring the information on the soundness of the predetermined building transmitted from the user terminal 70. Then, the control unit 68 transmits the request information to the soundness management device 450. The area name may be used as the request information for acquiring the information on the soundness of the predetermined building. The control unit 68 is an example of a request information output unit.

The control unit 58 of the soundness management device 450 receives the request information of a predetermined building transmitted from the user terminal 70, sets it to capture a moving image of the building corresponding to the request information, and stores it in the request information database 437. To do. The control unit 58 is an example of a request information receiving unit and a setting unit.

The request information database 437 of the soundness management device 450 stores request information for capturing a moving image for a predetermined building for which a moving image has not been captured.

The soundness determination system 10 of the first embodiment acquires the request information stored in the request information database 437 of the soundness management device 450, and captures the moving image of the building set to capture the moving image. .. Specifically, the user of the soundness determination system 10 confirms the list of buildings requested to capture the moving image, and arranges for the moving body mounting device 12 to capture the moving image of the building. ..

Then, when the moving image of the building requested to capture the moving image is imaged, the soundness determination device 13 of the soundness determination system 10 determines the natural frequency and soundness of the building in which the moving image is newly captured. The sex score is acquired, and the natural frequency and the soundness score are transmitted to the soundness management device 450.

The control unit 52 of the soundness management device 450 acquires the natural frequency and the soundness score transmitted from the soundness determination device 13 and stores them in the soundness database 236 in association with the building ID. Then, the control unit 52 transmits the update information indicating that the soundness of the building is newly determined to the data operation device 60.

<Operation of building management system>
The operation of the building management system 410 will be described with reference to FIG.

First, in step S200, the control unit 78 of the user terminal 70 causes the display unit 76 to display the public information. Then, the user browses the public information displayed on the display unit 76.

As a result of browsing the public information acquired in step S200, if a moving image of a predetermined building has not been acquired and the user wants to acquire information on the soundness of the building, the user can acquire information on the soundness of the building. Request information for capturing a moving image of a predetermined building is input to the operation unit 74.

Then, in step S401, the control unit 78 of the user terminal 70 transmits the request information received by the operation unit 74 of the user terminal 70 to the data operation device 60.

The control unit 68 of the data operation device 60 acquires the request information transmitted from the user terminal 70 in step S401. Then, in step S402, the control unit 68 of the data operation device 60 transmits the request information to the soundness management device 50.

The control unit 58 of the soundness management device 50 acquires the request information transmitted from the data operation device 60. Then, the control unit 58 acquires the request information of the predetermined building transmitted from the data operation device 60, sets it to capture the moving image of the building corresponding to the request information, and stores it in the request information database 437.

The soundness determination system 10 of the first embodiment acquires the request information stored in the request information database 437 of the soundness management device 450, and captures the moving image of the building set to capture the moving image. .. Then, when the moving image of the building requested to capture the moving image is imaged, the soundness determination device 13 of the soundness determination system 10 determines the natural frequency and soundness of the building in which the moving image is newly captured. The sex score is acquired, and the natural frequency and the soundness score are transmitted to the soundness management device 450.

The control unit 52 of the soundness management device 450 acquires the natural frequency and the soundness score transmitted from the soundness determination device 13 and stores them in the soundness database 236 in association with the building ID.

In step S404, the control unit 58 of the soundness management device 50 transmits updated information about the building whose soundness is newly determined to the data operation device 60.

In step S406, the control unit 68 of the data operation device 60 acquires the update information transmitted from the soundness management device 50 and transmits it to the user terminal 70.

The control unit 78 of the user terminal 70 acquires the update information transmitted from the data operation device 60 and displays it on the display unit 76.

The user of the user terminal 70 confirms the update information displayed on the display unit 76 of the user terminal 70. Then, as in the second embodiment, the user inputs inquiry information to the operation unit 74 of the user terminal 70 and acquires the soundness of a predetermined building via the data operation device 60.

As described above, in the fourth embodiment, when the moving image which is an example of the information on the soundness of the predetermined building is not captured, the imaging of the moving image of the predetermined building is appropriately requested. be able to. As a result, even if the building has not been determined to be sound, the soundness of the building can be determined based on the request from the user.

The display unit in each of the second to fourth embodiments displays, for example, a screen as shown in FIG.

For example, in the display screen of FIG. 13, the “data acquisition area” represents the area where the moving image is captured, and the “determined area” represents the area where the soundness of the building is determined. Further, the “photographing request property” represents a building for which a moving image is requested to be captured as in the fourth embodiment. The "data acquisition area", "determined area", and "photograph request property" are examples of public information, and even if they are displayed in association with the position on the map as shown in FIG. Good. Further, when the "property information list" on the display screen of FIG. 13 is clicked, a list of buildings whose soundness is judged is displayed.

Further, on the display screen in FIG. 13, when a user wants to acquire the soundness of a specific building, each user inputs inquiry information in an input field corresponding to his / her own attribute. For example, if the user is the owner of the building, enter the inquiry information in the "building owner" field, and if the user is a building management company or construction company, enter the inquiry information in the "building management company / construction company" field. Enter the inquiry information in. When requesting the imaging of a moving image of a building, enter the inquiry information in the "Data acquisition (shooting) request" field.

Then, when the data operation device determines that the input inquiry information satisfies the predetermined conditions, the information on the soundness of the specific building is displayed in the "output column: determination result so far" column. Will be done.

The present invention is not limited to the above-described embodiment, and various modifications and applications are possible without departing from the gist of the present invention.

For example, in the first embodiment, a case where spatiotemporal frequency analysis is performed on a moving image and temporal and spatial filtering is performed on the moving image has been described as an example, but the present invention is not limited to this. For example, the on-board device 12 further includes a sensor for acquiring the position information or the posture information of the camera 14, a moving image of the building captured by the camera 14, a time series of the position information or the posture information of the camera 14, and the camera 14. The moving component may be removed from the moving image based on the angle of view of. For example, based on the movement distance obtained from the time series of the position information of the camera 14 and the angle of view of the camera 14, the movement component of each frame image of the moving image caused by the movement of the camera 14 is estimated, and the movement component of each frame image is estimated from the moving image. The moving component of the camera 14 may be removed. Examples of the sensor that acquires the position information or the posture information of the camera 14 include a GPS sensor and an acceleration sensor.

Further, in the first embodiment, the case where the soundness is calculated based on the rate of change of the natural frequency of the building has been described as an example, but the present invention is not limited to this. For example, when detailed information on the building structure, ground structure, etc. of the building exists, the method of Patent Document 7 and the like can be used together. In addition, for example, when a moving image of a building whose soundness is to be calculated is captured for the first time and the natural frequency of the building whose soundness is to be calculated has not been calculated in the past, the soundness of a building similar to the target building. The soundness of the target building may be estimated based on. Specifically, based on information that affects the natural frequency, such as the height of the building, the building area, and the structural type (for example, RC, S, etc.), a clustering method such as a neural network is used to make the building sound. Gender may be estimated.

Further, the soundness determination system 10 according to the first embodiment has been described as an example of a configuration including the on-board device 12 as shown in FIG. 1, but is not limited thereto. For example, the soundness determination system 10 may be configured only by the soundness determination device 13 and may acquire a moving image of the building from the outside of the soundness determination device 13.

Further, in the second to fourth embodiments, the procedure for performing authentication by the control unit 68 or the control unit 88 after the public information is presented by the public unit 66 has been described as an example, but the present invention is not limited to this. For example, by operating the building management systems 210, 310, 410 as a form such as a membership system, the public information by the public unit 66 is presented after being certified by the control unit 68 or the control unit 88. May be good. This makes it possible to prevent the information on the presence / absence of the determination information itself from being disclosed to an unspecified number of users.

Further, in the fourth embodiment, as an example of the case where the information on the soundness of the predetermined building does not exist, the case where the moving image of the predetermined building is not captured has been described as an example, but the present invention is not limited to this. Absent. For example, when a moving image is captured and the soundness is not determined, the soundness of the building is determined according to the request information transmitted from the user terminal.

Further, in the fourth embodiment, the request from the user who is the building owner has been described as an example, but the present invention is not limited to this. For example, a request from a user different from the building owner, such as a user representing the construction company that constructed the target building, a user who is a resident of the rental housing complex that is the target building, or a user who is not related to the target building. May be targeted. In this case, a user different from the building owner operates the user terminal 70 and is requested to acquire information on the soundness of the target building.

Further, in the above description, the mode in which the program according to the present invention is stored (installed) in advance in the program storage unit (not shown) has been described, but the program according to the present invention includes a CD-ROM, a DVD-ROM, and a micro SD card. It is also possible to provide the program in a form recorded on any of the recording media such as.

2A Helicopter 2B, 4A, 4B Building 2C Stabilizer 10 Health judgment system 12 On-board device 13 Health judgment device 14 Camera 16, 22, 72, 82 Computer 18 Video storage unit 20, 52, 58, 68, 78, 88 Control Units 24, 76, 86 Display unit 25 Analysis unit 26 Acquisition unit 28 Information storage unit 30 Data storage unit 32 Building information database 34 Analysis result database 36 Judgment result database 38 Building identification unit 40 Removal unit 42 Measurement unit 44 Judgment unit 46 Display control Unit 50 Soundness management device 54, 62, 79, 89 Communication unit 60 Data operation device 64 Public information database 66 Public unit 67 Authentication database 70 User terminal 74, 84 Operation unit 80 Management device 210, 310, 410 Building management system 236 Health database 437 Request information database 450 Health management device

Claims (6)

An acquisition unit that acquires moving images of a single or multiple buildings captured by an imaging device included in a moving object, and an acquisition unit.
From the moving image acquired by the acquisition unit , a moving component representing the movement of the image pickup device and vibration caused by the image pickup device corresponding to a spatiotemporal frequency band different from the spatiotemporal frequency of the vibration of the building determined in advance. A removal part that removes components,
A measuring unit that measures the vibration of a single or a plurality of buildings based on each frame image of the moving image from which the moving component and the vibration component have been removed by the removing unit.
Measuring equipment including. A soundness determination device including a determination unit for determining the soundness of the building based on the vibration of the building measured by the measuring device according to claim 1 for each of the single or a plurality of buildings. A soundness management device including a storage unit for storing information on the soundness of the building obtained by the soundness determination device according to claim 2.
A public department that publishes information on whether or not information on the soundness of the building has been acquired by the soundness determination device for each of the single or multiple buildings.
Reception desk, which accepts inquiry information including information about a specific building to make inquiries
When the inquiry information received by the reception unit satisfies a predetermined condition, an inquiry for acquiring information on the soundness of the building corresponding to the inquiry information stored in the storage unit of the soundness management device. A data operation device including a processing unit and an output unit that outputs information on the soundness acquired by the inquiry processing unit.
Building management system with. A request information output unit that outputs request information indicating a request for permission to acquire information on the soundness of the specific building to a user who owns the specific building.
An approval information acquisition unit that acquires approval information indicating approval for acquisition of the soundness of the specific building from the user.
An approval information output unit that outputs the inquiry information including the approval information acquired by the approval information acquisition unit to the data operation device, and an approval information output unit.
A soundness information acquisition unit that acquires information on the soundness of the building corresponding to the inquiry information output from the data operation device, and a soundness information acquisition unit.
Further has a management device including
The reception unit of the data operation device receives the inquiry information output from the management device, and receives the inquiry information.
The output unit outputs information on the soundness of the building corresponding to the inquiry information to the management device.
The building management system according to claim 3. The reception unit of the data operation device receives request information for acquiring information on the soundness of a predetermined building, and receives the request information.
The data operation device further includes a request information output unit that outputs the request information to the soundness management device.
The soundness management device includes a request information receiving unit that receives the request information output from the data operation device, and a request information receiving unit.
Further including a setting unit for setting to acquire information on the soundness of the building corresponding to the request information received by the request information reception unit.
The building management system according to claim 3 or 4. A building management system including a measuring device, a soundness determination device, a soundness management device, a data operation device, and a management device.
The measuring device is
An acquisition unit that acquires moving images of a single or multiple buildings captured by an imaging device included in a moving object, and an acquisition unit.
A removing unit that removes a moving component representing the movement of the imaging device from the moving image acquired by the acquiring unit, and a removing unit.
A measuring unit that measures the vibration of a single or a plurality of buildings based on each frame image of the moving image from which the moving component has been removed by the removing unit includes.
The soundness determination device is
For each of a single building or a plurality of buildings, a determination unit for determining the soundness of the building based on the vibration of the building measured by the measuring device is included.
The soundness management device is
A storage unit that stores information on the soundness of the building obtained by the soundness determination device is included.
The data operation device is
A public department that publishes information on whether or not information on the soundness of the building has been acquired by the soundness determination device for each of the single or multiple buildings.
Reception desk, which accepts inquiry information including information about a specific building to make inquiries
When the inquiry information received by the reception unit satisfies a predetermined condition, an inquiry for acquiring information on the soundness of the building corresponding to the inquiry information stored in the storage unit of the soundness management device. Processing unit and
Includes an output unit that outputs information about the soundness acquired by the inquiry processing unit.
The management device is
A request information output unit that outputs request information indicating a request for permission to acquire information on the soundness of the specific building to a user who owns the specific building.
An approval information acquisition unit that acquires approval information indicating approval for acquisition of the soundness of the specific building from the user.
An approval information output unit that outputs the inquiry information including the approval information acquired by the approval information acquisition unit to the data operation device, and an approval information output unit.
Including a soundness information acquisition unit that acquires information on the soundness of the building corresponding to the inquiry information output from the data operation device.
The reception unit of the data operation device receives the inquiry information output from the management device, and receives the inquiry information.
The output unit outputs information on the soundness of the building corresponding to the inquiry information to the management device.
Building management system.

Images