JP2017045212A - Inspection support system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To shorten an inspection time at an inspection place.SOLUTION: An inspection support system includes an information acquisition terminal and an information processor. The information acquisition terminal photographs an inspection place instructed from the information processor, accepts an input of an inspection result by an inspector about inspection items after reducing items obtained by excluding items whose device determination result is "PASS", based on the photographed image, and transmits the inspection results to the information processor.SELECTED DRAWING: Figure 4

Description

The present invention relates to an inspection support system suitable for inspection of buildings and structures.

  As the current state of construction for building and structure construction, there is a problem that it takes time to perform a series of processes such as inspection, preparation of inspection indication materials, correction, and confirmation. Patent Document 1 discloses a method for shortening time such as preparation of inspection indication materials, correction instructions to partner companies, and confirmation of results. Specifically, “At the construction site, use a portable information terminal, perform construction quality inspection (completion inspection), send the inspection results to the host PC via the network, and inspect the indicated location. There is a description (summary) that is to paste a QR code in which the result is voice-inputted (QR code is a registered trademark).

JP 2005-190463 A

  Patent Document 1 states that the creation of a correction instruction enables quick and accurate transmission of correction contents and shortens the construction period. However, the field work has not been simplified, and it is not expected that the inspection time will be shortened. In other words, in accordance with the work drawings, work instructions and inspection instructions, it is necessary for the inspector to visit the site and visually check and photograph all the inspection items one by one.

  The present invention provides a technique for determining an inspection item using an image captured by an information acquisition terminal and reducing the inspection item. An example of a specific aspect is as follows.

  The server sends a work instruction such as an imaging instruction for an inspection location or imaging location to the inspector's information acquisition terminal.

  The inspector uses the information acquisition terminal to go to the inspection location, take an image of the inspection location, and transmit the image data to the server.

  The server stores the inspection item and CAD data based on the design drawing in advance, and further stores the received image data so as to be linked to the inspection item.

  The server compares the stored image data with the CAD data of the inspection object and / or detects a problem such as a crack using an inspection tool.

  As a result of the comparison, if the image data and the CAD data match, or if no problem is detected by the inspection tool, it is excluded from the inspection items, and if they do not match, they are registered as inspection items.

  The registered inspection item is sent to the inspector, who inspects the inspection item.

  The inspector is instructed by voice or text displayed from the information acquisition terminal.

  By performing the inspection as described above, the number of inspection items for the inspector can be reduced, so that the inspection time can be shortened.

  According to the present invention, the work contents of a construction inspection person in the field are reduced, and the inspection time is shortened. In addition, it is possible to reduce the work burden on the person in charge of inspection.

  Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

System Configuration. The figure which shows the hardware structural example of the information acquisition terminal of 1st Embodiment. 1 is a diagram illustrating a hardware configuration example of an information processing apparatus according to a first embodiment. The figure which shows the example of a sequence of 1st Embodiment. FIG. 3 is a flowchart illustrating an example of a processing procedure of the information processing apparatus according to the first embodiment. The flowchart which shows the process sequence example of the information acquisition terminal of 1st Embodiment. The figure which shows the hardware structural example of the information acquisition terminal of 2nd Embodiment. The figure which shows the hardware structural example of the information processing apparatus of 2nd Embodiment. The figure which shows the example of a sequence of 2nd Embodiment. The flowchart which shows the process sequence example of the information acquisition terminal of 2nd Embodiment. The figure which illustrates the inspection item list before item reduction. The figure which illustrates the inspection item list after item reduction. The flowchart at the time of apparatus determination.

  Hereinafter, embodiments will be described with reference to the drawings.

  FIG. 1 is a system configuration diagram of this embodiment. In this embodiment, the user performs login authentication from the information acquisition terminal 1 such as a smartphone to the information processing apparatus 2 via the communication network, and the information processing apparatus 2 notifies the information acquisition terminal 1 of the inspection location, the imaging instruction, and the like. The information acquisition terminal 1 picks up an image of the examination location and sends the image to the information processing device 2. The information processing apparatus 2 performs apparatus determination of an inspection item for an image of a sent inspection location, using CAD data based on a design drawing or an inspection tool stored in advance. The list is sent to the information acquisition terminal 1 with items other than the items for which no problem has been detected in the device determination required as inspections. The inspector performs an inspection using the information acquisition terminal 1 and sends the result to the information processing apparatus 2. Voice or text may be used as an input / output interface for the inspector.

  In this embodiment, a sound collection device 16 such as a microphone, an imaging device 17 such as a camera, and a position information acquisition device 15 using GPS, which are configured as shown in FIG. A portable electronic device is used as the information acquisition terminal 1, and a server including the sound processing unit 21 and the video processing unit 20 configured as shown in FIG. The information acquisition terminal 1 may not include the position information acquisition device 15 and the sound collection device 16. The image acquired by the information acquisition terminal 1 may be accompanied by sound from the sound collection device 16.

  The configuration of the information acquisition terminal 1 in FIG. 2 will be described. The information acquisition terminal 1 includes, for example, a central processing unit 11, a network connection device 12, an input / display device 13, a storage device 14, a position information acquisition device 15, a sound collection device 16, and an imaging device 17.

  FIG. 3 is a configuration diagram of the information processing apparatus 2. The information processing device 2 includes, for example, a central processing unit 23, a network connection device 24, an authentication device 25, a storage device 26, and a captured object determination device 22.

  Each device in the information acquisition terminal 1 and the information processing device 2 is realized by one or both of hardware and program execution. The storage device 14 of the information acquisition terminal 1 and the storage device 26 of the information processing device 2 store programs executed by the central processing unit 11 and the central processing unit 23, respectively.

  The central processing unit 11 and the central processing unit 23 read out and execute a program, and realize each processing of the present embodiment described below in cooperation with other devices in the device itself. The central processing unit 23 implements the video processing unit 20 and the sound processing unit 21 as functions by executing a program.

  FIG. 4 is a sequence diagram in the case of apparatus determination of inspection items according to the present embodiment.

  Step 100: The information acquisition terminal 1 performs login authentication to the information processing apparatus 2 using information such as an email address and a password by encrypted communication, for example, HTTPS communication.

  Step 101: The information processing apparatus 2 transmits to the information acquisition terminal 1 instructions for inspection locations and imaging locations such as building names, floor numbers, and room numbers.

  Step 102: The information acquisition terminal 1 captures one or a plurality of images for the examination location instructed to the information processing device 2 using the position information acquisition device 15, the imaging device 17, the sound collection device 16, and the like. At this time, position information such as GPS may be acquired using the position information acquisition device 15 and transmitted. Moreover, you may transmit the audio | voice collected using the sound collector 16. FIG. The image is not limited to a still image but may be a moving image.

  Step 103: The video processing unit 20 and the sound processing unit 21 of the information processing apparatus 2 analyze the transmitted image (or moving image) of the inspection location (details will be described later).

  The imaging object determination device 22 analyzes the analysis result of the items in the inspection item list before the item reduction in FIG. 11 by comparing the analysis result with CAD data stored in advance or using an inspection tool for detecting a problem such as a crack. If there is no problem, a process of excluding from inspection items is performed. As a result, an inspection item list after item reduction as shown in FIG. 12 is generated.

  Step 104: The information processing apparatus 2 transmits the inspection item list after the item reduction to the information acquisition terminal 1.

  Step 105: The information acquisition terminal 1 inputs the inspection result into the information acquisition terminal 1 by voice or text according to the inspection item list after item reduction transmitted from the information processing apparatus 2, and transmits it to the information processing apparatus 2.

  Step 106: The information processing apparatus 2 confirms the inspection result transmitted from the information acquisition terminal 1 and confirms whether there is any deficiency or deficiency in the inspection. If there is any deficiency or deficiency, step 104 and step 105 are repeated until completion can be confirmed.

  Step 107: The information acquisition terminal 1 is notified that the inspection has been completed.

  FIG. 5 is a flowchart illustrating an example of a processing procedure of the information processing apparatus 2 according to the present exemplary embodiment. The operation based on the flowchart of FIG. 5 is as follows.

  Step 201: The information processing apparatus 2 receives the login of the information acquisition terminal 1.

  Step 202: Send information from the information processing apparatus 2 to the information acquisition terminal 1, for example, an inspection location such as a building name, floor number, room number, etc., and an imaging location instruction.

  Step 203: Receive image data from the information acquisition apparatus 1.

  Step 204: Comparing with CAD data stored in advance and analyzing with an inspection tool for detecting problems such as cracks, excluding items without problems from the inspection item list before item reduction in FIG. Create inspection item list after item reduction.

  Step 205: The created inspection item list after item reduction is transmitted to the information acquisition terminal 1.

  Step 206: Receive input data of inspection items after item reduction from the information acquisition terminal 1.

  Step 207: The information processing apparatus 2 checks whether there is a deficiency or deficiency in the input data. If NO, go to step 209. If YES, go to step 208.

  Step 208: The information acquisition terminal 1 is contacted so as to inspect again the inspection items that are insufficient or incomplete, and the process proceeds to Step 206.

  Step 209: The inspection end is transmitted to the information acquisition terminal 1.

  Details of the processing in step 204 are shown in the flowchart of FIG.

  Step 701: The information processing apparatus 2 confirms that the imaging data acquired from the information acquisition terminal 1 exists.

  Step 702: Extract the items in which the apparatus determination availability column in FIG. 11 is “permitted”, for example, the items 601 and 602. Since the item 603 is an item for confirming the operation, the device determination availability is “No”.

  Step 703: CAD data relating to the item extracted in step 702 is extracted.

  Step 704: Comparison with CAD data and comparison with a predetermined threshold using existing technology such as an inspection tool for judging cracks.

  Step 705: As a result of the comparison, it is confirmed whether or not the item in the inspection item list matches the data at the time of design such as CAD data. If NO, go to step 707. If YES, go to step 706.

  Step 706: The corresponding item in the inspection item list is determined as “PASS”, and the process proceeds to Step 710.

  Step 707: The corresponding item in the inspection item list is determined as “FAIL”.

  Step 708: It is determined whether or not the reason for determining “FAIL” is deficiency in imaging data. If NO, go to Step 710. If YES, go to step 709. The determination may be based on visual observation, for example.

  Step 709: An instruction is given to the information acquisition terminal 1 to acquire the imaging data again, and new imaging data is acquired.

  Step 710: From the inspection item list, an inspection item list after item reduction is created by excluding the item for which the apparatus determination availability column is “permitted” and the determination of “PASS” in step 706.

  FIG. 6 is a flowchart illustrating an example of a processing procedure of the information acquisition terminal 1 according to the present exemplary embodiment. The operation based on the flowchart of FIG. 6 is as follows.

  Step 301: The information acquisition terminal 1 performs login authentication to the information processing apparatus 2 using information such as an email address and a password by encrypted communication, for example, HTTPS communication.

  Step 302: The information acquisition terminal 1 receives an instruction or the like of an inspection location or an imaging location from the information processing device 2.

  Step 303: The information acquisition terminal 1 captures one or a plurality of images for the examination location instructed to the information processing device 2 by using the imaging device 17. At this time, position information such as GPS may be acquired using the position information acquisition device 15 and transmitted. Moreover, you may transmit the audio | voice collected using the sound collector 16. FIG. The image is not limited to a still image but may be a moving image.

  Step 304: Transmit the captured data to the information processing apparatus 2.

  Step 305: Receive an inspection item list after item reduction.

  Step 306: The inspection item list after item reduction is displayed on the input / display device 13 of the information acquisition terminal 1, and according to the inspection item list after item reduction, voice (using the sound collector 16), text, etc. (input) The inspection result is input to the information acquisition terminal 1 by using the cum display device 13.

  Step 307: The information acquisition terminal 1 transmits the input data to the information processing device 2.

  Step 308: It is checked whether there is a reexamination instruction from the information processing apparatus 2. If NO, go to step 309. If YES, go to step 306.

  Step 309: The information acquisition device 1 is notified of the end of the examination from the information processing device 2.

  FIG. 11 shows an inspection item list before item reduction.

  For example, item 601 is an item for inspecting foundation deterioration and damage, and is an item for visually confirming that there is no deviation in the foundation stone, and that there are no reinforcing bars exposed, significant cracks, or defects on the concrete surface. It has become. Therefore, whether or not the apparatus can be determined using an inspection tool for detecting a problem such as a comparison with CAD data or a crack is set to “Yes”. Items 602 and 603 are items for inspecting the situation such as the settlement of the foundation. For items that can be visually confirmed, such as whether the foundation of the item 602 is bent, tilted, etc., the device determination possibility is “possible”. Therefore, since the device determination is insufficient for the imaging data, the device determination availability is set to “No”.

  FIG. 12 shows the inspection item list after item reduction excluding the item of “PASS” as a result of comparison between the imaging data and CAD data such as CAD data, which is “possible”.

  In this way, the information acquisition terminal 1 can determine the apparatus by using the inspection tool that transmits the imaging result of the inspection location to the information processing apparatus 2 and detects a problem such as a comparison with CAD data based on the design drawing or a crack. By generating the inspection item list after item reduction excluding the item whose determination result is “PASS” among the items, the labor of inspection at the site is reduced and the inspection time is shortened.

  In this embodiment, an information acquisition terminal 1 and an information processing apparatus 2 having different configurations are used. Specifically, the information processing device 2 includes the video processing unit 18, the sound processing unit 19, and the imaging object determination device 10 in the central processing unit 11, which are included in the information processing device 2 described in the first embodiment. The information acquisition terminal 1 is provided. A configuration example of the information acquisition terminal 1 of this embodiment is shown in FIG. However, the position information acquisition device 15 and the sound collection device 16 may not be provided. The image acquired by the information acquisition terminal 1 may be accompanied by sound from the sound collection device 16.

  Configurations and operations other than the above-described differences between the information acquisition terminal 1 in FIG. 7 and the information processing apparatus 2 in FIG. 8 are the same as those in the first embodiment.

  FIG. 9 is a sequence diagram in the case of the apparatus determination of the inspection item according to the present embodiment.

  Step 401: The information acquisition terminal 1 performs login authentication to the information processing apparatus 2 using information such as an e-mail address and a password by encrypted communication, for example, HTTPS communication.

Step 402: The information processing device 2 transmits an instruction of an inspection location and an imaging location to the information acquisition terminal 1. At this time, information including an inspection item list before item reduction and related CAD data is transmitted to the information acquisition terminal 1.
Step 403: The information acquisition terminal 1 captures one or a plurality of images for the examination location instructed to the information processing device 2 using the position information acquisition device 15, the imaging device 17, the sound collection device 16, and the like. At this time, position information such as GPS may be acquired using the position information acquisition device 15. Further, the sound may be collected using the sound collecting device 16. The image is not limited to a still image but may be a moving image.

  Step 404: Based on the captured image (including the video), the captured object determination device 10 of the information acquisition terminal 1 cooperates with the video processing unit 18 and the sound processing unit 19 in the inspection item list before the item reduction. Device-determine items.

  Step 405: The information acquisition terminal 1 performs device determination from the inspection item list before item reduction, and creates an inspection item list after item reduction in which the item whose result is “PASS” is deleted.

  Step 406: The information acquisition terminal 1 displays the inspection item list after the item reduction on the input / display device 13 of the information acquisition terminal 1. The inspector uses the sound collection device 16 according to the inspection item list after the item reduction, and inputs the inspection result to the information acquisition terminal 1 using voice, the display device 13, or text.

  Step 407: The information acquisition terminal 1 transmits to the information processing apparatus 2 the data that has been inspected and input according to the inspection item list after item reduction, and the inspection result determined by device determination.

  Step 408: The information processing apparatus 2 transmits to the information acquisition terminal 1 that the examination has been completed.

  FIG. 10 is a flowchart illustrating an example of a processing procedure of the information acquisition terminal 1 according to the present exemplary embodiment. The operation based on the flowchart of FIG. 10 is as follows.

  Step 501: The information acquisition terminal 1 performs login authentication to the information processing apparatus 2 using information such as an email address and a password by encrypted communication, for example, HTTPS communication.

  Step 502: The information acquisition terminal 1 receives an instruction or the like of an inspection location or an imaging location from the information processing device 2. At this time, information including an inspection item list before item reduction and related CAD data is received.

  Step 503: The information acquisition terminal 1 captures one or a plurality of images of the inspection location using the imaging device 17 in accordance with the shooting location, the shooting location instruction, and the like. At this time, position information such as GPS may be acquired using the position information acquisition device 15. Further, the sound may be collected using the sound collecting device 16. The image is not limited to a still image but may be a moving image.

  Step 504: Based on the captured image (including video), the imaging object determination device 10 of the information acquisition terminal 1 cooperates with the video processing unit 18 and the sound processing unit 19 to create an inspection item list before item reduction. Device-determine items. The information acquisition terminal 1 performs apparatus determination from the inspection item list before item reduction, and creates an inspection item list after item reduction in which the item whose result is “PASS” is deleted.

  Details of the processing in step 504 are shown in FIG. 13 as in the first embodiment.

  Step 505: The inspection item list after the item reduction is displayed on the information acquisition terminal 1 on the display device 13 of the information acquisition terminal 1. The inspector performs an inspection by voice or text according to the inspection item list after the item reduction, and inputs the information to the information acquisition terminal 1.

  Step 506: The information acquisition terminal 1 checks whether the input data is incomplete or insufficient. If there is any deficiency or deficiency, return to step 505. If there is no deficiency or deficiency, go to Step 507.

  Step 507: The inspection result is transmitted to the information processing apparatus 2.

  In this way, rather than using the inspection item list before the item reduction, inspection of the inspection item is performed using an inspection tool that detects a problem such as a comparison with CAD data or a crack in the information acquisition terminal 1. By reducing the items to be inspected by the inspector, the labor of the inspection at the site is reduced and the inspection time is shortened.

DESCRIPTION OF SYMBOLS 1 ... Information acquisition terminal, 2 ... Information processing apparatus, 10 ... Imaging object determination apparatus, 11 ... Central processing unit, 12 ... Network connection apparatus, 13 ... Display apparatus, 14 ... Memory | storage device, 15 ... Position information acquisition apparatus, 16 DESCRIPTION OF SYMBOLS ... Sound collecting device, 17 ... Imaging device, 18 ... Video processing unit, 19 ... Sound processing unit, 20 ... Video processing unit, 21 ... Sound processing unit, 22 ... Imaging object determination device, 23 ... Central processing unit, 24 ... Network connection device 25 ... Authentication device 26 ... Storage device

Claims (5)

An inspection support system comprising an information acquisition terminal and an information processing device,
The information acquisition terminal
Take a picture of the inspection location instructed by the information processing device,
Accept inspection data input by the inspector for inspection items after item reduction, excluding items with the device determination result of “PASS” based on the captured image,
An inspection support system, wherein the inspection result is transmitted to the information processing apparatus. The inspection support system according to claim 1,
The information processing apparatus transmits an instruction of an inspection location based on an inspection item before item reduction,
The information processing terminal transmits the captured image to the information processing apparatus;
The information processing apparatus includes:
Based on the received image, perform device determination of the designated inspection location,
Based on the result of the device determination, reduce the inspection items,
Send the inspection items after the item reduction to the information processing terminal,
The information processing terminal outputs the received inspection item after the item reduction. The inspection support system according to claim 1,
The information processing apparatus transmits an instruction of an inspection location based on an inspection item before item reduction,
The information processing terminal
Perform device determination of the inspected location based on the captured image,
Based on the result of the device determination, reduce the inspection items,
The inspection support system, wherein the inspection item after the item reduction is output to the information processing terminal. The inspection support system according to any one of claims 1 to 3,
The inspection items before the item reduction include an item that can be determined by the device and an item that is not determined by the device,
The information processing device or the information processing terminal performs the device determination on the device determination possible item,
The information processing terminal accepts an input of the inspection result by the inspector for an item whose device determination result is “FAIL” and an item of apparatus determination failure. The inspection support system according to any one of claims 1 to 4,
The information processing apparatus or the information processing terminal performs either one or both of comparison with CAD data and use of an inspection tool in the apparatus determination.

Images