JP2013168808A - Method, program and apparatus for supporting inspection of structure - Google Patents

Abstract

PROBLEM TO BE SOLVED: To generate a screen easy to compare a plurality of bridge piers with each other.SOLUTION: A method for supporting inspection of a structure includes: acquiring a moving image obtained by sequentially imaging a plurality of bride piers by repeating an operation of imaging one bridge pier while changing a zoom of an imaging device to a wide side, a tele-side and a wide side, for the plurality of bridge piers, and information on a focal distance of the imaging device at the time of imaging the moving image; accepting a comparison request issued when one frame of the moving image is specified; acquiring a focal distance A at a time when a focal distance becomes minimum before a time when having imaged the specified frame, and a focal distance B at a second time when a focal distance becomes minimum after the time when having imaged the specified frame and calculating a difference Δ between the focal distance A and the focal distance B; extracting one or more frames on the basis of a focal distance when imaging the specified frame and the difference Δ; and displaying in parallel the specified frame and the extracted frame.

Description

  This case relates to a structure inspection support method, a structure inspection support program, and a structure inspection support apparatus.

  Conventionally, an inspection support system has been proposed for smoothly performing inspection work on structures such as bridges. The main purpose of this inspection support system is to support simple inspections among various levels of inspection work such as simple inspections and detailed inspections of structures. Specifically, a conventional inspection support system performs a simple and smooth process of requesting an inspector (such as a construction consultant) to check a still image or a video of a structure photographed by a photographer (such as a local government employee). Is supporting.

  As a structure to be inspected, for example, there is a bridge pier. Since the number of piers to be inspected by one local government is very large, it is efficient to use the above-described inspection support system in the inspection of piers. In addition, when taking pictures of bridge piers over rivers, etc., taking into account efficiency and safety, you can shoot multiple piers sequentially from a place where you can see all of the piers of one bridge while adjusting the zoom of the photographic device. It is envisaged to use a method that does this.

JP 2004-21403 A

  Generally, when inspecting multiple piers of one bridge, the bridge inspector gives priority to which pier is based on the degree of damage (cracks, rust, etc.) of the multiple piers in consideration of the construction period and budget. It will be judged whether it should be renovated. This point is the same in the inspection using the above-mentioned movie, but the bridge inspector does not need to see everything from the beginning to the end of the movie. Should be able to. However, the inventors have found that it is difficult to compare the degree of damage by simply extracting and displaying the frames in which the piers are photographed from a moving image and displaying the frames side by side for visual inspection.

  This is because when shooting the pier from a distance, the distance between the imaging device and each pier is different, so each pier is not always displayed in the same size in each frame, and the magnitude of damage between frames This is because the actual degree of damage is not compared even if the comparison is made.

  Patent Document 1 discloses a technique for extracting features common to an image group designated by a user and making them a feature amount of a category to which the image group belongs. However, even if such a technique is used, whether or not the feature amount for extracting the pier from the image can be calculated depends on the contents of the image group designated by the user, and thus the degree of damage can be compared. The image may not be extracted.

  Accordingly, the present invention has been made in view of the above problems, and provides a structure inspection support method, a structure inspection support program, and a structure inspection support apparatus capable of generating a screen that can easily compare a plurality of structures. The purpose is to do.

  In the structure inspection support method described in this specification, an operation of photographing a structure to be photographed while changing the zoom of the photographing apparatus to the wide side, the tele side, and the wide side is performed on a plurality of structures. An acquisition step of acquiring a moving image obtained by sequentially capturing a plurality of structures by repeating, information on the focal length of the image capturing apparatus at the time of moving image capturing, and an instruction specifying one of the frames of the moving image Based on the receiving step of receiving and information on the focal length of the photographing apparatus, the focal length at the first time and the second time at which the focal length is minimized, and the focal length at the first time are acquired. One or more frames are extracted based on the calculation step of calculating the difference between the focal length and the focal length at the second time, the focal length when the specified frame is captured, and the difference An extraction step, a structure inspection support method a generation step, the computer executes to generate a screen displaying side by side and frame said it said extracted with a particular frame.

  The structure inspection support program described in this specification is configured to perform an operation of photographing a structure to be photographed while changing the zoom of the photographing apparatus to the wide side, the tele side, and the wide side with respect to a plurality of structures. Receiving a moving image obtained by sequentially capturing a plurality of structures by repeating, information on the focal length of the image capturing apparatus at the time of moving image capturing, and receiving an instruction specifying one of the frames of the moving image; Based on the focal length information of the photographing apparatus, the focal length at the first time and the second time at which the focal length is minimized is acquired, and the focal length at the first time and the second time are obtained. And calculating one or more frames based on the focal distance when the specified frame is photographed and the difference, and calculating the specified frame. It generates a screen to be displayed side by side with the extracted frame is a structure inspection support program for executing the processing to the computer.

  The structure inspection support device described in the present specification performs an operation for photographing a structure to be photographed while changing the zoom of the photographing device to the wide side, the tele side, and the wide side with respect to one structure to be photographed. An acquisition unit that acquires a moving image obtained by sequentially capturing a plurality of structures by repeating, information on a focal length of the imaging device at the time of moving image capturing, and an instruction that identifies one of the frames included in the moving image Based on the receiving unit that receives the information and the focal length information of the photographing apparatus, the focal length at the first time and the second time at which the focal length is minimized, and the focal length at the first time is acquired. And extracting the one or more frames based on the calculation unit that calculates the difference between the focal length at the second time and the focal length when the specified frame is captured and the difference When, and a, a generator for generating a screen displaying side by side and said it said extracted with specified frame frame.

  The structure inspection support method, the structure inspection support program, and the structure inspection support device described in the present specification have an effect that a screen that can easily compare a plurality of structures can be generated.

It is a figure showing roughly the composition of the bridge inspection support system concerning one embodiment. It is a hardware block diagram of the server of FIG. It is a functional block diagram of an imaging device, a server, and a consultant terminal. It is a figure which shows an example of the positional relationship of the pier at the time of imaging | photography of a pier and an imaging device. FIG. 5A is a diagram showing a zoom information work table, and FIG. 5B is a diagram showing a moving image DB. It is a flowchart which shows the acquisition process of the moving image file and imaging | photography information by a server. It is a figure which shows an example of a bridge name input screen. It is a flowchart (the 1) which shows the display process by a server and a consultant terminal. It is a flowchart (the 2) which shows the display process by a server and a consultant terminal. It is a flowchart (the 3) which shows the display process by a server and a consultant terminal. It is a figure which shows an example of a list screen. It is a figure which shows an example of a moving image file reproduction | regeneration screen. It is a graph which shows the relationship between the time stamp (imaging time) of the zoom information work table of Fig.5 (a), and a focal distance. It is a figure which shows an example of an pier comparison screen.

  Hereinafter, an embodiment will be described in detail with reference to FIGS. FIG. 1 schematically shows a bridge inspection support system 100 including a server 20 as a structure inspection support apparatus.

  As shown in FIG. 1, the bridge inspection support system 100 includes an imaging device 10, a server 20, and a consultant terminal 30, and each device (10, 20, 30) is connected to a network 40 such as the Internet. ing.

  The imaging device 10 is, for example, a video camera (see FIG. 4) that can capture a moving image. As illustrated in FIG. 3, the imaging device 10 includes an imaging unit 14, a display unit 15, an input unit 16, and a communication unit 18.

  The image capturing unit 14 captures a plurality of bridge piers of the bridge to be inspected with a moving image (for example, a high-definition moving image) based on an instruction input by a photographer (for example, a local government employee) via the input unit 16. The display unit 15 includes a liquid crystal display and the like, displays various menu screens, and displays a moving image (finder image) being shot. The input unit 16 includes a touch panel and various buttons, receives an instruction from the photographer, and transmits the instruction to the imaging unit 14 and the communication unit 18. The communication unit 18 includes a moving image file photographed by the photographing unit 14 and information including zoom information (focal length information) and a time stamp when the photographing unit 14 photographs the moving image (hereinafter referred to as “photographing information”). It transmits to the server 20.

Here, it is assumed that a photographer who photographs using the photographing apparatus 10 captures a moving image under the following conditions based on a predetermined manual.
(1) The structure to be photographed is a plurality of bridge piers included in the bridge.
(2) When photographing, the photographing apparatus 10 is installed at a place where all bridge piers of one bridge can be seen (a place as shown in FIG. 4).
(3) When photographing, a plurality of piers are photographed sequentially along the order of the piers.
(4) While photographing one pier, the zoom state of the photographing apparatus 10 is adjusted from wide → tele → wide.
(5) When returning the zoom state of the photographing apparatus 10 from tele to wide, care should be taken that the next photographing target pier is returned to a predetermined size within the photographing field of view.

  Returning to FIG. 1, the server 20 receives and holds the moving image file and the shooting information transmitted from the shooting device 10. Further, the server 20 generates a screen for displaying (playing back) a moving image (moving image file playback screen (FIG. 12)) in response to an instruction from the consultant terminal 30 and transmits the screen to the consultant terminal 30. Further, in response to an instruction from the consultant terminal 30, a screen (bridge pier comparison screen (FIG. 14)) for comparing the degree of damage of each pier is generated and transmitted to the consultant terminal 30.

  FIG. 2 shows the hardware configuration of the server 20. As shown in FIG. 2, the server 20 includes a CPU 90, a ROM 92, a RAM 94, a storage unit (here, HDD (Hard Disk Drive)) 96, a network interface 97, a portable storage medium drive 99, and the like. Each component of the 20 components is connected to a bus 98. In the server 20, the CPU 90 executes a program (structure inspection support program) stored in the ROM 92 or the HDD 96 or a program (structure inspection support program) read from the portable storage medium 91 by the portable storage medium drive 99. By doing so, the function of each part of FIG. 3 is implement | achieved. That is, in the server 20, the functions of the image recording unit 22 and the reproduction unit 24 as an acquisition unit are realized by the CPU 90. FIG. 3 also shows the zoom information work table 26 and the moving image DB 28 stored in the HDD 96 or the like.

  The image recording unit 22 stores the shooting information received from the communication unit 18 in the zoom information work table 26 and executes processing for storing the moving image file received from the communication unit 18 in the moving image DB 28.

  The reproducing unit 24 generates a screen to be displayed on the consultant terminal 30 using the zoom information work table 26 and the moving image DB 28 in accordance with an instruction from the consultant terminal 30. Further, the playback unit 24 transmits the generated screen to the consultant terminal 30.

  In the zoom information work table 26, as shown in FIG. 5A, a time stamp and a focal length are stored for each moving image ID. The moving image ID is a unique character string that the image recording unit 22 assigns to the moving image file, and the time stamp and the focal length are the time of the photographing apparatus 10 at a certain time (time when the photographing start time is set to 0m.00s.00). It means the zoom state (focal length). In FIG. 5A, the focal length is acquired every unit time, but the present invention is not limited to this. For example, only the focal length and the time stamp when the focal length changes may be acquired. If the zoom information work table is created in separate folders for each moving image ID, the moving image ID field can be omitted.

  As illustrated in FIG. 5B, the moving image DB 28 includes fields for a bridge name, a moving image ID, and a moving image file. In the bridge name field, the bridge name input from the input unit 16 of the photographing apparatus 10 is stored. Similar to the zoom information work table 26, a unique character string assigned to the moving image file by the image recording unit 22 is stored in the moving image ID field.

  Returning to FIG. 1, the consultant terminal 30 is a terminal used by a user (such as a construction consultant) who inspects the pier. The consultant terminal 30 displays a screen (video file reproduction screen (FIG. 12) or bridge pier comparison screen (FIG. 14)) provided from the server 20 by exchanging with the server 20. The construction consultant browses the moving image file photographed using the moving image file reproduction screen (FIG. 12) displayed on the consultant terminal 30 and inspects the pier. In addition, the construction consultant designates the pier displayed in a part of the frame of the video file as necessary, and the degree of damage of the designated pier and other piers (in this embodiment, adjacent piers). ) Is also checked to compare the degree of damage using the pier comparison screen (FIG. 14).

  As shown in FIG. 3, the consultant terminal 30 includes a control unit 32, a display unit 34, and an input unit 36. The control unit 32 includes a CPU, a ROM, a RAM, and the like, and comprehensively controls each unit of the consultant terminal 30 and transmits and receives data and the like (screen and instructions) to and from the server 20.

  The display unit 34 includes a liquid crystal display and the like, and displays a screen received from the server 20 under the instruction of the control unit 32. The input unit 36 receives an instruction input from the construction consultant and transmits the instruction to the reproduction unit 24 of the server 20 via the control unit 32.

  Next, the processing of each apparatus in this embodiment ((A) acquisition process of moving image file and shooting information by the server 20 and (B) display processing by the server 20 and the consultant terminal 30) will be described in detail.

(A) Moving Image File and Shooting Information Acquisition Processing by Server 20 FIG. 6 shows a flowchart of moving image file and shooting information acquisition processing by the server 20. The processing in FIG. 6 is started, for example, when the photographer completes photographing of the pier and inputs an instruction to transmit the photographed moving image to the server 20 via the input unit 16. To do.

  In the process of FIG. 6, first, in step S <b> 10, the image recording unit 22 displays a bridge name input screen on the display unit 15 of the photographing apparatus 10. The bridge name input screen is, for example, a screen as shown in FIG. In the bridge name input screen of FIG. 7, after narrowing down by the prefecture name, the bridge name can be transmitted to the server 20 by selecting the bridge name and pressing the transmission button after the selection. It has become. In this case, the server 20 stores a bridge name DB that stores the prefecture name and the bridge name, and generates the screen of FIG. 7 using the bridge name DB. However, the present invention is not limited to this, and the image recording unit 22 may display a bridge name input screen or the like on which the bridge name can be directly input on the display unit 15.

  In step S12, the image recording unit 22 stands by until a bridge name is received. That is, at the stage where the photographer inputs the bridge name in the photographing apparatus 10 (stage where the transmission button in FIG. 7 is pressed), the determination in step S12 is affirmed and the process proceeds to step S14.

  In step S14, the image recording unit 22 records the accepted bridge name in the moving image DB 28. Next, in step S <b> 16, the image recording unit 22 downloads a moving image file from the photographing apparatus 10. In this case, the image recording unit 22 captures a moving image captured based on the above-described manual (the operation of photographing a single pier while changing the zoom of the photographing device 10 to the wide side, the tele side, and the wide side). Can be repeated to obtain a moving image) of a plurality of bridge piers.

  After the download of the moving image file in step S16 is completed, in step S18, the image recording unit 22 allocates a moving image ID to the moving image file and records it in the moving image DB 28 in association with the file name.

  Next, in step S <b> 20, the image recording unit 22 records the moving image ID in the zoom information work table 26. Next, in step S <b> 22, the image recording unit 22 records moving image shooting information (focal length information and time stamp) in the zoom information work table 26.

  Thus, the moving image file and shooting information acquisition processing by the server 20 is completed. As a result, information relating to the moving image photographed by the photographing apparatus 10 is recorded in the zoom information work table 26 (FIG. 5A) and the moving image DB 28 (FIG. 5B).

  In the above description, the case where the moving image file and the shooting information are transmitted from the shooting device 10 to the server 20 via the network 40 has been described. However, the present invention is not limited to this. For example, a moving image file or shooting information shot by the shooting device 10 may be delivered to the server 20 via a storage medium (such as an optical disk or a flash memory). In the case of using a storage medium, the photographing apparatus 10 may not have the communication unit 18 (not necessarily connected to the network 40). Alternatively, the photographing apparatus 10 may be connected to a terminal such as a PC, and a moving image file or photographing information may be transmitted from the terminal to the server 20.

(B) Display Processing by Server 20 and Consultant Terminal 30 Next, display processing by the server 20 and consultant terminal 30 will be described along the flowcharts of FIGS. 8 to 10 with reference to other drawings as appropriate. In the flowcharts of FIGS. 8 to 10, the processes and determinations are arranged in consideration of the processing timing of the server 20 and the processing timing of the consultant terminal 30.

  The processing in FIG. 8 is started from the stage where the construction consultant using the consultant terminal 30 issues a request for displaying the inspection target image using the input unit 36. In the process of FIG. 8, first, in step S <b> 200, the control unit 32 transmits a display request to the server 20.

  On the other hand, on the server 20 side, the reproduction unit 24 stands by until a request for displaying the inspection target image is received from the consultant terminal 30 in step S100. Therefore, the reproduction unit 24 proceeds to step S102 when the consultant terminal 30 transmits a display request in step S200, acquires all bridge names registered from the moving image DB 28, creates a list screen, and creates the consultant terminal. To 30. As an example, the list screen is a screen as shown in FIG. The list screen of FIG. 11 includes a list of bridge names and a transmission button that is pressed after the construction consultant selects one bridge name from the list of bridge names.

  On the other hand, on the consultant terminal 30 side, the control unit 32 stands by after step S200 until a list screen is received from the server 20 in step S202. Therefore, the control part 32 will transfer to step S204, after the process of step S102 is performed by the server 20 side. In step S204, the control unit 32 displays the list screen (FIG. 11) received from the server 20 on the display unit 34.

  Next, in step S206, the control unit 32 stands by until accepting selection of a bridge name. When the construction consultant selects the bridge name on the list screen of FIG. 11 and presses the transmission button, the control unit 32 proceeds to step S208. If transfering it to step S208, the control part 32 will transmit the bridge name selected by the construction consultant to the server 20.

  On the other hand, on the server 20 side, the playback unit 24 stands by after step S102 until it receives a bridge name in step S103. Accordingly, the reproducing unit 24 proceeds to step S104 after the process of step S208 is performed on the consultant terminal 30 side.

  If transfering it to step S104, the reproducing part 24 will acquire the moving image file corresponding to the received bridge name from moving image DB28, and will produce | generate a moving image file reproduction screen (refer FIG. 12). Note that the movie file playback screen in FIG. 12 includes a playback screen, operation buttons for operating the playback screen (play button, pause button, fast forward button, rewind button, etc.), “adjacent pier and "Comparison display execution" button.

  Next, in step S <b> 106, the playback unit 24 transmits a moving image file playback screen to the consultant terminal 30. Thereafter, the reproducing unit 24 proceeds to step S108 in FIG.

  On the other hand, on the consultant terminal 30 side, the control unit 32 stands by after step S208 until the moving image file reproduction screen is received from the server 20 in step S210. Therefore, the control unit 32 proceeds to step S212 when the moving image file playback screen is transmitted from the server 20 side in step S106.

  In step S212, the control unit 32 displays the moving image file reproduction screen shown in FIG.

  Next, in step S214, the control unit 32 determines whether a comparison request with the adjacent leg has been accepted. Here, when the construction consultant wants to compare the damage degree of the pier being inspected with the damage degree of the adjacent piers, it is assumed that the image being reproduced on the moving image file reproduction screen is temporarily stopped. Then, the construction consultant shall issue a comparison request with the adjacent leg by pressing the “comparison display display with adjacent pier” button on the video file playback screen with the image being played being paused. . When the construction consultant performs the operation as described above and the determination in step S214 is affirmed, the process proceeds to step S216. However, when the determination in step S214 is negative, the process proceeds to step S232 in FIG. Transition.

  When the determination in step S214 is affirmed and the process proceeds to step S216, the control unit 32 sets the image (paused image) displayed on the moving image file playback screen when the comparison request is received as the starting image. The time stamp of the origin image is acquired. Thereafter, the process proceeds to step S218 in FIG.

  In step S <b> 218 of FIG. 9, the control unit 32 transmits the time stamp of the starting image and the starting image (snapshot) to the server 20.

  On the other hand, the reproduction unit 24 of the server 20 determines whether or not the time stamp and the starting point image (snapshot) are received from the consultant terminal 30 in step S108 after the process of step S106 in FIG. In addition, it can be said that the reproduction | regeneration part 24 has received the instruction | indication (comparison request) which the construction consultant specifies one frame for the process of this step S108. If the determination here is negative, the process proceeds to step S126 in FIG. 10, but if the determination is affirmative, the process proceeds to step S110.

  When the process proceeds to step S110, the reproducing unit 24 acquires the focal length at the received time stamp (time stamp of the starting image) from the zoom information work table 26. FIG. 13 is a graph showing the relationship between the time stamp (shooting time) of the zoom information work table 26 in FIG. 5A and the focal length. In the following, for convenience of explanation, explanation using the graph of FIG. 13 is also given (in the actual processing, the graph of FIG. 13 may or may not be generated). In the present embodiment, a change in focal length as shown in FIG. 13 is shown by performing moving image shooting of a plurality of bridge piers as defined in the manual described above. In the present embodiment, it is assumed that the focal length acquired in step S110 is the focal length of the point O in FIG. 13 (the focal length at which the bridge pier (starting pier) included in the starting point image is most photographed). .

  Next, in step S <b> 112, the playback unit 24 acquires the focal length of the valley immediately before the received time stamp from the zoom information work table 26. In this case, the “focal length of the immediately preceding valley” is the focal point at the time (first time) at which the focal length becomes the first minimum before the time when the origin image (the frame specified by the construction consultant) is taken. This is the distance (focal length A in the graph of FIG. 13).

  Next, in step S <b> 114, the reproducing unit 24 acquires the focal distance of the valley immediately after the received time stamp from the zoom information work table 26. In this case, “the focal length of the valley immediately after” is the focal point at the time (second time) at which the focal length becomes the first minimum after the time when the origin image (the frame specified by the construction consultant) is taken. This is the distance (focal length B in the graph of FIG. 13).

  Next, in step S116, the reproducing unit 24 obtains a difference (absolute value) Δ between the focal lengths A and B. Next, in step S118, the reproducing unit 24 acquires the time stamp 1 (see FIG. 13) immediately after having the focal length obtained by adding the difference Δ to the focal length of the origin image. It should be noted that the time stamp 1 has a difference Δ in the focal length when the focal length is taken from the origin image (the frame specified by the construction consultant) after the focal length B time (second time) in FIG. It can be said that this is the time (fourth time) at which the focal length is added.

  Next, in step S120, the reproduction unit 24 acquires the immediately preceding time stamp 2 having a focal length obtained by subtracting the difference Δ from the focal length of the starting image. Note that the time stamp 2 is a difference Δ from the focal length when the focal length is taken from the origin image (the frame specified by the construction consultant) before the time (first time) of the focal length A in FIG. It can be said that this is the time (third time) at which the focal length is obtained by subtracting. In the present embodiment, when there are a plurality of times when the focal distance obtained by subtracting the difference Δ from the focal distance of the starting image exists immediately before the starting point (such as X1 and X2 in FIG. 13), The time on the side that is earlier (closest to the second from the time of the focal length A) (the side on which the graph monotonously increases) is referred to as time stamp 2. In this way, the time stamp on the side where the graph monotonously increases is set to time stamp 2 because of the characteristics of the shooting method, the zoom state changes from tele to wide while changing from wide to tele. This is because the change speed of the zoom state is slower than that during the period, and the focus is likely to be on the pier.

  Next, in step S122, the playback unit 24 acquires frames (snapshots) at the time stamps 1 and 2 from the moving image file.

  Next, in step S124, the playback unit 24 uses the frame set as the starting point (the snapshot transmitted from the consultant terminal 30 in step S218) and the frame (snapshot) corresponding to the acquired time stamps 1 and 2. The screen displayed side by side (the pier comparison screen in FIG. 14) is generated and transmitted to the consultant terminal 30. Thereafter, the process proceeds to step S126 in FIG. Here, the pier comparison screen of FIG. 14 includes an image of the starting pier (frame received from the consultant terminal 30), an image of the immediately following pier (frame of time stamp 1), and an image of the immediately preceding pier (frame of time stamp 2). ) And are included. In addition, a “large” button and a “small” button are arranged above the image of the pier immediately after the pier comparison screen and the image of the pier immediately before.

  Returning to FIG. 9, after step S <b> 218, the control unit 32 of the consultant terminal 30 stands by until a bridge pier comparison screen is received from the server 20 in step S <b> 220. Therefore, after the process of step S124 is performed on the server 20 side, the control unit 32 proceeds to step S222.

  If transfering it to step S222, the control part 32 will display the bridge pier comparison screen of FIG. Thereafter, the process proceeds to step S224 in FIG. Here, in the present embodiment, as described above, since the image of the starting pier displayed in the pier comparison image, the image of the immediately following pier, and the image of the immediately preceding pier are determined, the size of the pier in each image is Almost the same. This is due to the above-mentioned manual (5) “When the zoom state of the photographing apparatus 10 is returned from tele to wide, care is taken so that the next shooting target bridge pier becomes a predetermined size within the photographing field of view”. Therefore, on the assumption that each pier is photographed, it is possible to extract frames in which the sizes of the piers are displayed almost the same by using the difference Δ described above.

  Next, in step S224 of FIG. 10, the control unit 32 determines whether an enlargement / reduction display request has been received. In this case, when the construction consultant selects (presses) the “large” or “small” button on the pier comparison screen of FIG. 14 via the input unit 36, the determination is affirmed. It should be noted that the construction consultant presses the “large” or “small” button for the purpose of adjusting the display when each pier is not displayed almost the same on the pier comparison screen of FIG. .

  If the determination in step S224 is negative, the process proceeds to step S232. If the determination is positive, the process proceeds to step S226.

  When the process proceeds to step S <b> 226, that is, when the “large” or “small” button is pressed, the control unit 32 transmits an enlargement / reduction display request to the server 20.

  On the other hand, on the server 20 side, in step S126, the reproduction unit 24 determines whether or not an enlargement / reduction display request has been received. If the determination is negative, the process proceeds to step S134. If the determination is positive, that is, if the process of step S226 is performed in the consultant terminal 30, the process proceeds to step S128.

  When the process proceeds to step S128, the playback unit 24 zooms a time stamp having a focal length that is the next largest or smaller than the focal length of the image whose button is pressed (large or small corresponds to the pressed button). Obtained from the information work table 26.

  Next, in step S <b> 130, the playback unit 24 acquires the acquired time stamp image (frame) from the moving image file stored in the moving image DB 28. Next, in step S132, the image on the bridge pier comparison screen is replaced with the newly acquired image (frame) and transmitted to the consultant terminal 30.

  On the other hand, on the consultant terminal 30 side, the control unit 32 stands by until a new pier comparison screen is received from the server 20 in step S228. Therefore, at the stage where the process of step S132 is performed in the server 20, the control unit 32 proceeds to step S230. In step S230, the control unit 32 displays the newly transmitted pier comparison screen on the display unit. In this case, the pier comparison screen in which the display of the pier is adjusted in accordance with the “large” or “small” button pressed by the construction consultant is displayed on the display unit 34 of the consultant terminal 30.

  After the process of step S230 or when the determination of step S224 is negative, the process proceeds to step S232, and the control unit 32 determines whether a display end request (input by the construction consultant) has been received. If the determination in step S232 is negative, the process returns to step S214 in FIG. If the determination in step S214 in FIG. 8 is negative, the process proceeds to step S232 in FIG. 10, and each determination in steps S214 and S232 is performed until a display end request or a comparison request with the adjacent leg is received. Will be in a standby state. On the other hand, if the determination in step S232 is affirmed, the process proceeds to step S234, and the control unit 32 transmits a display end request to the server 20, thereby ending all the processes in FIGS.

  On the other hand, on the server 20 side, after the process of step S132 or when the determination of step S126 is denied, the process proceeds to step S134. In step S134, the playback unit 24 determines whether a display end request has been received. If the determination is negative, the process proceeds to step S108 in FIG. In a situation where the determinations in steps S108 and S126 and the determination in step S134 are negative, the determinations (negative) in steps S108, S126, and S134 are repeatedly executed, and a standby state is entered. Then, when the determination in step S134 is affirmed, the reproduction unit 24 ends all the processes in FIGS.

  As can be seen from the above description, the playback unit 24 of the server 20 implements functions as a reception unit, a calculation unit, an extraction unit, and a generation unit.

  As described above in detail, according to the present embodiment, the image recording unit 22 repeatedly performs an operation of photographing a single pier while changing the zoom state of the photographing apparatus 10 from wide → tele → wide. A moving image file in which objects are sequentially photographed and photographing information including information on a focal length of the photographing apparatus 10 at the time of photographing the moving image are acquired (FIG. 6). In addition, the playback unit 24 receives an instruction (comparison request) specifying any frame of the moving image file (a frame on which the starting pier is displayed) (S108), and before the time when the specified frame is captured. Thus, the focal length (A) at the time when the focal length becomes the minimum and the focal length (B) at the time when the focal length becomes the minimum after the time when the specified frame is photographed are acquired (S112). , S114), a difference Δ between the focal length A and the focal length B is calculated (S116), and one or more frames extracted based on the difference Δ and the focal length when the identified frame is captured; A screen for displaying the identified frames side by side is generated (S124). Thus, in this embodiment, the focal lengths A and B (the size of the starting pier in the frame imaged at the focal length A and the size of the pier adjacent to the starting pier in the frame imaged at the focal length B are approximately The frame Δ to be displayed side by side with the identified frame is extracted using the difference Δ (which is estimated to match), so the size of the starting pier in the specified frame and the pier adjacent to the starting pier in the extracted frame The size of (the immediately preceding pier or the immediately following pier) can be made substantially the same. As a result, the construction consultant can provide the construction consultant with a screen (bridge comparison screen (FIG. 14)) that allows the degree of damage to the pier to be easily compared between adjacent piers. The degree can be easily checked. In the present embodiment, since the frame is extracted using the focal length information, the load (processing amount) of the server 20 is reduced as compared with the case where image processing such as calculating the feature amount of the image is performed. can do.

  In the present embodiment, the reproduction unit 24 receives the enlargement / reduction display request after generating the pier comparison screen (S126), extracts the previous and next frames based on the enlargement / reduction display request, and outputs the pier comparison screen. (S128 to S132), the construction consultant can accurately compare the degree of damage between the piers by finely adjusting the size of each pier displayed on the pier comparison screen. become.

  In the above embodiment, the difference Δ between the focal lengths A and B at the time when the focal length is minimized immediately before and after the starting point, and the frame (snapshot) displayed on the pier comparison screen using this difference Δ. ) Has been described from the video file, but is not limited thereto. For example, a plurality of differences in focal length between adjacent local minimum points may be calculated, and an average value of the plurality of differences may be used as the difference Δ. By doing in this way, even when there is a slight shift in the size of each pier in the shooting field of view in shooting according to the manual (5) by the photographer, it is possible to suppress the influence of the shift. .

  Moreover, although the said embodiment demonstrated the case where the difference (DELTA) of the focal distance of an adjacent minimum point was calculated, it is not restricted to this. For example, the difference Δ between the focal lengths at two local minimum points with one or more local minimum points in between is obtained, and the value divided by the number of local minimum points +1 with the difference Δ therebetween and the focal length of the origin image. The frame may be extracted.

  Moreover, although the said embodiment demonstrated the case where the snapshot of both the immediately preceding pier and the immediately following pier was displayed on a pier comparison screen, it is not restricted to this. For example, when the time stamp 1 or 2 cannot be acquired in any of steps S118 and S120, a snapshot of the time stamp that could not be acquired may not be displayed on the bridge pier comparison screen. Alternatively, only one of the immediately preceding pier and the immediately following pier may be displayed on the pier comparison screen so that the construction consultant can make a one-to-one comparison with the starting pier. The pier comparison screen may display not only the piers on both sides of the starting pier but also other piers (for example, all piers of one bridge).

  In the above embodiment, a case has been described in which information regarding the imaging order of “immediate pier” and “immediate pier” is displayed on the pier comparison screen, but the present invention is not limited to this. The reproducing unit 24 estimates the shooting direction (positional relationship of each image (snapshot)) based on, for example, the sign of the difference Δ (the relationship between the focal lengths A and B), and uses the information about the positional relationship of each image as a bridge pier. It is good also as displaying on a comparison screen. For example, in the case of FIG. 13, since the focal length of the minimum point tends to increase with time, it is estimated that the shooting direction is from the near side to the far side. Therefore, on the pier comparison screen, “front side pier” may be displayed instead of “previous screen”, and “back side pier” may be displayed instead of “previous screen”. In addition, when the position of the imaging device 10 with respect to the pier can be acquired using GPS or the like, “left pier” or “right pier” is displayed, or “start side pier that indicates whether the bridge is at the start point or the end point” Or “end side pier” may be displayed.

  In the above embodiment, a guide indicating “predetermined size” may be displayed on the display unit 15 or the viewfinder of the photographing apparatus 10 in order to make the photographer comply with the above-described manual (5). . By doing in this way, it becomes possible to raise the coincidence degree of the size of the pier displayed on the pier comparison screen.

  In addition, although the case where the server 20 was provided was demonstrated in the said embodiment, it is not restricted to this. For example, the consultant terminal 30 may have the function of the server 20.

  In the above-described embodiment, the case where the structure to be inspected (photographed object) is a bridge pier has been described. However, the present invention is not limited to this. The structures to be inspected (photographed) include, for example, pillars that support bridge arches and railings for railings, factory equipment such as gas tanks and chimneys, and buildings such as research buildings, housing complexes, and buildings. Various structures such as industrial products can be employed.

  The above processing functions can be realized by a computer. In that case, a program describing the processing contents of the functions that the processing apparatus should have is provided. By executing the program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium.

  When the program is distributed, for example, it is sold in the form of a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. It is also possible to store the program in a storage device of a server computer and transfer the program from the server computer to another computer via a network.

  The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. Further, each time the program is transferred from the server computer, the computer can sequentially execute processing according to the received program.

  The above-described embodiment is an example of a preferred embodiment of the present invention. However, the present invention is not limited to this, and various modifications can be made without departing from the scope of the present invention.

In addition, the following additional notes are disclosed regarding the above description.
(Additional remark 1) By repeating the operation | movement which image | photographs the structure of one imaging object, changing the zoom of an imaging device to a wide side, a tele side, and a wide side with respect to several structures, several structures are sequentially An acquisition step of acquiring a captured video and information on a focal length of the imaging device at the time of capturing the video;
A receiving step of receiving an instruction specifying one of the frames of the moving image;
Based on the focal length information of the photographing apparatus, the focal length at the first time and the second time at which the focal length is minimized is acquired, and the focal length at the first time and the second time are obtained. A calculation step of calculating a difference from the focal length at
An extraction step of extracting one or more frames based on the focal length when the specified frame is photographed and the difference;
A structure inspection support method, wherein a computer executes a generation step of generating a screen for displaying the identified frame and the extracted frame side by side.
(Supplementary Note 2) The first time is the time closest to the time at which the identified frame was photographed among the times at which the focal length is minimized before the time at which the identified frame was photographed. The second time is the time closest to the time at which the specified frame was taken out of the times at which the focal length is minimized after the time at which the specified frame was taken,
In the extracting step, a frame at a third time before the first time becomes a focal length obtained by subtracting the difference from a focal length when the identified frame is captured, and the first time At least one of the frames at the fourth time that becomes the focal length obtained by adding the difference to the focal length when the specified frame is captured after the time of 2 is extracted. The structure inspection support method according to Appendix 1.
(Supplementary Note 3) In the extraction step, when there are a plurality of the third times, a frame at a time closest to the first time among the plurality of third times is extracted, and the fourth time 3. The structure inspection support method according to appendix 2, wherein when there are a plurality of times, a frame at a time closest to the second time among the plurality of fourth times is extracted.
(Supplementary Note 4) In the generation step, a positional relationship between the identified frame and the extracted frame is estimated based on the sign of the difference calculated in the calculation step,
The structure inspection support method according to any one of appendices 1 to 3, wherein a screen for displaying the information on the estimated positional relationship is generated together with the identified frame and the extracted frame. .
(Additional remark 5) After producing | generating the said screen in the said production | generation process, the process of receiving the instruction | indication of expansion or reduction of the said extracted frame,
Any one of appendices 1 to 4, wherein the computer executes a step of extracting the frames before and after the extracted frame and regenerating the screen based on the enlargement or reduction instruction. The structure inspection support method described in 1.
(Additional remark 6) By repeating the operation | movement which image | photographs the structure of one imaging | photography object, changing the zoom of an imaging device to a wide side, a tele side, and a wide side with respect to several structures, several structures are sequentially Acquire the captured video and information on the focal length of the imaging device at the time of video recording,
Accepting an instruction specifying one of the frames of the video,
Based on the focal length information of the photographing apparatus, the focal length at the first time and the second time at which the focal length is minimized is acquired, and the focal length at the first time and the second time are obtained. Calculate the difference from the focal length at
One or more frames are extracted based on the focal length when the specified frame is photographed and the difference,
A structure inspection support program for causing a computer to execute a process of generating a screen for displaying the identified frame and the extracted frame side by side.
(Supplementary Note 7) The first time is the time closest to the time at which the identified frame was photographed among the times at which the focal length is minimized before the time at which the identified frame was photographed. The second time is the time closest to the time at which the specified frame was taken out of the times at which the focal length is minimized after the time at which the specified frame was taken,
In the extracting process, the frame at a third time before the first time becomes a focal length obtained by subtracting the difference from the focal length when the identified frame is captured, and the Extracting at least one of the frames at the fourth time that becomes the focal length obtained by adding the difference to the focal length when the specified frame is shot after the second time. The structure inspection support program according to appendix 6, which is a feature.
(Supplementary Note 8) In the extraction process, when there are a plurality of the third times, a frame at a time closest to the first time among the plurality of third times is extracted, and the first time The structure inspection support program according to appendix 7, wherein when there are a plurality of times of 4, the frame at the time closest to the second time is extracted from the plurality of fourth times.
(Supplementary Note 9) In the process of generating, the positional relationship between the identified frame and the extracted frame is estimated based on the sign of the difference calculated in the calculation step,
The structure inspection support program according to any one of appendices 6 to 8, wherein a screen for displaying the information on the estimated positional relationship is generated together with the identified frame and the extracted frame. .
(Supplementary Note 10) After generating the screen in the generating process, accepting an instruction to enlarge or reduce the extracted frame,
Any one of appendixes 6 to 9 that causes the computer to execute a process of extracting the frames before and after the extracted frame and regenerating the screen based on the enlargement or reduction instruction The structure inspection support program described.
(Additional remark 11) By repeating the operation | movement which image | photographs the structure of one imaging object, changing the zoom of an imaging device to a wide side, a tele side, and a wide side with respect to several structures, several structures are sequentially An acquisition unit that acquires a captured video and information on a focal length of the imaging device at the time of capturing the video;
A receiving unit that receives an instruction specifying one of the frames of the moving image;
Based on the focal length information of the photographing apparatus, the focal length at the first time and the second time at which the focal length is minimized is acquired, and the focal length at the first time and the second time are obtained. A calculation unit for calculating a difference from the focal length at
An extraction unit that extracts one or more frames based on a focal length when the identified frame is photographed and the difference;
A structure inspection support apparatus comprising: a generation unit that generates a screen for displaying the identified frame and the extracted frame side by side.
(Supplementary Note 12) The first time is the time closest to the time at which the specified frame was shot out of the time at which the focal length is minimized before the time at which the specified frame was shot. The second time is the time closest to the time at which the specified frame was taken out of the times at which the focal length is minimized after the time at which the specified frame was taken,
The extraction unit includes a frame at a third time before a first time, and a focal length obtained by subtracting the difference from a focal length when the identified frame is captured, and the first time At least one of the frames at the fourth time that becomes the focal length obtained by adding the difference to the focal length when the specified frame is captured after the time of 2 is extracted. The structure inspection support device according to appendix 11.
(Supplementary Note 13) When there are a plurality of the third times, the extraction unit extracts a frame at a time second closest to the first time among the plurality of third times, and the fourth time The structure inspection support device according to appendix 12, wherein a frame at a time closest to the second time is extracted from the plurality of fourth times when there are a plurality of times.
(Additional remark 14) The said production | generation part estimates the positional relationship between the said specified flame | frame and the said extracted flame | frame based on the positive / negative of the difference calculated by the said calculation part,
The structure inspection support device according to any one of appendices 11 to 13, wherein a screen for displaying the information on the estimated positional relationship is generated together with the identified frame and the extracted frame. .
(Additional remark 15) After the said production | generation part produces | generates the said screen, while receiving the instruction | indication of expansion or reduction of the said extracted frame, based on the instruction | indication of said expansion or reduction, the frame before and behind the extracted frame is received. The structure inspection support device according to any one of appendices 11 to 14, further comprising a regeneration unit that extracts and regenerates the screen.

10 imaging device 20 server (structure inspection support device)
22 Image recording unit (acquisition unit)
24 playback unit (accepting unit, calculating unit, extracting unit, generating unit)

Claims (7)

A moving image in which a plurality of structures are sequentially photographed by repeating the operation of changing the zoom of the photographing device for a structure to be photographed from wide side, tele side, and wide side to a plurality of structures. An acquisition step of acquiring information on a focal length of the imaging device at the time of capturing the video;
A receiving step of receiving an instruction specifying one of the frames of the moving image;
Based on the focal length information of the photographing apparatus, the focal length at the first time and the second time at which the focal length is minimized is acquired, and the focal length at the first time and the second time are obtained. A calculation step of calculating a difference from the focal length at
An extraction step of extracting one or more frames based on the focal length when the specified frame is photographed and the difference;
A structure inspection support method, wherein a computer executes a generation step of generating a screen for displaying the identified frame and the extracted frame side by side. The first time is the time closest to the time at which the identified frame was photographed among the times at which the focal length is minimized before the time at which the identified frame was photographed. Is the time closest to the time at which the specified frame was taken out of the times at which the focal length is minimized after the time at which the specified frame was taken,
In the extracting step, a frame at a third time before the first time becomes a focal length obtained by subtracting the difference from a focal length when the identified frame is captured, and the first time At least one of the frames at the fourth time that becomes the focal length obtained by adding the difference to the focal length when the specified frame is captured after the time of 2 is extracted. The structure inspection support method according to claim 1.   In the extracting step, when there are a plurality of the third times, a frame at a time closest to the first time among the plurality of third times is extracted, and the plurality of the fourth times are 3. The structure inspection support method according to claim 2, wherein a frame at a time closest to the second time among the plurality of fourth times is extracted in some cases. In the generating step,
Based on the sign of the difference calculated in the calculating step, estimate the positional relationship between the identified frame and the extracted frame,
The structure according to any one of claims 1 to 3, wherein a screen displaying information on the estimated positional relationship is generated together with the identified frame and the extracted frame. Inspection support method. Receiving the instruction to enlarge or reduce the extracted frame after generating the screen in the generating step;
5. The computer according to claim 1, wherein the computer executes a step of extracting the frames before and after the extracted frame and regenerating the screen based on the enlargement or reduction instruction. The structure inspection support method according to claim 1. A moving image in which a plurality of structures are sequentially photographed by repeating the operation of changing the zoom of the photographing device for a structure to be photographed from wide side, tele side, and wide side to a plurality of structures. , Obtaining information on the focal length of the imaging device at the time of video recording,
Accepting an instruction specifying one of the frames of the video,
Based on the focal length information of the photographing apparatus, the focal length at the first time and the second time at which the focal length is minimized is acquired, and the focal length at the first time and the second time are obtained. Calculate the difference from the focal length at
One or more frames are extracted based on the focal length when the specified frame is photographed and the difference,
A structure inspection support program for causing a computer to execute a process of generating a screen for displaying the identified frame and the extracted frame side by side. A moving image in which a plurality of structures are sequentially photographed by repeating the operation of changing the zoom of the photographing device for a structure to be photographed from wide side, tele side, and wide side to a plurality of structures. An acquisition unit for acquiring information on a focal length of the imaging device at the time of capturing the video;
A receiving unit that receives an instruction specifying one of the frames of the moving image;
Based on the focal length information of the photographing apparatus, the focal length at the first time and the second time at which the focal length is minimized is acquired, and the focal length at the first time and the second time are obtained. A calculation unit for calculating a difference from the focal length at
An extraction unit that extracts one or more frames based on a focal length when the identified frame is photographed and the difference;
A structure inspection support apparatus comprising: a generation unit that generates a screen for displaying the identified frame and the extracted frame side by side.

Images