WO2020225843A1 - Imaging assistance program, imaging assistance device, and imaging assistance method - Google Patents

Imaging assistance program, imaging assistance device, and imaging assistance method Download PDF

Info

Publication number
WO2020225843A1
WO2020225843A1 PCT/JP2019/018219 JP2019018219W WO2020225843A1 WO 2020225843 A1 WO2020225843 A1 WO 2020225843A1 JP 2019018219 W JP2019018219 W JP 2019018219W WO 2020225843 A1 WO2020225843 A1 WO 2020225843A1
Authority
WO
WIPO (PCT)
Prior art keywords
shooting
image data
range
inspection record
unit
Prior art date
Application number
PCT/JP2019/018219
Other languages
French (fr)
Japanese (ja)
Inventor
菊地　英幸
及川　浩一
祐輔 中西
Original Assignee
富士通株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士通株式会社 filed Critical 富士通株式会社
Priority to JP2021518224A priority Critical patent/JPWO2020225843A1/ja
Priority to PCT/JP2019/018219 priority patent/WO2020225843A1/en
Publication of WO2020225843A1 publication Critical patent/WO2020225843A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84—Systems specially adapted for particular applications

Definitions

  • the present invention relates to a shooting support program, a shooting support device, and a shooting support method.
  • the purpose is to support the shooting work.
  • One aspect is a shooting support program that supports the shooting work by the user. It is determined whether or not there is a portion within the shooting range during shooting that matches at least a part of the range of the image data stored in the storage unit. When it is determined that there is a matching portion, information for guiding the user to a shooting position where the range of image data including the matching portion and the shooting range during shooting match is output. Let the computer perform the process.
  • FIG. 1 is a diagram for explaining an outline of inspection work.
  • FIG. 2 is a diagram showing an example of the hardware configuration of the photographing support device.
  • FIG. 3 is a diagram showing an example of past inspection record data stored in the photographing support device.
  • FIG. 4A is a first diagram showing a specific example of each data associated with the inspection record data.
  • FIG. 4B is a second diagram showing a specific example of each data associated with the inspection record data.
  • FIG. 4C is a third diagram showing a specific example of each data associated with the inspection record data.
  • FIG. 5 is a diagram showing an example of the functional configuration of the shooting support unit of the shooting support device.
  • FIG. 6 is a flowchart showing the flow of inspection work.
  • FIG. 7 is a flowchart showing the flow of the reference image data generation process.
  • FIG. 8 is a flowchart showing the flow of the photographing process.
  • FIG. 9A is a first diagram showing an example of screen transition of the shooting support device during the shooting process.
  • FIG. 9B is a second diagram showing an example of screen transition of the shooting support device during the shooting process.
  • FIG. 10A is a third diagram showing an example of screen transition of the photographing support device during the photographing process.
  • FIG. 10B is a fourth diagram showing an example of screen transition of the photographing support device during the photographing process.
  • FIG. 11 is a fifth diagram showing an example of screen transition of the shooting support device during the shooting process.
  • FIG. 12 is a diagram showing an example of new inspection record data.
  • FIG. 1 is a diagram for explaining the outline of the inspection work, and shows a state in which the bridge 110 is regularly inspected by using the photographing support device 100 according to the first embodiment.
  • the target (inspection target) for which the photographing support device 100 is used for periodic inspection work is not limited to the bridge 110, and may be another structure.
  • the worker 120 performs a recording work for recording the position of the deformed portion (crack, surface rust, etc.) of the bridge 110 and the state of the deformed portion. Do. In addition, the worker 120 takes a picture of the deformed portion of the bridge 110 and saves it as image data. Further, the worker 120 performs a generation work of generating inspection record data using the recorded contents and the saved image data and the like.
  • the photographing support device 100 has a function of supporting the photographing operation in which the worker 120 photographs the deformed portion and saves it as image data in the series of operations in the inspection work.
  • the shooting support device 100 is an information processing terminal such as a tablet terminal, and a shooting support program is installed in the device. Then, when the program is executed, the shooting support device 100 functions as the shooting support unit 101.
  • the photographing support unit 101 reads out the past inspection record data for the bridge 110 to be inspected from the past inspection record data stored in the inspection record storage unit 102.
  • the shooting support unit 101 sets the worker 120 at the shooting position (so that the worker 120 can shoot at the same angle of view as the image data (past image data of the deformed portion) stored in association with the read inspection record data).
  • the shooting position is referred to as the "target shooting position").
  • the worker 120 can easily perform the shooting work of shooting at a desired angle of view, and the shooting time can be shortened.
  • the shooting support device 100 includes various functions (not shown) for performing work other than the shooting work. However, in the following description of the functions of the shooting support device 100, the shooting work is mainly supported. This is performed on the shooting support unit 101, which is a function to perform the function.
  • FIG. 2 is a diagram showing an example of the hardware configuration of the photographing support device.
  • the photographing support device 100 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, and a RAM (Random Access Memory) 203.
  • the CPU 201, ROM 202, and RAM 203 form a so-called computer.
  • the photographing support device 100 includes an auxiliary storage device 204, a display device 205, an operation device 206, an image pickup device 207, and a communication device 208.
  • the hardware of the photographing support device 100 is connected to each other via the bus 209.
  • the CPU 201 is an arithmetic device that executes various programs (for example, a shooting support program) installed in the auxiliary storage device 204.
  • ROM 202 is a non-volatile memory.
  • the ROM 202 functions as a main storage device for storing various programs, data, and the like necessary for the CPU 201 to execute various programs installed in the auxiliary storage device 204.
  • the ROM 202 functions as a main memory device that stores boot programs such as BIOS (Basic Input / Output System) and EFI (Extensible Firmware Interface).
  • BIOS Basic Input / Output System
  • EFI Extensible Firmware Interface
  • RAM 203 is a volatile memory such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory).
  • the RAM 203 functions as a main storage device that provides a work area that is expanded when various programs installed in the auxiliary storage device 204 are executed by the CPU 201.
  • Auxiliary storage device 204 is an auxiliary storage device that stores various programs and information used when various programs are executed.
  • the inspection record storage unit 102 is realized in the auxiliary storage device 204.
  • the display device 205 is a display device that displays various display screens on the worker 120 during shooting work.
  • the operation device 206 is an input device in which the operator 120 inputs various instructions to the photographing support device 100.
  • the image pickup device 207 is, for example, a camera with a single focus lens, and generates image data at a predetermined frame rate.
  • the communication device 208 is a communication device for connecting to a network (not shown).
  • FIG. 3 is a diagram showing an example of past inspection record data stored in the photographing support device.
  • the deformed part number an identification number for identifying the part of the deformed part in the bridge 110 to be inspected is stored.
  • image number an identifier for identifying the image data obtained by photographing each part of the deformed portion is stored in association with the deformed portion number.
  • Information indicating the situation at each part of the deformed part is stored in the "status of the deformed part".
  • the "image data” is associated with image data obtained by photographing each part of the deformed portion.
  • FIG. 3 shows that the file names are associated with the image data of "image data 4-1" to "image data 13_1".
  • the “reference image data” is data (reference image) indicating the range of image data including the characteristic shape (edge portion, specific color) extracted by processing the image data obtained by photographing each part of the deformed portion. (Called data) is associated.
  • the example of FIG. 3 shows that the file names are associated with the reference image data of "Ref4-1" to "Ref_13_1".
  • each data damage data, image data, reference image data
  • 4A to 4C are the first to third views showing specific examples of each data associated with the inspection record data.
  • FIG. 5 is a diagram showing an example of the functional configuration of the shooting support unit of the shooting support device.
  • the photographing support unit 101 includes an inspection record data acquisition unit 501, an image data acquisition unit 502, a photographed image data acquisition unit 503, a determination unit 504, a superimposed display unit 505, a movement information calculation unit 506, and a guide display. It has a part 507.
  • the photographing support unit 101 includes a capture unit 508, a leftover determination unit 509, and a reference image data generation unit 510.
  • the inspection record data acquisition unit 501 accepts the bridge name specified by the worker 120. Further, the inspection record data acquisition unit 501 searches the inspection record storage unit 102 based on the received bridge name, and reads out the corresponding past inspection record data. Further, the inspection record data acquisition unit 501 notifies the image data acquisition unit 502 of the read past inspection record data.
  • the inspection record data acquisition unit 501 generates new inspection record data corresponding to the read past inspection record data and stores it in the inspection record storage unit 102.
  • the new inspection record data the same "deformed part number” and “image number” as the read past inspection record data are recorded, and the "deformed part status”, “image data”, and “reference image data” are recorded. "Is the blank inspection record data.
  • the image data acquisition unit 502 reads the damage data associated with the inspection record data notified from the inspection record data acquisition unit 501 from the inspection record storage unit 102 and displays it on the display device 205. Further, the image data acquisition unit 502 receives the designation of the deformed portion from the worker 120 in response to displaying the damage data on the display device 205.
  • the image data acquisition unit 502 reads out the image data corresponding to the received deformed portion from the inspection record storage unit 102 and displays it on the display device 205. Further, the image data acquisition unit 502 reads out the reference image data corresponding to the received deformed portion from the inspection record storage unit 102 and notifies the determination unit 504. Further, the image data acquisition unit 502 notifies the captured image data acquisition unit 503 that the reference image data has been notified to the determination unit 504.
  • the captured image data acquisition unit 503 Upon receiving the notification from the image data acquisition unit 502, the captured image data acquisition unit 503 receives the captured image data captured by the image pickup device 207 and notifies the determination unit 504, the superimposed display unit 505, and the capture unit 508.
  • the determination unit 504 determines the presence or absence of a characteristic shape in the photographed image data notified from the photographed image data acquisition unit 503. Further, when the determination unit 504 determines that there is a characteristic shape, the determination unit 504 specifies the position and range of the characteristic shape and notifies the superimposed display unit 505. Specifically, the determination unit 504 searches within the captured image data (within the photographing range) for the same characteristic shape as the characteristic shape included in the reference image data notified from the image data acquisition unit 502. That is, the determination unit 504 determines whether or not a portion that matches at least a part of the range of the reference image data exists in the captured image data. Further, when the determination unit 504 determines that the matching portion exists in the captured image data, the determination unit 504 specifies the matching position and range in the captured image data and notifies the superimposed display unit 505.
  • the superimposed display unit 505 ensures that the characteristic shape included in the reference image data matches the position and range of the characteristic shape specified by the determination unit 504.
  • the reference image data is superimposed on the display device 205 and displayed on the display device 205.
  • the movement information calculation unit 506 calculates the direction of the target shooting position and the distance to the target shooting position based on the position and range of the superimposed reference image data in the captured image data displayed by superimposing the reference image data. ..
  • the movement information calculation unit 506 calculates the direction of the target shooting position with respect to the current orientation of the shooting support device 100 based on the position of the reference image data in the shot image data. Further, the movement information calculation unit 506 calculates the distance from the current position of the shooting support device 100 to the target shooting position based on the range (size) of the superimposed reference image data.
  • the guide display unit 507 is an example of an output unit, and displays the direction of the target shooting position and the distance to the target shooting position calculated by the movement information calculation unit 506 on the display device 205 as guide information. Further, the guide display unit 507 monitors whether or not the direction of the target shooting position becomes 0 ° and the distance to the target shooting position becomes 0 m as the worker 120 moves. Then, when it is determined that the direction of the target shooting position is 0 ° and the distance to the target shooting position is 0 m, the guide display unit 507 determines that the movement of the worker 120 is completed, and the capture unit 508. Notify to.
  • the capture unit 508 When the capture unit 508 receives a notification from the guide display unit 507 that the movement is completed, the capture unit 508 receives a capture instruction from the worker 120 and captures the captured image data notified by the captured image data acquisition unit 503. Further, the capture unit 508 stores the captured captured image data in the inspection record storage unit 102 via the uncaptured determination unit 509. At this time, the capture unit 508 stores the captured captured image data in association with the new inspection record data.
  • the unphotographed determination unit 509 refers to the new inspection record data stored in the inspection record storage unit 102, and determines whether or not there is an unphotographed image. Specifically, the uncaptured determination unit 509 determines whether or not there is an region in which the captured captured image data is not associated with each region of the "image data" included in the new inspection record data.
  • the unphotographed determination unit 509 determines that there is an unphotographed image.
  • the uncaptured determination unit 509 determines that there is no unrecorded image.
  • the reference image data generation unit 510 reads out the past inspection record data of the bridge 110 to which the worker 120 performs the inspection work from the past inspection record data stored in the inspection record storage unit 102. Further, the reference image data generation unit 510 reads each image data associated with the "image data" included in the read past inspection record data, and extracts a characteristic shape from each read image data for reference. Generate image data. Further, the reference image data generation unit 510 stores the generated reference image data in the inspection record storage unit 102 in association with the past inspection record data.
  • FIG. 6 is a flowchart showing the flow of inspection work.
  • step S601 the worker 120 determines the bridge to be inspected (here, the bridge 110).
  • step S602 the reference image data generation unit 510 executes the reference image data generation process for the bridge 110 determined by the worker 120. The details of the reference image data generation process will be described later.
  • step S603 the worker 120 associates the reference image data generated by executing the reference image data generation process (step S602) with the past inspection record data for the bridge 110 to be inspected, and the inspection record. It is stored in the storage unit 102.
  • step S604 the worker 120 carries the photographing support device 100 and moves to the inspection site where the bridge 110 to be inspected is located. In addition, the worker 120 first performs a recording operation at the inspection site to record the position of the deformed portion of the bridge 110 and the state of the deformed portion.
  • step S605 the worker 120 performs a shooting operation. Specifically, the worker 120 shoots each part of the deformed portion of the bridge 110 and saves the image data while executing the shooting process of the shooting support device 100. The details of the shooting process will be described later.
  • step S606 the worker 120 performs a generation operation of generating inspection record data using the recorded contents and the saved image data and the like.
  • FIG. 7 is a flowchart showing the flow of the reference image data generation process.
  • step S701 the reference image data generation unit 510 reads the past inspection record data of the bridge to be inspected from the inspection record storage unit 102. It is assumed that the inspection record storage unit 102 stores in advance the past inspection record data of the bridge to be inspected, for example, received by the communication device 208 via a network (not shown).
  • step S702 the reference image data generation unit 510 inputs "1" to the counter N that counts a plurality of types of image data associated with the past inspection record data.
  • step S703 the reference image data generation unit 510 reads out the Nth image data associated with the past inspection record data.
  • step S704 the reference image data generation unit 510 processes the read N-th image data and extracts a characteristic shape (edge portion, specific color).
  • the reference image data generation unit 510 stores the reference image data, which is data indicating the range of the image data including the extracted characteristic shape, in association with the past inspection record data.
  • step S706 the reference image data generation unit 510 determines whether or not the reference image data has been generated for all the image data associated with the past inspection record data.
  • step S706 If it is determined in step S706 that there is image data for which reference image data has not yet been generated (if No in step S706), the process proceeds to step S707.
  • step S707 the reference image data generation unit 510 increments the counter N and returns to step S703.
  • step S707 if it is determined in step S707 that the reference image data has been generated for all the image data (in the case of Yes in step S706), the reference image data generation process is terminated.
  • FIG. 8 is a flowchart showing the flow of the photographing process.
  • step S801 the inspection record data acquisition unit 501 reads out the past inspection record data corresponding to the bridge name designated by the worker 120 from the inspection record storage unit 102. Further, the inspection record data acquisition unit 501 generates new inspection record data corresponding to the read past inspection record data and stores it in the inspection record storage unit 102.
  • step S802 the image data acquisition unit 502 displays the damage data associated with the read past inspection record data on the display device 205. Further, the image data acquisition unit 502 accepts the deformed portion designated by the operator 120 according to the display of the damage data.
  • step S803 the image data acquisition unit 502 reads out the image data corresponding to the received deformed portion from the inspection record storage unit 102 and displays it on the display device 205. Further, the image data acquisition unit 502 reads out the reference image data corresponding to the received deformed portion from the inspection record storage unit 102 and notifies the determination unit 504.
  • step S804 the captured image data acquisition unit 503 receives the captured image data captured by the imaging device 207 and starts displaying the captured image data on the display device 205.
  • step S805 the determination unit 504 searches for the same characteristic shape as the characteristic shape included in the reference image data, so that the captured image data captured by the image pickup apparatus 207 has the characteristic shape included in the reference image data. It is determined whether or not the same characteristic shape as is included. In addition, the determination unit 504 specifies the position and range of the characteristic shape in the captured image data when it is determined that the image is included.
  • step S806 the superimposed display unit 505 displays the reference image so that the characteristic shape included in the reference image data matches the position and range of the specified characteristic shape in the captured image data captured by the image pickup apparatus 207.
  • the data is superimposed and displayed on the display device 205.
  • step S807 the movement information calculation unit 506 calculates the direction of the target shooting position and the distance to the target shooting position based on the position and range (size) on which the reference image data is superimposed. Further, the guide display unit 507 displays the calculated direction of the target shooting position and the distance to the target shooting position on the display device 205 as guide information.
  • step S808 the guide display unit 507 monitors the direction of the target shooting position and the distance to the target shooting position to determine whether or not the movement of the worker 120 to the target shooting position is completed. If it is determined in step S808 that the movement to the target shooting position has not been completed (if No in step S808), the process returns to step S807. On the other hand, if it is determined in step S808 that the movement to the target shooting position is completed (in the case of Yes in step S808), the process proceeds to step S809.
  • step S809 the capture unit 508 receives the capture instruction by the worker 120. Further, when the capture unit 508 receives the capture instruction, the capture image data captured by the image pickup device 207 is captured, and the captured image data is stored in the inspection record storage unit 102 in association with the new inspection record data. ..
  • step S810 the unphotographed determination unit 509 determines whether or not the captured image data has been captured for all the deformed portions (presence or absence of unrecorded images). If it is determined in step S810 that there is an unphotographed image (No in step S810), the process returns to step S802. On the other hand, if it is determined in step S810 that there is no unphotographed portion (in the case of Yes in step S810), the photographing process is terminated.
  • FIG. 9A shows the inspection record data search screen 910 for the inspection record data acquisition unit 501 to receive the designation of the bridge name from the worker 120 and to search the past inspection record data corresponding to the accepted bridge name. It is a figure which shows an example.
  • the inspection record data search screen 910 includes an input field 911 for inputting the "bridge name".
  • the inspection record data search screen 910 includes a "search" button 912 for instructing a search for past inspection record data.
  • the inspection record data acquisition unit 501 corresponds to the bridge name ("XX" in the example of FIG. 9A) in the past.
  • the inspection record data of is read from the inspection record storage unit 102.
  • FIG. 9B is a diagram showing an example of a damage data display screen 920 in which the image data acquisition unit 502 displays the damage data associated with the read past inspection record data.
  • the damage data 921 is displayed so that each deformed portion can be specified.
  • the damage data display screen 920 includes a "back" button 923 for returning to the inspection record data search screen 910, and when the "back" button 923 is pressed, the screen returns to the inspection record data search screen 910. .
  • FIG. 10A is a diagram showing an example of a shooting screen 1010 displayed on the display device 205 due to the designation of the deformed portion.
  • the shooting screen 1010 has a past image data display area 1011, a shot image data display area 1012, a guide image data display area 1013, a guide information display area 1014, and a "capture" button 1015. And are included.
  • the past image data is displayed in the past image data display area 1011 by the image data acquisition unit 502.
  • the captured image data display area 1012 the captured image data currently captured by the imaging device 207 is displayed.
  • the captured image data is displayed on the captured image data display area 1012 by the captured image data acquisition unit 503.
  • the reference image is set so that the characteristic shape included in the reference image data matches the position and range of the characteristic shape of the captured image data currently captured by the imaging device 207.
  • the captured image data on which the data is superimposed is displayed.
  • the captured image data is displayed on the guide image data display area 1013 by the superimposed display unit 505.
  • the guide image data display area 1013 shown in FIG. 10A shows how the captured image data before the reference image data is superimposed is displayed.
  • the guide information display area 1014 In the guide information display area 1014, the direction of the target shooting position and the distance to the target shooting position as seen from the current shooting support device 100 are displayed as guide information.
  • the display on the guide information display area 1014 is performed by the guide display unit 507.
  • the guide information display area 1014 shown in FIG. 10A shows a state before the movement information calculation unit 506 calculates the direction of the target shooting position and the distance to the target shooting position.
  • the "capture” button 1015 is a button for the worker 120 to input a capture instruction. Since the direction of the target shooting position and the distance to the target shooting position have not been calculated for the "capture” button 1015 shown in FIG. 10A, the operator 120 cannot press the button.
  • FIG. 10B is a diagram showing an example of a shooting screen 1020 after the reference image data is superimposed by the superimposed display unit 505 and the direction of the target shooting position and the distance to the target shooting position are calculated by the movement information calculation unit 506. is there.
  • the captured image data after the reference image data 1022 is superimposed is displayed by the superimposed display unit 505. Further, in the guide information display area 1023, the direction of the target shooting position and the distance to the target shooting position calculated by the movement information calculation unit 506 are displayed.
  • the reference image data 1022 is superimposed on the upper left position in the captured image data in a range (size) smaller than that of the captured image data. Therefore, by referring to the reference image data 1022, the operator 120 can recognize that the distance to the target shooting position is long and that the target shooting position is in the diagonally forward left direction. Further, since the guide information display area 1023 displays a specific angle value representing the direction of the target shooting position and a distance information representing a specific distance to the target shooting position, the operator 120 can display the angle value. And it is possible to move to the target shooting position according to the distance information.
  • FIG. 11 is a diagram showing an example of a shooting screen 1110 after the worker 120 has moved to the target shooting position.
  • the captured image data after the reference image data 1112 is superimposed is displayed by the superimposed display unit 505. Further, in the guide information display area 1113, the direction of the target shooting position and the distance to the target shooting position calculated by the movement information calculation unit 506 are displayed.
  • the operator 120 can recognize that the target shooting position has been reached by referring to the reference image data 1112.
  • "0 °” is displayed as an angle value indicating the direction of the target shooting position
  • "0 m” is displayed as the distance information indicating the distance to the target shooting position. Therefore, the operator 120 can also recognize that the target shooting position has been reached by referring to the guide information display area 1113.
  • the angle value indicating the direction of the target shooting position is "0", and the distance information indicating the distance to the target shooting position is "0 m", so that the movement of the operator 120 is completed on the guide display unit 507. Is determined.
  • the "capture” button 1114 can be pressed, and the operator 120 captures the captured image data by pressing the "capture” button 1114.
  • FIG. 12 is a diagram showing an example of new inspection record data.
  • the new inspection record data 1200 includes the same items as the information items included in the past inspection record data 300.
  • the difference from the past inspection record data 300 is that in the case of the new inspection record data 1200, the "image data" is associated with the newly captured captured image data, and the "reference image data".
  • the point is that the associated reference image data has not yet been generated.
  • the photographing support device is -Whether or not there is a part of the captured image data during shooting that matches the range of the characteristic shape of the image data associated with the past inspection record data, which is the image data stored in the inspection record storage unit. Is determined. -When it is determined that there is a matching part, the reference image data including the characteristic shape is superimposed on the matching part. -Movement information is calculated to guide the operator of the inspection work to the target shooting position, which is the shooting position where the range of the superimposed reference image data and the shooting range of the shot image data during shooting match. Is output as guide information.
  • the shooting support device As described above, according to the shooting support device according to the first embodiment, it is possible to support the shooting work at the time of inspection (shooting work for shooting at a desired angle of view). As a result, according to the photographing support device according to the first embodiment, the burden on the operator in the photographing work at the time of inspection can be reduced, and the photographing time can be shortened.
  • the angle value representing the direction of the target shooting position is "0 °”
  • the distance information representing the distance to the target shooting position is "0 m”
  • the method for determining whether or not the movement of the worker 120 is completed is not limited to this. For example, when the angle value indicating the direction of the target shooting position is equal to or less than a predetermined threshold value and the distance information indicating the distance to the target shooting position is equal to or less than a predetermined threshold value, it is determined that the movement of the worker 120 is completed. May be good.
  • the "capture” button can be pressed when it is determined that the movement of the worker 120 is completed.
  • the "capture” button may be configured to be pressed regardless of whether the movement of the worker 120 is complete.
  • the guide information has been described as displaying the angle value indicating the direction of the target shooting position and the distance information indicating the distance to the target shooting position, but the method of outputting the guide information is this. Not limited to. For example, an "arrow" may be displayed according to the direction of the target shooting position and the distance to the target shooting position.
  • the angle value indicating the direction of the target shooting position and the distance information indicating the distance to the target shooting position may be output by voice.

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Studio Devices (AREA)

Abstract

The present invention assists in an imaging operation. The present invention provides an imaging assistance program for assisting in an imaging operation by a user, the imaging assistance program causing a computer to execute processing for determining whether a part matching at least a portion of a range of image data stored in a storage unit is present in an imaging range being imaged, and outputting information for guiding a user to an imaging position at which the range of image data including the matching part and the imaging range being imaged match when it is determined that a matching part is present.

Description

撮影支援プログラム、撮影支援装置及び撮影支援方法Shooting support program, shooting support device and shooting support method
　本発明は、撮影支援プログラム、撮影支援装置及び撮影支援方法に関する。 The present invention relates to a shooting support program, a shooting support device, and a shooting support method.
　従来より、橋梁やトンネル等の構造物に対して行われる定期的な点検作業においては、変状部分の位置及び状況を記録するとともに、変状部分を撮影し、画像データとして保存しておくことが義務付けられている。そして、かかる点検作業においては、近年、タブレット端末等が広く用いられている。 Conventionally, in regular inspection work performed on structures such as bridges and tunnels, the position and status of the deformed part should be recorded, and the deformed part should be photographed and saved as image data. Is obligatory. In recent years, tablet terminals and the like have been widely used in such inspection work.
特開２０１６－２１１９５５号公報Japanese Unexamined Patent Publication No. 2016-21955
　ここで、変状部分の撮影の際には、画角を、当該変状部分の過去の画像データの撮影時の画角に合わせることが求められる。一方で、撮影対象となる複数の変状部分それぞれについて、タブレット端末等を動かしながら画角を合わせる作業（撮影作業）は、作業者（タブレット端末のユーザ）にとって負担が大きく、時間もかかる。 Here, when shooting the deformed portion, it is required to match the angle of view with the angle of view at the time of shooting the past image data of the deformed portion. On the other hand, the work of adjusting the angle of view (shooting work) while moving the tablet terminal or the like for each of the plurality of deformed parts to be photographed is burdensome and time-consuming for the worker (user of the tablet terminal).
　一つの側面では、撮影作業を支援することを目的とする。 On one side, the purpose is to support the shooting work.
　一態様は、ユーザによる撮影作業を支援する撮影支援プログラムであって、
　撮影中の撮影範囲内に、記憶部に記憶した画像データの少なくとも一部の範囲と一致する箇所が存在するか否かを判定し、
　一致する箇所が存在すると判定した場合に、前記一致する箇所を含む画像データの範囲と前記撮影中の撮影範囲とが一致する撮影位置に前記ユーザを誘導する情報を出力する、
　処理をコンピュータに実行させる。 One aspect is a shooting support program that supports the shooting work by the user.
It is determined whether or not there is a portion within the shooting range during shooting that matches at least a part of the range of the image data stored in the storage unit.
When it is determined that there is a matching portion, information for guiding the user to a shooting position where the range of image data including the matching portion and the shooting range during shooting match is output.
Let the computer perform the process.
　撮影作業を支援することができる。 Can support shooting work.
図１は、点検作業の概要を説明するための図である。FIG. 1 is a diagram for explaining an outline of inspection work. 図２は、撮影支援装置のハードウェア構成の一例を示す図である。FIG. 2 is a diagram showing an example of the hardware configuration of the photographing support device. 図３は、撮影支援装置に格納される過去の点検調書データの一例を示す図である。FIG. 3 is a diagram showing an example of past inspection record data stored in the photographing support device. 図４Ａは、点検調書データに関連付けられる各データの具体例を示す第１の図である。FIG. 4A is a first diagram showing a specific example of each data associated with the inspection record data. 図４Ｂは、点検調書データに関連付けられる各データの具体例を示す第２の図である。FIG. 4B is a second diagram showing a specific example of each data associated with the inspection record data. 図４Ｃは、点検調書データに関連付けられる各データの具体例を示す第３の図である。FIG. 4C is a third diagram showing a specific example of each data associated with the inspection record data. 図５は、撮影支援装置の撮影支援部の機能構成の一例を示す図である。FIG. 5 is a diagram showing an example of the functional configuration of the shooting support unit of the shooting support device. 図６は、点検作業の流れを示すフローチャートである。FIG. 6 is a flowchart showing the flow of inspection work. 図７は、参照画像データ生成処理の流れを示すフローチャートである。FIG. 7 is a flowchart showing the flow of the reference image data generation process. 図８は、撮影処理の流れを示すフローチャートである。FIG. 8 is a flowchart showing the flow of the photographing process. 図９Ａは、撮影処理時の撮影支援装置の画面遷移の一例を示す第１の図である。FIG. 9A is a first diagram showing an example of screen transition of the shooting support device during the shooting process. 図９Ｂは、撮影処理時の撮影支援装置の画面遷移の一例を示す第２の図である。FIG. 9B is a second diagram showing an example of screen transition of the shooting support device during the shooting process. 図１０Ａは、撮影処理時の撮影支援装置の画面遷移の一例を示す第３の図である。FIG. 10A is a third diagram showing an example of screen transition of the photographing support device during the photographing process. 図１０Ｂは、撮影処理時の撮影支援装置の画面遷移の一例を示す第４の図である。FIG. 10B is a fourth diagram showing an example of screen transition of the photographing support device during the photographing process. 図１１は、撮影処理時の撮影支援装置の画面遷移の一例を示す第５の図である。FIG. 11 is a fifth diagram showing an example of screen transition of the shooting support device during the shooting process. 図１２は、新たな点検調書データの一例を示す図である。FIG. 12 is a diagram showing an example of new inspection record data.
　以下、各実施形態について添付の図面を参照しながら説明する。なお、本明細書及び図面において、実質的に同一の機能構成を有する構成要素については、同一の符号を付することにより重複した説明を省略する。 Hereinafter, each embodiment will be described with reference to the attached drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.
　［第１の実施形態］
　＜点検作業の説明＞
　はじめに、第１の実施形態に係る撮影支援装置を用いて行う点検作業の概要について説明する。図１は、点検作業の概要を説明するための図であり、第１の実施形態に係る撮影支援装置１００を用いて、橋梁１１０に対して定期的な点検作業を行う様子を示している。なお、撮影支援装置１００を用いて定期的な点検作業を行う対象（点検対象）は、橋梁１１０に限定されず、他の構造物であってもよい。 [First Embodiment]
<Explanation of inspection work>
First, an outline of the inspection work performed by using the photographing support device according to the first embodiment will be described. FIG. 1 is a diagram for explaining the outline of the inspection work, and shows a state in which the bridge 110 is regularly inspected by using the photographing support device 100 according to the first embodiment. The target (inspection target) for which the photographing support device 100 is used for periodic inspection work is not limited to the bridge 110, and may be another structure.
　橋梁１１０に対する定期的な点検作業において、作業者（撮影支援装置１００のユーザ）１２０は、橋梁１１０の変状部分（クラック、表面錆等）の位置及び変状部分の状況を記録する記録作業を行う。また、作業者１２０は、橋梁１１０の変状部分を撮影し、画像データとして保存する撮影作業を行う。更に、作業者１２０は、記録した内容及び保存した画像データ等を用いて点検調書データを生成する生成作業を行う。 In the periodic inspection work for the bridge 110, the worker (user of the photographing support device 100) 120 performs a recording work for recording the position of the deformed portion (crack, surface rust, etc.) of the bridge 110 and the state of the deformed portion. Do. In addition, the worker 120 takes a picture of the deformed portion of the bridge 110 and saves it as image data. Further, the worker 120 performs a generation work of generating inspection record data using the recorded contents and the saved image data and the like.
　撮影支援装置１００は、点検作業における上記一連の作業のうち、作業者１２０が変状部分を撮影し、画像データとして保存する撮影作業を支援するための機能を有する。具体的には、撮影支援装置１００は、タブレット端末等の情報処理端末であり、当該装置には、撮影支援プログラムがインストールされている。そして、当該プログラムが実行されることで、撮影支援装置１００は、撮影支援部１０１として機能する。 The photographing support device 100 has a function of supporting the photographing operation in which the worker 120 photographs the deformed portion and saves it as image data in the series of operations in the inspection work. Specifically, the shooting support device 100 is an information processing terminal such as a tablet terminal, and a shooting support program is installed in the device. Then, when the program is executed, the shooting support device 100 functions as the shooting support unit 101.
　撮影支援部１０１は、点検調書記憶部１０２に格納された過去の点検調書データのうち、点検対象の橋梁１１０についての過去の点検調書データを読み出す。また、撮影支援部１０１は、読み出した点検調書データに関連付けて格納されている画像データ（変状部分の過去の画像データ）と同じ画角で撮影ができるように、作業者１２０を撮影位置（当該撮影位置を"目標撮影位置"と称す）まで誘導する。 The photographing support unit 101 reads out the past inspection record data for the bridge 110 to be inspected from the past inspection record data stored in the inspection record storage unit 102. In addition, the shooting support unit 101 sets the worker 120 at the shooting position (so that the worker 120 can shoot at the same angle of view as the image data (past image data of the deformed portion) stored in association with the read inspection record data). The shooting position is referred to as the "target shooting position").
　これにより、作業者１２０は、所望の画角で撮影を行う撮影作業を容易に行うことができ、撮影時間を短縮することができる。 As a result, the worker 120 can easily perform the shooting work of shooting at a desired angle of view, and the shooting time can be shortened.
　なお、撮影支援装置１００には、撮影作業以外の作業を行うための種々の機能（不図示）が含まれるが、以下、撮影支援装置１００の機能の説明にあたっては、主に、撮影作業を支援する機能である撮影支援部１０１について行う。 The shooting support device 100 includes various functions (not shown) for performing work other than the shooting work. However, in the following description of the functions of the shooting support device 100, the shooting work is mainly supported. This is performed on the shooting support unit 101, which is a function to perform the function.
　＜撮影支援装置のハードウェア構成＞
　次に、撮影支援装置１００のハードウェア構成について説明する。図２は、撮影支援装置のハードウェア構成の一例を示す図である。図２に示すように、撮影支援装置１００は、ＣＰＵ（Central Processing Unit）２０１、ＲＯＭ（Read Only Memory）２０２、ＲＡＭ（Random Access Memory）２０３を有する。ＣＰＵ２０１、ＲＯＭ２０２、ＲＡＭ２０３は、いわゆるコンピュータを形成する。 <Hardware configuration of shooting support device>
Next, the hardware configuration of the photographing support device 100 will be described. FIG. 2 is a diagram showing an example of the hardware configuration of the photographing support device. As shown in FIG. 2, the photographing support device 100 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, and a RAM (Random Access Memory) 203. The CPU 201, ROM 202, and RAM 203 form a so-called computer.
　また、撮影支援装置１００は、補助記憶装置２０４、表示装置２０５、操作装置２０６、撮像装置２０７、通信装置２０８を有する。なお、撮影支援装置１００の各ハードウェアは、バス２０９を介して相互に接続されている。 Further, the photographing support device 100 includes an auxiliary storage device 204, a display device 205, an operation device 206, an image pickup device 207, and a communication device 208. The hardware of the photographing support device 100 is connected to each other via the bus 209.
　ＣＰＵ２０１は、補助記憶装置２０４にインストールされている各種プログラム（例えば、撮影支援プログラム等）を実行する演算デバイスである。 The CPU 201 is an arithmetic device that executes various programs (for example, a shooting support program) installed in the auxiliary storage device 204.
　ＲＯＭ２０２は、不揮発性メモリである。ＲＯＭ２０２は、補助記憶装置２０４にインストールされている各種プログラムをＣＰＵ２０１が実行するために必要な各種プログラム、データ等を格納する主記憶デバイスとして機能する。具体的には、ＲＯＭ２０２はＢＩＯＳ（Basic Input/Output System）やＥＦＩ（Extensible Firmware Interface）等のブートプログラム等を格納する、主記憶デバイスとして機能する。 ROM 202 is a non-volatile memory. The ROM 202 functions as a main storage device for storing various programs, data, and the like necessary for the CPU 201 to execute various programs installed in the auxiliary storage device 204. Specifically, the ROM 202 functions as a main memory device that stores boot programs such as BIOS (Basic Input / Output System) and EFI (Extensible Firmware Interface).
　ＲＡＭ２０３は、ＤＲＡＭ（Dynamic Random Access Memory）やＳＲＡＭ（Static Random Access Memory）等の揮発性メモリである。ＲＡＭ２０３は、補助記憶装置２０４にインストールされている各種プログラムがＣＰＵ２０１によって実行される際に展開される作業領域を提供する、主記憶デバイスとして機能する。 RAM 203 is a volatile memory such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). The RAM 203 functions as a main storage device that provides a work area that is expanded when various programs installed in the auxiliary storage device 204 are executed by the CPU 201.
　補助記憶装置２０４は、各種プログラムや、各種プログラムが実行される際に用いられる情報を格納する補助記憶デバイスである。例えば、点検調書記憶部１０２は、補助記憶装置２０４において実現される。 Auxiliary storage device 204 is an auxiliary storage device that stores various programs and information used when various programs are executed. For example, the inspection record storage unit 102 is realized in the auxiliary storage device 204.
　表示装置２０５は、撮影作業において作業者１２０に各種表示画面を表示する表示デバイスである。操作装置２０６は、作業者１２０が撮影支援装置１００に対して各種指示を入力する入力デバイスである。 The display device 205 is a display device that displays various display screens on the worker 120 during shooting work. The operation device 206 is an input device in which the operator 120 inputs various instructions to the photographing support device 100.
　撮像装置２０７は、例えば、単焦点レンズのカメラであり、所定のフレームレートで画像データを生成する。通信装置２０８は、不図示のネットワークと接続するための通信デバイスである。 The image pickup device 207 is, for example, a camera with a single focus lens, and generates image data at a predetermined frame rate. The communication device 208 is a communication device for connecting to a network (not shown).
　＜点検調書データの詳細＞
　次に、撮影支援装置１００の点検調書記憶部１０２に格納される過去の点検調書データの詳細について説明する。図３は、撮影支援装置に格納される過去の点検調書データの一例を示す図である。 <Details of inspection record data>
Next, the details of the past inspection record data stored in the inspection record storage unit 102 of the photographing support device 100 will be described. FIG. 3 is a diagram showing an example of past inspection record data stored in the photographing support device.
　図３の例は、橋梁名が"ＸＸ"の橋梁１１０についての過去の点検調書データ３００であり、損傷図（橋梁における変状部分の箇所及び変状部分の状況を記録した図）として、損傷データ（ファイル名＝"損傷データＡ"）が関連付けられていることを示している。 The example of FIG. 3 is the past inspection record data 300 for the bridge 110 whose bridge name is "XX", and is damaged as a damage diagram (a diagram recording the location of the deformed portion and the state of the deformed portion in the bridge). It indicates that the data (file name = "damage data A") is associated.
　また、図３に示すように、過去の点検調書データ３００には、情報の項目として、"変状部分番号"、"画像番号"、"変状部分の状況"、"画像データ"、"参照画像データ"が含まれる。 Further, as shown in FIG. 3, in the past inspection record data 300, as information items, refer to "deformed part number", "image number", "status of deformed part", "image data", and ". "Image data" is included.
　"変状部分番号"には、点検対象の橋梁１１０における変状部分の箇所を識別するための識別番号が格納される。図３の例は、変状部分番号＝"４"～"１３"の１０箇所の変状部分が記録されていることを示している。"画像番号"には、変状部分の各箇所を撮影した画像データを識別するための識別子が、変状部分番号と対応付けて格納される。 In the "deformed part number", an identification number for identifying the part of the deformed part in the bridge 110 to be inspected is stored. The example of FIG. 3 shows that 10 deformed parts of the deformed part number = "4" to "13" are recorded. In the "image number", an identifier for identifying the image data obtained by photographing each part of the deformed portion is stored in association with the deformed portion number.
　"変状部分の状況"には、変状部分の各箇所における状況を示す情報が格納される。"画像データ"には、変状部分の各箇所を撮影した画像データが関連付けられる。図３の例は、ファイル名が、"画像データ４＿１"～"画像データ１３＿１"の画像データが関連付けられていることを示している。 Information indicating the situation at each part of the deformed part is stored in the "status of the deformed part". The "image data" is associated with image data obtained by photographing each part of the deformed portion. The example of FIG. 3 shows that the file names are associated with the image data of "image data 4-1" to "image data 13_1".
　"参照画像データ"には、変状部分の各箇所を撮影した画像データを処理することで抽出された特徴的形状（エッジ部分、特定の色）を含む画像データの範囲を示すデータ（参照画像データと称す）が関連付けられる。図３の例は、ファイル名が、"Ｒｅｆ４＿１"～"Ｒｅｆ＿１３＿１"の参照画像データが関連付けられていることを示している。 The "reference image data" is data (reference image) indicating the range of image data including the characteristic shape (edge portion, specific color) extracted by processing the image data obtained by photographing each part of the deformed portion. (Called data) is associated. The example of FIG. 3 shows that the file names are associated with the reference image data of "Ref4-1" to "Ref_13_1".
　＜点検調書データに関連付けられる各データ＞
　次に、点検調書データ３００に関連付けられる各データ（損傷データ、画像データ、参照画像データ）の具体例について説明する。図４Ａ～図４Ｃは、点検調書データに関連付けられる各データの具体例を示す第１乃至第３の図である。 <Each data associated with inspection record data>
Next, specific examples of each data (damage data, image data, reference image data) associated with the inspection record data 300 will be described. 4A to 4C are the first to third views showing specific examples of each data associated with the inspection record data.
　このうち、図４Ａの符号４１０は、点検調書データ３００に関連付けられた損傷データ（ファイル名＝"損傷データＡ"）の一例を示す図である。図４Ａの符号４１０に示すように、損傷データには、橋梁名＝"ＸＸ"の橋梁１１０における代表的な部材（主桁、横桁等）と、当該部材において確認された変状部分の位置及び変状部分の状況を示す情報とが記録される。これにより、作業者１２０は、損傷データを閲覧することで、変状部分の位置及び変状部分の状況を容易に把握することができる。 Of these, reference numeral 410 in FIG. 4A is a diagram showing an example of damage data (file name = "damage data A") associated with the inspection record data 300. As shown by reference numeral 410 in FIG. 4A, the damage data includes representative members (main girder, cross girder, etc.) in the bridge 110 with the bridge name = "XX" and the positions of the deformed portions confirmed in the members. And information indicating the status of the deformed part is recorded. As a result, the worker 120 can easily grasp the position of the deformed portion and the state of the deformed portion by viewing the damage data.
　図４Ｂの符号４２０は、点検調書データ３００に関連付けられた複数の種類の画像データのうちの１の画像データ（ファイル名＝"画像データ７＿１"）の一例を示す図である。符号４２０に示すように、画像データは、橋梁１１０の一部分であって、変状部分を含む撮影範囲が所定の画角で撮影されることで生成される。 Reference numeral 420 in FIG. 4B is a diagram showing an example of image data (file name = "image data 7-1") of one of a plurality of types of image data associated with the inspection record data 300. As shown by reference numeral 420, the image data is a part of the bridge 110, and is generated when the photographing range including the deformed portion is photographed at a predetermined angle of view.
　図４Ｃの符号４３０は、図４Ｂの符号４２０に示す画像データ（ファイル名＝"画像データ７＿１"）を処理することで抽出された参照画像データ（ファイル名＝"Ｒｅｆ７＿１"）の一例を示す図である。図４Ｃの符号４３０の例は、図４Ｂの符号４２０に示す画像データ（ファイル名＝"画像データ７＿１"）に含まれる白色で示す部材のエッジ部分が特徴的形状として抽出されたことを示している。 Reference numeral 430 of FIG. 4C is a diagram showing an example of reference image data (file name = "Ref7_1") extracted by processing the image data (file name = "image data 7_1") shown by reference numeral 420 of FIG. 4B. Is. The example of reference numeral 430 in FIG. 4C shows that the edge portion of the member shown in white included in the image data (file name = "image data 7-1") shown in reference numeral 420 of FIG. 4B was extracted as a characteristic shape. There is.
　符号４３０に示す参照画像データを用いることで、撮影支援装置１００では、新たに撮影した画像データの中から、当該箇所（特徴的形状の範囲と一致する箇所）を検索することができる。また、符号４３０に示す参照画像データを用いることで、符号４２０に示す画像データ（ファイル名＝"画像データ７＿１"）と同じ画角で撮影するための撮影位置である目標撮影位置まで、作業者１２０を誘導するのに必要な移動情報を算出することができる。 By using the reference image data indicated by reference numeral 430, the photographing support device 100 can search for the relevant part (the part matching the range of the characteristic shape) from the newly photographed image data. Further, by using the reference image data shown by reference numeral 430, the operator can reach the target shooting position, which is the shooting position for shooting at the same angle of view as the image data (file name = "image data 7-1") shown by reference numeral 420. The movement information required to guide the 120 can be calculated.
　つまり、図４Ｃの符号４３０に示す参照画像データを用いることで、目標撮影位置に作業者１２０を誘導するための移動情報を算出し、ガイド情報として出力することができる。 That is, by using the reference image data shown by reference numeral 430 in FIG. 4C, it is possible to calculate the movement information for guiding the worker 120 to the target shooting position and output it as guide information.
　＜撮影支援装置の機能構成＞
　次に、撮影支援装置１００の撮影支援部１０１の機能構成の詳細について説明する。図５は、撮影支援装置の撮影支援部の機能構成の一例を示す図である。図５に示すように、撮影支援部１０１は、点検調書データ取得部５０１、画像データ取得部５０２、撮影画像データ取得部５０３、判定部５０４、重畳表示部５０５、移動情報算出部５０６、ガイド表示部５０７を有する。また、撮影支援部１０１は、キャプチャ部５０８、撮り残し判定部５０９、参照画像データ生成部５１０を有する。 <Functional configuration of shooting support device>
Next, the details of the functional configuration of the shooting support unit 101 of the shooting support device 100 will be described. FIG. 5 is a diagram showing an example of the functional configuration of the shooting support unit of the shooting support device. As shown in FIG. 5, the photographing support unit 101 includes an inspection record data acquisition unit 501, an image data acquisition unit 502, a photographed image data acquisition unit 503, a determination unit 504, a superimposed display unit 505, a movement information calculation unit 506, and a guide display. It has a part 507. In addition, the photographing support unit 101 includes a capture unit 508, a leftover determination unit 509, and a reference image data generation unit 510.
　点検調書データ取得部５０１は、作業者１２０により指定された橋梁名を受け付ける。また、点検調書データ取得部５０１は、受け付けた橋梁名に基づいて、点検調書記憶部１０２を検索し、対応する過去の点検調書データを読み出す。また、点検調書データ取得部５０１は、読み出した過去の点検調書データを画像データ取得部５０２に通知する。 The inspection record data acquisition unit 501 accepts the bridge name specified by the worker 120. Further, the inspection record data acquisition unit 501 searches the inspection record storage unit 102 based on the received bridge name, and reads out the corresponding past inspection record data. Further, the inspection record data acquisition unit 501 notifies the image data acquisition unit 502 of the read past inspection record data.
　更に、点検調書データ取得部５０１は、読み出した過去の点検調書データに対応する、新たな点検調書データを生成し、点検調書記憶部１０２に格納する。なお、新たな点検調書データは、読み出した過去の点検調書データと同じ"変状部分番号"、"画像番号"が記録され、"変状部分の状況"、"画像データ"、"参照画像データ"が空欄の点検調書データである。 Further, the inspection record data acquisition unit 501 generates new inspection record data corresponding to the read past inspection record data and stores it in the inspection record storage unit 102. In addition, as the new inspection record data, the same "deformed part number" and "image number" as the read past inspection record data are recorded, and the "deformed part status", "image data", and "reference image data" are recorded. "Is the blank inspection record data.
　画像データ取得部５０２は、点検調書データ取得部５０１より通知された点検調書データに関連付けられた損傷データを、点検調書記憶部１０２より読み出し、表示装置２０５に表示する。また、画像データ取得部５０２は、表示装置２０５に損傷データを表示したことに応じて、作業者１２０より変状部分の指定を受け付ける。 The image data acquisition unit 502 reads the damage data associated with the inspection record data notified from the inspection record data acquisition unit 501 from the inspection record storage unit 102 and displays it on the display device 205. Further, the image data acquisition unit 502 receives the designation of the deformed portion from the worker 120 in response to displaying the damage data on the display device 205.
　また、画像データ取得部５０２は、受け付けた変状部分に対応する画像データを、点検調書記憶部１０２より読み出し、表示装置２０５に表示する。また、画像データ取得部５０２は、受け付けた変状部分に対応する参照画像データを、点検調書記憶部１０２より読み出し、判定部５０４に通知する。更に、画像データ取得部５０２は、参照画像データを判定部５０４に通知したことを、撮影画像データ取得部５０３に通知する。 Further, the image data acquisition unit 502 reads out the image data corresponding to the received deformed portion from the inspection record storage unit 102 and displays it on the display device 205. Further, the image data acquisition unit 502 reads out the reference image data corresponding to the received deformed portion from the inspection record storage unit 102 and notifies the determination unit 504. Further, the image data acquisition unit 502 notifies the captured image data acquisition unit 503 that the reference image data has been notified to the determination unit 504.
　撮影画像データ取得部５０３は、画像データ取得部５０２から通知を受けると、撮像装置２０７により撮影された撮影画像データを受け付け、判定部５０４、重畳表示部５０５及びキャプチャ部５０８に通知する。 Upon receiving the notification from the image data acquisition unit 502, the captured image data acquisition unit 503 receives the captured image data captured by the image pickup device 207 and notifies the determination unit 504, the superimposed display unit 505, and the capture unit 508.
　判定部５０４は、撮影画像データ取得部５０３から通知された撮影画像データにおいて、特徴的形状の有無を判定する。また、判定部５０４は、特徴的形状があると判定した場合に、特徴的形状の位置及び範囲を特定し、重畳表示部５０５に通知する。具体的には、判定部５０４は、画像データ取得部５０２から通知された参照画像データに含まれる特徴的形状と同じ特徴的形状を撮影画像データ内（撮影範囲内）において検索する。つまり、判定部５０４は、参照画像データの少なくとも一部の範囲と一致する箇所が撮影画像データ内に存在するか否かを判定する。また、判定部５０４は、一致する箇所が撮影画像データ内に存在すると判定した場合、撮影画像データにおいて、当該一致する位置及び範囲を特定して、重畳表示部５０５に通知する。 The determination unit 504 determines the presence or absence of a characteristic shape in the photographed image data notified from the photographed image data acquisition unit 503. Further, when the determination unit 504 determines that there is a characteristic shape, the determination unit 504 specifies the position and range of the characteristic shape and notifies the superimposed display unit 505. Specifically, the determination unit 504 searches within the captured image data (within the photographing range) for the same characteristic shape as the characteristic shape included in the reference image data notified from the image data acquisition unit 502. That is, the determination unit 504 determines whether or not a portion that matches at least a part of the range of the reference image data exists in the captured image data. Further, when the determination unit 504 determines that the matching portion exists in the captured image data, the determination unit 504 specifies the matching position and range in the captured image data and notifies the superimposed display unit 505.
　重畳表示部５０５は、撮影画像データ取得部５０３から通知された撮影画像データにおいて、判定部５０４により特定された特徴的形状の位置及び範囲に、参照画像データに含まれる特徴的形状が一致するように参照画像データを重畳し、表示装置２０５に表示する。 In the captured image data notified from the captured image data acquisition unit 503, the superimposed display unit 505 ensures that the characteristic shape included in the reference image data matches the position and range of the characteristic shape specified by the determination unit 504. The reference image data is superimposed on the display device 205 and displayed on the display device 205.
　移動情報算出部５０６は、参照画像データが重畳して表示された撮影画像データにおける、重畳した参照画像データの位置及び範囲に基づいて、目標撮影位置の方向及び目標撮影位置までの距離を算出する。 The movement information calculation unit 506 calculates the direction of the target shooting position and the distance to the target shooting position based on the position and range of the superimposed reference image data in the captured image data displayed by superimposing the reference image data. ..
　具体的には、移動情報算出部５０６は、撮影支援装置１００の現在の向きに対する目標撮影位置の方向を、撮影画像データ内における参照画像データの位置に基づいて算出する。また、移動情報算出部５０６は、撮影支援装置１００の現在の位置から目標撮影位置までの距離を、重畳した参照画像データの範囲（大きさ）に基づいて算出する。 Specifically, the movement information calculation unit 506 calculates the direction of the target shooting position with respect to the current orientation of the shooting support device 100 based on the position of the reference image data in the shot image data. Further, the movement information calculation unit 506 calculates the distance from the current position of the shooting support device 100 to the target shooting position based on the range (size) of the superimposed reference image data.
　ガイド表示部５０７は出力部の一例であり、移動情報算出部５０６により算出された、目標撮影位置の方向及び目標撮影位置までの距離を、ガイド情報として、表示装置２０５に表示する。また、ガイド表示部５０７は、作業者１２０が移動することで、目標撮影位置の方向が０°となり、かつ、目標撮影位置までの距離が０ｍとなったか否かを監視する。そして、目標撮影位置の方向が０°となり、かつ、目標撮影位置までの距離が０ｍとなったと判定した場合、ガイド表示部５０７は、作業者１２０の移動が完了したと判定し、キャプチャ部５０８に通知する。 The guide display unit 507 is an example of an output unit, and displays the direction of the target shooting position and the distance to the target shooting position calculated by the movement information calculation unit 506 on the display device 205 as guide information. Further, the guide display unit 507 monitors whether or not the direction of the target shooting position becomes 0 ° and the distance to the target shooting position becomes 0 m as the worker 120 moves. Then, when it is determined that the direction of the target shooting position is 0 ° and the distance to the target shooting position is 0 m, the guide display unit 507 determines that the movement of the worker 120 is completed, and the capture unit 508. Notify to.
　キャプチャ部５０８は、ガイド表示部５０７から移動が完了した旨の通知を受けると、作業者１２０からのキャプチャ指示を受け付け、撮影画像データ取得部５０３から通知された撮影画像データをキャプチャする。また、キャプチャ部５０８は、キャプチャした撮影画像データを撮り残し判定部５０９を介して、点検調書記憶部１０２に格納する。このとき、キャプチャ部５０８は、キャプチャした撮影画像データを、新たな点検調書データと関連付けて格納する。 When the capture unit 508 receives a notification from the guide display unit 507 that the movement is completed, the capture unit 508 receives a capture instruction from the worker 120 and captures the captured image data notified by the captured image data acquisition unit 503. Further, the capture unit 508 stores the captured captured image data in the inspection record storage unit 102 via the uncaptured determination unit 509. At this time, the capture unit 508 stores the captured captured image data in association with the new inspection record data.
　撮り残し判定部５０９は、点検調書記憶部１０２に格納された新たな点検調書データを参照し、撮り残しの有無を判定する。具体的には、撮り残し判定部５０９は、当該新たな点検調書データに含まれる"画像データ"の各領域のうち、キャプチャした撮影画像データが関連付けられていない領域の有無を判定する。 The unphotographed determination unit 509 refers to the new inspection record data stored in the inspection record storage unit 102, and determines whether or not there is an unphotographed image. Specifically, the uncaptured determination unit 509 determines whether or not there is an region in which the captured captured image data is not associated with each region of the "image data" included in the new inspection record data.
　撮り残し判定部５０９は、キャプチャした撮影画像データが関連付けられていない領域があると判定した場合には、撮り残しがあると判定する。一方、撮り残し判定部５０９は、キャプチャした撮影画像データが関連付けられていない領域がないと判定した場合には、撮り残しがないと判定する。 When it is determined that there is an area to which the captured image data is not associated, the unphotographed determination unit 509 determines that there is an unphotographed image. On the other hand, when it is determined that there is no area to which the captured captured image data is not associated, the uncaptured determination unit 509 determines that there is no unrecorded image.
　参照画像データ生成部５１０は、点検調書記憶部１０２に格納された過去の点検調書データのうち、作業者１２０が点検作業を行う橋梁１１０についての、過去の点検調書データを読み出す。また、参照画像データ生成部５１０は、読み出した過去の点検調書データに含まれる"画像データ"に関連付けられた各画像データを読み出し、読み出した各画像データから特徴的形状を抽出することで、参照画像データを生成する。更に、参照画像データ生成部５１０は、生成した参照画像データを、過去の点検調書データと関連付けて、点検調書記憶部１０２に格納する。 The reference image data generation unit 510 reads out the past inspection record data of the bridge 110 to which the worker 120 performs the inspection work from the past inspection record data stored in the inspection record storage unit 102. Further, the reference image data generation unit 510 reads each image data associated with the "image data" included in the read past inspection record data, and extracts a characteristic shape from each read image data for reference. Generate image data. Further, the reference image data generation unit 510 stores the generated reference image data in the inspection record storage unit 102 in association with the past inspection record data.
　＜点検作業全体の流れ＞
　次に、点検対象の橋梁に対して行われる点検作業全体の流れについて説明する。図６は、点検作業の流れを示すフローチャートである。 <Overall inspection work flow>
Next, the flow of the entire inspection work performed on the bridge to be inspected will be described. FIG. 6 is a flowchart showing the flow of inspection work.
　ステップＳ６０１において、作業者１２０は、点検対象の橋梁（ここでは、橋梁１１０）を決定する。ステップＳ６０２において、参照画像データ生成部５１０は、作業者１２０が決定した橋梁１１０について、参照画像データ生成処理を実行する。なお、参照画像データ生成処理の詳細は後述する。 In step S601, the worker 120 determines the bridge to be inspected (here, the bridge 110). In step S602, the reference image data generation unit 510 executes the reference image data generation process for the bridge 110 determined by the worker 120. The details of the reference image data generation process will be described later.
　ステップＳ６０３において、作業者１２０は、参照画像データ生成処理（ステップＳ６０２）が実行されることで生成された参照画像データを、点検対象の橋梁１１０についての過去の点検調書データと関連付けて、点検調書記憶部１０２に格納する。 In step S603, the worker 120 associates the reference image data generated by executing the reference image data generation process (step S602) with the past inspection record data for the bridge 110 to be inspected, and the inspection record. It is stored in the storage unit 102.
　ステップＳ６０４において、作業者１２０は、撮影支援装置１００を携帯して、点検対象の橋梁１１０がある点検現場へと移動する。また、作業者１２０は、点検現場において、まず、橋梁１１０の変状部分の位置及び変状部分の状況を記録する記録作業を行う。 In step S604, the worker 120 carries the photographing support device 100 and moves to the inspection site where the bridge 110 to be inspected is located. In addition, the worker 120 first performs a recording operation at the inspection site to record the position of the deformed portion of the bridge 110 and the state of the deformed portion.
　ステップＳ６０５において、作業者１２０は、撮影作業を行う。具体的には、作業者１２０は、撮影支援装置１００の撮影処理を実行させながら、橋梁１１０の変状部分の各箇所の撮影を行い、画像データを保存する。なお、撮影処理の詳細は後述する。 In step S605, the worker 120 performs a shooting operation. Specifically, the worker 120 shoots each part of the deformed portion of the bridge 110 and saves the image data while executing the shooting process of the shooting support device 100. The details of the shooting process will be described later.
　ステップＳ６０６において、作業者１２０は、記録した内容及び保存された画像データ等を用いて点検調書データを生成する生成作業を行う。 In step S606, the worker 120 performs a generation operation of generating inspection record data using the recorded contents and the saved image data and the like.
　＜参照画像データ生成処理の流れ＞
　次に、参照画像データ生成処理（ステップＳ６０２）の詳細について説明する。図７は、参照画像データ生成処理の流れを示すフローチャートである。 <Flow of reference image data generation process>
Next, the details of the reference image data generation process (step S602) will be described. FIG. 7 is a flowchart showing the flow of the reference image data generation process.
　ステップＳ７０１において、参照画像データ生成部５１０は、点検調書記憶部１０２より、点検対象の橋梁についての、過去の点検調書データを読み出す。なお、点検調書記憶部１０２には、例えば、不図示のネットワークを介して通信装置２０８が受信した、点検対象の橋梁についての過去の点検調書データが予め格納されているものとする。 In step S701, the reference image data generation unit 510 reads the past inspection record data of the bridge to be inspected from the inspection record storage unit 102. It is assumed that the inspection record storage unit 102 stores in advance the past inspection record data of the bridge to be inspected, for example, received by the communication device 208 via a network (not shown).
　ステップＳ７０２において、参照画像データ生成部５１０は、過去の点検調書データに関連付けられた複数の種類の画像データをカウントするカウンタＮに、"１"を入力する。 In step S702, the reference image data generation unit 510 inputs "1" to the counter N that counts a plurality of types of image data associated with the past inspection record data.
　ステップＳ７０３において、参照画像データ生成部５１０は、過去の点検調書データに関連付けられたＮ番目の画像データを読み出す。 In step S703, the reference image data generation unit 510 reads out the Nth image data associated with the past inspection record data.
　ステップＳ７０４において、参照画像データ生成部５１０は、読み出したＮ番目の画像データを処理し、特徴的形状（エッジ部分、特定の色）を抽出する。 In step S704, the reference image data generation unit 510 processes the read N-th image data and extracts a characteristic shape (edge portion, specific color).
　ステップＳ７０５において、参照画像データ生成部５１０は、抽出した特徴的形状を含む画像データの範囲を示すデータである参照画像データを、過去の点検調書データと関連付けて格納する。 In step S705, the reference image data generation unit 510 stores the reference image data, which is data indicating the range of the image data including the extracted characteristic shape, in association with the past inspection record data.
　ステップＳ７０６において、参照画像データ生成部５１０は、過去の点検調書データに関連付けられた全ての画像データについて、参照画像データを生成したか否かを判定する。 In step S706, the reference image data generation unit 510 determines whether or not the reference image data has been generated for all the image data associated with the past inspection record data.
　ステップＳ７０６において、未だ参照画像データを生成していない画像データがあると判定した場合には（ステップＳ７０６においてＮｏの場合には）、ステップＳ７０７に進む。 If it is determined in step S706 that there is image data for which reference image data has not yet been generated (if No in step S706), the process proceeds to step S707.
　ステップＳ７０７において、参照画像データ生成部５１０は、カウンタＮをインクリメントし、ステップＳ７０３に戻る。 In step S707, the reference image data generation unit 510 increments the counter N and returns to step S703.
　一方、ステップＳ７０７において、全ての画像データについて参照画像データを生成したと判定した場合には（ステップＳ７０６においてＹｅｓの場合には）、参照画像データ生成処理を終了する。 On the other hand, if it is determined in step S707 that the reference image data has been generated for all the image data (in the case of Yes in step S706), the reference image data generation process is terminated.
　＜撮影処理の流れ＞
　次に、撮影処理（ステップＳ６０５）の詳細について説明する。図８は、撮影処理の流れを示すフローチャートである。 <Flow of shooting process>
Next, the details of the photographing process (step S605) will be described. FIG. 8 is a flowchart showing the flow of the photographing process.
　ステップＳ８０１において、点検調書データ取得部５０１は、作業者１２０により指定された橋梁名に対応する過去の点検調書データを、点検調書記憶部１０２から読み出す。また、点検調書データ取得部５０１は、読み出した過去の点検調書データに対応する、新たな点検調書データを生成し、点検調書記憶部１０２に格納する。 In step S801, the inspection record data acquisition unit 501 reads out the past inspection record data corresponding to the bridge name designated by the worker 120 from the inspection record storage unit 102. Further, the inspection record data acquisition unit 501 generates new inspection record data corresponding to the read past inspection record data and stores it in the inspection record storage unit 102.
　ステップＳ８０２において、画像データ取得部５０２は、読み出された過去の点検調書データに関連付けられた損傷データを表示装置２０５に表示する。また、画像データ取得部５０２は、損傷データを表示したことに応じて作業者１２０により指定された変状部分を受け付ける。 In step S802, the image data acquisition unit 502 displays the damage data associated with the read past inspection record data on the display device 205. Further, the image data acquisition unit 502 accepts the deformed portion designated by the operator 120 according to the display of the damage data.
　ステップＳ８０３において、画像データ取得部５０２は、受け付けた変状部分に対応する画像データを、点検調書記憶部１０２より読み出し、表示装置２０５に表示する。また、画像データ取得部５０２は、受け付けた変状部分に対応する参照画像データを、点検調書記憶部１０２より読み出し、判定部５０４に通知する。 In step S803, the image data acquisition unit 502 reads out the image data corresponding to the received deformed portion from the inspection record storage unit 102 and displays it on the display device 205. Further, the image data acquisition unit 502 reads out the reference image data corresponding to the received deformed portion from the inspection record storage unit 102 and notifies the determination unit 504.
　ステップＳ８０４において、撮影画像データ取得部５０３は、撮像装置２０７により撮影された撮影画像データを受け付け、表示装置２０５への表示を開始する。 In step S804, the captured image data acquisition unit 503 receives the captured image data captured by the imaging device 207 and starts displaying the captured image data on the display device 205.
　ステップＳ８０５において、判定部５０４は、参照画像データに含まれる特徴的形状と同じ特徴的形状を検索することで、撮像装置２０７により撮影された撮影画像データに、参照画像データに含まれる特徴的形状と同じ特徴的形状が含まれるか否かを判定する。また、判定部５０４は、含まれると判定した場合に、撮影画像データにおける当該特徴的形状の位置及び範囲を特定する。 In step S805, the determination unit 504 searches for the same characteristic shape as the characteristic shape included in the reference image data, so that the captured image data captured by the image pickup apparatus 207 has the characteristic shape included in the reference image data. It is determined whether or not the same characteristic shape as is included. In addition, the determination unit 504 specifies the position and range of the characteristic shape in the captured image data when it is determined that the image is included.
　ステップＳ８０６において、重畳表示部５０５は、撮像装置２０７により撮影された撮影画像データにおいて、特定された特徴的形状の位置及び範囲に、参照画像データに含まれる特徴的形状が一致するように参照画像データを重畳し、表示装置２０５に表示する。 In step S806, the superimposed display unit 505 displays the reference image so that the characteristic shape included in the reference image data matches the position and range of the specified characteristic shape in the captured image data captured by the image pickup apparatus 207. The data is superimposed and displayed on the display device 205.
　ステップＳ８０７において、移動情報算出部５０６は、参照画像データが重畳された位置及び範囲（大きさ）に基づいて、目標撮影位置の方向及び目標撮影位置までの距離を算出する。また、ガイド表示部５０７は、算出された目標撮影位置の方向及び目標撮影位置までの距離を、ガイド情報として表示装置２０５に表示する。 In step S807, the movement information calculation unit 506 calculates the direction of the target shooting position and the distance to the target shooting position based on the position and range (size) on which the reference image data is superimposed. Further, the guide display unit 507 displays the calculated direction of the target shooting position and the distance to the target shooting position on the display device 205 as guide information.
　ステップＳ８０８において、ガイド表示部５０７は、目標撮影位置の方向及び目標撮影位置までの距離を監視することで、作業者１２０の目標撮影位置への移動が完了したか否かを判定する。ステップＳ８０８において、目標撮影位置への移動が完了していないと判定した場合には（ステップＳ８０８においてＮｏの場合には）、ステップＳ８０７に戻る。一方、ステップＳ８０８において、目標撮影位置への移動が完了したと判定した場合には（ステップＳ８０８においてＹｅｓの場合には）、ステップＳ８０９に進む。 In step S808, the guide display unit 507 monitors the direction of the target shooting position and the distance to the target shooting position to determine whether or not the movement of the worker 120 to the target shooting position is completed. If it is determined in step S808 that the movement to the target shooting position has not been completed (if No in step S808), the process returns to step S807. On the other hand, if it is determined in step S808 that the movement to the target shooting position is completed (in the case of Yes in step S808), the process proceeds to step S809.
　ステップＳ８０９において、キャプチャ部５０８は、作業者１２０によるキャプチャ指示を受け付ける。また、キャプチャ部５０８は、キャプチャ指示を受け付けると、撮像装置２０７により撮影された撮影画像データをキャプチャし、キャプチャした撮影画像データを、新たな点検調書データと関連付けて点検調書記憶部１０２に格納する。 In step S809, the capture unit 508 receives the capture instruction by the worker 120. Further, when the capture unit 508 receives the capture instruction, the capture image data captured by the image pickup device 207 is captured, and the captured image data is stored in the inspection record storage unit 102 in association with the new inspection record data. ..
　ステップＳ８１０において、撮り残し判定部５０９は、全ての変状部分について撮影画像データをキャプチャしたか否か（撮り残しの有無）を判定する。ステップＳ８１０において、撮り残しがあると判定した場合には（ステップＳ８１０においてＮｏの場合には）、ステップＳ８０２に戻る。一方、ステップＳ８１０において撮り残しがないと判定した場合には（ステップＳ８１０においてＹｅｓの場合には）、撮影処理を終了する。 In step S810, the unphotographed determination unit 509 determines whether or not the captured image data has been captured for all the deformed portions (presence or absence of unrecorded images). If it is determined in step S810 that there is an unphotographed image (No in step S810), the process returns to step S802. On the other hand, if it is determined in step S810 that there is no unphotographed portion (in the case of Yes in step S810), the photographing process is terminated.
　＜撮影処理時の画面遷移＞
　次に、撮影処理時（図８参照）の撮影支援装置１００の画面遷移について説明する。図９Ａ～図１１は、撮影処理時の撮影支援装置の画面遷移の一例を示す第１乃至第５の図である。 <Screen transition during shooting process>
Next, the screen transition of the shooting support device 100 during the shooting process (see FIG. 8) will be described. 9A to 11 are the first to fifth views showing an example of the screen transition of the shooting support device during the shooting process.
　このうち、図９Ａは、点検調書データ取得部５０１が、作業者１２０より橋梁名の指定を受け付け、受け付けた橋梁名に対応する、過去の点検調書データを検索するための点検調書データ検索画面９１０の一例を示す図である。 Of these, FIG. 9A shows the inspection record data search screen 910 for the inspection record data acquisition unit 501 to receive the designation of the bridge name from the worker 120 and to search the past inspection record data corresponding to the accepted bridge name. It is a figure which shows an example.
　図９Ａに示すように、点検調書データ検索画面９１０には、"橋梁名"を入力する入力欄９１１が含まれる。また、点検調書データ検索画面９１０には、過去の点検調書データの検索を指示するための"検索"ボタン９１２が含まれる。作業者１２０が入力欄９１１に橋梁名を入力し、"検索"ボタン９１２を押下することで、点検調書データ取得部５０１は、橋梁名（図９Ａの例では、"ＸＸ"）に対応する過去の点検調書データを、点検調書記憶部１０２より読み出す。 As shown in FIG. 9A, the inspection record data search screen 910 includes an input field 911 for inputting the "bridge name". In addition, the inspection record data search screen 910 includes a "search" button 912 for instructing a search for past inspection record data. When the worker 120 inputs the bridge name in the input field 911 and presses the "search" button 912, the inspection record data acquisition unit 501 corresponds to the bridge name ("XX" in the example of FIG. 9A) in the past. The inspection record data of is read from the inspection record storage unit 102.
　図９Ｂは、画像データ取得部５０２が、読み出された過去の点検調書データに関連付けられた損傷データを表示する損傷データ表示画面９２０の一例を示す図である。図９Ｂに示すように、損傷データ表示画面９２０には、橋梁名＝"ＸＸ"の過去の点検調書データに関連付けられた損傷データ９２１（ファイル名＝"損傷データＡ"）が表示される。なお、損傷データ表示画面９２０において、損傷データ９２１は、各変状部分が指定可能に表示される。 FIG. 9B is a diagram showing an example of a damage data display screen 920 in which the image data acquisition unit 502 displays the damage data associated with the read past inspection record data. As shown in FIG. 9B, the damage data display screen 920 displays the damage data 921 (file name = "damage data A") associated with the past inspection record data of the bridge name = "XX". On the damage data display screen 920, the damage data 921 is displayed so that each deformed portion can be specified.
　図９Ｂの例は、指示子９２２により、所定の変状部分が指定された様子を示している。指示子９２２により変状部分（図９Ｂの例では、変状部分番号＝"７"）が指定されたことで、撮影支援装置１００の表示装置２０５は撮影画面に遷移する。なお、損傷データ表示画面９２０には、点検調書データ検索画面９１０に戻るための"戻る"ボタン９２３が含まれ、"戻る"ボタン９２３が押圧された場合には、点検調書データ検索画面９１０に戻る。 The example of FIG. 9B shows a state in which a predetermined deformed portion is designated by the indicator 922. Since the deformed portion (in the example of FIG. 9B, the deformed portion number = "7") is designated by the indicator 922, the display device 205 of the shooting support device 100 transitions to the shooting screen. The damage data display screen 920 includes a "back" button 923 for returning to the inspection record data search screen 910, and when the "back" button 923 is pressed, the screen returns to the inspection record data search screen 910. ..
　図１０Ａは、変状部分が指定されたことで表示装置２０５に表示された撮影画面１０１０の一例を示す図である。図１０Ａに示すように、撮影画面１０１０は、橋梁名＝"ＸＸ"の過去の点検調書データに関連付けられた損傷データ（ファイル名＝"損傷データＡ"）における変状部分番号＝"７"の変状部分を撮影するための撮影画面の一例である。 FIG. 10A is a diagram showing an example of a shooting screen 1010 displayed on the display device 205 due to the designation of the deformed portion. As shown in FIG. 10A, the shooting screen 1010 shows the deformation part number = "7" in the damage data (file name = "damage data A") associated with the past inspection record data of the bridge name = "XX". This is an example of a shooting screen for shooting a deformed part.
　図１０Ａに示すように、撮影画面１０１０には、過去画像データ表示領域１０１１と、撮影画像データ表示領域１０１２と、ガイド用画像データ表示領域１０１３と、ガイド情報表示領域１０１４と、"キャプチャ"ボタン１０１５とが含まれる。 As shown in FIG. 10A, the shooting screen 1010 has a past image data display area 1011, a shot image data display area 1012, a guide image data display area 1013, a guide information display area 1014, and a "capture" button 1015. And are included.
　過去画像データ表示領域１０１１には、変状部分（ここでは、変状部分番号＝"７"の変状部分）に対応する過去の画像データが表示される。過去画像データ表示領域１０１１への過去の画像データの表示は、画像データ取得部５０２によって行われる。 In the past image data display area 1011, the past image data corresponding to the deformed portion (here, the deformed portion of the deformed portion number = "7") is displayed. The past image data is displayed in the past image data display area 1011 by the image data acquisition unit 502.
　撮影画像データ表示領域１０１２には、現在、撮像装置２０７により撮影されている撮影画像データが表示される。撮影画像データ表示領域１０１２への撮影画像データの表示は、撮影画像データ取得部５０３によって行われる。 In the captured image data display area 1012, the captured image data currently captured by the imaging device 207 is displayed. The captured image data is displayed on the captured image data display area 1012 by the captured image data acquisition unit 503.
　ガイド用画像データ表示領域１０１３には、現在、撮像装置２０７により撮影されている撮影画像データの特徴的形状の位置及び範囲に、参照画像データに含まれる特徴的形状が一致するように、参照画像データが重畳された撮影画像データが表示される。ガイド用画像データ表示領域１０１３への撮影画像データの表示は、重畳表示部５０５によって行われる。なお、図１０Ａに示すガイド用画像データ表示領域１０１３は、参照画像データが重畳される前の撮影画像データが表示された様子を示している。 In the guide image data display area 1013, the reference image is set so that the characteristic shape included in the reference image data matches the position and range of the characteristic shape of the captured image data currently captured by the imaging device 207. The captured image data on which the data is superimposed is displayed. The captured image data is displayed on the guide image data display area 1013 by the superimposed display unit 505. The guide image data display area 1013 shown in FIG. 10A shows how the captured image data before the reference image data is superimposed is displayed.
　ガイド情報表示領域１０１４には、ガイド情報として、現在の撮影支援装置１００から見た目標撮影位置の方向及び目標撮影位置までの距離が表示される。ガイド情報表示領域１０１４への表示は、ガイド表示部５０７によって行われる。なお、図１０Ａに示すガイド情報表示領域１０１４は、移動情報算出部５０６が、目標撮影位置の方向及び目標撮影位置までの距離を算出する前の状態を示している。 In the guide information display area 1014, the direction of the target shooting position and the distance to the target shooting position as seen from the current shooting support device 100 are displayed as guide information. The display on the guide information display area 1014 is performed by the guide display unit 507. The guide information display area 1014 shown in FIG. 10A shows a state before the movement information calculation unit 506 calculates the direction of the target shooting position and the distance to the target shooting position.
　"キャプチャ"ボタン１０１５は、作業者１２０がキャプチャ指示を入力するためのボタンである。なお、図１０Ａに示す"キャプチャ"ボタン１０１５は、目標撮影位置の方向、目標撮影位置までの距離が算出されていないため、作業者１２０が押圧できない状態となっている。 The "capture" button 1015 is a button for the worker 120 to input a capture instruction. Since the direction of the target shooting position and the distance to the target shooting position have not been calculated for the "capture" button 1015 shown in FIG. 10A, the operator 120 cannot press the button.
　図１０Ｂは、重畳表示部５０５によって参照画像データが重畳され、移動情報算出部５０６によって、目標撮影位置の方向及び目標撮影位置までの距離が算出された後の撮影画面１０２０の一例を示す図である。 FIG. 10B is a diagram showing an example of a shooting screen 1020 after the reference image data is superimposed by the superimposed display unit 505 and the direction of the target shooting position and the distance to the target shooting position are calculated by the movement information calculation unit 506. is there.
　図１０Ｂに示すように、ガイド用画像データ表示領域１０２１には、重畳表示部５０５によって、参照画像データ１０２２が重畳された後の撮影画像データが表示される。また、ガイド情報表示領域１０２３には、移動情報算出部５０６によって算出された目標撮影位置の方向及び目標撮影位置までの距離が表示される。 As shown in FIG. 10B, in the guide image data display area 1021, the captured image data after the reference image data 1022 is superimposed is displayed by the superimposed display unit 505. Further, in the guide information display area 1023, the direction of the target shooting position and the distance to the target shooting position calculated by the movement information calculation unit 506 are displayed.
　ガイド用画像データ表示領域１０２１に表示された撮影画像データの場合、参照画像データ１０２２が、撮影画像データ内の左上の位置に、撮影画像データよりも小さい範囲（大きさ）で重畳されている。このため、作業者１２０は、参照画像データ１０２２を参照することで、目標撮影位置までの距離が遠いこと、目標撮影位置が左斜め前の方向にあることを認識することができる。また、ガイド情報表示領域１０２３には、目標撮影位置の方向を表す具体的な角度値及び目標撮影位置までの具体的な距離を表す距離情報が表示されるため、作業者１２０は、当該角度値及び当該距離情報に従って目標撮影位置まで移動することができる。 In the case of the captured image data displayed in the guide image data display area 1021, the reference image data 1022 is superimposed on the upper left position in the captured image data in a range (size) smaller than that of the captured image data. Therefore, by referring to the reference image data 1022, the operator 120 can recognize that the distance to the target shooting position is long and that the target shooting position is in the diagonally forward left direction. Further, since the guide information display area 1023 displays a specific angle value representing the direction of the target shooting position and a distance information representing a specific distance to the target shooting position, the operator 120 can display the angle value. And it is possible to move to the target shooting position according to the distance information.
　図１１は、作業者１２０が目標撮影位置に移動した後の撮影画面１１１０の一例を示す図である。 FIG. 11 is a diagram showing an example of a shooting screen 1110 after the worker 120 has moved to the target shooting position.
　図１１に示すように、ガイド用画像データ表示領域１１１１には、重畳表示部５０５によって、参照画像データ１１１２が重畳された後の撮影画像データが表示される。また、ガイド情報表示領域１１１３には、移動情報算出部５０６によって算出された目標撮影位置の方向及び目標撮影位置までの距離が表示される。 As shown in FIG. 11, in the guide image data display area 1111, the captured image data after the reference image data 1112 is superimposed is displayed by the superimposed display unit 505. Further, in the guide information display area 1113, the direction of the target shooting position and the distance to the target shooting position calculated by the movement information calculation unit 506 are displayed.
　ガイド用画像データ表示領域１１１１に表示された撮影画像データの場合、参照画像データ１１１２と完全に重なっている。このため、作業者１２０は、参照画像データ１１１２を参照することで、目標撮影位置に到達したことを認識することができる。なお、ガイド情報表示領域１１１３には、目標撮影位置の方向を表す角度値として"０°"が、目標撮影位置までの距離を表す距離情報として"０ｍ"が表示される。このため、作業者１２０は、ガイド情報表示領域１１１３を参照することによっても、目標撮影位置に到達したことを認識することができる。 In the case of the photographed image data displayed in the guide image data display area 1111, it completely overlaps with the reference image data 1112. Therefore, the operator 120 can recognize that the target shooting position has been reached by referring to the reference image data 1112. In the guide information display area 1113, "0 °" is displayed as an angle value indicating the direction of the target shooting position, and "0 m" is displayed as the distance information indicating the distance to the target shooting position. Therefore, the operator 120 can also recognize that the target shooting position has been reached by referring to the guide information display area 1113.
　なお、目標撮影位置の方向を表す角度値が"０"となり、目標撮影位置までの距離を表す距離情報が"０ｍ"となることで、ガイド表示部５０７では、作業者１２０の移動が完了したと判定する。これにより、"キャプチャ"ボタン１１１４が押圧可能な状態となり、作業者１２０は、"キャプチャ"ボタン１１１４を押圧することで、撮影画像データをキャプチャする。 The angle value indicating the direction of the target shooting position is "0", and the distance information indicating the distance to the target shooting position is "0 m", so that the movement of the operator 120 is completed on the guide display unit 507. Is determined. As a result, the "capture" button 1114 can be pressed, and the operator 120 captures the captured image data by pressing the "capture" button 1114.
　＜新たな点検調書データ＞
　次に、撮影支援装置１００により撮影処理が実行されることでキャプチャされた撮影画像データが関連付けられる、新たな点検調書データについて説明する。図１２は、新たな点検調書データの一例を示す図である。 <New inspection record data>
Next, new inspection record data to which the captured image data captured by executing the photographing process by the photographing support device 100 will be described. FIG. 12 is a diagram showing an example of new inspection record data.
　図１２に示すように、新たな点検調書データ１２００には、過去の点検調書データ３００に含まれる情報の項目と同じ項目が含まれる。過去の点検調書データ３００との相違点は、新たな点検調書データ１２００の場合、"画像データ"に、新たにキャプチャされた撮影画像データが関連付けられている点、及び、"参照画像データ"に関連付けられる参照画像データが未だ生成されていない点である。なお、参照画像データは、次回の点検作業までの間に、各画像データ（ファイル名＝"画像データ４＿２"～"画像データ１３＿２"の各画像データ）に基づいて生成される。 As shown in FIG. 12, the new inspection record data 1200 includes the same items as the information items included in the past inspection record data 300. The difference from the past inspection record data 300 is that in the case of the new inspection record data 1200, the "image data" is associated with the newly captured captured image data, and the "reference image data". The point is that the associated reference image data has not yet been generated. The reference image data is generated based on each image data (file name = each image data of "image data 4_2" to "image data 13_2") until the next inspection work.
　以上の説明から明らかなように、第１の実施形態に係る撮影支援装置は、
・撮影中の撮影画像データ内に、点検調書記憶部に格納された画像データであって、過去の点検調書データに関連付けられた画像データの特徴的形状の範囲と一致する箇所が存在するか否かを判定する。
・一致する箇所が存在すると判定した場合に、当該一致する箇所に、特徴的形状を含む参照画像データを重畳させる。
・重畳させた参照画像データの範囲と、撮影中の撮影画像データの撮影範囲とが一致する撮影位置である目標撮影位置に、点検作業の作業者を誘導すべく移動情報を算出し、作業者に対して、ガイド情報として出力する。 As is clear from the above description, the photographing support device according to the first embodiment is
-Whether or not there is a part of the captured image data during shooting that matches the range of the characteristic shape of the image data associated with the past inspection record data, which is the image data stored in the inspection record storage unit. Is determined.
-When it is determined that there is a matching part, the reference image data including the characteristic shape is superimposed on the matching part.
-Movement information is calculated to guide the operator of the inspection work to the target shooting position, which is the shooting position where the range of the superimposed reference image data and the shooting range of the shot image data during shooting match. Is output as guide information.
　このように、第１の実施形態に係る撮影支援装置によれば、点検時の撮影作業（所望の画角で撮影を行うための撮影作業）を支援することができる。この結果、第１の実施形態に係る撮影支援装置によれば、点検時の撮影作業における作業者の負担を軽減でき、撮影時間を短縮することができる。 As described above, according to the shooting support device according to the first embodiment, it is possible to support the shooting work at the time of inspection (shooting work for shooting at a desired angle of view). As a result, according to the photographing support device according to the first embodiment, the burden on the operator in the photographing work at the time of inspection can be reduced, and the photographing time can be shortened.
　［第２の実施形態］
　上記第１の実施形態では、目標撮影位置の方向を表す角度値が"０°"となり、目標撮影位置までの距離を表す距離情報が"０ｍ"となることで、作業者１２０の移動が完了したと判定するものとして説明した。しかしながら、作業者１２０の移動が完了したか否かの判定方法はこれに限定されない。例えば、目標撮影位置の方向を表す角度値が所定の閾値以下となり、目標撮影位置までの距離を表す距離情報が所定の閾値以下となることで、作業者１２０の移動が完了したと判定してもよい。 [Second Embodiment]
In the first embodiment, the angle value representing the direction of the target shooting position is "0 °", and the distance information representing the distance to the target shooting position is "0 m", so that the movement of the worker 120 is completed. It was explained as assuming that it was done. However, the method for determining whether or not the movement of the worker 120 is completed is not limited to this. For example, when the angle value indicating the direction of the target shooting position is equal to or less than a predetermined threshold value and the distance information indicating the distance to the target shooting position is equal to or less than a predetermined threshold value, it is determined that the movement of the worker 120 is completed. May be good.
　また、上記第１の実施形態では、作業者１２０の移動が完了したと判定されることで"キャプチャ"ボタンが押圧可能な状態になるものとして説明した。しかしながら、"キャプチャ"ボタンは、作業者１２０の移動が完了したか否かに関わらず、押圧できるように構成してもよい。 Further, in the first embodiment described above, it has been described that the "capture" button can be pressed when it is determined that the movement of the worker 120 is completed. However, the "capture" button may be configured to be pressed regardless of whether the movement of the worker 120 is complete.
　また、上記第１の実施形態では、ガイド情報として、目標撮影位置の方向を示す角度値及び目標撮影位置までの距離を示す距離情報を表示するものとして説明したが、ガイド情報の出力方法はこれに限定されない。例えば、目標撮影位置の方向及び目標撮影位置までの距離に応じた"矢印"を表示してもよい。あるいは、目標撮影位置の方向を示す角度値及び目標撮影位置までの距離を示す距離情報を、音声出力してもよい。 Further, in the first embodiment, the guide information has been described as displaying the angle value indicating the direction of the target shooting position and the distance information indicating the distance to the target shooting position, but the method of outputting the guide information is this. Not limited to. For example, an "arrow" may be displayed according to the direction of the target shooting position and the distance to the target shooting position. Alternatively, the angle value indicating the direction of the target shooting position and the distance information indicating the distance to the target shooting position may be output by voice.
　なお、上記実施形態に挙げた構成等に、その他の要素との組み合わせ等、ここで示した構成に本発明が限定されるものではない。これらの点に関しては、本発明の趣旨を逸脱しない範囲で変更することが可能であり、その応用形態に応じて適切に定めることができる。 It should be noted that the present invention is not limited to the configurations shown here, such as combinations with other elements in the configurations and the like described in the above embodiments. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form thereof.
１００　　　　　　　：撮影支援装置
１０１　　　　　　　：撮影支援部
１０２　　　　　　　：点検調書記憶部
３００　　　　　　　：点検調書データ
５０１　　　　　　　：点検調書データ取得部
５０２　　　　　　　：画像データ取得部
５０３　　　　　　　：撮影画像データ取得部
５０４　　　　　　　：判定部
５０５　　　　　　　：重畳表示部
５０６　　　　　　　：移動情報算出部
５０７　　　　　　　：ガイド表示部
５０８　　　　　　　：キャプチャ部
５０９　　　　　　　：撮り残し判定部
９１０　　　　　　　：点検調書データ検索画面
９２０　　　　　　　：損傷データ表示画面
１０１０　　　　　　：撮影画面
１０１１　　　　　　：過去画像データ表示領域
１０１２　　　　　　：撮影画像データ表示領域
１０１３　　　　　　：ガイド用画像データ表示領域
１０１４　　　　　　：ガイド情報表示領域
１０２０　　　　　　：撮影画面
１０２１　　　　　　：ガイド用画像データ表示領域
１０２２　　　　　　：参照画像データ
１０２３　　　　　　：ガイド情報表示領域
１１１０　　　　　　：撮影画面
１１１１　　　　　　：ガイド用画像データ表示領域
１１１２　　　　　　：参照画像データ
１１１３　　　　　　：ガイド情報表示領域
１２００　　　　　　：点検調書データ 100: Shooting support device 101: Shooting support unit 102: Inspection record storage unit 300: Inspection record data 501: Inspection record data acquisition unit 502: Image data acquisition unit 503: Photographed image data acquisition unit 504: Judgment unit 505: Superimposition display unit 506: Movement information calculation unit 507: Guide display unit 508: Capture unit 509: Leftover judgment unit 910: Inspection record data search screen 920: Damage data display screen 1010: Shooting screen 1011: Past image data display area 1012: Photographed image data Display area 1013: Guide image data display area 1014: Guide information display area 1020: Shooting screen 1021: Guide image data display area 1022: Reference image data 1023: Guide information display area 1110: Shooting screen 1111: Guide image data display Area 1112: Reference image data 1113: Guide information display area 1200: Inspection record data

Claims (10)

  1. 　ユーザによる撮影作業を支援する撮影支援プログラムであって、
    　撮影中の撮影範囲内に、記憶部に記憶した画像データの少なくとも一部の範囲と一致する箇所が存在するか否かを判定し、
    　一致する箇所が存在すると判定した場合に、前記一致する箇所を含む画像データの範囲と前記撮影中の撮影範囲とが一致する撮影位置に前記ユーザを誘導する情報を出力する、
    　処理をコンピュータに実行させる撮影支援プログラム。     A shooting support program that supports shooting work by users.
    It is determined whether or not there is a portion within the shooting range during shooting that matches at least a part of the range of the image data stored in the storage unit.
    When it is determined that there is a matching portion, information for guiding the user to a shooting position where the range of image data including the matching portion and the shooting range during shooting match is output.
    A shooting support program that lets a computer execute processing.
  2. 　前記一致する箇所が存在するか否かを、前記撮影範囲及び前記画像データに含まれるエッジの情報に基づいて判定する処理をコンピュータに実行させる、請求項１に記載の撮影支援プログラム。 The shooting support program according to claim 1, wherein a computer is made to execute a process of determining whether or not the matching portion exists based on the information of the shooting range and the edge included in the image data.
  3. 　前記一致する箇所が存在するか否かを、前記撮影範囲及び前記画像データに含まれる色の情報に基づいて判定する処理をコンピュータに実行させる、請求項１に記載の撮影支援プログラム。 The shooting support program according to claim 1, wherein a computer is made to execute a process of determining whether or not the matching portion exists based on the shooting range and the color information included in the image data.
  4. 　前記記憶部は、複数の種類の前記画像データを格納しており、前記判定する処理は、複数の種類の前記画像データのうち、指定を受け付けた画像データに対して行う、請求項１乃至３のいずれか１項に記載の撮影支援プログラム。 The storage unit stores a plurality of types of the image data, and the determination process is performed on the designated image data among the plurality of types of the image data, claims 1 to 3. The shooting support program described in any one of the above.
  5. 　前記撮影中の撮影範囲内の前記一致する箇所に、前記一致する箇所を含む画像データの範囲を重畳して表示する、
    　処理をコンピュータに実行させる、請求項１に記載の撮影支援プログラム。     The range of image data including the matching portion is superimposed and displayed on the matching portion within the shooting range during shooting.
    The shooting support program according to claim 1, wherein the processing is executed by a computer.
  6. 　前記撮影中の撮影範囲の大きさに対する、前記画像データの範囲の大きさに基づいて、前記撮影位置までの距離を算出し、
    　前記撮影中の撮影範囲における、前記画像データの範囲の位置に基づいて、前記撮影位置の方向を算出する、
    　処理をコンピュータに実行させ、
    　算出した前記距離及び前記方向に基づいて前記ユーザを誘導する情報を出力する、請求項５に記載の撮影支援プログラム。     The distance to the shooting position is calculated based on the size of the range of the image data with respect to the size of the shooting range during shooting.
    The direction of the shooting position is calculated based on the position of the range of the image data in the shooting range during shooting.
    Let the computer do the work
    The shooting support program according to claim 5, which outputs information for guiding the user based on the calculated distance and the direction.
  7. 　前記画像データの範囲と、前記撮影中の撮影範囲とが一致した場合に、前記ユーザの前記撮影位置への移動が完了したと判定する、
    　処理をコンピュータに実行させる、請求項１に記載の撮影支援プログラム。     When the range of the image data and the shooting range during shooting match, it is determined that the movement of the user to the shooting position is completed.
    The shooting support program according to claim 1, wherein the processing is executed by a computer.
  8. 　前記ユーザの前記撮影位置への移動が完了したと判定した場合に、前記撮影中の撮影範囲についてキャプチャが可能になる、請求項７に記載の撮影支援プログラム。 The shooting support program according to claim 7, wherein when it is determined that the movement of the user to the shooting position is completed, the shooting range during shooting can be captured.
  9. 　ユーザによる撮影作業を支援する撮影支援装置であって、
    　撮影中の撮影範囲内に、記憶部に記憶した画像データの少なくとも一部の範囲と一致する箇所が存在するか否かを判定する判定部と、
    　一致する箇所が存在すると判定した場合に、前記一致する箇所を含む画像データの範囲と前記撮影中の撮影範囲とが一致する撮影位置に前記ユーザを誘導する情報を出力する出力部と
    　を有する撮影支援装置。     It is a shooting support device that supports the shooting work by the user.
    A determination unit that determines whether or not there is a portion that matches at least a part of the range of the image data stored in the storage unit within the shooting range during shooting.
    Shooting having an output unit that outputs information that guides the user to a shooting position where the range of image data including the matching part and the shooting range during shooting match when it is determined that there is a matching part. Support device.
  10. 　ユーザによる撮影作業を支援する撮影支援方法であって、
    　撮影中の撮影範囲内に、記憶部に記憶した画像データの少なくとも一部の範囲と一致する箇所が存在するか否かを判定し、
    　一致する箇所が存在すると判定した場合に、前記一致する箇所を含む画像データの範囲と前記撮影中の撮影範囲とが一致する撮影位置に前記ユーザを誘導する情報を出力する、
    　処理をコンピュータが実行する撮影支援方法。     It is a shooting support method that supports the shooting work by the user.
    It is determined whether or not there is a portion within the shooting range during shooting that matches at least a part of the range of the image data stored in the storage unit.
    When it is determined that there is a matching portion, information for guiding the user to a shooting position where the range of image data including the matching portion and the shooting range during shooting match is output.
    A shooting support method in which a computer executes processing.
PCT/JP2019/018219 2019-05-07 2019-05-07 Imaging assistance program, imaging assistance device, and imaging assistance method WO2020225843A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2021518224A JPWO2020225843A1 (en) 2019-05-07 2019-05-07
PCT/JP2019/018219 WO2020225843A1 (en) 2019-05-07 2019-05-07 Imaging assistance program, imaging assistance device, and imaging assistance method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/018219 WO2020225843A1 (en) 2019-05-07 2019-05-07 Imaging assistance program, imaging assistance device, and imaging assistance method

Publications (1)

Publication Number Publication Date
WO2020225843A1 true WO2020225843A1 (en) 2020-11-12

Family

ID=73050829

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/018219 WO2020225843A1 (en) 2019-05-07 2019-05-07 Imaging assistance program, imaging assistance device, and imaging assistance method

Country Status (2)

Country Link
JP (1) JPWO2020225843A1 (en)
WO (1) WO2020225843A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009253659A (en) * 2008-04-07 2009-10-29 Toshiba Corp Digital camera for construction photography
US20100049367A1 (en) * 2008-08-25 2010-02-25 Kyung-Taek Yang Method of controlling robot for bridge inspection
JP2013074376A (en) * 2011-09-27 2013-04-22 Sony Corp Imaging guide apparatus, imaging apparatus, imaging guide method, and program
JP2015082830A (en) * 2013-10-24 2015-04-27 富士通株式会社 Guide method, information processing apparatus, and guide program
JP2016220047A (en) * 2015-05-20 2016-12-22 インターマン株式会社 Fixed point imaging program
WO2017051735A1 (en) * 2015-09-25 2017-03-30 富士フイルム株式会社 Image capture support system, device and method, and image capturing terminal
WO2018143263A1 (en) * 2017-02-06 2018-08-09 富士フイルム株式会社 Photographing control device, photographing control method, and program

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002073730A (en) * 2000-09-05 2002-03-12 Jutaku Shizai Ryutsu Center:Kk Method of confirming construction state of building
JP6278927B2 (en) * 2015-05-08 2018-02-14 古河電気工業株式会社 Bridge inspection support device, bridge inspection support method, bridge inspection support system, and program
JP2016219980A (en) * 2015-05-19 2016-12-22 株式会社パスコ Target information display device
JP6471986B2 (en) * 2016-08-16 2019-02-20 株式会社 零Ｓｐａｃｅ Portable electronic device and program for photography and management

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009253659A (en) * 2008-04-07 2009-10-29 Toshiba Corp Digital camera for construction photography
US20100049367A1 (en) * 2008-08-25 2010-02-25 Kyung-Taek Yang Method of controlling robot for bridge inspection
JP2013074376A (en) * 2011-09-27 2013-04-22 Sony Corp Imaging guide apparatus, imaging apparatus, imaging guide method, and program
JP2015082830A (en) * 2013-10-24 2015-04-27 富士通株式会社 Guide method, information processing apparatus, and guide program
JP2016220047A (en) * 2015-05-20 2016-12-22 インターマン株式会社 Fixed point imaging program
WO2017051735A1 (en) * 2015-09-25 2017-03-30 富士フイルム株式会社 Image capture support system, device and method, and image capturing terminal
WO2018143263A1 (en) * 2017-02-06 2018-08-09 富士フイルム株式会社 Photographing control device, photographing control method, and program

Also Published As

Publication number Publication date
JPWO2020225843A1 (en) 2020-11-12

Similar Documents

Publication Publication Date Title
US8615111B2 (en) Method and apparatus for image detection with undesired object removal
JP4513869B2 (en) Imaging apparatus, strobe image generation method, and program
JP6338424B2 (en) Image processing apparatus, control method therefor, imaging apparatus, and program
JP2017198671A (en) Image processor and image processing method
JP5096301B2 (en) Imaging device
JP2007306524A (en) Mobile device with camera, method for assisting photographing
JP2012164002A (en) Imaging apparatus and imaging method
WO2017043258A1 (en) Calculating device and calculating device control method
JP2011164694A (en) Device and method for support of standard operation execution
JPWO2018158812A1 (en) Inspection support device, inspection support method and program
JP2011146821A (en) Device and method for providing tactile information, and program
JP5441799B2 (en) Electronic camera
JP2017068849A (en) Article assembling status information display device
JP6525724B2 (en) Panning information display device, method of executing display processing of panning information, and panning information display program
WO2020225843A1 (en) Imaging assistance program, imaging assistance device, and imaging assistance method
JP2009134357A (en) Image processor, imaging device, image processing program, and image processing method
JP2013170831A (en) Strain measuring device and strain measuring method
US20120057065A1 (en) Focusing image display device and method for displaying same
JP2018007082A (en) Image reproduction device, control method therefor, and program
JP5788197B2 (en) Image processing apparatus, image processing method, image processing program, and imaging apparatus
JP2010200360A (en) Imaging apparatus, stroboscopic image generation method, and program
JP2008014857A (en) Device, method, and program for acquiring coordinate for inspection of printed board
CN115210529A (en) Dimension measuring method and dimension measuring device
JP2005079727A (en) Photographed image projecting apparatus
JP2013162154A (en) Photographing apparatus and photographing system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19927824

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021518224

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19927824

Country of ref document: EP

Kind code of ref document: A1