WO2024101046A1 - 画像表示装置、画像表示装置の作動方法、および画像表示装置の作動プログラム - Google Patents
画像表示装置、画像表示装置の作動方法、および画像表示装置の作動プログラム Download PDFInfo
- Publication number
- WO2024101046A1 WO2024101046A1 PCT/JP2023/036436 JP2023036436W WO2024101046A1 WO 2024101046 A1 WO2024101046 A1 WO 2024101046A1 JP 2023036436 W JP2023036436 W JP 2023036436W WO 2024101046 A1 WO2024101046 A1 WO 2024101046A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- displayed
- partial image
- display device
- image display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- E—FIXED CONSTRUCTIONS
- E21—EARTH OR ROCK DRILLING; MINING
- E21D—SHAFTS; TUNNELS; GALLERIES; LARGE UNDERGROUND CHAMBERS
- E21D11/00—Lining tunnels, galleries or other underground cavities, e.g. large underground chambers; Linings therefor; Making such linings in situ, e.g. by assembling
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
- G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B19/00—Cameras
- G03B19/02—Still-picture cameras
- G03B19/04—Roll-film cameras
- G03B19/07—Roll-film cameras having more than one objective
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—Two-dimensional [2D] image generation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—Two-dimensional [2D] image generation
- G06T11/10—Texturing; Colouring; Generation of textures or colours
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
- G06T7/579—Depth or shape recovery from multiple images from motion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30181—Earth observation
- G06T2207/30184—Infrastructure
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30204—Marker
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
Definitions
- the technology disclosed herein relates to an image display device, an operating method for an image display device, and an operating program for an image display device.
- JP 2022-056085 A, JP 2022-139903 A, and JP 2017-168077 A a technology has been proposed for extracting abnormalities that have occurred in a structure from an image obtained by photographing the structure with a photographing device.
- the structure is, for example, so-called infrastructure such as a dam, a bridge, or a tunnel.
- the abnormalities include, for example, cracks, peeling, rust, water leakage, or exposed rebar.
- JP 2022-056085 A and JP 2022-139903 A in the case of a relatively large structure such as a dam, bridge, or tunnel, an image that covers the entire structure is obtained by photographing the structure multiple times while moving the imaging device, for example, from the entrance to the exit of the tunnel.
- Such an image that covers the entire structure will be very long, for example, an image from the entrance to the exit of a tunnel with a total length of 5 km.
- an image is displayed on a display together with the results of the extraction of abnormalities, etc., and is made available for viewing by the user.
- the image displayed in this case is a portion of an image that covers the entire structure, such as an image of a 50 m distance range, for example, 2 km to 2.05 km of a 5 km long tunnel.
- JP 2017-168077 A describes a mode in which an image covering the entire structure (referred to as a panoramic image in JP 2017-168077 A) and a partial image of the image covering the entire structure (referred to as an inspection image in JP 2017-168077 A) are displayed on the same screen.
- JP 2017-168077 A displays a frame for the inspection image on the panoramic image, allowing the user to recognize which part of the structure was photographed by the inspection image.
- JP 2017-168077 A the panoramic image and the inspection image are displayed on the same screen, and the frame of the inspection image is displayed on the panoramic image, resulting in a cluttered screen configuration.
- One embodiment of the technology disclosed herein provides an image display device, an operating method for an image display device, and an operating program for an image display device that allows a user to recognize, with a simple screen configuration, which part of a structure the displayed image was taken from.
- the image display device of the present disclosure includes a processor, and the processor controls the display of a display screen having a display area of a partial image that is obtained by photographing a structure extending in a first direction with a photographing device and is a part of a long image whose long side direction is along the first direction, and a first index bar that extends along the first direction and indicates a first distance range that is at least a part of the distance range of the structure in the first direction, and on which a photographing position mark is displayed that indicates the photographing position of the structure of the partial image being displayed in the display area.
- the processor preferably accepts a position specification of an arbitrary position on the first index bar, and displays in the display area a partial image in which the specified position corresponds to the shooting position.
- the second distance range is preferably the entire distance range of the structure in the first direction.
- the partial image can be enlarged and preferably an auxiliary window can be displayed that indicates which position on the partial image the enlarged portion corresponds to.
- the display screen is provided with an operation unit for inputting an instruction to switch the partial image being displayed in the display area to a partial image adjacent to the partial image being displayed in the display area.
- a focus point mark indicating a focus point on the long image can be displayed on the first index bar.
- the points of interest include at least one of the points specified by the user and the points where a specific subject is present.
- text memos or voice memos entered by the user can be displayed in association with the points of interest.
- the location specified by the user is at least one of the location specified by the photographer of the long image when photographing the long image and the location specified by the inspector of the long image when inspecting the long image.
- the first index bar be able to distinguish between areas where partial images are displayed and areas where they are not.
- the processor preferably receives a specification of a measurement target within the partial image, and in response to the specification, displays at least one of the position of the measurement target in the structure and the actual dimensions of the measurement target.
- the long image is preferably an image obtained by synthesizing multiple images obtained by photographing different parts of a structure multiple times with an imaging device along at least the first direction among the first direction and a second direction intersecting the first direction.
- the multiple captured images are preferably images obtained by capturing images of the structure at multiple different positions in the first direction while moving the image capture device along the first direction.
- the photographing device has a plurality of cameras arranged along the second direction, and the plurality of photographed images are images obtained by photographing the structure with the plurality of cameras. It is also preferable that the photographing device has a plurality of cameras arranged along the first direction, and the plurality of photographed images are images obtained by photographing the structure with the plurality of cameras.
- the imaging device has multiple cameras arranged along the second direction, and the multiple captured images are images obtained by capturing images of the structure with the multiple cameras while moving the imaging device along the first direction, and the long image is an image obtained by synthesizing the multiple captured images along the first and second directions.
- the structure is a tunnel
- the first direction is the longitudinal direction connecting the entrance and exit of the tunnel
- the second direction is the circumferential direction of the tunnel.
- the operating method of the image display device disclosed herein includes controlling the display of a display screen having a display area of a partial image that is obtained by photographing a structure extending in a first direction with a photographing device and is a part of a long image whose long side direction is along the first direction, and a first index bar that extends along the first direction and indicates a first distance range that is at least a part of the distance range of the structure in the first direction, the first index bar displaying a photographing position mark that indicates the photographing position of the structure of the partial image being displayed in the display area.
- the operating program of the image display device disclosed herein causes a computer to execute processing including controlling the display of a display screen having a display area of a partial image that is obtained by photographing a structure extending in a first direction with a photographing device and is a part of a long image whose long side direction is along the first direction, and a first index bar that extends along the first direction and indicates a first distance range that is at least a part of the distance range of the structure in the first direction, and on which a photographing position mark is displayed that indicates the photographing position of the structure of the partial image being displayed in the display area.
- the technology disclosed herein can provide an image display device, an operating method for an image display device, and an operating program for an image display device that can enable a user to recognize which part of a structure the displayed image was taken of, using a simple screen configuration.
- FIG. 13 is a diagram showing the state in which the inner wall surface of a tunnel is photographed using an imaging device.
- FIG. FIG. FIG. FIG. 2 is a diagram showing the shooting areas of a first shooting unit and a second shooting unit.
- FIG. 2 is a diagram for explaining the formation of a long image.
- FIG. FIG. FIG. 13 is a diagram showing an operation screen when a location specification button is selected.
- FIG. 11 is a diagram showing information on a location designated at the time of shooting.
- 1 is a diagram showing an imaging device, an information management server, an inspector terminal, and information transmitted from the imaging device to the information management server.
- FIG. 2 is a block diagram of a computer constituting an information management server and an inspector terminal.
- FIG. 2 is a block diagram showing a processing unit of a CPU of the information management server.
- FIG. 13 is a diagram showing inspection designated location information.
- FIG. 13 is a diagram illustrating the process of an extraction unit.
- FIG. 11 is a diagram showing extracted image information.
- 3 is a block diagram showing a processing unit of a CPU of the inspector terminal;
- FIG. FIG. FIG. 13 is a diagram showing a partial index bar on an overhead screen.
- FIG. 13 is a diagram showing a state in which a text memo is displayed in association with a mark of a location designated at the time of shooting.
- FIG. 13 is a diagram showing a state in which a text memo is displayed in association with an inspection designated location mark.
- FIG. 13 is a diagram showing a partial image display screen.
- FIG. 13 is a diagram showing a partial index bar on the partial image display screen.
- 13 is a diagram showing a process of accepting a position specification of an arbitrary position on the partial index bar and displaying in the display area a partial image in which the position specified by the accepting process corresponds to the shooting position.
- FIG. FIG. 4 is a diagram showing a group of operation buttons.
- FIG. 13 is a diagram showing a case where a partial image is enlarged and displayed.
- FIG. 13 is a diagram showing a case where an extracted image is displayed superimposed on a partial image.
- 13 is a diagram showing a state in which the position and actual size of a measurement target specified in a partial image are displayed.
- FIG. 13 is a diagram showing a state in which the position and actual size of a measurement target specified in a partial image are displayed.
- FIG. 13A and 13B are diagrams illustrating a process of switching a partial image currently displayed in a display area to a partial image adjacent to the partial image currently displayed in the display area.
- 13A and 13B are diagrams illustrating a process of switching a partial image currently displayed in a display area to a partial image adjacent to the partial image currently displayed in the display area.
- 10 is a flowchart showing a processing procedure of the information management server and the inspector terminal.
- FIG. 13 is a diagram showing another example in which a portion where a partial image is displayed is displayed distinctly from a portion where a partial image is not displayed.
- FIG. 13 is a diagram showing an example in which marks for designated locations during shooting and the like are displayed on the overall index bar.
- FIG. 11 is a diagram showing another example of the shooting-time designated location information.
- the tunnel 10 has an entrance 13 and an exit 14, and extends in a longitudinal direction LD connecting the entrance 13 and the exit 14.
- the length from the entrance 13 to the exit 14, i.e., the total length of the tunnel 10, is, for example, 10,000 m.
- the photographer UP moves the photographing device 12 along the longitudinal direction LD from the entrance 13 to the exit 14, for example, by moving the photographing device 12 along the center line of the road surface 15.
- the tunnel 10 is an example of a "structure” according to the technology of the present disclosure.
- the longitudinal direction LD is an example of a "first direction” according to the technology of the present disclosure.
- the circumferential direction CD is an example of a "second direction” according to the technology of the present disclosure.
- the photographer UP is an example of a "user” according to the technology of the present disclosure.
- the imaging device 12 is composed of an imaging device main body 20 and a dolly 21 on which the imaging device main body 20 is mounted.
- the imaging device main body 20 has a base 22, a first support pillar 231 and a second support pillar 232, a first mounting plate 241 and a second mounting plate 242, and a first imaging unit 251 and a second imaging unit 252.
- the base 22 is a rectangular plate and is attached to the cart 21 by screws or the like.
- the first support pillar 231 and the second support pillar 232 are square pillars extending vertically from the base 22.
- the first mounting plate 241 and the second mounting plate 242 are disk-shaped and their centers are fixed to the ends of the first support pillar 231 and the second support pillar 232 opposite the base 22.
- first imaging units 251 are attached to the first mounting plate 241 via first mounting fixtures 261.
- Five second imaging units 252 are attached to the second mounting plate 242 via second mounting fixtures 262.
- the imaging device body 20 has a total of nine imaging units 25.
- the first shooting unit 251 is arranged at 90°, 150°, 210°, and 270°.
- the second shooting unit 252 is arranged at 60°, 120°, 180°, 240°, and 300°. In other words, the first shooting unit 251 and the second shooting unit 252 are all arranged at an angle interval of 60°.
- the total of nine shooting units 25 including the first shooting unit 251 and the second shooting unit 252 are arranged at an angle interval of 30°.
- the number of shooting units 25 is not limited to the example of nine. There may be one imaging unit 25 or more than nine.
- the first and second photographing units 251 and 252 each consist of one camera 27 and two lights 28 arranged symmetrically on either side of the camera 27.
- the camera 27 is, for example, a high-performance single-lens reflex camera equipped with an image sensor of 20 million pixels or more and equipped with a distance measuring function for measuring the distance to the subject and a blur correction function for correcting blur.
- the lights 28 are, for example, LEDs (Light-Emitting Diodes) with a light distribution angle that exceeds the photographing angle of view of the camera 27.
- the first support pillar 231 and the first mounting plate 241, and therefore the first imaging unit 251 are located in front of the traveling direction of the dolly 21.
- the second support pillar 232 and the second mounting plate 242, and therefore the second imaging unit 252 are located in the rear of the traveling direction of the dolly 21. Therefore, the cameras 27 of the first imaging unit 251 and the second imaging unit 252 are arranged along the traveling direction of the dolly 21.
- the traveling direction of the dolly 21 is along the length direction LD of the tunnel 10 as shown in FIG. 1. Therefore, it can be said that the camera 27 is arranged along the length direction LD.
- the camera 27 is attached so as to surround the circular first mounting plate 241 and the second mounting plate 242, and the dolly 21 runs so that the normal direction of the first mounting plate 241 and the second mounting plate 242 is along the length direction LD.
- the cameras 27 are arranged along the circumferential direction CD.
- three or more cameras 27 may be arranged along the length direction LD.
- one camera 27 may be moved along the circumferential direction CD and take multiple images in the circumferential direction CD.
- the dolly 21 has a dolly body 35, front wheels 36, rear wheels 37, and a handle 38.
- the dolly body 35 is box-shaped.
- the imaging device body 20 is attached to the top plate portion of the dolly body 35 that is parallel to the horizontal surface.
- the front wheels 36 and rear wheels 37 are arranged on the left and right sides of the bottom of the bogie body 35.
- the bogie 21 runs on the road surface 15 using the front wheels 36 and rear wheels 37.
- the rear wheels 37 are driven to rotate by a rear-wheel drive unit 39.
- the front wheels 36 rotate following the rotation of the rear wheels 37.
- the bogie 21 has four wheels and is a rear-wheel drive type.
- the rear wheel drive unit 39 is two motors connected to the left and right rear wheels 37.
- the two motors rotate the left and right rear wheels 37 independently. Therefore, when the motor connected to the right rear wheel 37 makes the right rear wheel 37 rotate faster than the left rear wheel 37, the trolley 21 turns left. On the other hand, when the motor connected to the left rear wheel 37 makes the left rear wheel 37 rotate faster than the right rear wheel 37, the trolley 21 turns right.
- the handle 38 is attached to the upper rear surface of the dolly body 35.
- the handle 38 is cylindrical and elongated in the width direction of the dolly body 35.
- the handle 38 is held by the photographer UP to steer the dolly 21.
- the dolly 21 travels on the road surface 15 by the photographer UP operating the handle 38.
- the operation of the handle 38 by the photographer UP refers to the photographer UP grasping the handle 38 and changing the way in which he applies force to the handle 38 or adjusting the direction in which he applies force to the handle 38. In this way, in the imaging device 12, the photographer UP independently determines the travel speed and direction by operating the handle 38 to travel the dolly 21.
- the rear wheel drive unit 39 is also driven in response to the operation of the handle 38 by the photographer UP. However, the rear wheel drive unit 39 is driven only according to the force applied to the dolly 21 by the photographer UP via the handle 38. For this reason, the dolly 21 will not move unless the force of the photographer UP is applied. Conversely, the dolly 21 will not move with only the force of the photographer UP, and will only move with the assistance of the rear wheel drive unit 39.
- the force applied to the dolly 21 by the photographer UP is detected using, for example, a piezoelectric sensor (not shown), and the rear wheel drive unit 39 is driven in response to this detection result.
- the photographer UP may ride on the dolly 21 and operate it.
- the dolly 21 may also be driven automatically without the help of the photographer UP.
- a number of magnetic bodies 40 are attached to the underside of the rear wheel 37 at equal angles along the circumferential direction.
- a magnetic sensor 41 is provided at a position on the cart body 35 facing the magnetic bodies 40. The magnetic sensor 41 detects the magnetism emitted by the magnetic bodies 40.
- a pulse PL corresponding to the magnetism of the magnetic bodies 40 is output from the magnetic sensor 41 along the time axis.
- the travel distance of the cart 21, and therefore the imaging device 12 can be calculated based on the number of these pulses PL, the circumference of the rear wheel 37, and the spacing between the magnetic bodies 40, etc.
- a tablet terminal 42 is attached to the inclined surface on the rear wheel 37 side of the cart body 35.
- the tablet terminal 42 is removable from the cart body 35.
- the tablet terminal 42 is operated by the photographer UP.
- the tablet terminal 42 may be a commercially available one that can be used for other purposes, or may be one that cannot be used for anything other than the imaging device 12.
- the camera 27 of the first photographing unit 251 photographs four areas (hereinafter referred to as first photographing areas) 501, one spaced apart from each other, out of the nine rectangular areas obtained by dividing the inner wall surface 11 into nine equal parts.
- the camera 27 of the second photographing unit 252 photographs five areas (hereinafter referred to as second photographing areas) 502, one spaced apart from each other, out of the nine rectangular areas obtained by dividing the inner wall surface 11 into nine equal parts.
- the first and second shooting areas 501 and 502 each have a short side aligned along the length direction LD and a long side aligned along the circumferential direction CD. As shown in FIG. 4, the first and second shooting areas 501 and 502 are arranged in a staggered pattern because the first and second shooting units 251 and 252 are arranged in different phases in the circumferential direction CD.
- the first and second shooting areas 501 and 502 are an example of "different parts of a structure" according to the technology disclosed herein.
- the first and second shooting areas 501 and 502 overlap somewhat in the length direction LD and the circumferential direction CD. In FIG. 5, the direction from the back of the page to the front is the traveling direction of the cart 21.
- the photographing device 12 is moved along the longitudinal direction LD, and in the process of this movement, the camera 27 of the first photographing unit 251 photographs the first photographing area 501, and the camera 27 of the second photographing unit 252 photographs the second photographing area 502, in turn. Therefore, as shown in FIG. 6 as an example, a plurality of first photographed images 511 photographed of the first photographing area 501 and a plurality of second photographed images 512 photographed of the second photographing area 502 are obtained.
- the first captured images 511 and the second captured images 512 thus obtained are aligned based on the overlapping portions and synthesized along the length direction LD and the circumferential direction CD to generate a long image 55 covering the entire surface of the inner wall surface 11.
- the long side of the long image 55 is along the length direction LD, and the short side is along the circumferential direction CD.
- the symbols A1 to A9 indicate the correspondence between the actual positions of the first captured images 511 and the second captured images 512 on the inner wall surface 11 and their positions in the long image 55.
- the symbols A1 to A9 indicate the numbers 1 to 9 that are assigned in order to the nine regions obtained by dividing the inner wall surface 11 into nine equal parts.
- the even numbers 2, 4, 6, and 8 are the first captured images 511, and the odd numbers 1, 3, 5, 7, and 9 are the second captured images 512.
- the direction from the back of the page to the front is the traveling direction of the dolly 21.
- the first captured image 511 and the second captured image 512 may be collectively referred to as captured image 51.
- the photographing device 12 generates photographed image information 60, which is information on a plurality of photographed images 51.
- the photographed image information 60 is information in which the photographed image 51 itself, the photographed date and time of the photographed image 51, the photographed position of the photographed image 51 in the circumferential direction CD (indicated as the circumferential position in FIG. 7), and the photographed position of the photographed image 51 in the length direction LD (indicated as the length direction position in FIG. 7) are registered for each image ID (Identification Data) for uniquely identifying the photographed image 51. Any of the numbers 1 to 9 of the symbols A1 to A9 shown in FIG. 6 is registered as the photographed position in the circumferential direction CD.
- the moving distance of the photographing device 12 derived based on the number of pulses PL, etc.
- the photographed image information 60 also registers basic information on the photographed image 51, such as the distance from the camera 27 to the subject (here, the inner wall surface 11) measured by the distance measuring function, the photographing magnification, the focal length, and the number of pixels of the image sensor.
- An operation screen 65 is displayed on the touch panel display (not shown) of the tablet terminal 42.
- a message 66 is displayed on the operation screen 65, informing the photographer UP of the distance from the entrance 13 of the tunnel 10, which is the starting point of shooting, to the current position.
- the operation screen 65 also has a start shooting button 67, a pause button 68, an end shooting button 69, and a location designation button 70.
- the start shooting button 67 is a button that the photographer UP uses to instruct the photographing device 12 to start taking the photographed image 51.
- the photographer UP selects the start shooting button 67, for example, at the entrance 13 of the tunnel 10.
- the lighting lamp 28 is turned on, and the camera 27 starts taking the photographed image 51.
- Counting of the pulses PL output from the magnetic sensor 41 also starts, and the travel distance of the photographing device 12 is derived.
- the pause button 68 is a button that allows the photographer UP to instruct the photographing device 12 to pause and resume photographing the photographed image 51.
- photographing of the photographed image 51 by the camera 27 is temporarily stopped.
- the pause button 68 is selected again in this state, photographing of the photographed image 51 by the camera 27 is resumed.
- the end shooting button 69 is a button that the photographer UP uses to instruct the photographing device 12 to end photographing the photographed image 51.
- the photographer UP selects the end shooting button 69, for example, at the exit 14 of the tunnel 10.
- the illumination light 28 is turned off and photographing of the photographed image 51 by the camera 27 is terminated.
- the counting of the pulses PL output from the magnetic sensor 41 is also terminated.
- the location designation button 70 is a button for issuing an instruction to record a location that the photographer UP thinks should be examined more closely when inspecting the long image 55 after the capture of the captured image 51, and therefore the long image 55, finds when he or she finds the location.
- the photographer UP finds a location that should be examined more closely when inspecting the long image 55 he or she first stops the movement of the imaging device 12. Then, the photographer UP selects the pause button 68 to temporarily suspend the capture of the captured image 51 by the camera 27, and then selects the location designation button 70.
- the operation screen 65 transitions as shown in FIG. 9.
- an input box 71 As an example, as shown in FIG. 9, when the location designation button 70 is selected, an input box 71, a first record button 721, and a second record button 722 are provided on the operation screen 65.
- a text memo related to the designated location is input into the input box 71 by the photographer UP.
- the first record button 721 is a button for issuing an instruction to record the text memo and the location in association with each other.
- the second record button 722 is a button for issuing an instruction to record only the location without recording a text memo. In this way, the location can be recorded with or without a text memo.
- the photographing device 12 generates designated location information 75 during photographing.
- the designated location information 75 during photographing is information in which, for each location ID for uniquely identifying the location, the date and time when the location was designated, the designated position of the location in the length direction LD (represented as length direction position in FIG. 10), text memos, etc. are registered.
- the designated position of the location in the length direction LD is the distance traveled by the photographing device 12 derived based on the number of pulses PL, etc., as is the shooting position of the photographed image 51 in the length direction LD.
- the location designated by the photographer UP is an example of a "user designated location” and a "location of interest" according to the technology disclosed herein.
- the image capture device 12 is connected to an information management server 80 so as to be able to communicate with each other via a WAN (Wide Area Network) such as the Internet or a public communication network.
- the information management server 80 is, for example, a server computer.
- the information management server 80 receives captured image information 60 and information 75 about the location specified at the time of capture from the image capture device 12.
- the information management server 80 is further connected to an inspector terminal 81 via a WAN such as the Internet or a public communication network so as to be able to communicate with each other.
- the inspector terminal 81 is a desktop personal computer, a notebook personal computer, or a tablet terminal.
- the inspector terminal 81 is operated by an inspector UI of the long image 55.
- the inspector terminal 81 is an example of an "image display device" according to the technology of the present disclosure.
- the inspector UI is an example of a "user” according to the technology of the present disclosure.
- FIG. 11 only one inspector terminal 81 is depicted in FIG. 11, in reality, multiple inspector terminals 81 are connected to the information management server 80.
- the inspector terminal 81 may be a commercially available one that can be used for other purposes, or may be one that cannot be used for purposes other than as an image display device.
- the computers that make up the information management server 80 and the inspector terminal 81 are basically the same in configuration, and include storage 85, memory 86, a CPU (Central Processing Unit) 87, a communication unit 88, a display 89, and an input device 90. These are interconnected via a bus line 91.
- Storage 85 is a hard disk drive built into the computer that constitutes information management server 80 and inspector terminal 81, or connected via a cable or network.
- storage 85 is a disk array consisting of multiple hard disk drives.
- Storage 85 stores control programs such as an operating system, various application programs (hereinafter abbreviated as AP (Application Program)), and various data associated with these programs.
- AP Application Program
- a solid state drive may be used instead of a hard disk drive.
- Memory 86 is a work memory for CPU 87 to execute processing.
- CPU 87 loads programs stored in storage 85 into memory 86 and executes processing according to the programs. In this way, CPU 87 comprehensively controls each part of the computer.
- CPU 87 is an example of a "processor" according to the technology of this disclosure. Note that memory 86 may be built into CPU 87.
- the communication unit 88 is a network interface that controls the transmission of various information via a WAN or the like.
- the display 89 displays various screens.
- the various screens are equipped with operation functions using a GUI (Graphical User Interface).
- the computers that make up the information management server 80 and the inspector terminal 81 accept input of operation instructions from the input device 90 via the various screens.
- the input device 90 is a keyboard, mouse, touch panel, microphone for voice input, etc.
- the computer parts constituting the information management server 80 are distinguished by adding the suffix "A” to their reference numbers (storage 85 and CPU 87), and the computer parts constituting the inspector terminal 81 are distinguished by adding the suffix "B" to their reference numbers (storage 85, CPU 87, display 89, and input device 90).
- an operating program 95 is stored in storage 85A of the information management server 80.
- the operating program 95 is an AP for causing a computer to function as the information management server 80.
- storage 85A also stores a crack extraction model 96 and inspection designated location information 97.
- the CPU 87A of the computer constituting the information management server 80 works in cooperation with the memory 86 etc. to function as an acquisition unit 100, a read/write (hereinafter abbreviated as RW (Read Write)) control unit 101, an extraction unit 102, and a screen distribution control unit 103.
- RW Read Write
- the acquisition unit 100 acquires the captured image information 60 and the location information 75 designated at the time of shooting from the imaging device 12.
- the acquisition unit 100 outputs the captured image information 60 and the location information 75 designated at the time of shooting to the RW control unit 101.
- the RW control unit 101 controls the storage of various data in storage 85A and the reading of various data stored in storage 85A.
- the RW control unit 101 stores the captured image information 60 and the designated location information 75 at the time of shooting from the acquisition unit 100 in storage 85A.
- the RW control unit 101 reads the captured image information 60 from storage 85A, and outputs the read captured image information 60 to the extraction unit 102 and the screen delivery control unit 103.
- the RW control unit 101 also reads the designated location information 75 at the time of shooting and the designated location information 97 at the time of inspection from storage 85A, and outputs the read designated location information 75 at the time of shooting and the designated location information 97 at the time of inspection to the screen delivery control unit 103.
- the RW control unit 101 also reads the crack extraction model 96 from storage 85A, and outputs the read crack extraction model 96 to the extraction unit 102.
- the extraction unit 102 applies the captured images 51 of the captured image information 60 to the crack extraction model 96, and causes the crack extraction model 96 to output extracted images 110 (see FIG. 15) of cracks 111 (see FIG. 15).
- the extraction unit 102 causes the extracted images 110 to be output for all captured images 51.
- the extraction unit 102 generates extracted image information 105, which is information on the extracted images 110 for all captured images 51.
- the extraction unit 102 outputs the extracted image information 105 to the screen distribution control unit 103.
- the screen distribution control unit 103 controls the generation of various screens and the distribution of various screens to the inspector terminal 81.
- the screen distribution control unit 103 generates a partial image display screen 135 (see FIG. 23) based on the captured image information 60, the location designated at the time of capture information 75, and the location designated at the time of inspection information 97, and controls the distribution of the generated partial image display screen 135 to the inspector terminal 81.
- the screen distribution control unit 103 outputs various screens in the form of screen data for web distribution created using a markup language such as XML (Extensible Markup Language). This makes it possible for the inspector terminal 81 to view various screens on a web browser.
- the screen distribution control unit 103 specifies the inspector terminal 81 to which the various screens are to be distributed by a terminal ID that is registered in the distribution request for the various screens and that uniquely identifies the inspector terminal.
- JSON Javascript (registered trademark) Object Notation
- the inspection designated location information 97 is information generated when the inspector UI finds a location that he or she thinks should be monitored during past inspection of the long image 55 and gives an instruction to record that location on the partial image display screen 135.
- the inspection designated location information 97 is information in which, like the photography designated location information 75, the date and time when the location was designated, the designated position of the location in the length direction LD (shown as the length direction position in FIG. 14), and text memos are registered for each location ID for uniquely identifying the location.
- the location designated by the inspector UI can be recorded with or without a text memo.
- the location designated by the inspector UI is an example of a "user designated location" and a "location of interest" according to the technology disclosed herein.
- the extraction unit 102 inputs the captured image 51 to the crack extraction model 96, and causes the crack extraction model 96 to output an extracted image 110.
- the extracted image 110 is an image in which a crack 111 that appears in the captured image 51 is indicated by, for example, a red line.
- the crack 111 is an example of a "specific subject" according to the technology of the present disclosure. Note that while FIG. 15 shows an example in which the crack 111 has been extracted in the extracted image 110, there are of course cases in which the crack 111 is not extracted in the extracted image 110.
- the crack extraction model 96 is a machine learning model composed of, for example, a neural network.
- the crack extraction model 96 is repeatedly trained using as training data a pair of a training image 51 and a correct answer image in which cracks 111 appearing in the training image 51 have been manually annotated.
- the crack extraction model 96 outputs a training extracted image 110 in response to an input of a training image 51.
- the crack extraction model 96 stored in the storage 85 has reached a preset level of extraction accuracy for the cracks 111 in the training extracted image 110 relative to the correct answer image.
- the extracted image information 105 is information in which the extracted image 110 itself, the position of the extracted image 110 in the circumferential direction CD (referred to as the circumferential position in FIG. 16), and the position of the extracted image 110 in the length direction LD (referred to as the length direction position in FIG. 16) are registered for each image ID (Identification Data) for uniquely identifying the extracted image 110.
- image ID Identity Data
- the image ID of the captured image 51, the shooting position of the captured image 51 in the circumferential direction CD, and the shooting position of the captured image 51 in the length direction LD are transcribed into the image ID of the extracted image 110, the position of the extracted image 110 in the circumferential direction CD, and the position of the extracted image 110 in the length direction LD.
- an inspection AP 112 is stored in the storage 85B of the inspector terminal 81.
- the inspection AP 112 is installed in the inspector terminal 81 by the inspector UI.
- the inspection AP 112 is an AP for causing the computer constituting the inspector terminal 81 to function as an "image display device" according to the technology of the present disclosure.
- the inspection AP 112 is an example of an "operation program for an image display device" according to the technology of the present disclosure.
- the CPU 87B of the inspector terminal 81 works in cooperation with the memory 86 etc. to function as the browser control unit 113.
- the browser control unit 113 controls the operation of a dedicated web browser for the inspection AP 112.
- the browser control unit 113 generates various screens.
- the browser control unit 113 receives screen data for various screens from the information management server 80.
- the browser control unit 113 reproduces various screens to be displayed on the web browser based on the screen data, and displays these on the display 89B.
- the browser control unit 113 also accepts various operation instructions input from the input device 90B by the inspector UI via the various screens.
- the browser control unit 113 transmits various requests according to the operation instructions to the information management server 80.
- the browser control unit 113 displays on the display 89 an overhead screen 115 delivered from the information management server 80 in response to a request from the inspector UI.
- the overhead screen 115 is divided into an upper display area 116 and a lower display area 117.
- An overall index bar 118 is displayed in the upper display area 116.
- the overall index bar 118 is a thin, rod-shaped GUI whose long side direction coincides with the length direction LD.
- the overall index bar 118 indicates a distance range of 0 m to 10,000 m.
- the distance range of 0 m to 10,000 m is, in other words, the distance range of the entire length of the tunnel 10.
- the overall index bar 118 is an example of a "second index bar" according to the technology disclosed herein.
- the distance range of 0 m to 10,000 m is also an example of a "second distance range” according to the technology disclosed herein.
- the overall index bar 118 is divided into small areas 119 of 1000 m each.
- the five small areas 119 covering the first half of the tunnel 10 from 0 m to 5000 m are arranged in the upper section of the upper display area 116, and the five small areas 119 covering the second half of the tunnel 10 from 5000 m to 10000 m are arranged in the lower section of the upper display area 116.
- the partial index bar 120 is displayed in the lower display area 117.
- the partial index bar 120 is a thin, rod-shaped GUI whose long side direction coincides with the length direction LD, similar to the entire index bar 118.
- the partial index bar 120 indicates ten distance ranges obtained by dividing the total distance range of 0m to 10,000m of the tunnel 10 into ten equal parts: 0m to 1000m, 1000m to 2000m, 2000m to 3000m, ..., 7000m to 8000m, 8000m to 9000m, and 9000m to 10000m.
- the partial index bar 120 is an example of a "first index bar” according to the technology disclosed herein.
- the distance ranges of 0m to 1000m, 1000m to 2000m, etc. are examples of a "first distance range” according to the technology disclosed herein.
- the lower display area 117 can only display a maximum of five partial index bars 120 covering 5000 m.
- a scroll bar 121 is provided in the lower display area 117, and the partial index bar 120 displayed in the lower display area 117 can be changed by operating the scroll bar 121.
- the partial index bar 120 displayed in the lower display area 117 can also be changed by placing the mouse cursor 130 (see FIG. 21, etc.) on a desired small area 119 of the whole index bar 118 and single-clicking.
- the partial index bar 120 indicating the distance range of 2000 m to 3000 m when a small area 119 in the distance range of 2000 m to 3000 m is selected, the partial index bar 120 indicating the distance range of 2000 m to 3000 m, and the partial index bars 120 indicating the distance range of 6000 m to 7000 m are displayed in the lower display area 117.
- FIG. 18 illustrates an example in which the partial index bars 120 of 0m to 1000m, 1000m to 2000m, 2000m to 3000m, 3000m to 4000m, and 4000m to 5000m are currently displayed in the lower display area 117.
- FIG. 19 also illustrates an example in which partial index bars 120 for 5000m to 6000m, 6000m to 7000m, 7000m to 8000m, 8000m to 9000m, and 9000m to 10000m are displayed in the lower display area 117.
- the partial index bar 120 displays a numerical value and a scale 125 indicating the distance every 100 m.
- a designated location mark 126 at the top of the partial index bar 120 is displayed, a designated location mark 127 at the bottom is displayed, and a crack presence mark 128 is displayed inside.
- the designated location mark 126 at the time of photography, the designated location mark 127 at the time of inspection, and the crack presence mark 128 are examples of "attention location marks" according to the technology of this disclosure.
- the designated location mark 126 at the time of shooting is a mark that resembles the shape of a pin.
- the screen distribution control unit 103 places the designated location mark 126 at a position on the partial index bar 120 that corresponds to the designated position of the location in the length direction LD of the designated location information 75 at the time of shooting.
- the inspection designated location mark 127 is a triangular mark that resembles an arrowhead shape.
- the screen distribution control unit 103 places the inspection designated location mark 127 at a position on the partial index bar 120 that corresponds to the designated position of the location in the length direction LD of the inspection designated location information 97.
- the crack presence location mark 128 is a line that extends across the entire width of the partial index bar 120.
- the crack presence location mark 128 is thicker than the scale 125 to distinguish it from the scale 125.
- the screen distribution control unit 103 places the crack presence location mark 128 at a position on the partial index bar 120 that corresponds to a position in the length direction LD of the extracted image 110 from which a crack 111 with a length equal to or greater than the threshold is extracted.
- the location where a crack 111 with a length equal to or greater than the threshold exists is an example of a "location of interest" according to the technology of the present disclosure, just like the location specified by the photographer UP and the location specified by the inspector UI.
- the designated location mark 126 during photography and the designated location mark 127 during inspection can be selected with the mouse cursor 130.
- a text memo bubble 131 recorded in association with the location specified by the photographer UP is displayed above the selected designated location mark 126 during photography.
- a text memo bubble 132 recorded in association with the location specified by the inspector UI is displayed below the selected designated location mark 127 during inspection. If no text memo has been recorded, then naturally the bubble 131 and 132 are not displayed.
- the browser control unit 113 When an instruction is given on the bird's-eye view screen 115, for example, by placing the mouse cursor 130 on a desired small area 119 of the overall index bar 118 and double-clicking, the browser control unit 113 sends a delivery request for a partial image display screen 135 to the information management server 80. In response to the delivery request for the partial image display screen 135, the screen delivery control unit 103 generates the partial image display screen 135 shown in FIG. 23 as an example, and delivers the generated partial image display screen 135 to the inspector terminal 81. The browser control unit 113 displays the partial image display screen 135 on the display 89B.
- the partial image display screen 135 has a partial index bar 120 and a partial image display area 136.
- a partial image 137 that is a part of the long image 55 is displayed in the partial image display area 136.
- the partial image 137 is an image within a distance range of 50 m.
- the partial image 137 within a distance range of 50 m at the end on the entrance 13 side is displayed.
- a numerical value indicating the distance is displayed every 5 m at the top of the partial image display area 136. Also, like the partial index bar 120, the top of the partial image display area 136 displays the designated location mark 126 for photography, the designated location mark 127 for inspection, and the crack presence location mark 128.
- FIG. 23 shows an example in which the small area 119 from 0m to 1000m is double-clicked on the overhead screen 115, and a partial index bar 120 from 0m to 1000m and a partial image 137 in the distance range from 0m to 50m are displayed.
- the partial image display screen 135 is an example of a "display screen” according to the technology of the present disclosure.
- the partial image display area 136 is an example of a "display area" according to the technology of the present disclosure.
- a back button 138 is provided at the top of the partial image display screen 135. When the back button 138 is selected, the display returns to the bird's-eye view screen 115. Inside the partial image display area 136, an auxiliary window 139 is provided in which the partial image 137 is displayed in its initial display state before being enlarged. Furthermore, a group of operation buttons 140 are provided to the left of the partial image display area 136.
- the partial index bar 120 of the partial image display screen 135 has a scale 125 and a distance indication every 100 m, and also has a designated location mark 126 for shooting, and is basically the same display format as the partial index bar 120 of the overhead screen 115.
- a shooting position mark 145 is displayed on the partial index bar 120 of the partial image display screen 135.
- the shooting position mark 145 indicates the shooting position in the tunnel 10 of the partial image 137 being displayed in the partial image display area 136. More specifically, the shooting position mark 145 is a frame that encloses the distance range of the tunnel 10 shown in the partial image 137.
- FIG. 24 shows an example in which a partial image 137 with a distance range of 0 m to 50 m is displayed in the partial image display area 136, and a shooting position mark 145 that encloses the distance range of 0 m to 50 m is displayed on the partial index bar 120.
- a displayed mark 146 is displayed at the bottom of the partial index bar 120 to indicate the location where the partial image 137 is displayed.
- the displayed mark 146 is a solid bar extending along the long side of the partial index bar 120. This displayed mark 146 makes it possible to distinguish between the locations where the partial image 137 is displayed and the locations where it is not displayed.
- text memo bubbles 131 and 132 are displayed in response to the selection of the designated location at time of photography mark 126 and the designated location at time of inspection mark 127.
- Distance range switching buttons 147A and 147B are provided on the left and right of the partial index bar 120.
- the display of the partial index bar 120 is switched to the partial index bar 120 on the single entrance 13 side.
- the distance range switching button 147B is selected, the display of the partial index bar 120 is switched to the partial index bar 120 on the single exit 14 side.
- the display of the partial image 137 in the partial image display area 136 is switched.
- the distance range switching button 147A is selected.
- the display of the partial index bar 120 in the distance range of 3000m to 4000m is switched to the partial index bar 120 in the distance range of 2000m to 3000m.
- the display of the partial image 137 in the partial image display area 136 is switched to the partial image 137 in the distance range of 2000m to 2050m.
- the partial index bar 120 in the distance range of 7000m to 8000m is displayed and the distance range switching button 147B is selected.
- the display of the partial index bar 120 in the distance range of 7000m to 8000m is switched to the partial index bar 120 in the distance range of 8000m to 9000m.
- the display of the partial image 137 in the partial image display area 136 is switched to the partial image 137 in the distance range of 8000m to 8050m.
- the browser control unit 113 When a position specification is accepted, the browser control unit 113 generates position specification information 150 indicating the specified position, and transmits it to the information management server 80.
- the screen delivery control unit 103 displays the partial image 137, whose specified position corresponds to the shooting position, in the partial image display area 136.
- the screen delivery control unit 103 also changes the display of the shooting position mark 145 in response to the display change of the partial image 137.
- the screen delivery control unit 103 displays a displayed mark 146 at the bottom of the partial index bar 120.
- the screen delivery control unit 103 distributes the partial image display screen 135 thus generated to the inspector terminal 81.
- FIG. 25 shows an example in which the position of 180 m on the partial index bar 120 is specified by the cursor 130.
- the partial image 137 in the partial image display area 136 switches from a partial image 137 in the distance range of 0 m to 50 m to a partial image 137 in the distance range of 180 m to 230 m.
- the shooting position mark 145 also switches from the distance range of 0 m to 50 m to the distance range of 180 m to 230 m, and a displayed mark 146 is displayed below the distance range of 180 m to 230 m.
- the operation button group 140 includes a zoom button 155, a movement/rotation button 156, a superimposition/unsuperimposition button 157, a measurement button 158, and display switching buttons 159A and 159B.
- the zoom button 155 is a button for enlarging or reducing the display size of the partial image 137 in the partial image display area 136.
- a frame 160 is displayed in the auxiliary window 139.
- the frame 160 indicates which position of the currently enlarged portion of the partial image 137 in the initial display state before enlargement.
- the movement and rotation button 156 is a button for changing the display position of the partial image 137 in the partial image display area 136 to either up, down, left, or right.
- the movement and rotation button 156 is also a button for changing the display orientation of the partial image 137 in the partial image display area 136 in a clockwise or counterclockwise manner in increments of a specified angle (e.g., 90°).
- the superimpose/unsuperimpose button 157 is a button for instructing the superimposition and unsuperimposition of the extracted image 110 on the partial image 137 in the partial image display area 136.
- the superimpose/unsuperimpose button 157 is selected in FIG. 23, the extracted image 110 is displayed superimposed on the partial image 137 in the partial image display area 136, as shown in FIG. 28 as an example.
- the superimpose/unsuperimpose button 157 is selected again in this state, the superimposition of the extracted image 110 is canceled, and the display form of FIG. 23 is restored.
- the measurement button 158 is a button for displaying the position and actual size of the measurement target in the tunnel 10 in the partial image 137 of the partial image display area 136.
- a display window 166 including the position in the tunnel 10 of the crack 111 specified in the area 165 and the actual size of the crack 111 specified in the area 165 is displayed in the partial image display area 136.
- the position in the tunnel 10 of the crack 111 specified in the area 165 is the center position of the side along the length direction LD of the area 165.
- the actual size here is the width W in the length direction LD and the height H in the circumferential direction CD of the crack 111 specified in the area 165.
- FIG. 29 shows an example in which the position in the tunnel 10 is 24 m, the width W is 4.8 m, and the height H is 2 m.
- a display window 166 including the position in the tunnel 10 of the crack 111 specified by the points 167 and the actual size of the crack 111 specified by the points 167 is displayed in the partial image display area 136.
- the position in the tunnel 10 of the crack 111 specified by the points 167 is the center position of the line connecting the points 167.
- the actual size is the length L of the line connecting the points 167.
- FIG. 30 shows an example in which the position in the tunnel 10 is 24 m and the length L is 4.8 m.
- the measurement target may be specified as the rectangular area 165 shown in FIG. 29 or as the point 167 shown in FIG. 30.
- the actual size can be calculated from the distance to the subject measured by the distance measurement function of the camera 27, the shooting magnification, the focal length, the number of pixels of the image sensor, the pixel size, the pixel pitch, etc.
- Display switch buttons 159A and 159B are buttons for switching the display of partial image 137 being displayed in partial image display area 136.
- Display switch buttons 159A and 159B are an example of an "operation unit" according to the technology of this disclosure.
- FIG. 31 illustrates an example in which the display switch button 159A is selected when a partial image 137 in the distance range of 600m to 650m is displayed in the partial image display area 136.
- the display of the partial image 137 in the partial image display area 136 is switched to a partial image 137 in the distance range of 550m to 600m adjacent to the partial image 137 in the distance range of 600m to 650m.
- the display of the shooting position mark 145 is also switched from the distance range of 600m to 650m to the distance range of 550m to 600m.
- a displayed mark 146 is also displayed below the distance range of 550m to 600m.
- the partial image 137 in the distance range of 550m to 600m is an example of an "adjacent partial image" according to the technology of this disclosure. Note that if the partial image 137 in the distance range of 550m to 600m had been displayed up until that point, the displayed mark 146 has already been displayed below the distance range of 550m to 600m.
- FIG. 32 illustrates an example in which the display switch button 159B is selected when a partial image 137 in the distance range of 100 m to 150 m is displayed in the partial image display area 136.
- the display of the partial image 137 in the partial image display area 136 is switched to a partial image 137 in the distance range of 150 m to 200 m adjacent to the partial image 137 in the distance range of 100 m to 150 m.
- the display of the shooting position mark 145 is also switched from the distance range of 100 m to 150 m to the distance range of 150 m to 200 m.
- a displayed mark 146 is also displayed below the distance range of 150 m to 200 m.
- the partial image 137 in the distance range of 150 m to 200 m is an example of an "adjacent partial image" according to the technology of this disclosure. Note that if the partial image 137 in the distance range of 150 m to 200 m had been displayed up until that point, the displayed mark 146 has already been displayed below the distance range of 150 m to 200 m.
- the operation of the above configuration will be described with reference to the flowchart shown in FIG. 33 as an example.
- the inner wall surface 11 of the tunnel 10 is photographed by the camera 27 of the photographing device 12.
- the distance traveled by the photographing device 12 is derived based on the pulse PL output from the magnetic sensor 41 in response to the magnetism of the magnetic body 40 attached to the rear wheel 37 of the dolly 21 of the photographing device 12.
- the photographing device 12 generates photographed image information 60, which is information on the photographed image 51 obtained by the above photographing.
- photographing designated location information 75 which is information on the location designated by the photographer UP via the operation screen 65 shown in FIG. 8 etc., is generated.
- the CPU 87A of the information management server 80 functions as the acquisition unit 100, the RW control unit 101, the extraction unit 102, and the screen distribution control unit 103, as shown in FIG. 13. Also, when the inspection AP 112 is started in the inspector terminal 81, the CPU 87B of the inspector terminal 81 functions as the browser control unit 113, as shown in FIG. 17.
- the photographed image information 60 and the designated location information 75 at the time of photographing are transmitted from the photographing device 12 to the information management server 80.
- the photographed image information 60 and the designated location information 75 at the time of photographing are acquired by the acquisition unit 100 (step ST100).
- the photographed image information 60 and the designated location information 75 at the time of photographing are output from the acquisition unit 100 to the RW control unit 101, and are stored in the storage 85A by the RW control unit 101 (step ST110).
- a request for distribution of the overhead screen 115 is made by the inspector UI, and the distribution request is sent from the browser control unit 113 to the information management server 80 (step ST200).
- the RW control unit 101 reads out the captured image information 60 and the designated location information 75 at the time of shooting from the storage 85A (step ST130).
- the captured image information 60 and the designated location information 75 at the time of shooting are output from the RW control unit 101 to the screen distribution control unit 103.
- the captured image information 60 is output to the extraction unit 102 together with the crack extraction model 96.
- the designated location information 97 at the time of inspection is also read out from the storage 85A by the RW control unit 101, and is output from the RW control unit 101 to the screen distribution control unit 103 together with the captured image information 60, etc.
- the screen distribution control unit 103 generates the overhead screen 115 shown in Figures 18 and 19 and distributes it to the inspector terminal 81 (step ST140).
- the browser control unit 113 displays the overhead screen 115 on the display 89B (step ST210).
- An entire index bar 118 is displayed in the upper display area 116 of the overhead screen 115, and a partial index bar 120 is displayed in the lower display area 117.
- the overall index bar 118 is divided into multiple small areas 119, each 1000 m apart. Of the multiple small areas 119, the small area 119 that corresponds to the distance range indicated by the partial index bar 120 being displayed in the lower display area 117 is displayed separately from the other small areas 119.
- the partial index bar 120 displays a designated location mark 126 for photography, a designated location mark 127 for inspection, and a crack presence location mark 128.
- An instruction to distribute the partial image display screen 135 is given on the bird's-eye view screen 115, and a distribution request corresponding to the distribution instruction is sent from the browser control unit 113 to the information management server 80 (step ST220).
- the screen distribution control unit 103 When the request to distribute the partial image display screen 135 is accepted (step ST150), the screen distribution control unit 103 generates the partial image display screen 135 shown in FIG. 23 etc., and distributes it to the inspector terminal 81 (step ST160).
- the browser control unit 113 displays the partial image display screen 135 on the display 89B (step ST230).
- the partial image display screen 135 has a partial index bar 120 and a partial image display area 136. However, the partial image display screen 135 does not have a display area for the long image 55.
- the partial image display area 136 displays a partial image 137 that is a part of the long image 55.
- the partial index bar 120 displays a shooting position mark 145 that indicates the shooting position in the tunnel 10 of the partial image 137 being displayed in the partial image display area 136.
- the captured image 51 is input to the crack extraction model 96 in the extraction unit 102, and an extracted image 110 is output from the crack extraction model 96.
- extracted image information 105 is generated, which is information on the extracted images 110 of all captured images 51.
- the extracted image information 105 is output from the extraction unit 102 to the screen delivery control unit 103.
- the extracted image 110 is displayed superimposed on the partial image 137 in the partial image display area 136.
- a display window 166 is displayed that shows the position of the specified object to be measured in the tunnel 10 and the actual dimensions of the specified object to be measured.
- the CPU 87B of the inspector terminal 81 includes a browser control unit 113.
- the browser control unit 113 controls the display of the partial image display screen 135 on the display 89B.
- the partial image display screen 135 includes a partial index bar 120 and a partial image display area 136.
- the partial image display area 136 displays a partial image 137.
- the partial image 137 is an image obtained by photographing the tunnel 10 extending in the length direction LD with the photographing device 12, and is a part of the long image 55 whose long side direction is along the length direction LD.
- the partial index bar 120 extends along the length direction LD, and indicates at least a part of the distance range of the tunnel 10 in the length direction LD.
- the partial index bar 120 displays a photographing position mark 145 indicating the photographing position in the tunnel 10 of the partial image 137 being displayed in the partial image display area 136.
- the photographing position mark 145 allows the inspector UI to recognize which part of the tunnel 10 was photographed with the partial image 137 being displayed in the partial image display area 136. This makes it possible to prevent problems such as being unable to identify the position of the tunnel 10 where a defect such as a crack 111 has occurred.
- the partial image display screen 135 only has the partial index bar 120 and the partial image display area 136 as described above. This makes the screen configuration very simple. If a display area for the long image 55 were provided, a large space would be required, but the partial index bar 120 does not require as much space as the long image 55. Also, if the length of a structure is very long, such as the tunnel 10 in this example, it is difficult to display it using the long image 55, but the partial index bar 120 can display it even if the structure is long. Therefore, according to the technology disclosed herein, it is possible to have the inspector UI recognize, with a simple screen configuration, which part of the tunnel 10 the partial image 137 being displayed in the partial image display area 136 was captured from.
- the browser control unit 113 accepts a position specification for any position on the partial index bar 120.
- the browser control unit 113 displays a partial image 137 in the partial image display area 136, where the specified position corresponds to the shooting position. This allows the inspector UI to instantly display the desired partial image 137 with a simple operation, facilitating inspection of the long image 55.
- the inspector terminal 81 can display an overall index bar 118 that indicates a wider distance range than the distance range of the partial index bar 120, and that indicates to which position within the distance range of the overall index bar 118 the currently displayed partial index bar 120 corresponds. This makes it possible for the inspector UI to recognize the position corresponding to the currently displayed partial index bar 120.
- the distance range indicated by the overall index bar 118 is the entire distance range in the length direction LD of the tunnel 10. This makes it possible for the inspector UI to recognize which position in the entire distance range in the length direction LD of the tunnel 10 the partial index bar 120 being displayed corresponds to. Note that the distance range indicated by the overall index bar 118 does not necessarily have to be the entire distance range in the length direction LD of the tunnel 10. For example, half of the distance range in the length direction LD of the tunnel 10 may be indicated by the overall index bar 118.
- the inspector terminal 81 is capable of enlarging and displaying a partial image 137 in the partial image display area 136. It is also possible to display an auxiliary window 139 that includes a frame 160 that indicates which position on the partial image 137 the enlarged portion corresponds to. This allows the inspector UI to recognize which part of the partial image 137 is being enlarged.
- the partial image display screen 135 is provided with display switch buttons 159A and 159B for inputting an instruction to switch the partial image 137 being displayed in the partial image display area 136 to the partial image 137 adjacent to the partial image 137 being displayed in the partial image display area 136.
- This allows the display of the partial image 137 in the partial image display area 136 to be instantly switched with a simple operation, facilitating inspection of the long image 55.
- the inspector terminal 81 can display, in the partial index bar 120, attention point marks such as the designated point mark 126 at the time of shooting, which indicates attention points in the long image 55. This allows the inspector UI to recognize where the attention points are in the long image 55. Since attention points are points that the inspector UI should inspect with priority and focus, inspection of the long image 55 can be made more efficient if the inspector UI can recognize where the attention points are.
- the points of interest include the points specified by the user, the photographer UP or the inspector UI, and the points where the crack 111, which is the specific subject, is located. Therefore, the inspector UI can be made to recognize where the points specified by the photographer UP or the inspector UI and the points where the crack 111 is located are located.
- the inspector terminal 81 can display text memos made by the photographer UP or inspector UI in association with a location specified by the photographer UP or inspector UI. This allows the inspector UI to easily check the text memos.
- the location specified by the user is the location specified by the photographer UP of the long image 55 when the long image 55 was photographed, and the location specified by the inspector UI of the long image 55 when inspecting the long image 55. Therefore, it is possible to cause the inspector UI to recognize where the location is located that was specified by the photographer UP of the long image 55 when the long image 55 was photographed, and the location that was specified by the inspector UI of the long image 55 when inspecting the long image 55.
- the inspector terminal 81 can display a displayed mark 146 indicating the location where the partial image 137 is displayed, making it possible to distinguish between locations where the partial image 137 is displayed and locations where it is not displayed in the partial index bar 120. This allows the inspector UI to recognize locations that have been inspected by displaying the partial image 137 and locations that have not. This can eliminate the double work of inspecting a location that has already been inspected without realizing it.
- the browser control unit 113 accepts the specification of the measurement target in the partial image 137.
- the browser control unit 113 displays the position of the measurement target in the tunnel 10 and the actual dimensions of the measurement target in response to the specification. This allows the inspector UI to easily know the position of the measurement target in the tunnel 10 and the actual dimensions of the measurement target. Note that it is not limited to displaying both the position of the measurement target in the tunnel 10 and the actual dimensions of the measurement target, and it is sufficient to display at least one of these.
- the long image 55 is an image obtained by synthesizing multiple captured images 51 obtained by capturing images of different parts of the tunnel 10 multiple times with the camera 12, at least along the length direction LD of the length direction LD and the circumferential direction CD that intersects (is perpendicular to) the length direction LD. Therefore, the long image 55 is an image that captures at least different parts along the length direction LD of the inner wall surface 11 of the tunnel 10, and is an image that is suitable for comprehensively inspecting the inner wall surface 11 of the tunnel 10 along the length direction LD.
- intersecting refers to the first direction and the second direction intersecting at a certain angle, and includes other than the "perpendicular" of the illustrated length direction LD and circumferential direction CD.
- the multiple captured images 51 are images obtained by capturing images of the inner wall surface 11 of the tunnel 10 at multiple different positions in the length direction LD while moving the imaging device 12 along the length direction LD. Therefore, multiple captured images 51 capturing different locations along the length direction LD of the inner wall surface 11 of the tunnel 10 can be easily obtained.
- the photographing device 12 has multiple cameras 27 arranged along the circumferential direction CD.
- the multiple photographed images 51 are images obtained by photographing the tunnel 10 with the multiple cameras 27 arranged along the circumferential direction CD. Therefore, it is possible to easily obtain multiple photographed images 51 that capture different locations along the circumferential direction CD of the inner wall surface 11 of the tunnel 10.
- the photographing device 12 has multiple cameras 27 arranged along the length direction LD.
- the multiple photographed images 51 are images obtained by photographing the tunnel 10 with the multiple cameras 27 arranged along the length direction LD. Therefore, it is possible to easily obtain multiple photographed images 51 that capture different locations along the length direction LD of the inner wall surface 11 of the tunnel 10.
- the photographing device 12 has multiple cameras 27 arranged along the circumferential direction CD.
- the multiple photographed images 51 are images obtained by photographing the tunnel 10 with the multiple cameras 27 while moving the photographing device 12 along the length direction LD.
- the long image 55 is an image obtained by combining the multiple photographed images 51 along the length direction LD and the circumferential direction CD. For this reason, multiple photographed images 51 showing different locations along the length direction LD and the circumferential direction CD of the inner wall surface 11 of the tunnel 10 can be easily obtained.
- the long image 55 is an image showing different locations along the length direction LD and the circumferential direction CD of the inner wall surface 11 of the tunnel 10, and is an image suitable for comprehensively inspecting the inner wall surface 11 of the tunnel 10 along the length direction LD and the circumferential direction CD.
- the structure is a tunnel 10, the first direction is the longitudinal direction LD connecting the entrance 13 and exit 14 of the tunnel 10, and the second direction is the circumferential direction CD of the tunnel 10. This allows the inner wall surface 11 of the tunnel 10 to be comprehensively inspected.
- the inspection designated location mark 127 may be displayed not only at locations previously designated by an inspector UI, but also at locations designated by an inspector UI viewing the partial image display screen 135.
- the partial image 137 displayed in the partial image display area 136 may be an image in a distance range of a preset distance range, such as 50 m, with some margin, such as ⁇ 10 m.
- the adjacent partial images 137 whose display is switched in response to the selection of the display switching buttons 159A and 159B are also images in a distance range with some margin.
- the display switching button 159B is selected while a partial image 137 in a distance range of 190 m to 260 m (a distance range of 200 m to 250 m without a margin) is displayed in the partial image display area 136, the display is switched to a partial image 137 in a distance range of 240 m to 310 m (a distance range of 250 m to 300 m without a margin).
- the partial image 137 in the distance range of 240 m to 310 m is an example of an "adjacent partial image" according to the technology disclosed herein.
- the method of distinguishing between the areas where partial image 137 is displayed and the areas where it is not displayed is not limited to the illustrated displayed mark 146.
- the areas of the partial index bar 120 where partial image 137 is displayed may be displayed in at least one of a brightness, color, and pattern that differs from the areas where it is not displayed, to distinguish between them.
- This display method also allows the inspector UI to recognize the areas that have been inspected by displaying partial image 137 and the areas that have not, eliminating the need to inspect areas that have already been inspected again without realizing it.
- the mark 126 for the location designated during photography, the mark 127 for the location designated during inspection, the mark 128 for the location of cracks, and the mark 146 for the location already displayed may be displayed not only on the partial index bar 120 but also on the overall index bar 118.
- the memo recorded in association with the location specified by the photographer UP is not limited to the text memo shown in the example.
- a voice memo may be recorded instead of a text memo, as shown in the designated location information 170 at the time of shooting in FIG. 36.
- the designated location mark 126 at the time of shooting on the partial index bar 120 is selected, a voice memo is played and displayed from the speaker.
- the memo recorded in association with the location specified by the inspector UI may also be a voice memo.
- the memo recorded in association with the location specified by the photographer UP or inspector UI may be at least one of a text memo and a voice memo.
- the specific subject to be extracted is not limited to the crack 111 shown in the example. Other abnormalities such as peeling, rust, water leakage, or exposed rebar may also be extracted. Multiple types of abnormalities may be extracted, and the extracted images of the multiple types of abnormalities may be selectively superimposed on the partial image 137 in response to the operation of the superimposition/unsuperimposition button 157. Furthermore, the specific subject to be extracted is not limited to abnormalities. It may also be lighting fixtures, ventilation openings, etc. arranged at regular intervals in the tunnel 10.
- the structure is not limited to the tunnel 10. It may be a dam, a bridge, a levee, or a public facility.
- the imaging device 12 may also be an aircraft such as a drone.
- the width direction of the levee body is the first direction
- the height direction is the second direction.
- the length direction of the bridge girder is the first direction
- the height direction is the second direction.
- the hardware configuration of the computer that constitutes the information management server 80 can be modified in various ways.
- the information management server 80 can be configured with multiple computers separated as hardware in order to improve processing power and reliability.
- the functions of the acquisition unit 100 and RW control unit 101, and the functions of the extraction unit 102 and screen distribution control unit 103 are distributed and carried out by two server computers.
- the information management server 80 is made up of two server computers.
- some or all of the functions of the information management server 80 may be carried out by the inspector terminal 81.
- the hardware configuration of the computer can be changed as appropriate according to the required performance such as processing power, safety, and reliability.
- APs such as the operating program 95 can of course be duplicated or stored in a distributed manner across multiple storage devices in order to ensure safety and reliability.
- the location and operator of the information management server 80 may be a data center operated by a company other than the structure inspection company, or it may be one of multiple inspection companies.
- the hardware structure of the processing unit that executes various processes such as the acquisition unit 100, RW control unit 101, extraction unit 102, screen delivery control unit 103, and browser control unit 113 can use the various processors shown below.
- the various processors include the CPUs 87A and 87B, which are general-purpose processors that execute software (operation program 95 and inspection AP 112) and function as various processing units as described above, as well as programmable logic devices (Programmable Logic Devices: PLDs), which are processors whose circuit configuration can be changed after manufacture such as FPGAs (Field Programmable Gate Arrays), and dedicated electric circuits, which are processors having a circuit configuration designed specifically to execute specific processes such as ASICs (Application Specific Integrated Circuits), etc.
- PLDs programmable Logic Devices
- FPGAs Field Programmable Gate Arrays
- dedicated electric circuits which are processors having a circuit configuration designed specifically to execute specific processes such as ASICs (Application Specific Integrated Circuits), etc.
- a single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs and/or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.
- Examples of configuring multiple processing units with a single processor include, first, a form in which one processor is configured with a combination of one or more CPUs and software, as typified by client and server computers, and this processor functions as multiple processing units. Second, a form in which a processor is used to realize the functions of the entire system, including multiple processing units, with a single IC (Integrated Circuit) chip, as typified by system-on-chip (SoC). In this way, the various processing units are configured as a hardware structure using one or more of the various processors listed above.
- SoC system-on-chip
- the hardware structure of these various processors can be an electrical circuit that combines circuit elements such as semiconductor elements.
- a processor is provided.
- the processor a display area of a partial image that is a part of a long image obtained by photographing a structure extending in a first direction with a photographing device and whose long side direction is along the first direction; a first index bar extending along the first direction and indicating a first distance range that is at least a part of a distance range of the structure in the first direction, the first index bar indicating a shooting position mark indicating a shooting position of the partial image being displayed in the display area in the structure; Controlling to display a display screen having the display Image display device.
- the processor Accepting a position designation of an arbitrary position of the first index bar; 2.
- the image display device according to claim 1, wherein the partial image, the designated position of which corresponds to the shooting position, is displayed in the display area.
- An image display device as described in appendix 1 or 2 which is capable of displaying a second index bar indicating a second distance range wider than the first distance range, the second index bar indicating to which position within the second distance range the first index bar being displayed corresponds.
- the image display device according to claim 3, wherein the second distance range is the entire distance range of the structure in the first direction.
- the partial image can be enlarged and displayed; 5.
- the image display device according to claim 1, further comprising a window that indicates a position of the partial image corresponding to the enlarged portion.
- the image display device which is capable of displaying a text memo or a voice memo input by the user in association with the portion of interest.
- the first index bar is capable of displaying areas where the partial image is displayed and areas where the partial image is not displayed in a distinguishable manner.
- [Additional Item 15] The image display device described in any one of Appendix 1 to Appendix 14, wherein the long image is an image obtained by synthesizing multiple captured images obtained by photographing different parts of the structure multiple times with the photographing device along at least the first direction among the first direction and a second direction intersecting the first direction.
- [Additional Item 16] The image display device described in Appendix 15, wherein the multiple captured images are images obtained by photographing the structure at multiple different positions in the first direction while moving the imaging device along the first direction.
- the imaging device has a plurality of cameras arranged along the second direction, 17.
- the image display device according to claim 15, wherein the plurality of captured images are images obtained by capturing images of the structure with the plurality of cameras.
- the imaging device has a plurality of cameras arranged along the first direction, 18.
- the plurality of captured images are images obtained by photographing the structure with the plurality of cameras.
- the imaging device has a plurality of cameras arranged along the second direction, the plurality of photographed images are images obtained by photographing the structure with the plurality of cameras while moving the photographing device along the first direction, 19.
- the image display device according to any one of supplementary items 15 to 18, wherein the elongated image is an image obtained by synthesizing the plurality of captured images along the first direction and the second direction.
- the structure is a tunnel;
- the first direction is a longitudinal direction connecting an entrance and an exit of the tunnel, 20.
- the image display device according to any one of claims 15 to 19, wherein the second direction is a circumferential direction of the tunnel.
- a and/or B is synonymous with “at least one of A and B.”
- a and/or B means that it may be just A, or just B, or a combination of A and B.
- the same idea as “A and/or B” is also applied when three or more things are linked together with “and/or.”
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Mining & Mineral Resources (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Optics & Photonics (AREA)
- Astronomy & Astrophysics (AREA)
- Architecture (AREA)
- Civil Engineering (AREA)
- Structural Engineering (AREA)
- Human Computer Interaction (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Life Sciences & Earth Sciences (AREA)
- Geochemistry & Mineralogy (AREA)
- Geology (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
Description
プロセッサを備え、
前記プロセッサは、
第1方向に延びる構造物を撮影装置で撮影して得られ、かつ長辺方向が前記第1方向に沿う長尺画像のうちの一部である部分画像の表示領域と、
前記第1方向に沿って延び、前記構造物の前記第1方向の距離範囲のうちの少なくとも一部の第1距離範囲を示す第1インデックスバーであり、前記表示領域に表示中の前記部分画像の前記構造物における撮影位置を示す撮影位置マークが表示された第1インデックスバーと、
を有する表示画面をディスプレイに表示する制御を行う、
画像表示装置。
[付記項2]
前記プロセッサは、
前記第1インデックスバーの任意の位置の位置指定を受け付け、
前記位置指定された位置が前記撮影位置に該当する前記部分画像を前記表示領域に表示する付記項1に記載の画像表示装置。
[付記項3]
前記第1距離範囲よりも広い第2距離範囲を示す第2インデックスバーであり、表示中の前記第1インデックスバーが前記第2距離範囲の中のどの位置に対応するかを示す第2インデックスバーを表示することが可能である付記項1または付記項2に記載の画像表示装置。
[付記項4]
前記第2距離範囲は、前記構造物の前記第1方向の距離範囲の全体である付記項3に記載の画像表示装置。
[付記項5]
前記表示領域において、前記部分画像は拡大表示することが可能であり、
前記拡大表示している部分が前記部分画像のどの位置に対応するかを示す補助ウィンドウを表示することが可能である付記項1から付記項4のいずれか1項に記載の画像表示装置。
[付記項6]
前記表示領域に表示中の前記部分画像を、前記表示領域に表示中の前記部分画像に隣接する部分画像に切り替える指示を入力するための操作部が、前記表示画面に設けられている付記項1から付記項5のいずれか1項に記載の画像表示装置。
[付記項7]
前記長尺画像の注目箇所を示す注目箇所マークを、前記第1インデックスバーに表示することが可能である付記項1から付記項6のいずれか1項に記載の画像表示装置。
[付記項8]
前記注目箇所は、ユーザが指定した箇所、および特定被写体が存在する箇所のうちの少なくとも1つを含む付記項7に記載の画像表示装置。
[付記項9]
前記ユーザにより入力されたテキストメモまたはボイスメモを前記注目箇所と関連付けて表示することが可能である付記項8に記載の画像表示装置。
[付記項10]
前記ユーザが指定した箇所は、前記長尺画像の撮影者が前記長尺画像の撮影時に指定した箇所、および前記長尺画像の点検者が前記長尺画像の点検時に指定した箇所のうちの少なくとも1つである付記項8または付記項9に記載の画像表示装置。
[付記項11]
前記第1インデックスバーにおいて、前記部分画像を表示した箇所と表示していない箇所とを区別して表示することが可能である付記項1から付記項10のいずれか1項に記載の画像表示装置。
[付記項12]
前記第1インデックスバーにおいて、前記部分画像を表示した箇所を示す表示済みマークを表示することで、前記部分画像を表示した箇所と表示していない箇所とを区別して表示する付記項11に記載の画像表示装置。
[付記項13]
前記第1インデックスバーの明るさ、色、および模様のうちの少なくとも1つを変更することで、前記部分画像を表示した箇所と表示していない箇所とを区別して表示する付記項11に記載の画像表示装置。
[付記項14]
前記プロセッサは、
前記部分画像内の測定対象の指定を受け付け、
前記指定に応じて、前記測定対象の前記構造物における位置、および前記測定対象の実寸のうちの少なくとも1つを表示する付記項1から付記項13のいずれか1項に記載の画像表示装置。
[付記項15]
前記長尺画像は、前記構造物の異なる箇所を前記撮影装置で複数回撮影することで得られた複数の撮影画像を、前記第1方向および前記第1方向と交差する第2方向のうちの、少なくとも前記第1方向に沿って合成した画像である付記項1から付記項14のいずれか1項に記載の画像表示装置。
[付記項16]
前記複数の撮影画像は、前記撮影装置を前記第1方向に沿って移動させながら、前記構造物を前記第1方向における異なる複数の位置で撮影することにより得られた画像である付記項15に記載の画像表示装置。
[付記項17]
前記撮影装置は、前記第2方向に沿って配された複数のカメラを有し、
前記複数の撮影画像は、前記複数のカメラで前記構造物を撮影することで得られた画像である付記項15または付記項16に記載の画像表示装置。
[付記項18]
前記撮影装置は、前記第1方向に沿って配された複数のカメラを有し、
前記複数の撮影画像は、前記複数のカメラで前記構造物を撮影することで得られた画像である付記項17に記載の画像表示装置。
[付記項19]
前記撮影装置は、前記第2方向に沿って配された複数のカメラを有し、
前記複数の撮影画像は、前記撮影装置を前記第1方向に沿って移動させながら、前記複数のカメラで前記構造物を撮影することで得られた画像であり、
前記長尺画像は、前記複数の撮影画像を、前記第1方向および前記第2方向に沿って合成した画像である付記項15から付記項18のいずれか1項に記載の画像表示装置。
[付記項20]
前記構造物はトンネルであり、
前記第1方向は、前記トンネルの入口と出口を結ぶ長さ方向であり、
前記第2方向は、前記トンネルの周方向である付記項15から付記項19のいずれか1項に記載の画像表示装置。
Claims (22)
- プロセッサを備え、
前記プロセッサは、
第1方向に延びる構造物を撮影装置で撮影して得られ、かつ長辺方向が前記第1方向に沿う長尺画像のうちの一部である部分画像の表示領域と、
前記第1方向に沿って延び、前記構造物の前記第1方向の距離範囲のうちの少なくとも一部の第1距離範囲を示す第1インデックスバーであり、前記表示領域に表示中の前記部分画像の前記構造物における撮影位置を示す撮影位置マークが表示された第1インデックスバーと、
を有する表示画面をディスプレイに表示する制御を行う、
画像表示装置。 - 前記プロセッサは、
前記第1インデックスバーの任意の位置の位置指定を受け付け、
前記位置指定された位置が前記撮影位置に該当する前記部分画像を前記表示領域に表示する請求項1に記載の画像表示装置。 - 前記第1距離範囲よりも広い第2距離範囲を示す第2インデックスバーであり、表示中の前記第1インデックスバーが前記第2距離範囲の中のどの位置に対応するかを示す第2インデックスバーを表示することが可能である請求項1に記載の画像表示装置。
- 前記第2距離範囲は、前記構造物の前記第1方向の距離範囲の全体である請求項3に記載の画像表示装置。
- 前記表示領域において、前記部分画像は拡大表示することが可能であり、
前記拡大表示している部分が前記部分画像のどの位置に対応するかを示す補助ウィンドウを表示することが可能である請求項1に記載の画像表示装置。 - 前記表示領域に表示中の前記部分画像を、前記表示領域に表示中の前記部分画像に隣接する部分画像に切り替える指示を入力するための操作部が、前記表示画面に設けられている請求項1に記載の画像表示装置。
- 前記長尺画像の注目箇所を示す注目箇所マークを、前記第1インデックスバーに表示することが可能である請求項1に記載の画像表示装置。
- 前記注目箇所は、ユーザが指定した箇所、および特定被写体が存在する箇所のうちの少なくとも1つを含む請求項7に記載の画像表示装置。
- 前記ユーザにより入力されたテキストメモまたはボイスメモを前記注目箇所と関連付けて表示することが可能である請求項8に記載の画像表示装置。
- 前記ユーザが指定した箇所は、前記長尺画像の撮影者が前記長尺画像の撮影時に指定した箇所、および前記長尺画像の点検者が前記長尺画像の点検時に指定した箇所のうちの少なくとも1つである請求項8に記載の画像表示装置。
- 前記第1インデックスバーにおいて、前記部分画像を表示した箇所と表示していない箇所とを区別して表示することが可能である請求項1に記載の画像表示装置。
- 前記第1インデックスバーにおいて、前記部分画像を表示した箇所を示す表示済みマークを表示することで、前記部分画像を表示した箇所と表示していない箇所とを区別して表示する請求項11に記載の画像表示装置。
- 前記第1インデックスバーの明るさ、色、および模様のうちの少なくとも1つを変更することで、前記部分画像を表示した箇所と表示していない箇所とを区別して表示する請求項11に記載の画像表示装置。
- 前記プロセッサは、
前記部分画像内の測定対象の指定を受け付け、
前記指定に応じて、前記測定対象の前記構造物における位置、および前記測定対象の実寸のうちの少なくとも1つを表示する請求項1に記載の画像表示装置。 - 前記長尺画像は、前記構造物の異なる箇所を前記撮影装置で複数回撮影することで得られた複数の撮影画像を、前記第1方向および前記第1方向と交差する第2方向のうちの、少なくとも前記第1方向に沿って合成した画像である請求項1に記載の画像表示装置。
- 前記複数の撮影画像は、前記撮影装置を前記第1方向に沿って移動させながら、前記構造物を前記第1方向における異なる複数の位置で撮影することにより得られた画像である請求項15に記載の画像表示装置。
- 前記撮影装置は、前記第2方向に沿って配された複数のカメラを有し、
前記複数の撮影画像は、前記複数のカメラで前記構造物を撮影することで得られた画像である請求項15に記載の画像表示装置。 - 前記撮影装置は、前記第1方向に沿って配された複数のカメラを有し、
前記複数の撮影画像は、前記複数のカメラで前記構造物を撮影することで得られた画像である請求項17に記載の画像表示装置。 - 前記撮影装置は、前記第2方向に沿って配された複数のカメラを有し、
前記複数の撮影画像は、前記撮影装置を前記第1方向に沿って移動させながら、前記複数のカメラで前記構造物を撮影することで得られた画像であり、
前記長尺画像は、前記複数の撮影画像を、前記第1方向および前記第2方向に沿って合成した画像である請求項15に記載の画像表示装置。 - 前記構造物はトンネルであり、
前記第1方向は、前記トンネルの入口と出口を結ぶ長さ方向であり、
前記第2方向は、前記トンネルの周方向である請求項15に記載の画像表示装置。 - 第1方向に延びる構造物を撮影装置で撮影して得られ、かつ長辺方向が前記第1方向に沿う長尺画像のうちの一部である部分画像の表示領域と、
前記第1方向に沿って延び、前記構造物の前記第1方向の距離範囲のうちの少なくとも一部の第1距離範囲を示す第1インデックスバーであり、前記表示領域に表示中の前記部分画像の前記構造物における撮影位置を示す撮影位置マークが表示された第1インデックスバーと、
を有する表示画面をディスプレイに表示する制御を行うこと、
を含む画像表示装置の作動方法。 - 第1方向に延びる構造物を撮影装置で撮影して得られ、かつ長辺方向が前記第1方向に沿う長尺画像のうちの一部である部分画像の表示領域と、
前記第1方向に沿って延び、前記構造物の前記第1方向の距離範囲のうちの少なくとも一部の第1距離範囲を示す第1インデックスバーであり、前記表示領域に表示中の前記部分画像の前記構造物における撮影位置を示す撮影位置マークが表示された第1インデックスバーと、
を有する表示画面をディスプレイに表示する制御を行うこと、
を含む処理をコンピュータに実行させる画像表示装置の作動プログラム。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2024557069A JPWO2024101046A1 (ja) | 2022-11-10 | 2023-10-05 | |
| CN202380078115.XA CN120226343A (zh) | 2022-11-10 | 2023-10-05 | 图像显示装置、图像显示装置的操作方法及图像显示装置的工作程序 |
| US19/200,637 US20250265738A1 (en) | 2022-11-10 | 2025-05-06 | Image display device, method for operating image display device, and program for operating image display device |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2022-180167 | 2022-11-10 | ||
| JP2022180167 | 2022-11-10 | ||
| JP2023-001824 | 2023-01-10 | ||
| JP2023001824 | 2023-01-10 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US19/200,637 Continuation US20250265738A1 (en) | 2022-11-10 | 2025-05-06 | Image display device, method for operating image display device, and program for operating image display device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024101046A1 true WO2024101046A1 (ja) | 2024-05-16 |
Family
ID=91032693
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2023/036436 Ceased WO2024101046A1 (ja) | 2022-11-10 | 2023-10-05 | 画像表示装置、画像表示装置の作動方法、および画像表示装置の作動プログラム |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20250265738A1 (ja) |
| JP (1) | JPWO2024101046A1 (ja) |
| CN (1) | CN120226343A (ja) |
| WO (1) | WO2024101046A1 (ja) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2016086237A (ja) * | 2014-10-23 | 2016-05-19 | 協立電子工業株式会社 | サーバ装置及び方法 |
| JP2022030436A (ja) * | 2020-08-07 | 2022-02-18 | 株式会社リコー | 表示装置、撮影システム、表示制御方法およびプログラム |
-
2023
- 2023-10-05 JP JP2024557069A patent/JPWO2024101046A1/ja active Pending
- 2023-10-05 CN CN202380078115.XA patent/CN120226343A/zh active Pending
- 2023-10-05 WO PCT/JP2023/036436 patent/WO2024101046A1/ja not_active Ceased
-
2025
- 2025-05-06 US US19/200,637 patent/US20250265738A1/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2016086237A (ja) * | 2014-10-23 | 2016-05-19 | 協立電子工業株式会社 | サーバ装置及び方法 |
| JP2022030436A (ja) * | 2020-08-07 | 2022-02-18 | 株式会社リコー | 表示装置、撮影システム、表示制御方法およびプログラム |
Also Published As
| Publication number | Publication date |
|---|---|
| JPWO2024101046A1 (ja) | 2024-05-16 |
| CN120226343A (zh) | 2025-06-27 |
| US20250265738A1 (en) | 2025-08-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2702160C2 (ru) | Устройство поддержки отслеживания, система поддержки отслеживания и способ поддержки отслеживания | |
| JP4375555B2 (ja) | X線ct装置 | |
| JP2009512879A (ja) | 走行する撚り線を検査する方法及び装置 | |
| JP2011044837A5 (ja) | ||
| WO2005094458A3 (en) | Monitoring system and method | |
| JP6366707B2 (ja) | 映像監視システム及び映像監視方法 | |
| JP2018092092A (ja) | 自走式管内検査カメラ装置および管内検査カメラの光軸調整方法 | |
| JP6926486B2 (ja) | 情報処理装置、情報処理方法およびプログラム | |
| JP4041042B2 (ja) | 欠陥確認装置および欠陥確認方法 | |
| JP2016092693A (ja) | 撮像装置、撮像装置の制御方法およびプログラム | |
| WO2024101046A1 (ja) | 画像表示装置、画像表示装置の作動方法、および画像表示装置の作動プログラム | |
| US20230357998A1 (en) | Road surface management device, road surface management method, and recording medium | |
| JP2013077936A5 (ja) | ||
| JP2020022036A (ja) | 表示制御装置、表示制御方法、およびプログラム | |
| US20200175763A1 (en) | Content providing device, content providing method, and storage medium | |
| WO2017056412A1 (ja) | モニタ制御システム、モニタ制御方法、及び、モニタ制御プログラム | |
| JP2011145730A (ja) | 監視画面表示制御装置 | |
| JP5950100B2 (ja) | X線検査装置 | |
| JP2017161403A (ja) | 撮像装置、方法、及びプログラム、表示制御装置及びプログラム | |
| TW201939023A (zh) | 缺陷確認裝置、缺陷確認方法以及電腦可讀取記憶媒體 | |
| JP4577214B2 (ja) | X線検査装置 | |
| WO2021075878A1 (ko) | 증강현실 기록물 서비스 제공 방법 및 사용자 단말 | |
| US20250380052A1 (en) | Processing device | |
| JP2025180152A (ja) | 画像処理装置、方法及びプログラム | |
| JP2025005231A (ja) | 制御装置、制御方法及びプログラム |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23888399 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2024557069 Country of ref document: JP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202380078115.X Country of ref document: CN |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWP | Wipo information: published in national office |
Ref document number: 202380078115.X Country of ref document: CN |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 23888399 Country of ref document: EP Kind code of ref document: A1 |