JP2024057692A - Information processing device, information processing method, program, photographing system, and analysis system - Google Patents

Abstract

[Problem] To easily check the shooting position of an image taken by a camera installed on a moving object and not satisfying a predetermined condition. [Solution] A data acquisition device 9 includes a generation unit 83 that generates a display screen 2000 that displays position information 2011-2041 indicating the shooting position of an image taken by a camera 7 installed on a moving object 6 and not satisfying a predetermined condition. The position information 2011-2041 indicates a position on a map, and the display screen 2000 displays the position information 2011-2041 superimposed on a map 2100. [Selected Figure] Fig. 9

Description

The present invention relates to an information processing device, an information processing method, a program, an imaging system, and an analysis system.

Patent Document 1 describes a road condition management system that, based on the latitude and longitude information of the location where damage has occurred, identifies the ID and kilometer post of the road closest to that latitude and longitude, and displays a mark indicating that damage has occurred on the corresponding road on a map together with the kilometer post value.

JP2006-112127A

The present invention aims to easily check the shooting position of an image captured by a camera installed on a moving object that does not satisfy a specified condition.

The information processing device according to claim 1 of the present invention includes a generating means for generating a display screen that displays position information indicating the shooting position of an image captured by a camera installed on a moving body and that does not satisfy a predetermined condition.

The present invention makes it easy to check the shooting position of an image captured by a camera installed on a moving object that does not satisfy a specified condition.

1 is a diagram showing an example of an overall configuration of a state inspection system according to an embodiment; FIG. 2 is a diagram illustrating a state in which an in-vehicle device is installed in a vehicle and captures images. FIG. 2 is a diagram illustrating an example of a hardware configuration of a data acquisition device. FIG. 2 illustrates an example of a hardware configuration of a management device and an analysis device. FIG. 2 is a diagram illustrating an example of a functional configuration of a state inspection system. FIG. 4 is a conceptual diagram illustrating an example of an image information management table. FIG. 13 is a conceptual diagram illustrating an example of an analysis information management table. 13 is a flowchart showing an image confirmation process. 1 is an example of a display screen. FIG. 11 is a sequence diagram illustrating an example of a data analysis process. 13 is a flowchart showing a measurement information update process.

Below, we will explain the mode for implementing the invention with reference to the drawings. Note that in the explanation of the drawings, the same elements are given the same reference numerals, and duplicate explanations will be omitted.

●Embodiment●
● Overview of the System First, an overview of the condition inspection system will be described with reference to Figures 1 and 2. Figure 1 is a diagram showing an example of the overall configuration of a condition inspection system according to an embodiment. The condition inspection system 1 shown in Figure 1 is an example of an information processing system, and is a system for measuring and investigating properties such as cracks in structures such as road surfaces, using various data acquired by a mobile system 60.

The structure may be a sidewalk surface, a roadway surface (street surface) on which cars travel, a railway line on which trains travel, an embankment, the inside of a tunnel, or a structure on a road. Note that structures on roads are, for example, signs and utility poles installed on roadsides. In the following explanation, we will explain the case of inspecting the properties of a road surface on which a moving object 6 such as a vehicle travels. The condition inspection system 1 is used, for example, when dividing a long structure that extends in one direction into certain sections and inspecting the surface properties of the sections.

The condition inspection system 1 is composed of a mobile system 60, an analysis system 4, a communication terminal 1100 of the national or local government, and a communication terminal 1200 of a commissioned business operator. The mobile system 60 is an example of an imaging system, and is composed of a data acquisition device 9 and a mobile body 6 such as a vehicle equipped with the data acquisition device 9. The data acquisition device 9 is an example of a measurement device, and has an imaging device 7, which is an example of a measurement device that measures structures, and a GNSS (Global Navigation Satellite System) sensor 8. GNSS is a general term for satellite positioning systems such as the Global Positioning System (GPS) or the Quasi-Zenith Satellite System (QZSS). The GNSS sensor 8 is an example of a sensor device. The mobile system 60 images structures such as road surfaces while the mobile body 6 is traveling.

The imaging device 7 is provided, for example, on the rear of the roof of the mobile unit 6, facing in the opposite direction to the traveling direction, and captures an image of the road surface R behind the mobile unit 6. The imaging device 7 may be provided on the front of the roof of the mobile unit 6 facing in the same direction as the traveling direction, or on the side of the roof of the mobile unit 6 facing perpendicular (or approximately perpendicular) to the traveling direction. The imaging device 7 may also be installed around the license plate at the front of the mobile unit 6.

The imaging device 7 is a stereo camera that captures an image of a predetermined range of the road surface R. The stereo camera is a camera that uses parallax information from, for example, two cameras arranged side by side to obtain depth information such as unevenness formed on the road surface R to be analyzed. The stereo camera repeatedly captures images at a timing when parts of the images overlap in the traveling direction of the mobile body 6. Considering the mounting on the mobile body 6, it is preferable to install only one stereo camera. Note that, in order to accommodate roads with a wide road surface width, multiple cameras may be installed so that they can capture the entire width of the road surface R, and multiple cameras may capture images simultaneously so that parts of the images overlap in the width direction as well. In this case, the stereo cameras are arranged in a row facing diagonally downward toward the road surface R.

The mobile object 6 is not limited to a special-purpose vehicle, and may be a general vehicle such as a parcel delivery vehicle. By attaching the imaging device 7 to a general vehicle, it is possible to capture and measure data that can output information on cracks, ruts, flatness, and IRI while driving, without incurring the costs of a special-purpose vehicle. When there is only one stereo camera, it is easy to install even if the mobile object 6 is a general vehicle.

The analysis system 4 is constructed by a management device 3 and an analysis device 5. The management device 3 and the analysis device 5 constituting the analysis system 4 can communicate with a mobile system 60, a communication terminal 1100, and a communication terminal 1200 via a communication network 100. The communication network 100 is constructed by the Internet, a mobile communication network, a LAN (Local Area Network), etc.

Note that the communication network 100 may include not only wired communication, but also wireless communication networks such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), Wi-Fi (Wireless Fidelity) (registered trademark), WiMAX (Worldwide Interoperability for Microwave Access), or LTE (Long Term Evolution).

The management device 3 and the analysis device 5 may also have a communication function using a short-range communication technology such as NFC (Near Field Communication) (registered trademark).

The analysis device 5 is an example of an information processing device, and is a computer such as a PC that analyzes various data acquired by the data acquisition device 9. A dedicated application program for analyzing the state of the road surface R is installed in the analysis device 5. The method of transferring various data from the analysis device 5 to the management device 3 may be manual transfer using a USB (Universal Serial Bus) memory or the like.

The management device 3 is a computer such as a PC that manages various analysis information transferred from the analysis device 5. The management device 3 also generates a report to be submitted to a road administrator such as the national government, a local government, or a commissioned business operator, using the captured image data, sensor data, analysis information, and detailed analysis results. The report data generated by the management device 3 is submitted to the national government or local government via the commissioned business operator in electronic data or printed form. The report generated by the management device 3 is called an investigation record sheet, inspection sheet, investigation ledger, or report, etc. The management device 3 is not limited to a PC, and may be a smartphone or tablet terminal, etc. The analysis system 4 may be configured to construct the management device 3 and the analysis device 5 as a single device or terminal.

The communication terminal 1200 is provided to the commissioned business operator, and the communication terminal 1100 is provided to the national or local government. The management device 3, the communication terminal 1100, and the communication terminal 1200 are examples of terminal devices capable of communicating with the analysis device 5, and various data managed by the analysis device 5 can be viewed.

Figure 2 is a schematic diagram showing the state in which an image is captured by a moving object.

As shown in FIG. 2, the image capture device 7 captures the target area following the direction of movement of the moving object 6 as different frames (captured images) at different times so as to include an overlapping imaging area (image overlapping portion) of a predetermined width. The image overlapping portion is set to, for example, 10-30% of the width of the captured image. Note that FIG. 2 shows a schematic diagram of frames captured at different times by one of a total of two image capture elements equipped in the stereo camera.

The captured image is sent to the analysis device 5 as luminance image data, where it is analyzed by AI or manually. However, when the image is analyzed by the analysis device 5, it is sometimes found that the luminance is too high or low, or that the luminance information itself is missing, making image analysis difficult.

In this case, it is necessary to make the mobile object 6 travel again and take new photographs using the photographing device 7, but there are problems in that some of the photographed images are difficult to analyze, so all photographs must be taken again, and if the target area is far away, it may take several days until the next photographs can be taken.

In view of the above problems, the present embodiment aims to easily check the shooting position of an image that does not satisfy a certain condition, and to easily retake the image at that shooting position.

Hardware Configuration Next, the hardware configuration of each device constituting the state inspection system 1 will be described with reference to Figures 2 and 4. Note that components may be added or deleted from the hardware configurations shown in Figures 2 and 4 as necessary.

○Hardware configuration of data acquisition device○
2 is a diagram showing an example of a hardware configuration of a data acquisition device 9. The data acquisition device 9 includes the image capture device 7 and the sensor device 8 as shown in FIG.

The photographing device 7 includes a first camera 71 and a second camera 72. The photographing device 7 provides the controller 900 with photographed image data of the road surface R photographed by the first camera 71 and the second camera 72.

Specifically, the image capturing device 7 provides the controller 900 with luminance image data captured by the first camera 71 and the second camera 72, respectively, and parallax image data indicating parallax information from the first camera 71 and the second camera 72.

The photographing process by the first camera 71 and the second camera 72 constituting the photographing device 7 is controlled by the controller 900. The controller 900 sets various parameters including the exposure positions of the first camera 71 and the second camera 72, issues instructions to start and end photographing, and records photographed images. Note that the photographing device 7 is preferably a single stereo camera consisting of the first camera 71 and the second camera 72, but may be equipped with two or more stereo cameras.

The controller 900 includes an imaging device I/F (Interface) 901, a sensor device I/F 902, a bus line 910, a CPU (Central Processing Unit) 911, a ROM (Read Only Memory) 912, a RAM (Random Access Memory) 913, a HD (Hard Disk) 914, a HDD (Hard Disk Drive) controller 915, a network I/F 916, a DVD-RW (Digital Versatile Disk Rewritable) drive 918, a media I/F 922, an external device connection I/F 923, and a timer 924.

Of these, the imaging device I/F 901 is an interface for transmitting and receiving various data or information to and from the imaging device 7. The sensor device I/F 902 is an interface for transmitting and receiving various data or information to and from the sensor device 8. The bus line 910 is an address bus, data bus, etc. for electrically connecting each component such as the CPU 911 shown in FIG. 3.

The CPU 911 also controls the operation of the entire data acquisition device 9. The ROM 912 stores programs used to drive the CPU 911, such as IPL. The RAM 913 is used as a work area for the CPU 911. The HD 914 stores various data such as programs. The HDD controller 915 controls the reading and writing of various data from the HD 914 under the control of the CPU 911. The network I/F 916 is an interface for data communication using the communication network 100.

The DVD-RW drive 918 controls the reading and writing of various data from and to a DVD-RW 917, which is an example of a removable recording medium. Note that the medium is not limited to a DVD-RW, and may be a DVD-R or a Blu-ray (registered trademark) Disc, etc.

The media I/F 922 controls the reading and writing (storing) of data from and to a recording medium 921 such as a flash memory. The external device connection I/F 923 is an interface for connecting an external device such as an external PC 930 having a display, keyboard, and pointing device. The timer 924 is a measuring device with a time measurement function. The timer 924 may be a software timer by a computer.

○Hardware configuration of management device○
Fig. 4 is a diagram showing an example of the hardware configuration of the management device. Each piece of hardware configuration of the management device 3 is indicated by a reference number in the 300 series. As shown in Fig. 4, the management device 3 is constructed by a computer, and includes a CPU 301, a ROM 302, a RAM 303, a HD 304, a HDD controller 305, a display 306, an external device connection I/F 308, a network I/F 309, a bus line 310, a keyboard 311, a pointing device 312, a DVD-RW drive 314, and a media I/F 316.

Of these, CPU 301 controls the operation of the entire management device 3. ROM 302 stores programs used to drive CPU 301, such as IPL. RAM 303 is used as a work area for CPU 301. HD 304 stores various data such as programs. HDD controller 305 controls the reading and writing of various data from HD 304 according to the control of CPU 301. Display 306 displays various information such as a cursor, menu, window, text, or image. Display 306 is an example of a display unit.

The external device connection I/F 308 is an interface for connecting various external devices. In this case, the external devices are, for example, a USB memory or a printer. The network I/F 309 is an interface for data communication using the communication network 100. The bus line 310 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 301 shown in FIG. 4.

The keyboard 311 is a type of input means equipped with multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 312 is a type of input means for selecting and executing various instructions, selecting a processing target, moving the cursor, etc. The DVD-RW drive 314 controls the reading and writing of various data from the DVD-RW 313, which is an example of a removable recording medium. Note that the medium is not limited to a DVD-RW, and may be a DVD-R or Blu-ray Disc, etc. The media I/F 316 controls the reading and writing (storing) of data from the recording medium 315, such as a flash memory.

○Hardware configuration of the analysis device○
Fig. 4 is a diagram showing an example of the hardware configuration of the analysis device. Each piece of hardware configuration of the analysis device 5 is indicated by a reference number in the 500 range in parentheses. As shown in Fig. 4, the analysis device 5 is constructed by a computer, and has the same configuration as the management device 3, as shown in Fig. 4, and therefore a description of each piece of hardware configuration will be omitted. Note that the communication terminals 1100 and 1200 are also constructed by a computer and have the same configuration as the management device 3, but a description of each piece of hardware configuration will be omitted.

The above programs may be recorded in a computer-readable recording medium as an installable or executable file and distributed. Examples of recording media include CD-Rs (Compact Disc Recordable), DVDs (Digital Versatile Discs), Blu-ray Discs, SD cards, USB memories, etc. The recording media may be provided domestically or internationally as a program product. For example, the analysis system 4 according to the embodiment realizes the analysis method according to the present invention by executing the program according to the present invention.

Functional Configuration Fig. 5 is a diagram showing an example of the functional configuration of the state inspection system according to the first embodiment. Note that Fig. 5 shows devices related to the processes or operations described below among those shown in Fig. 1.

○Functional configuration of data acquisition device○
First, a description will be given of the functional configuration of the data acquisition device 9. The data acquisition device 9 has a communication unit 91, a determination unit 92, an imaging device control unit 93, a sensor device control unit 94, a captured image data acquisition unit 95, a sensor data acquisition unit 96, a time data acquisition unit 97, a request acceptance unit 98, and a storage/readout unit 99. The data acquisition device 9 also has a storage unit 9000 constructed by the ROM 912 and HD 915 shown in FIG. 2.

Each of these units is a function or means realized when any of the components shown in FIG. 3 operates in response to an instruction from the CPU 911 in accordance with a program for the data acquisition device that is loaded from the HD 914 onto the RAM 913. The data acquisition device 9 also has a memory unit 9000 constructed by the ROM 912 and HD 914 shown in FIG. 3.

The communication unit 91 is mainly realized by the processing of the CPU 911 on the network I/F 916, and communicates various data or information with other devices via the communication network 100. The communication unit 91 transmits, for example, data acquired by the captured image data acquisition unit 95 and the sensor data acquisition unit 96 to the analysis device 5. The communication unit 91 is an example of a transmitting means and a receiving means. The judgment unit 92 is realized by the processing of the CPU 911, and makes various judgments.

The imaging device control unit 93 is mainly realized by the processing of the CPU 911 for the imaging device I/F 901, and controls the imaging processing by the imaging device 7. The sensor device control unit 94 is mainly realized by the processing of the CPU 911 for the sensor device I/F 902, and controls the data acquisition processing for the sensor device 8.

The photographed image data acquisition unit 95 is mainly realized by the processing of the CPU 911 for the photographing device I/F 901, and acquires brightness image data and parallax image data from the photographing device 7. For example, the photographed image data acquisition unit 95 can acquire images necessary for constructing a stereo image of the road surface R in the road width direction, for example, by a single photographing trigger from the photographing device control unit 93.

The sensor data acquisition unit 96 is mainly realized by the processing of the CPU 911 on the sensor device I/F 902, and acquires sensor data that is the detection result by the sensor device 8. The sensor data acquisition unit 96 is an example of a distance information acquisition unit and a position information acquisition unit. The time data acquisition unit 97 is mainly realized by the processing of the CPU 911 on the timer 924, and acquires time data indicating the time when data was acquired by the captured image data acquisition unit 95 or the sensor data acquisition unit 96.

The request reception unit 98 is mainly realized by the processing of the CPU 911 on the external device connection I/F 923, and receives a specific request from an external PC 930, etc.

The storage/reading unit 99 is mainly realized by the processing of the CPU 911, and stores various data (or information) in the storage unit 9000 and reads various data (or information) from the storage unit 9000.

The reception unit 81 is mainly realized by the processing of the CPU 911 on a keyboard or pointing device provided in the external PC 930, etc., and receives various selections or inputs. The reception unit 32 receives various selections or inputs on a display provided in the external PC 930, etc. The display control unit 82 is mainly realized by the processing of the CPU 911, and causes the display to display various images. The generation unit 83 is realized by the processing of the CPU 911, and generates a display screen, etc. The generation unit 83 is an example of a generation means.

○Functional configuration of management device○
Next, the functional configuration of the management device 3 will be described. The management device 3 has a communication unit 31, a reception unit 32, a display control unit 33, a judgment unit 34, an evaluation target data generation unit 35, a detection unit 36, a map data management unit 37, a report generation unit 38, and a storage/readout unit 39. Each of these units is a function or means realized by any of the components shown in Fig. 4 being loaded from the HD 304 onto the RAM 303 and operating according to an instruction from the CPU 301 in accordance with a program for the management device. The management device 3 also has a storage unit 3000 constructed by the ROM 302 and the HD 304 shown in Fig. 4.

The communication unit 31 is mainly realized by the processing of the CPU 301 on the network I/F 309, and communicates various data or information with other devices via the communication network 100. The communication unit 31 transmits and receives various data related to the analysis of road surface conditions, for example, with the analysis device 5. The communication unit 31 is an example of a transmitting means and a receiving means.

The reception unit 32 is mainly realized by the processing of the CPU 301 on the keyboard 311 or the pointing device 312, and receives various selections or inputs from the user. The reception unit 32 receives various selections or inputs on the display 306. The display control unit 33 is mainly realized by the processing of the CPU 301, and causes the display 306 to display various images. The judgment unit 34 is realized by the processing of the CPU 301, and makes various judgments. The reception unit 32 is an example of an operation reception means.

The evaluation target data generation unit 35 is realized by the processing of the CPU 301, and generates data to be evaluated. The detection unit 36 is mainly realized by the processing of the CPU 301, and performs a process of detecting the condition of the road surface using the evaluation target data generated by the evaluation target data generation unit 35. The map data management unit 37 is mainly realized by the processing of the CPU 301, and manages map information acquired from an external server, etc. The map information includes position information for any position on the map.

The report generation unit 38 is mainly realized by the processing of the CPU 301, and generates an evaluation report to be submitted to the road administrator based on the evaluation results.

The storage/reading unit 39 is mainly realized by the processing of the CPU 301, and stores various data (or information) in the storage unit 3000 and reads various data (or information) from the storage unit 3000. The storage/reading unit 39 is an example of an update means.

○Functional configuration of the analysis device○
Next, the functional configuration of the analysis device 5 will be described. The analysis device 5 has a communication unit 51, a judgment unit 52, a data management unit 53, a generation unit 54, a setting unit 55, an analysis unit 56, and a storage/readout unit 59. Each of these units is a function or means realized by any of the components shown in Fig. 4 being loaded from the HD 504 onto the RAM 503 and operating according to an instruction from the CPU 501 in accordance with a program for the analysis device. The analysis device 5 also has a storage unit 5000 constructed by the ROM 502 and the HD 504 shown in Fig. 4.

The communication unit 51 is mainly realized by the processing of the CPU 501 on the network I/F 509, and communicates various data or information with other devices via the communication network 100. The communication unit 51 receives, for example, captured image data and sensor data transmitted from the data acquisition device 9. The communication unit 51 also transmits and receives various data with, for example, the management device 3. The communication unit 51 is an example of a transmitting means and a receiving means. The determination unit 52 is an example of a position generating means, and is realized by the processing of the CPU 501, and performs various determinations.

The data management unit 53 is mainly realized by the processing of the CPU 501, and manages various data related to the evaluation of road surface conditions. For example, the data management unit 53 registers the captured image data and sensor data transmitted from the data acquisition device 9 in the acquired data management DB 5001. The data management unit 53 also registers, for example, data processed or generated by the management device 3 in the processed data management DB 5003. The generation unit 54 is mainly realized by the processing of the CPU 501, and generates various image data related to the road surface.

The generation unit 54 is realized by the processing of the CPU 301 and performs various generation operations. The setting unit 55 is realized by the processing of the CPU 301 and performs various settings. The analysis unit 56 is realized by the processing of the CPU 301 and performs various analyses.

The storage/reading unit 59 is mainly realized by the processing of the CPU 501 , and stores various data (or information) in the storage unit 5000 and reads various data (or information) from the storage unit 5000 .
○Functional configuration of communication terminal○

Next, the functional configuration of the communication terminal 1100 will be described. The communication terminal 1100 has a communication unit 1101, a reception unit 1102, a display control unit 1103, a judgment unit 1104, and a storage/reading unit 1105. Each of these units is a function or means realized when any of the components shown in FIG. 4 is expanded from the HD onto the RAM and operates according to an instruction from the CPU in accordance with a program for the communication terminal. The communication terminal 1100 also has a storage unit 1106 constructed by the ROM and HD shown in FIG. 4.

The communication unit 1101 is mainly realized by the processing of the CPU for the network I/F, and communicates various data or information with other devices via the communication network 100. The communication unit 1101 is an example of a transmitting means and a receiving means.

The reception unit 1102 is mainly realized by CPU processing on a keyboard or pointing device, and receives various selections or inputs from the user. The display control unit 1103 is mainly realized by CPU processing, and causes the display to display various images. The judgment unit 1104 is realized by CPU 301 processing, and makes various judgments. The reception unit 1102 is an example of an operation reception means.

The storage/reading unit 1105 is realized mainly by the processing of the CPU, and stores various data (or information) in the storage unit 1106 and reads various data (or information) from the storage unit 1106.

Next, the functional configuration of the communication terminal 1200 will be described. The communication terminal 1200 has a communication unit 1201, a reception unit 1202, a display control unit 1203, a judgment unit 1204, and a storage/readout unit 1205. Each of these units is a function or means realized when any of the components shown in FIG. 4 is expanded from the HD onto the RAM and operates according to an instruction from the CPU in accordance with a program for the communication terminal. The communication terminal 1200 also has a storage unit 1206 constructed by the ROM and HD shown in FIG. 4.

The communication unit 1201 is mainly realized by the processing of the CPU for the network I/F, and communicates various data or information with other devices via the communication network 100.

The reception unit 1202 is mainly realized by CPU processing on a keyboard or pointing device, and receives various selections or inputs from the user. The display control unit 1203 is mainly realized by CPU processing, and causes various images to be displayed on the display. The judgment unit 1204 is realized by CPU 301 processing, and makes various judgments.

The storage/reading unit 1205 is realized mainly by the processing of the CPU, and stores various data (or information) in the storage unit 1206 and reads various data (or information) from the storage unit 1206.

Figure 6 is a conceptual diagram showing an example of an image information management table. The image information management table is a table for managing various information associated with captured image information. An image information management DB 9001 composed of an image information management table such as that shown in Figure 6 is constructed in the memory unit 9000.

In this image information management table, for each piece of shooting data, the target area is divided into multiple shooting areas along the moving direction of the moving body 6, and multiple images captured by the shooting device 7 are stored in the order they were captured, and location information, time information, and confirmation information are associated with and managed for each piece of image information.

The shooting data shows data obtained by dividing the target area into multiple shooting areas along the direction of movement of the moving object 6, from the start of shooting by the shooting device 7 to the end of shooting.

The image information indicates each of the images captured by the imaging device by dividing the target area into multiple imaging areas along the direction of movement of the moving body 6.

The location information indicates the location when the image information was acquired, and the time information indicates the time when the image information was acquired.

The confirmation information includes condition information, structure information, and prediction information indicating the conditions when the image information does not satisfy the specified conditions. In the example of FIG. 6, "No Data" when there is no image information data, "High Brightness NG" when the brightness of the image information is not below the upper limit, and "Low Brightness NG" when the brightness of the image information is not above the lower limit are each managed as condition information associated with the image information.

In addition, "inside the tunnel" as structural information and "re-shooting postponed" as prediction information are each associated with image information and managed.

The structure information indicates the structure at the position indicated by the location information, and the prediction information indicates information predicting that the specified conditions will not be met even if the image is captured again by the image capture device at the position indicated by the location information.

Analysis Information Management Table Fig. 7 is a conceptual diagram showing an example of an analysis information management table. The analysis information management table is a table for managing primary analysis information and secondary analysis information obtained by analyzing measurement information. An analysis information management DB 3001 configured with an analysis information management table as shown in Fig. 7 is constructed in the storage unit 3000. In this analysis information management table, measurement information, position information, additional information, primary analysis information, and secondary analysis information are associated and managed for each section information.

The measurement information of the imaging device 7 includes brightness image data captured by the first camera 71 and the second camera 72, respectively, and parallax image data indicating parallax information from the first camera 71 and the second camera 72.

The location information includes the location information of the start point where the measurement information was obtained, and the location information of the end point. The additional information includes the measurement date and time when the measurement information was obtained, and the weather at that time.

Primary analysis information is numerical information that indicates cracks, etc. that have been analyzed without human intervention using AI analysis, etc. Secondary analysis information is performed not only automatically, but also manually. It differs from primary analysis information in that it is more accurate due to the use of human intervention and the inclusion of more detailed information, and that it has more analysis items. As an example of the inclusion of detailed information, the crack rate output in primary analysis is done only by counting the number of cracks, whereas in secondary analysis, based on the test method handbook, output is done using not only the number of cracks count information, but also the area count information of patching (partial repair marks). Examples of analysis items include the crack rate, rutting amount, flatness, IRI, MCI, etc. mentioned above.

Processing or Operation of the Embodiment FIG. 8 is a flowchart showing the image confirmation processing.

When the reception unit 81 of the data acquisition device 9 receives an operation to specify shooting data, the storage/reading unit 99 reads out the image information of the first image taken in the order of shooting from the specified shooting data in the image information management DB 9001, and the judgment unit 92 judges whether the image information includes brightness data (step S31).

If brightness data is not included in step S31, the storage/reading unit 99 writes confirmation information indicating "no brightness data" to the image information management DB 9001 in association with the image information (step S32).

If brightness data is included in step S31, the determination unit 92 determines whether the brightness of the image information exceeds an upper limit value (step S33). This upper limit value is set to a value that allows the analysis device 5 to perform image analysis of the captured image.

If the upper limit is exceeded in step S33, the storage/readout unit 99 writes confirmation information "high brightness NG" to the image information management DB 9001 in association with the image information (step S34).

If the upper limit is not exceeded in step S33, the determination unit 92 determines whether the brightness of the image information is less than a lower limit (step S35). This lower limit is set to a value that allows the analysis device 5 to perform image analysis of the captured image.

If the result in step S35 is less than the lower limit, the storage/readout unit 99 writes confirmation information "low brightness NG" to the image information management DB 9001 in association with the image information (step S36).

The memory/read unit 99 reads out the location information corresponding to the image information from the image information management DB 9001, and the judgment unit 92 judges whether the captured image was captured inside a tunnel based on the location information and map information read out by the memory/read unit 99 (step S37). The map information may be stored in the memory unit 9000, or may be obtained from the map data management unit 37 of the management device 3.

If it is determined in step S37 that the image was taken inside a tunnel, the storage/readout unit 99 writes confirmation information "re-shooting postponed" and "inside a tunnel" to the image information management DB 9001 in association with the image information (step S38).

The determination unit 92 determines whether all captured images in the specified shooting data have been checked (step S39), and if the next image remains, the storage/reading unit 99 reads out the next image information in the shooting order from the specified shooting data in the image information management DB 9001 (step S40), and returns to step S31 to continue processing.

When all captured images have been confirmed in step S39, the storage/readout unit 99 reads out the image information, location information, time information, and condition information of the specified captured data from the image information management DB 9001, the generation unit 83 generates a display screen based on the various information and map information read out from the image information management DB 9001, and the display control unit 82 displays the display screen on a display provided in the external PC 930 or the like (step S41). Step S41 is an example of a generation step and a display step.

In the above flowchart, if it is determined in step S37 that the image was taken inside a tunnel, it is determined in step S38 that "re-shooting should be postponed." However, if it is determined in step S37 that the image was not taken inside a tunnel, the following further determinations may be made.

In other words, an image of the area in front of the moving body 6 may be captured separately from the stereo camera, and if there is a sun-blocking object such as a tree or a high-rise building, it may be determined that "re-shooting should be postponed" based on the illuminance value measured by a light meter installed on the moving body 6.

Specifically, if a sunshade is present, a judgment may be made to "postpone reshooting" by comparing the illuminance ratio between illuminance A under open sky conditions in the same measurement time period (e.g., the highest illuminance value within the past 30 minutes to 1 hour) and the maximum illuminance value B possible in the same season (a value measured and stored in advance) with a threshold value. As the maximum illuminance value B, rather than using the maximum illuminance value as is, a value less than 1.0 and greater than or equal to 0.6 times the maximum illuminance value B may be used to provide a range of time periods in which reshooting is possible.

Figure 9 is an example of a display screen. Figure 9 shows a display screen 2000 that is generated by the generation unit 83 in step S41 of Figure 8 and displayed on the display by the display control unit 82.

The display screen 2000 displays route information 2010-2070 for each piece of shooting data superimposed on a map 2100, and displays location information 2011-2041 superimposed on each piece of route information 2010-2070.

The route information 2010 to 2070 indicates a route on a map 2100 captured by the image capture device 7, with the target area divided into multiple image capture areas along the movement direction of the mobile object 6. The generation unit 83 generates a display screen 2000 that displays the route information 2010 to 2070 for each captured data superimposed on the map 2100, based on the position information for each captured data and the map information shown in FIG. 6.

The location information 2011 to 2041 indicates the shooting location on the map of the captured image that does not satisfy the specified conditions, and the generation unit 83 generates a display screen 2000 that displays the location information 2011 to 2041 superimposed on the route information 2010 to 2070 for each captured data on the map 2100 based on the confirmation information and location information for each captured data shown in FIG. 6 and the map information.

The display screen 2000 displays confirmation information 2011C to 2041C in association with location information 2011 to 2041.

Confirmation information 2011C to 2041C includes condition information, section information, time information, structure information, and prediction information.

Here, the condition information indicates a predetermined condition that is not satisfied by the captured image at the position indicated by the position information 2011 to 2041, the time information indicates the time of capture at the position indicated by the position information 2011 to 2041, the structure information indicates the structure at the position indicated by the position information 2041, and the prediction information indicates information predicting that the predetermined condition will not be satisfied even if another image is captured by the image capture device at the position indicated by the position information 2041.

The generation unit 83 generates a display screen 2000 that displays confirmation information 2011C to 2041C in association with the location information 2011 to 2041 based on the confirmation information and location information for each piece of shooting data shown in FIG. 6 and the map information.

Specifically, the display screen 2000 displays the location information 2011 superimposed on the route information 2010 related to the shooting data 1, and displays the confirmation information 2011C in association with the location information 2011.

The confirmation information 2011C includes "high brightness NG" indicating condition information, "about **m" indicating section information which is the length of the section in which image information determined to be high brightness NG continues, and "date and time XXX" indicating time information.

This allows the user to easily check the shooting locations of captured images that do not satisfy the specified conditions based on the location information 2011 and the section information, and therefore allows the user to efficiently move the moving object for re-shooting.

The user can also confirm that the reason the captured image does not meet the specified conditions is because it is "high brightness NG," i.e., too bright, and if the time information indicates, for example, a time when sunlight is strong, the user can decide to retake the image when the sunlight is weaker.

Next, the display screen 2000 displays the location information 2031 superimposed on the route information 2030 related to the shooting data 3, and displays the confirmation information 2031C in association with the location information 2031.

The confirmation information 2031C includes "Low brightness NG" indicating condition information, "About **m" indicating section information which is the length of the section in which image information determined to be low brightness NG continues, and "Date and time XXX" indicating time information.

This allows the user to easily check the shooting locations of images that do not satisfy the specified conditions based on the location information 2031 and the section information, and therefore allows the user to efficiently move the moving object for reshooting.

The user can also confirm that the reason the captured image does not meet the specified conditions is because it is "low brightness NG," i.e., too dark, and if the time information indicates, for example, a time when sunlight is weak, the user can decide to retake the image when sunlight is strong.

Furthermore, the display screen 2000 displays location information 2041 superimposed on the route information 2040 related to the shooting data 4, and displays confirmation information 2041C in association with the location information 2041.

The confirmation information 2041C includes "Low brightness NG" indicating condition information, "About **m" indicating section information which is the length of the section in which image information determined to be low brightness NG continues, "Date and time XXX" indicating time information, "Inside tunnel" indicating structure information, and "Reshooting postponed" indicating prediction information.

This allows the user to easily check the shooting locations of images that do not satisfy the specified conditions based on the location information 2031 and the section information.

The user can also confirm that the reason the captured image does not satisfy the specified conditions is because it is "low brightness NG," i.e., too dark. Based on "inside a tunnel," which indicates structure information, and "re-shooting postponed," which indicates prediction information, the user can determine that it will be difficult for the captured image to satisfy the specified conditions even if re-shooting is performed, and can therefore give up on moving the moving object to re-shoot.

The display screen 2000 described above may be generated by a generation unit provided in the management device 3. In this case, the communication unit 31 of the management device 3 transmits display screen information indicating the display screen 2000 to the data acquisition device 9, the communication unit 91 of the data acquisition device 9 receives the display screen information, and the display control unit 82 of the data acquisition device 9 displays the display screen 2000 on the display.

Data analysis and processing
FIG. 10 is a sequence diagram illustrating an example of a data analysis process.

The processing of communication terminals 1100 and 1200 will be described in terms of the processing of communication terminal 1100, but the processing of communication terminal 1200 is similar.

The communication unit 91 of the data acquisition device 9 transmits the measurement information, location information, and additional information to the management device 3 in association with each other, and the communication unit 31 of the management device 3 receives this information (step S1). Step S1 is an example of a receiving step.

If the location information and measurement information corresponding to the location information and measurement information received in step S1 are not stored in the analysis information management DB 3001, the storage/reading unit 39 associates the measurement information received in step S1 with the location information and additional information received in step S1 and stores the measurement information received in step S1 in the analysis information management DB 3001.

In addition, if the location information and measurement information corresponding to the location information and measurement information received in step S1 are already stored in the analysis information management DB 3001 and a specific update condition is satisfied, the storage and reading unit 39 associates the measurement information received in step S1 with the location information and additional information received in step S1, stores the measurement information received in step S1 in the analysis information management DB 3001, and updates it (step S2).

The communication unit 31 transmits the measurement information stored or updated in step S2 to the analysis device 5 in association with the location information and the primary analysis request, and the communication unit 51 of the analysis device 5 receives this information (step S3).

Based on the primary analysis request received in step S3, the analysis unit 56 performs a primary analysis of the measurement information received in step S3, and stores the primary analysis information in the memory unit 5000 in association with the location information and the measurement information (step S4).

The communication unit 51 associates the primary analysis information analyzed in step S4 with the location information received in step S3 and transmits it to the management device 3, and the communication unit 31 of the management device 3 receives this information (step S5).

If the location information and primary analysis information corresponding to the location information and primary analysis information received in step S5 are not stored in the analysis information management DB 3001, the storage/reading unit 39 stores the primary analysis information received in step S5 in the analysis information management DB 3001 in association with the location information received in step S5.

If the location information and primary analysis information corresponding to the location information and primary analysis information received in step S5 are already stored in the analysis information management DB 3001, the storage and reading unit 39 updates the primary analysis information received in step S5 by storing it in the analysis information management DB 3001 in association with the location information received in step S5 (step S6). Step S6 is an example of an update step.

The communication unit 31 transmits the primary analysis information stored or updated in step S6 to the communication terminal 1100 in association with the location information and measurement information, and the communication unit 1101 of the communication terminal 1100 receives this information (step S7).

The display control unit 1203 associates the primary analysis information received in step S7 with the location information and measurement information and displays it on the display (step S8), and the reception unit 1102 receives a secondary analysis request for the primary analysis information displayed in step S8 (step S9).

The display control unit 1203 may display the primary analysis information and measurement information at a position corresponding to the position information on the map displayed on the display, and may display updated primary analysis information and measurement information so that they can be distinguished from other primary analysis information and measurement information.

The communication unit 1101 transmits the secondary analysis request received in step S9 to the management device 3 in association with the location information, and the communication unit 31 of the management device 3 receives this information (step S10).

The communication unit 31 transmits the secondary analysis request and location information received in step S10 to the analysis device 5, and the communication unit 51 of the analysis device 5 receives this information (step S11).

Based on the secondary analysis request and location information received in step S11, the analysis unit 56 performs a secondary analysis of the measurement information stored in the memory unit 5000 in association with the location information in step S4, and stores the secondary analysis information in the memory unit 5000 in association with the location information and the measurement information (step S12).

The communication unit 51 associates the secondary analysis information analyzed in step S12 with the location information received in step S11 and transmits it to the management device 3, and the communication unit 31 of the management device 3 receives this information (step S13).

If the location information and secondary analysis information corresponding to the location information and secondary analysis information received in step S13 are not stored in the analysis information management DB 3001, the storage/reading unit 39 stores the secondary analysis information received in step S13 in the analysis information management DB 3001 in association with the location information received in step S13.

In addition, if the location information and secondary analysis information corresponding to the location information and secondary analysis information received in step S13 are already stored in the analysis information management DB 3001, the storage and reading unit 39 associates the secondary analysis information received in step S13 with the location information received in step S13, stores it in the analysis information management DB 3001, and updates it (step S14).

The communication unit 31 transmits the secondary analysis information stored or updated in step S14 to the communication terminal 1100 in association with the location information and measurement information, and the communication unit 1101 of the communication terminal 1100 receives this information (step S15).

The display control unit 1203 associates the secondary analysis information received in step S15 with the location information and measurement information and displays it on the display (step S16).

The display control unit 1203 may display the secondary analysis information and the measurement information at a position corresponding to the position information on the map displayed on the display, and may display the updated secondary analysis information so that it can be distinguished from other secondary analysis information.

In the above, the analysis device 5 may be integrated with the management device 3, in which case steps S3, S5, S11 and S13 relating to transmission and reception are unnecessary, and steps S4 and S12 are executed by an analysis unit provided in the management device 3.

In addition, the communication terminal 1100 or 1200 may be integrated with the management device 3, in which case steps S7, S10 and S15 relating to transmission and reception are unnecessary, steps S8 and S16 are executed by the display control unit 33, and step S9 is executed by the reception unit 32.

As described above, the management device 3 manages primary analysis information obtained by analyzing the measurement information of the road surface R without basing it on an analysis request, and secondary analysis information obtained by analyzing the measurement information based on the primary analysis information and the analysis request. This makes it possible to obtain analysis information more quickly than when the road surface R is measured after receiving an analysis request, and to obtain analysis information for the required measurement information more efficiently and without waste than when analyzing the information at its final quality in advance before receiving an analysis request.

In particular, when a general vehicle such as a parcel delivery vehicle is used as the mobile object 6, the road surface R can be easily measured before receiving an analysis request without incurring the costs of a dedicated vehicle, and primary analysis information can be obtained more easily by using AI or analyzing simple content than when analyzing at final quality.

The user can then appropriately determine whether or not to issue an analysis request based on updated primary analysis information, compared to when the user has to determine whether or not to issue an analysis request based on non-updated primary analysis information.

In other words, even if the need for an analysis request cannot be determined based on old primary analysis information, it will be possible to determine the need for an analysis request based on updated primary analysis information.

In addition, by the management device 3 sending the updated primary analysis information, the user can check the updated primary analysis information received by the communication terminals 1100 and 1200 and appropriately determine whether or not to issue an analysis request, and the management device 3 can receive an appropriate analysis request based on the updated primary analysis information.

In addition, the display control unit 33 displays the primary analysis information on the display 306, allowing the user to appropriately determine whether or not to issue an analysis request.

In other words, unless a user is highly experienced, it is difficult for the user to determine whether or not to issue an analysis request by simply checking the measurement information. However, by checking the primary analysis information, which is a simplified analysis of the measurement information, the user can appropriately determine whether or not to issue an analysis request.

In addition, the display control unit 33 associates the measurement information with the primary analysis information and displays them on the display 306, allowing the user to more appropriately determine whether or not to issue an analysis request.

In addition, the display control unit 33 displays the updated primary analysis information on the display 306, allowing the user to check the updated primary analysis information and appropriately determine whether or not to issue an analysis request, and the reception unit 32 can receive an appropriate analysis request based on the updated primary analysis information.

Figure 11 is a flowchart showing the measurement information update process, and shows the specific process corresponding to step S2 in Figure 10.

If the determination unit 34 determines that the location information and measurement information corresponding to the location information and measurement information received in step S1 are not stored in the analysis information management DB 3001 (step 21), the storage/reading unit 39 stores the measurement information received in step S1 in the analysis information management DB 3001 in association with the location information and additional information received in step S1 (step S22).

On the other hand, if it is determined in step S21 that the location information and measurement information corresponding to the received location information and measurement information are already stored in the analysis information management DB 3001, the determination unit 34 determines whether the secondary analysis information associated with the location information received in step S1 is stored in the analysis information management DB 3001 (step S23).

This allows new measurement information to be stored or existing measurement information to be updated depending on the position of the road surface R, so that new primary analysis information can be stored or existing primary analysis information can be updated depending on the position of the road surface R.

If it is determined in step S23 that the secondary analysis information is already stored in the analysis information management DB 3001, the determination unit 34 determines whether the measurement date of the measurement information received in step S1 has passed a predetermined number of days or more with respect to the measurement date of the measurement information corresponding to the secondary analysis information stored in the analysis information management DB 3001 (step S24).

If it is determined in step S24 that the predetermined number of days has not passed, the process is terminated. If the predetermined number of days has passed, the storage and reading unit 39 associates the measurement information received in step S1 with the location information and additional information received in step S1, and stores and updates the measurement information received in step S1 in the analysis information management DB 3001 (step S27).

As a result, if the measurement date of the measurement information received in step S1 is less than a predetermined number of days away from the measurement date of the measurement information corresponding to the already stored secondary analysis information, it is assumed that the road surface R is unlikely to have deteriorated over time, and the measurement information is not updated, thereby preventing unnecessary analysis and updating of the primary analysis information.

On the other hand, if the measurement date of the measurement information received in step S1 is more than a predetermined number of days away from the measurement date of the measurement information corresponding to the already stored secondary analysis information, it is assumed that there is a high possibility that the road surface R has deteriorated over time, and the measurement information is updated, making it possible to confirm from the primary analysis information that the road surface R has deteriorated over time.

When the measurement information is updated in step S27, the primary analysis information is also updated as described in steps S2 to S6 of FIG. 10.

If it is determined in step S23 that the secondary analysis information is not stored in the analysis information management DB 3001, the determination unit 34 determines whether the measurement information received in step S1 satisfies a specified update condition (step S25).

If the update conditions are met in step S25, the process proceeds to step S27, where the storage and reading unit 39 associates the measurement information received in step S1 with the location information and additional information received in step S1, and stores and updates the measurement information received in step S1 in the analysis information management DB 3001.

As a result, if the received additional information satisfies a specified update condition, the primary analysis information can be analyzed and updated by updating the measurement information.

Specifically, if the measurement time of the measurement information already stored was in the evening, but the measurement time of the measurement information received in step S1 was during the day, it is assumed that the measurement accuracy is better during the day, and the update condition is met.

In addition, if the weather at the time of measurement in the measurement information already stored was rainy, but the weather at the time of measurement in the measurement information received in step S1 was sunny, it is assumed that sunny weather provides better measurement accuracy, and the update condition is satisfied.

In other words, by updating to more accurate measurement information, it is possible to analyze more accurate primary analysis information.

On the other hand, if the update conditions are not met in step S25, the judgment unit 34 judges whether the additional information received in step S1 meets the specified update conditions (step S26).

If the update conditions are met in step S26, the process proceeds to step S27, where the storage/readout unit 39 associates the measurement information received in step S1 with the location information and additional information received in step S1, stores the measurement information received in step S1 in the analysis information management DB 3001, and updates it. If the update conditions are not met in step S26, the process ends.

●Summary●
[First aspect]
As described above, the data acquisition device 9, which is an example of an information processing device according to one embodiment of the present invention, is equipped with a generation unit 83 that generates a display screen 2000 that displays location information 2011-2041 indicating the shooting location of an image that is captured by an imaging device 7 installed on a moving body 6 and does not satisfy specified conditions.

This makes it easy to check the shooting position of an image that does not meet the specified conditions, making it easy to retake the image at that shooting position.

[Second aspect]
In the first aspect, the position information 2011 to 2041 indicates a position on a map, and the display screen 2000 displays the position information 2011 to 2041 superimposed on the map 2100.

This makes it easy to check on the map the shooting locations of images that do not satisfy the specified conditions. Note that the location information 2011 to 2041 is not limited to information that is superimposed on the map and may be, for example, information indicating latitude and longitude as text information, or information indicating landmarks such as structures near the shooting locations of images that do not satisfy the specified conditions.

[Third aspect]
In the second mode, the display screen 2000 divides the target area into multiple shooting areas along the movement direction of the moving body 6 and displays route information 2010-2070 indicating the route on a map 2100 photographed by a photographing device 7, and location information 2011-2041, superimposed on the map 2100.

This makes it easy to check the shooting locations of images along the route of the target area that do not meet the specified conditions.

[Fourth aspect]
In any of the first to third aspects, the specified condition includes a plurality of conditions, and the display screen 2000 displays confirmation information 2011C to 2041C including condition information indicating any one of the plurality of conditions, in association with the location information 2011 to 2041.

This allows you to check which of multiple conditions the shooting position of an image that does not satisfy a certain condition does not satisfy.

[Fifth aspect]
In any of the first to fourth aspects, confirmation information 2011C to 2041C including time information indicating the time of shooting at the position indicated by the position information 2011 to 2041 is displayed in association with the position information 2011 to 2041.

This makes it possible to determine the reason why a photographed image does not satisfy a specified condition based on the photographing time for the photographed position of the image.

[Sixth aspect]
In any of the first to fifth aspects, confirmation information 2041C including structure information indicating a structure at a position indicated by the position information 2041 is displayed in association with the position information 2041.

This makes it possible to determine the reason why a photographed image does not meet a specified condition based on the presence or absence of a structure such as a tunnel.

[Seventh aspect]
In any of the first to sixth aspects, confirmation information 2041C including prediction information predicting that a specified condition will not be satisfied even if an image is captured again by an image capturing device at the position indicated by the position information 2041 is displayed in correspondence with the position information 2041.

This makes it possible to reduce unnecessary labor required to retake images at positions that do not meet certain conditions.

[Eighth aspect]
In any of the first to seventh aspects, whether or not a predetermined condition is satisfied is determined based on whether or not image analysis of the captured image is possible.

This allows you to check the shooting position of the captured image that does not meet the specified conditions before performing image analysis of the captured image, and then take the image again at that shooting position, preventing the target captured image from being missing when performing image analysis of the captured image.

[Ninth aspect]
In any of the first to eighth aspects, whether or not the predetermined condition is satisfied is determined based on luminance information indicating the luminance of the captured image.

This makes it possible to check the shooting position of an image where the brightness does not meet the specified conditions, and by taking the image again at that shooting position, it is possible to obtain an image where the brightness meets the specified conditions.

[Tenth aspect]
An information processing method according to one embodiment of the present invention executes a generation step S41 for generating a display screen 2000 that displays location information 2011-2041 indicating the shooting location of an image that is captured by an image capturing device installed on a moving body and does not satisfy specified conditions.

[Eleventh aspect]
An information processing method according to one embodiment of the present invention executes a display step S41 in which location information 2011-2041 indicating the shooting location of an image captured by an image capturing device installed on a moving body and not satisfying a predetermined condition is displayed on a display unit.

[Twelfth aspect]
A program according to an embodiment of the present invention causes a computer to execute the information processing method of the tenth or eleventh aspect.

[Thirteenth aspect]
A mobile body system 60, which is an example of an imaging system according to one embodiment of the present invention, includes an imaging device 7 installed on a mobile body 6, and a display control unit 82 that displays, on a display unit of an external PC 930, location information 2011 to 2041 indicating the imaging location of an image that is captured by the imaging device 7 and does not satisfy predetermined conditions.

[14th aspect]
In the thirteenth aspect, a generation unit 83 is provided that generates a display screen 2000 that displays the position information 2011 to 2041 , and a display control unit 82 causes the display screen 2000 to be displayed on the display unit of the external PC 930 .

[Fifteenth aspect]
A status inspection system 1, which is an example of an analysis system according to an embodiment of the present invention, comprises a mobile system 60 described in the thirteenth or fourteenth aspect, and an analysis device 5 that analyzes the captured image, and whether or not a specified condition is met is determined based on whether or not the captured image is capable of being analyzed by the analysis device 5.

●Additional Information●
Each function of the above-described embodiment can be realized by one or more processing circuits. Here, the "processing circuit" in the present embodiment includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and devices such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), an SOC (System on a chip), a GPU (Graphics Processing Unit), and a conventional circuit module designed to execute each function described above.

1. Status inspection system (an example of an information processing system)
3 Management device 4 Analysis system 5 Analysis device (an example of an information processing device)
6 Mobile object 7 Photographing device 8 Sensor device 8 GNSS sensor 9 Data acquisition device (an example of a communication terminal)
92 Determination unit 93 Shooting device control unit (an example of an angle changing unit)
96 Sensor data acquisition unit (an example of a distance information acquisition unit or a position information acquisition unit)
31 Communication unit (an example of a receiving means)
32 Reception unit (an example of an operation reception means)
33 Display control unit (an example of a display control means)
34 Judgment unit 35 Evaluation target data generation unit (an example of evaluation target data generation means)
36 Detection unit (an example of a detection means)
38 Report generation unit (an example of an evaluation information generation means)
39 Memory/read unit (an example of an updating means)
3001 Analysis information management DB
51 Communication unit (an example of a transmission means)
52 Determination unit (an example of a position generating means)
54 Generation unit (an example of an image generation means)
55 Setting unit (an example of a setting means)
56 Analysis unit (an example of an analysis means)
59 Memory/read unit (an example of a memory control means)
60 Mobile system (an example of a photography system)
71, 72 First and second image capturing devices 1100 Communication terminal (an example of a terminal device)
1200 Communication terminal (an example of a terminal device)
2000 Display screen 2010, 2020, 2030, 2040, 2060, 2070 Route information 2011, 2031, 2041 Position information 2011C, 2031C, 2041C Confirmation information (condition information, time information, structure information, and prediction information)
2100 Map

Claims (15)

An information processing device having a generation means for generating a display screen that displays location information indicating the shooting location of an image captured by a camera installed on a moving object and that does not satisfy a predetermined condition. the location information indicates a location on a map;
The information processing apparatus according to claim 1 , wherein the display screen displays the location information superimposed on the map. The information processing device according to claim 2, wherein the display screen displays route information indicating a route on a map captured by the image capture device by dividing a target area into a plurality of image capture areas along the moving direction of the moving body, and the location information superimposed on the map. The predetermined condition includes a plurality of conditions,
The information processing apparatus according to claim 1 , wherein the display screen displays condition information indicating any one of the plurality of conditions in association with the position information. The information processing device according to claim 1, which displays time information indicating the time of shooting at the position indicated by the position information in association with the position information. The information processing device according to claim 1, which displays structure information indicating a structure at a position indicated by the position information in association with the position information. The information processing device according to claim 1, which displays, in association with the location information, prediction information predicting that the predetermined condition will not be satisfied even if the image is captured again by the image capture device at the position indicated by the location information. The information processing device according to claim 1, wherein whether or not the predetermined condition is satisfied is determined based on whether or not image analysis of the captured image is possible. The information processing device according to claim 1, wherein whether or not the predetermined condition is satisfied is determined based on luminance information indicating the luminance of the captured image. An information processing method that executes a generation step of generating a display screen that displays location information indicating the shooting location of an image captured by a camera installed on a moving object and that does not satisfy a predetermined condition. An information processing method that executes a display step of displaying, on a display unit, location information indicating the location of an image captured by a camera installed on a moving object and that does not satisfy a predetermined condition. A program for causing a computer to execute the information processing method according to claim 10 or 11. A photographing system including a photographing device installed in a moving body,
The photographing system further comprises a display control means for displaying, on a display unit, position information indicating a photographing position of a photographed image photographed by the photographing device and not satisfying a predetermined condition. a generating means for generating a display screen for displaying the position information,
14. The photographing system according to claim 13, wherein the display control means causes the display screen to be displayed on the display unit. 15. An analysis system comprising the photographing system according to claim 13 or 14 and an analysis device that analyzes the photographed image,
An analysis system in which whether or not the predetermined condition is satisfied is determined based on whether or not the captured image can be subjected to image analysis by the analysis device.