JP2017173054A - Device, method and program for inspecting solar panel - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a solar panel inspection method which allows an abnormal part of solar panels to be automatically detected with high accuracy.SOLUTION: A panel inspection device 50A comprises: inspection range detection means 54 which detects respective ranges of solar panels 21 to be inspected, on the basis of a temperature distribution appearing in a thermal image 22 obtained by photographing the solar panels from above; abnormality detection means 55 which detects abnormal panels by, if the presence of a part exhibiting temperature abnormality in a detected range of a solar panel is determined, determining this solar panel to be abnormal; position information acquisition means 56 which acquires photographing position information of the image used for detecting respective ranges of the solar panels; and display processing means 57A which generates an inspection result image including inspection result information indicative of at least detected abnormal solar panels out of the solar panels to be inspected, over a map shown by read map information.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a solar panel inspection apparatus, inspection method, and inspection program.

  In a conventional solar panel inspection, an inspector moves through a vast solar power plant and visually observes the solar panel, or uses a desired type of image such as a visible image or infrared image of the acquired solar panel. Since the solar panels are visually inspected one by one for the presence of hot spots, which are local high-temperature locations, the inspection takes a lot of time.

  In recent years, from the viewpoint of reducing the burden on the inspector's movement, for example, a remotely controlled mobile object such as a radio control helicopter equipped with an imaging device that images solar panels can be used in a large solar power plant. There has been proposed a solar panel inspection technique for obtaining an image (inspection image) that is moved and used for inspection of an infrared image or the like of a solar panel.

JP2015-146371A

  In the case of solar panel inspection, we want to obtain a bird's-eye view of the solar panel taken from above, so the types of mobile objects are, for example, radio controlled aircraft, unmanned aircraft systems (UAS), small manned aircraft, etc. An aircraft capable of aerial photography with a desired image quality and range is preferred.

  However, even if the moving body acquires a desired type of image, the number of images to be acquired is enormous and varies depending on the scale of the solar power plant. Hundreds, or thousands if many. In the conventional solar panel inspection apparatus, it is the inspector who confirms the acquired image, and the burden of confirmation by the inspector is still enormous.

  Further, since solar panels are arranged in an orderly manner at the solar power plant, it is difficult for the inspector to specify the position of the abnormal location from the acquired image, and there are many burdens.

  On the other hand, from the viewpoint of inspection accuracy, the method of inspecting hot spots by visual confirmation using an image showing a temperature distribution such as an infrared image (hereinafter referred to as “thermal image”) for inspection is visually Since it depends on the judgment of the inspector to confirm, there is a problem that the judgment result varies.

  Further, when using a thermal image for inspection, the risk of erroneous determination increases due to the temperature environment at the time of image acquisition. For example, when the temperature of the solar panel and the temperature other than the solar panel are close, it is difficult to determine the contour of the solar panel, so that there is a high possibility that the range of the solar panel is erroneous. In addition, in a temperature environment exceeding a certain temperature, there is a high possibility that a hot spot other than the solar panel is erroneously determined as a hot spot.

  Further, when a thermal image is used for inspection, there are abnormalities that are not accompanied by a heat generation phenomenon such as cracks. Therefore, in the confirmation by the thermal image, there is a possibility that an abnormal part without the heat generation phenomenon is overlooked. In other words, there is a possibility of an erroneous determination that an abnormal location that does not exhibit healthy performance is determined as a normal location that exhibits healthy performance.

  The present invention has been made in consideration of the above-described circumstances, and an object thereof is to provide a solar panel inspection apparatus, inspection method, and inspection program capable of automatically detecting an abnormal portion of a solar panel with higher accuracy than before. And

  In order to solve the above-described problem, the solar panel inspection apparatus according to the embodiment of the present invention is based on a temperature distribution that appears in a thermal image obtained by photographing the solar panel to be inspected from above. If it is determined that there is a portion indicating a temperature abnormality in the range of each of the solar panels detected by the inspection range detection means, the inspection range detection means including a first inspection range detection unit for detecting the solar panel Abnormality detection means having a first abnormality detection unit for determining abnormalities and detecting abnormal solar panels, and photographing of images used when the inspection range detection means detects the ranges of the solar panels to be inspected Read position information acquisition means for acquiring position information of the position, and map information including position information where the position of the solar panel to be inspected is written, The range of each of the solar panels to be inspected detected by the inspection range detecting means, the positional information of the photographing position of the image acquired by the positional information acquiring means, and the abnormal detecting means detecting an abnormal solar panel The inspection includes at least inspection result information indicating the abnormal solar panel among the solar panels to be inspected on the map indicated by the map information based on the abnormal solar panel and the read map information. And display processing means for generating a result image.

  In order to solve the above-described problem, the solar panel inspection method according to the embodiment of the present invention is based on the temperature distribution that appears in a thermal image obtained by photographing the solar panel to be inspected from above, and the range of each solar panel to be inspected. If it is determined that there is a portion indicating a temperature abnormality in the range of each of the solar panels detected by the inspection range detection means, the inspection range detection means including a first inspection range detection unit for detecting the solar panel Abnormality detection means having a first abnormality detection unit for determining abnormalities and detecting abnormal solar panels, and photographing of images used when the inspection range detection means detects the ranges of the solar panels to be inspected Position information acquisition means for acquiring position information, ranges of the solar panels to be inspected detected by the inspection range detection means, and the position information Based on the information on the shooting position of the image acquired by the acquisition unit and the abnormal solar panel when the abnormality detection unit detects an abnormal solar panel, the abnormal solar panel among the solar panels to be inspected A solar panel inspection procedure using a solar panel inspection device comprising a display processing means for generating an inspection result image including inspection result information indicating a solar panel as distinguished from other solar panels, the solar panel inspection procedure The inspection range detecting step includes a first inspection range detecting step for detecting a range of each of the solar panels to be inspected based on a temperature distribution appearing in the thermal image, and the abnormality detecting means. However, it is determined that there is a portion indicating a temperature abnormality from the range of each of the solar panels detected in the inspection range detection step. In this case, it is determined that the solar panel is abnormal, and an abnormality detection step including a first abnormality detection step of detecting an abnormal solar panel, and the position information acquisition unit includes the solar panel in the inspection range detection step. A position information acquisition step of acquiring information on the photographing position of an image used when detecting the range of the solar panel, the range of each of the solar panels detected by the display processing means in the inspection range detection step, and the acquisition of the position information Among the solar panels to be inspected based on the information of the photographing position of the image acquired in the process and the detected abnormal solar panel when the abnormal solar panel is detected in the abnormality detecting process A display processing step of generating an inspection result image including inspection result information indicating the abnormal solar panel as distinguished from other solar panels. It is characterized by doing.

  In order to solve the above-described problem, the solar panel inspection program according to the embodiment of the present invention sets the range of the solar panel to be inspected based on the temperature distribution appearing in the thermal image obtained by photographing the solar panel to be inspected from above. If it is determined that there is a part indicating a temperature abnormality from the range of the solar panel detected in the inspection range detection step and the inspection range detection step including the first inspection range detection step to detect, the solar panel is regarded as abnormal Determining and obtaining an abnormality detection step comprising a first abnormality detection step for detecting an abnormal solar panel, and information on a photographing position of an image used when detecting the range of the solar panel in the inspection range detection step; In the position information acquisition step, the range of the solar panel detected in the inspection range detection step, and the position information acquisition step The abnormal detection of the abnormal solar panel based on the obtained information on the photographing position of the image and the abnormal solar panel detected when the abnormal solar panel is detected in the abnormality detection step. A computer is caused to execute the solar panel inspection procedure including a display processing step of generating an inspection result image showing the solar panel to be inspected separately from the solar panel that is not determined to be abnormal in the process. And

  According to the present invention, an abnormal part of a solar panel can be automatically detected with higher accuracy than in the past.

Schematic which showed the hardware structural example of the inspection apparatus of the solar panel which concerns on embodiment of this invention. Explanatory drawing which shows the example of acquisition of the image used when the inspection apparatus of the solar panel which concerns on embodiment of this invention determines the presence or absence of abnormality about each solar panel. The functional block diagram which shows the functional structural example of the panel inspection apparatus which concerns on the 1st Embodiment of this invention. The processing flowchart which shows the flow of the process of the panel inspection procedure (1st-3rd panel inspection procedure) which the panel inspection apparatus which concerns on embodiment of this invention performs. The processing flowchart which shows the flow of a process of the 1st test | inspection range detection process in the panel test | inspection procedure which the panel test | inspection apparatus which concerns on embodiment of this invention performs. The processing flowchart which shows the flow of a process of the hot spot detection process in the panel inspection procedure which the panel inspection apparatus which concerns on the 1st Embodiment of this invention performs. The processing flowchart which shows the flow of a process of the unusual location detection process in the panel inspection procedure which the panel inspection apparatus which concerns on the 1st Embodiment of this invention performs. The processing flowchart which shows the flow of a process of the 1st test result image generation process in the panel test | inspection procedure which the panel test | inspection apparatus which concerns on the 1st Embodiment of this invention performs. The functional block diagram which shows the functional structural example of the panel inspection apparatus which concerns on the 2nd Embodiment of this invention. The processing flowchart which shows the flow of a process of the 2nd test result image generation process in the panel test | inspection procedure which the panel test | inspection apparatus which concerns on the 2nd Embodiment of this invention performs. The functional block diagram which shows the functional structural example of the panel inspection apparatus which concerns on the 3rd Embodiment of this invention. The processing flowchart which shows the flow of a process of the 2nd test | inspection range detection process in the panel test | inspection procedure which the panel test | inspection apparatus which concerns on the 3rd Embodiment of this invention performs. The processing flowchart which shows the flow of a process of the 3rd test result image generation process in the panel test | inspection procedure which the panel test | inspection apparatus which concerns on the 3rd Embodiment of this invention performs.

  Hereinafter, a solar panel inspection apparatus, inspection method, and inspection program according to embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a schematic diagram showing an example of a hardware configuration of a solar panel inspection apparatus (hereinafter referred to as “panel inspection apparatus”) according to an embodiment of the present invention.

  The panel inspection apparatus according to the embodiment of the present invention uses, for example, a solar panel inspection program (hereinafter referred to as “panel inspection PG”) according to the embodiment of the present invention in the computer 1 which is hardware having an arithmetic processing function. ) Is executed by causing the computer 1 to function as a solar panel inspection device equipped with means for inspecting the presence or absence of an abnormality in a solar panel (inspected object) installed in a solar power plant or the like. Is done. That is, the computer 1 that is hardware and the panel inspection PG that is software cooperate to realize a function of inspecting the computer 1 for the presence or absence of a solar panel abnormality.

  Here, panel inspection PG10 (10A-10C) is an example of the panel inspection program which concerns on embodiment of this invention, and is a program which functions the computer 1 which is hardware as the panel inspection apparatus 50 (50A-50C). . The panel inspection PG 10 is a computer from the viewpoint of causing the computer 1 to execute a panel inspection procedure that is an example of a solar panel inspection method (hereinafter referred to as “panel inspection method”) according to the embodiment of the present invention. 1 is a program that causes a panel inspection procedure to be executed.

  The computer 1 includes, for example, a CPU (Central Processing Unit) 2 which is an example of a processor, a main storage device 3 such as a RAM (Random Access Memory), a ROM (Read Only Memory), a HDD (Hard Disk Drive), and the like. It includes an auxiliary storage device 4, an input device 5 such as a keyboard and a mouse, an output device 6 such as a display and a printer, and a communication device 7 that communicates with an external device.

  For example, the computer 1 can be connected to an external device on the network such as the calculation server 8 via the communication device 7 and can transmit and receive data to and from the external device. For example, the computer 1 can cause the calculation server 8 to execute at least a part of the arithmetic processing or receive the execution result. The computer 1 can be connected to an external device other than the calculation server 8 via a network.

  The auxiliary storage device 4 accessible by the CPU 2, such as a ROM, is a map that is an electronic map showing the locations where programs and data used for inspection, for example, the panel inspection PG10 and the solar panel to be inspected are installed. Data 11, ortho image 13 including an area where all of the solar panels to be inspected are imaged, panel layout data 15 that is an electronic drawing showing the arrangement of all the solar panels to be inspected, and the like are auxiliary memory It is stored in the device 4.

  The computer 1 loads the panel inspection PG10 stored in the auxiliary storage device 4 and data necessary for execution of the panel inspection PG10 into the main storage device 3 such as a RAM, and executes processing according to this program. The main storage device 3 such as a RAM provides a work area for temporarily storing programs and data executed by the CPU 2.

  Then, the image used when the panel inspection apparatus which concerns on embodiment of this invention determines the presence or absence of abnormality with respect to each of a solar panel (test object) is demonstrated.

  FIG. 2 illustrates an image (thermal image 22, image) used when the panel inspection apparatus 50 that targets the solar panel 21 installed in the solar power plant 20 determines whether each solar panel 21 has an abnormality. It is explanatory drawing which shows the example of acquisition of the visible image 23 and the high-resolution visible image 24).

  In addition to a plurality of solar panels 21 that perform solar power generation, an indoor building 25 and the like are installed in the solar power plant 20. In the panel inspection apparatus 50, for example, images 22, 23, and 24 obtained by photographing all of the solar panels 21 to be inspected without omission while moving the UAS 30 along a movement route such as the flight route R are communicated by radio. Alternatively, the images 22, 23, and 24 are acquired via a storage medium such as a magnetic disk, an optical disk, or a semiconductor memory.

  The images 22, 23, and 24 are all images taken from above of the solar panel 21 that constitutes at least a part of the object to be inspected. For example, an unmanned aerial vehicle equipped with a photographing device capable of photographing a desired image quality and range This is a so-called bird's-eye view image taken using a moving body such as a system (hereinafter simply referred to as “UAS”) 30.

  The thermal image 22 is an image showing a temperature distribution, and is acquired using, for example, a thermography 26 as a photographing apparatus.

  The visible image 23 is an image representing reflection of light waves (visible light) in a wavelength band (about 380 nm to 780 nm) that can be visually recognized by humans, and is acquired by using, for example, a visible camera 27 as an imaging device.

  It is preferable that the thermal image 22 and the visible image 23 have the same range in one image, but it is not always necessary to match.

  For example, when acquiring the thermal image 22 and the visible image 23 using different imaging devices, such as using the thermography 26 to acquire the thermal image 22 and using the visible camera 27 to acquire the visible image 23, Due to the difference between the angle of view of both the imaging devices and the shooting timing, it is possible that the ranges shown in the thermal image 22 and the visible image 23 are different.

  When the angle of view between the thermography 26 and the visible camera 27 is different, the same range as the imaging range of the thermography 26 may be set in the visible camera 27. With this setting, a range corresponding to the entire range of the thermal image 22 can be set with respect to the visible image 23, as in the case where the ranges captured for each of the thermal image 22 and the visible image 23 are aligned. A panel inspection procedure described later can be performed.

  Note that a camera (hereinafter simply referred to as “integrated camera”) 28 that is integrally provided with a thermography 26 and a visible camera 27 may be used as a photographing apparatus that acquires the thermal image 22 and the visible image 23.

  Further, when the integrated camera 28 is used, the resolution of the obtained visible image 23 may not be sufficient as compared with the case of using a general visible camera 27 (which does not have a function of acquiring the thermal image 22). Therefore, a visible camera 29 (hereinafter referred to as “high resolution visible camera”) having a resolution higher than the resolution of the visible image 23 obtained by the integrated camera 28 may be mounted separately from the integrated camera 28.

  In the panel inspection apparatus 50, when obtaining the visible images 23 of two different resolutions by using the UAS 30 equipped with the integrated camera 28 and the high-resolution visible camera 29, from the viewpoint of distinguishing both visible images 23, The relatively high resolution visible image 23 is referred to as a high resolution visible image 24, and the relatively low resolution is simply referred to as a visible image 23. In particular, when it is not necessary to distinguish the two visible images 23, they are simply referred to as the visible image 23.

  The images 22, 23, and 24 used in the panel inspection apparatus 50 are usually not a single still image, but a plurality of still images obtained by shooting different areas (including some overlapping areas). It covers the area including all of the solar panels 21 to be inspected.

  Note that the images 22, 23, and 24 are not necessarily limited to still images. If all the solar panels 21 to be inspected as a whole are included, a moving image may be used. The advantage of using moving images is that the flight speed of the UAS 30 can be increased by shooting moving images having a higher frame rate than still images. The advantage that the flight speed of the UAS 30 can be increased means that a wider range can be shot with one aerial shot. Therefore, when photographing the same range, the aerial shooting time can be further shortened.

  In the following description, when it is necessary to distinguish the thermal image 22, the visible image 23, and the high-resolution visible image 24 from the moving image and the still image, The still image is referred to as a resolution visible moving image 24 and will be described as a thermal still image 22, a visible still image 23, and a high resolution visible still image 24, respectively.

  Further, it is preferable that the thermal moving image 22 and the visible moving image 23 (including the high-resolution visible moving image 24) be taken by synchronizing the thermography 26 and the visible camera 27, or the integrated camera 28 and the high-resolution visible camera 29. When both of them are moving imaged synchronously, the thermal moving image 22 and the visible moving image 23 can be directly input to the panel inspection apparatus 50 without a preprocessing step.

  On the other hand, also when the timing for starting moving image shooting of the thermography 26 and the visible camera 27, or the integrated camera 28 and the high-resolution visible camera 29 is shifted (asynchronous moving image shooting), the panel inspection device 50 Although the solar panel 21 can be inspected using a moving image, in this case, a moving image that starts input in consideration of a shift in the shooting start timing of the thermal moving image 22 and the visible moving image 23 that are input to the panel inspection apparatus 50. Preprocessing steps such as a process of adjusting the position of the frame and a process of cutting out the frame of the moving image at the same time as the thermal still image 22 and the visible still image 23 are necessary.

  In the panel inspection device 50, the inspection range of the solar panel 21 and the individual solar panels 21 are specified and specified using at least a thermal image 22 obtained by photographing an area including all of the solar panels 21 to be inspected from above. The presence / absence of abnormality of the solar panel 21 existing within the inspection range is determined, and the solar panel 21 determined to be abnormal is displayed so as to be distinguishable from the solar panel 21 determined to be normal (sound).

  Subsequently, a panel inspection apparatus, a panel inspection method, and a panel inspection PG according to each embodiment will be described. Panel inspection apparatuses 50 (50A to 50C) described later are apparatuses that are realized by causing the computer 1 (FIG. 1) to execute the panel inspection PG10 (10A to 10C) (FIG. 1).

[First embodiment]
FIG. 3 is a functional block diagram showing a functional configuration of a panel inspection apparatus 50A that is an example of the panel inspection apparatus according to the first embodiment of the present invention.

  The panel inspection apparatus 50A (FIG. 3) includes, for example, inspection range detection including an input unit 51, an output unit 52, a communication unit 53, a first inspection range detection unit 541, and a second inspection range detection unit 542. Means 54A, anomaly detection means 55 comprising a hot spot detection part 551 and an unusual location detection part 552, a position information acquisition means 56, a display processing means 57A comprising a first inspection result image generation part 571, and storage A means 58, a control means 59, and a still image extraction means 61 are provided.

  The input means 51 is realized by, for example, an input device connected to a computer via an interface or an input means such as a keyboard or a mouse provided in the computer itself. The input unit 51 receives an input of information and gives the received information to the control unit 59. The input means 51 includes, for example, a request for executing a panel inspection procedure to be described later, a request for selecting an image to be read out and panel layout data 15, and a request for setting various conditions.

  The output unit 52 is realized by, for example, a display unit such as a display device connected to a computer via an interface or a display provided in the computer itself, a printing unit such as a printer connected via a computer interface, or the like. When receiving the display request, the output unit 52 displays the content corresponding to the display request on the screen. Further, when receiving the print request, the output means 52 prints out the contents corresponding to the print request.

  The communication means 53 receives data from external devices such as the computer server 8 illustrated in FIG. 1 and the unmanned aircraft system (UAS) 30 illustrated in FIG. 2 (including devices such as a control device and an imaging device to be mounted). Has a function to transmit and receive. The communication unit 53 transmits the data received from the control unit 59 to the external device, and gives the data transmitted from the external device to the control unit 59.

  The inspection range detection means 54A has a function of detecting the range of each individual solar panel 21 for each solar panel 21 to be inspected from a given inspection image (thermal image 22 or thermal image 22 and visible image 23). Have The inspection range detection unit 54A includes, for example, a first inspection range detection unit 541 that detects a range of each solar panel 21 to be inspected based on a temperature distribution appearing in the thermal image 22, and a visible image 23 (a high-resolution visible image 24). A second inspection range detection unit 542 that detects the range of each solar panel 21 for each of the solar panels 21 to be inspected.

  The inspection range detection means 54A includes the second inspection range detection unit 542 in addition to the first inspection range detection unit 541. The solar panel 21 is not necessarily accurate only by the temperature distribution appearing in the thermal image 22. This is because the range of the range may not be detected.

  For example, depending on the surrounding environment in which the solar panel 21 is installed, the temperature environment at the time of shooting, and the like, there is a case where there is almost no difference in temperature between the solar panel 21 and the surroundings of the solar panel 21. The outline of the solar panel 21 does not appear clearly only by the temperature distribution. Therefore, by configuring the inspection range detection unit 54A so that the contour of the solar panel 21 appearing in the visible image 23 can be specified, the panel inspection device 50A reduces the possibility of erroneously detecting the range of the solar panel 21.

  The abnormality detection means 55 determines whether or not each of the solar panels 21 detected by the inspection range detection means 54A is in an abnormal state (normal state) in a state in which the ability at the time of health cannot be exhibited. And the identification information of the image (hereinafter referred to as “image identification information”) and the identification information of the solar panel 21 (hereinafter referred to as “image identification information”). "Panel identification information") and a function of holding it in association with it.

  The abnormality detection means 55 includes, for example, a hot spot detection unit 551 that detects whether or not a temperature abnormality location (hot spot) exists in the solar panel 21, and damage such as cracks due to some external force applied to the solar panel 21. An abnormal location detection unit that detects a location where the solar panel 21 is in a different state from the normal time (hereinafter referred to as “unusual”), such as the occurrence of an obstacle or the presence of some obstacle that prevents light reception 552.

  In the abnormality detection unit 55 illustrated in FIG. 3, for example, whether or not there is a location (hot spot) in the solar panel 21 where there is a temperature abnormality is determined as to whether there is an abnormality in the solar panel 21. 551 detects and the unusual location detection part 552 detects whether an unusual location exists in the solar panel 21. FIG.

  The hot spot detection unit 551 detects, as a hot spot, a portion having a luminance exceeding a set threshold value based on the temperature distribution in the solar panel 21, that is, the luminance distribution in the solar panel 21 in the thermal image 22. To do.

  The non-ordinary part detection unit 552 detects a line segment vector from the region in the solar panel 21 (including the outer edge that forms the contour) that appears in the visible image 23, and the vertical and horizontal directions that form the contour of the solar panel 21 are detected. It is determined whether or not an unusual location exists by determining whether or not there is a line segment vector that is inclined (oblique) with respect to the line segment.

  Since the abnormal part includes a part that is abnormal and abnormal, such as damage such as a crack, the abnormality detection means 55 including the abnormal part detection unit 552 generates a temperature abnormality. Abnormalities other than the location (hot spot) can be detected. In addition, an event that can cause a hot spot occurs if the current state is healthy (normally operating) but is left unattended (hereinafter referred to as “abnormal standby state”). Since the location is also included, the abnormality detection means 55 including the non-normal location detection unit 552 can detect the abnormal standby state of the solar panel 21. By making it possible to eliminate the abnormal preliminary state in advance, the risk of future abnormal occurrence of the solar panel 21 can be further reduced.

  The abnormality detecting means 55 includes a first event that there is a location (hot spot) where a temperature abnormality occurs in the solar panel 21 and a second event that an abnormal location exists in the solar panel 21. Among the events, if at least the first event has occurred, it is determined as “abnormal”, and if no event has occurred, it is determined as “no abnormality” (normal).

  In addition, if only the second event occurs, it will be judged as “unusual (suspicion of abnormality)” more accurately, but from the viewpoint of encouraging human inspection, “there is an abnormality” The abnormality detection means 55 may be configured to determine “

  The position information acquisition unit 56 has a function of acquiring position information indicating a shooting position of an inspection image (for example, the thermal image 22) used when the inspection range detection unit 54A detects each range of the solar panel 21. .

  For example, when position information indicating latitude, longitude, and altitude measured by GPS, such as a geotag, is added to the image, the position information acquisition unit 56 acquires the added position information, thereby obtaining the thermal image 22. The information indicating the imaging position of the inspection image (hereinafter referred to as “imaging position information”) is acquired.

  In addition, when the imaging position information of the inspection image is not added to the inspection image such as the thermal image 22, the thermal image is obtained by acquiring information including the imaging position information from elements other than the image such as the UAS 30. The photographing position information of the inspection image such as 22 is obtained.

  Usually, an image includes information on the shooting time (hereinafter referred to as “shooting time information”). Therefore, if there is shooting position information of an image associated with the time information, the time at which the image was shot The photographing position information at can be acquired.

  For example, since the flight log of the UAS 30 used for photographing includes the flight time of the UAS 30 and position information indicating the flight position at that time, using this flight log, an image such as the thermal image 22 is displayed. The flight position of the UAS 30 at the time of shooting, that is, the shooting position can be specified, and shooting position information of an image such as the thermal image 22 can be acquired.

  The display processing means 57A is, for example, an image showing the range of the solar panel detected by the inspection range detection means 54A, an image showing the abnormal solar panel detected when detecting the abnormal solar panel detected by the abnormality detection means 55, etc. It has a function of generating display information for displaying information including an inspection result image indicating the inspection result on a display means such as a display. That is, in the panel inspection apparatus 50A, the display processing unit 57A includes a first inspection result image generation unit 571 as an inspection result image generation unit that generates an inspection result image.

  The first inspection result image generation unit 571 is at least on an image (hereinafter, referred to as “background image”) showing the position of the solar panel 21 to be inspected, such as a map image used for displaying the inspection result. The abnormality detection means 55 has a function of generating an inspection result image to be displayed in a superimposed manner by associating (aligning) the thermal image 22 of the solar panel 21 that is detected and detected as abnormal with the position of the map image. The map image is included in the map data 11 as the map information including the position information of the place where the solar panel 21 is installed, and is acquired by reading the given map data 11.

  Further, the first inspection result image generation unit 571 has a function of generating an inspection result image for displaying the solar panel 21 determined by the abnormality detection unit 55 as having no abnormality in association with the position of the map image. Also good. That is, the abnormality detection means 55 may have a function of generating an inspection result image that is displayed in correspondence with the position of the map image for all the solar panels 21 that have been inspected for abnormality.

  When the display processing unit 57A receives information to be displayed such as an inspection result image, the display processing unit 57A generates display information for displaying the received content, and provides the generated display information to the control unit 59. How information is displayed may be initially set or may be set from the input means 51 each time.

  Note that the first inspection result image generation unit 571 generates the inspection result image by using the map image included in the map data 11 as the background image, and the position of the region including the solar panel 21 to be inspected. When the ortho image 13 having information is provided from a private or public office, the ortho image 13 can be used as a background image.

  When the ortho image 13 is used as a background image, the image is aligned using the position information of the thermal image 22 acquired by the position information acquisition means 56 and the position information such as the geotag of the ortho image 13. 13 can project a thermal image 22 including information on the inspection result.

  The storage unit 58 includes a storage area where information can be read (read) and written (write), and has a function of holding information in the storage area. The storage unit 58 provides a storage area in which information can be read and written to the inspection range detection unit 54A, the abnormality detection unit 55, the display processing unit 57A, and the control unit 59, and stores information necessary for executing each process. Reading (reading) and writing (writing) are performed.

  The control means 59 is a means for controlling the overall processing of the panel inspection apparatus 50A. The input means 51, the output means 52, the communication means 53, the inspection range detection means 54A, the abnormality detection means 55, the still image extraction means 61, The display processing unit 57A and the storage unit 58 have a function of exchanging data with each other and controlling them.

  The still image extraction unit 61 has a function of cutting out a frame of the moving image as a still image such as the thermal still image 22 when the inspection image such as the given thermal image 22 is a moving image. The still image such as the thermal still image 22 obtained by the still image extracting unit 61 is given to the inspection range detecting unit 54A.

  In the panel inspection apparatus 50A configured as described above, the range of each solar panel 21 is automatically detected using the thermal image 22 obtained by photographing the solar panel 21 to be inspected from above, and each detected solar panel 21 is detected. Since it is detected whether or not there is a location where an abnormality has occurred, the burden on the inspector required for the inspection of the solar panel 21 can be reduced.

  Further, in the panel inspection apparatus 50A, the inspection range detection unit 54A includes the second inspection range detection unit 542, so that the range of each solar panel 21 cannot be sufficiently specified from the thermal image 22, even if there is a crack or the like. The contour line of each solar panel 21 can be detected by using the visible image 23 used when detecting the range also for detecting the range of each solar panel 21.

  Therefore, the panel inspection apparatus 50A including the second inspection range detection unit 542 can detect the contour line of each solar panel 21 more accurately than the thermal image 22 alone, and can detect the contour line detected from the visible image 23. By projecting on the thermal image 22, the range of each solar panel 21 can be detected more accurately, and the abnormal part appearing on each solar panel 21 can be automatically detected with higher accuracy than before.

  Note that the panel inspection apparatus 50A is not limited to the configuration illustrated in FIG. For example, if it is not necessary to cut out a still image from a moving image, such as when the input thermal image 22 and visible image 23 are still images, the panel inspection apparatus 50A does not necessarily include the still image extraction means 61. Good.

  Further, in the panel inspection apparatus 50A, there is no particular problem in detecting the range of the solar panel 21 from the thermal image 22, such as obtaining a thermal image 22 having a resolution high enough to sufficiently identify the individual solar panels 21. If present, the inspection range detection unit 54A does not necessarily need to include the second inspection range detection unit 542.

  Furthermore, in the panel inspection apparatus 50A, when detecting a hot spot of the solar panel 21 and not detecting an abnormal location, the abnormality detection means 55 is not necessarily provided with the abnormal location detection unit 552. There is no.

  Next, as a panel inspection method according to the first embodiment of the present invention, a first panel inspection procedure performed by the panel inspection apparatus 50A will be described.

  FIG. 4 is a process flow diagram (flowchart) showing a flow of processes of the first to third panel inspection procedures (steps S1 to S5) performed by the panel inspection apparatus 50 (50A to 50C).

  The first to third panel inspection procedures illustrated in FIG. 4 are processing procedures performed by the panel inspection apparatuses 50A to 50C, respectively. Among the first to third panel inspection procedures, a preprocessing step (step) S1), the hot spot detection step (step S3) of the abnormality detection step, and the non-normal location detection step (step S4) are processing steps common to any panel inspection procedure.

  On the other hand, the first inspection range detection step (step S2) and the second inspection range detection step (step S6) as the inspection range detection step and the first inspection as the inspection result image generation step are other processing steps. The result image generation step (step S5), the second inspection result image generation step (step S7), and the third inspection result image generation step (step S8) are different processing steps in the first to third panel inspection procedures. It is.

  Among the first to third panel inspection procedures illustrated in FIG. 4, the first panel inspection procedure includes a preprocessing step (step S <b> 1) performed as necessary and a first inspection range detection step (steps). S2), a hot spot detection step (step S3) and an abnormal location detection step (step S4) of the abnormality detection step, and a first inspection result image generation step (step S5).

  In the first panel inspection procedure, when a processing step is started (START), a preprocessing step (step S1) is performed as necessary. The pre-processing step is, for example, the case where the imaging start timings of the thermal moving image 22 (FIG. 2) and the visible moving image 23 (FIG. 2) input to the panel inspection apparatus 50A (FIG. 3) are not synchronized, or the same imaging from the moving image This is performed when a still image that covers the range is cut out. When the pretreatment process is completed, a first inspection range detection process (step S2) is subsequently performed.

  The pretreatment process (step S1) may be performed by the panel inspection apparatus 50A, but may be performed by another apparatus. In this case, the preprocessing step is skipped and is performed from the inspection range detection step (step S2) that continues using the thermal image 22 and the visible image 23 obtained by performing the preprocessing step in advance with another device. The preprocessing step is also skipped when the preprocessing itself is unnecessary.

  In the first inspection range detection step (step S2), the inspection range detection means 54A (FIG. 3) specifies each range of the solar panel 21 (FIG. 2) to be inspected with respect to the thermal image 22. This is a processing step of detecting each range of the solar panel 21. When the range of each solar panel 21 is detected, an abnormality detection process (steps S3 and S4) is subsequently performed.

  The abnormality detection step (steps S3 and S4) is a processing step in which the abnormality detection means 55 (FIG. 3) detects an abnormality for each solar panel 21 detected in the first inspection range detection step (step S2). There is at least a hot spot detection step (step S3) for detecting a hot spot. The abnormality detection process illustrated in FIG. 4 includes an abnormal spot detection process that detects an abnormality other than a hot spot and an abnormal state that can be a precursor of the occurrence of an abnormality, in addition to the hot spot detection process (step S3). (Step S4) is further provided.

  The first inspection result image generation step (step S5) is abnormal on the map used by the first inspection result image generation unit 571 (FIG. 3) of the display processing unit 57A (FIG. 3) to display the inspection results. This is a processing step for generating an inspection result image indicating whether or not the solar panel 21 is present, and is a processing step that forms part of the display processing step. When the inspection result image is generated and the first inspection result image generation step (step S5) is completed, the first panel inspection procedure ends all processing steps (END).

  Subsequently, in the first panel inspection procedure, a first inspection range detection step (step S2), a hot spot detection step (step S3), an abnormal location detection step (step S4), and a first inspection result image generation step (Step S5) will be described.

  FIG. 5 is a process flow diagram showing a process flow of the first inspection range detection step (step S2: FIG. 4).

  The first inspection range detection step specifies each range of the solar panel 21 with respect to the inspection image such as the thermal image 22 used in the subsequent abnormality detection step (FIG. 4), and specifies the specified range as the inspection range. It is the process process detected as.

  In the first inspection range detection step, each solar panel reflected in the thermal image 22 with reference to the contour line detected from the thermal image 22 or the visible image 23 (including the high-resolution visible image 24; hereinafter the same). The selection of whether or not to use the visible image 23 when detecting 21 contour lines is accepted, and the processing steps from step S21 to step S26 are performed according to the accepted selection content.

  The first inspection range detection step (steps S21 to S26) is directly detected from the thermal image 22 and the step (step S21) of detecting a contour line for each of the solar panels 21 from the thermal image 22, for example. The step of identifying the range of each solar panel 21 based on the contour line of each solar panel 21 and setting the range of each solar panel 21 (step S23), and the contour line for each solar panel 21 from the visible image 23 , The step of projecting the contour line detected from the visible image 23 onto the thermal image 22 (step S25), and the solar panels 21 detected from the visible image 23 and projected onto the thermal image 22. The range of each solar panel 21 is specified on the basis of the outline of the solar panel 21, and the range of each solar panel 21 is set as the range. Step S26) and a.

  When the first inspection range detection process is started (ENTER), the first inspection range detection unit 541 first detects the outline of the solar panel 21 to be inspected from the thermal image 22 obtained by photographing the solar panel 21. (Step S21). Here, when the visible image 23 is not used for detecting the contour line of each solar panel 21 (NO in step S22), the first inspection range detection unit 541 detects each solar panel directly detected from the thermal image 22. The range of each solar panel 21 is specified on the basis of the outline of 21 and detected as each range of the solar panel 21 (step S23).

  When the first inspection range detection unit 541 detects each range of the solar panel 21, panel identification information is attached to each detected solar panel 21, and an image of the detection source image (here, the thermal image 22). The first inspection range detection step is completed in association with the identification information (RETURN).

  On the other hand, when the visible image 23 is used to detect the contour line of each solar panel 21 (YES in step S22), the second inspection range detection unit 542 applies each of the solar panel 21 from the visible image 23. An outline is detected (step S24), and the detected outline is projected onto the thermal image 22 (step S25).

  The projection of the outline of each solar panel 21 detected from the visible image 23 onto the thermal image 22 is, for example, plane position information (hereinafter referred to as “plane position information”) ignoring the altitude of the visible image 23 and the thermal image 22. )), The visible image 23 is temporarily determined on the thermal image 22, the feature amount extracted from the thermal image 22 is searched in the visible image 23, and the feature amount matches from the determined position. The visible image 23 is moved to the nearest position. Then, the position of the visible image 23 after movement that matches the feature amount is determined as the final position of the visible image 23, and the position on the thermal image 22 that overlaps the position of the contour line detected from the visible image 23 is determined by solar power. This is done by using the outline of the panel 21.

  By performing such feature amount matching processing in the image, even if the thermography 26 that captures the thermal image 22 and the visible camera 27 that captures the visible image 23 are not coaxial, they are detected from the visible image 23. The contour line of each solar panel 21 can be aligned with the thermal image 22 without positional deviation.

  When the projection of the contour line detected from the visible image 23 onto the thermal image 22 is completed, the second inspection range detection unit 542 is projected onto the thermal image 22 using the thermal image 22 after the contour projection. The range of each solar panel 21 is specified on the basis of the outline of each solar panel 21, and it detects as each range of the solar panel 21 (step S26).

  When the second inspection range detection unit 542 detects each range of the solar panel 21, panel identification information is attached to each detected solar panel 21, and an image of the detection source image (here, the thermal image 22) The first inspection range detection step is completed in association with the identification information (RETURN).

  Note that the first inspection range detection process described above does not necessarily include all the processing steps of Steps S21 to S26.

  For example, when it is assumed that the visible image 23 is not used when detecting the contour line of each solar panel 21, each range of the solar panel 21 to be inspected is detected based on the temperature distribution appearing in the thermal image 22. It can also be set as the 1st inspection range detection process provided with the 1st inspection range detection step. That is, the processing steps (step S21 and step S23) in which step S22 and steps S24 to S26 are omitted from the first inspection range detection step (steps S21 to S26) described above are used as the first inspection range detection step. It can also be set as the inspection range detection process provided.

  Conversely, when it is assumed that the visible image 23 is used when detecting the contour line of each solar panel 21, the contour line of each solar panel 21 is detected from the visible image 23, and the detected contour line is It can also be set as the 1st inspection range detection process provided with the 2nd inspection range detection step which detects each range of solar panel 21 inspected as a standard. In other words, the inspection range detection step provided with the processing steps (step S21 and step S23) in which steps S22 and S23 are omitted from the first inspection range detection step (steps S21 to S26) described above as the second inspection range detection step. It can also be.

  FIG. 6 is a process flow diagram showing a process flow of the hot spot detection step (step S3: FIG. 4).

  The hot spot detection step (steps S31 to S38) includes, for example, a luminance average calculation step (step S31), a luminance standard deviation calculation step (step S32), a threshold automatic setting step (step S33), and a luminance determination step ( Step S34 to Step S37).

  When the hot spot detection process is started (ENTER), first, the hot spot detection unit 551 (FIG. 3) calculates the average value μ of the luminance L in one solar panel 21 (FIG. 2) appearing in the thermal image 22. Then, the standard deviation value σ of the luminance L in the same solar panel 21 is calculated (step S32).

After calculating the average value μ and the standard deviation value σ, the hot spot detection unit 551 calculates a threshold value t defined by the following formula (1), and uses the calculation result (calculated value) for hot spot presence / absence determination. Set as threshold t.
[Equation 1]
t = μ + nσ (1) (n is an arbitrary positive number)

  In the panel inspection apparatus 50, by giving an arbitrary value to the positive number n in the right-hand side term together with the above equation (1), the calculation is performed in step S31 and step S32 without setting the threshold value t itself. It is possible to configure the hot spot detection unit 551 that automatically sets the threshold value t calculated by further using the average value μ and the standard deviation value σ as a threshold value for determining whether or not there is a hot spot.

  When the hot spot detection unit 551 sets the threshold value t (step S33), the hot spot detection unit 551 subsequently compares whether or not the luminance L exceeds the threshold value t (is equal to or less than the threshold value t) with respect to the threshold value t. (Step S34). This is because, in the thermal image 22, the higher the temperature, the higher the brightness, and therefore the location where higher luminance L is observed with respect to the surrounding temperature (luminance) can be regarded as a hot spot.

  As a result of the hot spot detection unit 551 comparing the threshold value t with the luminance L, if the luminance L is equal to or less than the threshold value t (YES in step S34), the hot spot detection unit 551 provides a hot spot at the location where the luminance L is given. If the luminance L exceeds the threshold value t (NO in step S34), it is determined that the location that gives the luminance L is a hot spot (abnormal). (Step S36).

  When the determination (step S35 or step S36) of whether or not the location giving the luminance L is a hot spot is completed, it is confirmed whether or not there is another solar panel 21 detected in the thermal image 22 (step S35). S37) When remaining (in the case of NO in step S37), the processing steps from step S31 to step S36 are performed on the remaining solar panel 21.

  On the other hand, when all the solar panels 21 detected in the thermal image 22 have been determined (step S35 or step S36) as to whether or not the location giving the luminance L is a hot spot (in step S37). In the case of YES), the hot spot detection unit 551 further confirms whether or not there is another thermal image 22 that shows the solar panel 21 that has not been inspected (step S38).

  When other thermal images 22 showing the solar panel 21 to be inspected remain (in the case of NO in step S38), the hot spot detection unit 551 performs step S31 for each solar panel 21 appearing in the remaining thermal image 22. -The processing step of step S37 is performed.

  On the other hand, when there is no other thermal image 22 in which the solar panel 21 to be inspected remains, that is, it is determined whether or not all the inspection targets (solar panels 21) are hot spots (step S38). If YES, the hot spot detection unit 551 completes the hot spot detection process (RETURN).

  In the above-described hot spot detection step (steps S31 to S38), as shown in the above equation (1), the threshold t for determining the presence / absence of the hot spot is determined in consideration of the average value μ and the standard deviation value σ. This is because the temperature, solar radiation, power generation, etc. may not be due to the high temperature caused by hot spots, but may be simply high overall due to the effects of temperature, solar radiation, power generation, etc. This is because hot spots can be detected more accurately by eliminating the influence of the quantity.

  In the hot spot detection step described above, in the luminance standard deviation calculation step (step S32), an area for acquiring the luminance used when calculating the standard deviation value σ (hereinafter referred to as “standard deviation value calculation area”). ) Is the entire range in one solar panel 21, and the standard deviation value σ is obtained based on the luminance acquired for the entire range in the solar panel 21, but the standard deviation value calculation region is not necessarily limited to the solar panel 21. It may not be the entire range. A small area may be set in one solar panel 21, and the standard deviation value σ may be obtained based on the luminance in the area.

  The advantage of obtaining the standard deviation value σ based on the luminance in a partial area in the solar panel 21 is compared with the case of obtaining the standard deviation value σ based on the luminance of the entire range in one solar panel 21. The variation of the standard deviation value σ between the solar panels 21 can be kept small, and the hot spot detection accuracy can be further increased.

  More specifically, when a hot spot is present in the solar panel 21, a portion having a high brightness is included locally, so that the standard deviation value σ is relatively large, while a healthy spot without a hot spot is present. In the solar panel 21, the standard deviation value σ is relatively small. Therefore, when the standard deviation value calculation area is the entire range of the solar panel 21, the threshold value t of the solar panel 21 where the hot spot exists is larger than the threshold value t of the healthy solar panel 21.

  On the other hand, when the standard deviation value calculation area is a partial area in the solar panel 21, if a place where no hot spot exists is set as the standard deviation value calculation area, a locally high-luminance part is included. Therefore, there is an advantage that the standard deviation value σ of each solar panel 21 can be kept within the same level (variation within a predetermined range) regardless of whether or not the solar panel 21 has a hot spot.

  In a place where there is no hot spot, since the temperature is about the same as that of the surrounding area, the variation in the luminance L is small. Therefore, a partial area having a predetermined area is set in the solar panel 21, the standard deviation value σ in the set partial area is calculated, and based on the luminance of the partial area that gives the smallest standard deviation value σ. The calculated standard deviation value σ may be used for calculating the threshold value t. The partial area that gives the smallest standard deviation value σ can be identified by calculating the standard deviation value σ each time while shifting the partial area within the solar panel 21 in units of pixels, for example.

  FIG. 7 is a process flow diagram showing the flow of processing in the non-normal location detection step (step S4: FIG. 4).

  The unusual part detection process (steps S41 to S45) includes, for example, a line segment detection step (step S41) and a normal / unusual part determination step (steps S42 to S44).

  When the non-normal location detection step is started (ENTER), first, the non-normal location detection unit 552 detects a line segment vector from a region within the range of the detected solar panel 21 in the visible image 23 (step S41). Then, it is determined whether or not there is a line segment vector in the inclined (oblique) direction with respect to the vertical and horizontal line segments forming the outline of the solar panel 21 (step S42).

  If the non-ordinary part detection unit 552 detects a line segment vector in the oblique direction in the solar panel 21 shown in the visible image 23 (YES in step S42), the solar panel 21 determines that there is an unusual part. (Step S43). On the other hand, when the non-normal location detection unit 552 does not detect the diagonal line segment vector in the solar panel 21 (NO in step S42), it is determined that there is no non-normal location in the solar panel 21 ( Step S44).

  When all the solar panels 21 detected in the visible image 23 are left with the solar panels 21 for which the determination of the presence / absence of the non-normal location (step S43 or step S44) is not completed (NO in step S45) ), A line segment detection step (step S41) and a normal / non-normal location determination step (steps S42 to S44) are performed on the solar panel 21 in which the determination of the presence or absence of the abnormal location is incomplete.

  On the other hand, if the determination of the presence / absence of an unusual location has been completed for all the solar panels 21 detected in the visible image 23 (YES in step S45), the unusual location detection step is completed. (RETURN).

  FIG. 8 is a process flow diagram showing a process flow of the first inspection result image generation step (step S5: FIG. 4) in the first panel inspection procedure (FIG. 4).

  The first inspection result image generation step (steps S51 to S57) includes, for example, an inspection result acquisition step (step S51), an abnormal solar panel enhancement step (step S53), and an image position information acquisition step (step S54). And a position association step (step S56).

  When the first inspection result image generation process is started (ENTER), first, the first inspection result image generation unit 571 (FIG. 3) determines whether there is an abnormality for each of the solar panels 21 (FIG. 2). That is, the result of the abnormality detection step (step S3 and step S4: FIG. 4) is acquired (step S51).

  If the determination result of the presence / absence of abnormality is abnormal (YES in step S52), the first inspection result image generation unit 571 highlights the solar panel 21 having abnormality (step S53). The highlighting of the solar panel 21 includes various types such as changing the thickness of the outline of the solar panel 21, changing the color of the outline of the solar panel 21, or applying a pattern to the area of the solar panel 21. Techniques can be employed. Further, the highlighting method may be changed according to the content of the abnormality.

  When the solar panel 21 with an abnormality is highlighted, the first inspection result image generation unit 571 subsequently acquires position information of the inspection image such as the thermal image 22 that gives the determination result of the presence or absence of the abnormality (step S54). Acquisition of the position information of the inspection image such as the thermal image 22 is performed by acquiring the position information acquired by the position information acquisition unit 56.

  When the first inspection result image generation unit 571 acquires the position information of the inspection image such as the thermal image 22, subsequently, the map data 11 that is the basis of the background image such as the map image used for displaying the inspection result is displayed. The position based on the read-out position information of the inspection image and the position on the map indicated by the map data 11 are associated with each other, and the inspection image is positioned on the map (step S56).

  When the first inspection result image generation unit 571 positions the inspection image such as the thermal image 22 on the map indicated by the map data 11, the generation of the inspection result image is completed, and the generation of the inspection result image is completed (Step S1). S57), the first inspection result image generation unit 571 completes the first inspection result image generation step (RETURN).

  On the other hand, in the first inspection result image generation step, when the abnormality determination result is normal (NO in step S52), the first inspection result image generation unit 571 skips step S53 and performs step S54. The subsequent processing steps are performed.

  According to the panel inspection apparatus 50A, the first panel inspection procedure, and the first panel inspection PG10A, each of the solar panels 21 to be inspected is automatically inspected using an inspection image such as a thermal image 22 taken from above. Since the range of the solar panel 21 is detected and it is detected whether there is a location where an abnormality has occurred in each detected solar panel 21, it is possible to reduce the burden on the inspector required for the inspection of the solar panel 21. it can.

  Further, in the panel inspection apparatus 50A, the first panel inspection procedure, and the first panel inspection PG10A, the contour line of each solar panel 21 is detected from the visible image 23 used when detecting cracks and the like, and the detected contour line is detected. By enabling projection onto the thermal image 22 including the same range as the visible image 23, the thermal image 22 alone can detect the range of each solar panel 21 even when the outline of each solar panel 21 cannot be detected sufficiently. It is possible to automatically detect an abnormal point appearing on each solar panel 21 with higher accuracy than in the past.

  Furthermore, in the panel inspection apparatus 50A, the first panel inspection procedure, and the first panel inspection PG10A, it is possible to detect whether or not an abnormal location exists in the solar panel 21, thereby preventing damage such as cracks. Such an abnormality other than a hot spot can be detected. In addition, since an unusual location other than a location where damage such as a crack has occurred can also be detected, an abnormal standby state can also be detected. Therefore, it is possible to detect not only the currently occurring abnormality but also an event that may become an abnormality in the future, and prevent future abnormality.

  According to the panel inspection apparatus 50A, the first panel inspection procedure, and the first panel inspection PG10A, by using the communication means 53, the thermal image 22 and the like can be received from the UAS 30 and the panel inspection can be performed in real time. Even if the UAS 30 has not landed (being in flight) after the start of shooting, the inspection of the solar panel 21 can be started. Moreover, when an abnormal location is detected on site, repair can be started at an earlier timing.

  According to the panel inspection apparatus 50A, the first panel inspection procedure, and the first panel inspection PG10A, the threshold t for determining the presence / absence of a hot spot is determined in consideration of the average value μ and the standard deviation value σ. Hot spots can be detected more accurately by eliminating the effects of temperature, solar radiation, and power generation.

  In addition, as the standard deviation value σ used for the threshold value t, a small area is set in one solar panel 21, and the standard deviation value σ giving the minimum value among the standard deviation values σ obtained based on the luminance in the area is given. If this is used, the variation of the standard deviation value σ between the solar panels 21 can be reduced, and the hot spot detection accuracy can be further increased.

  According to the panel inspection apparatus 50A, the first panel inspection procedure, and the first panel inspection PG10A, a moving image having a higher frame rate than a still image can be obtained by making it possible to use a moving image such as the thermal moving image 22 as an inspection image. The solar panel 21 to be inspected can be photographed in a state where the flight speed of the UAS 30 is further increased. Therefore, it is possible to capture a wider range or to capture a predetermined range in a shorter time by one aerial photography for acquiring the inspection image.

[Second Embodiment]
FIG. 9 is a functional block diagram showing a functional configuration of a panel inspection apparatus 50B which is an example of a panel inspection apparatus according to the second embodiment of the present invention.

  The panel inspection apparatus 50B (FIG. 9) is different from the panel inspection apparatus 50A (FIG. 3) in that it further includes an image compositing means 62 and a display processing means 57A including a first inspection result image generation unit 571. Are different in that they include display processing means 57B including a second inspection result image generation unit 572, but are not substantially different in other points. Therefore, in the present embodiment, constituent elements that are not substantially different from the panel inspection apparatus 50A are assigned the same reference numerals and redundant description is omitted.

  The panel inspection apparatus 50B includes, for example, an input unit 51, an output unit 52, a communication unit 53, an inspection range detection unit 54A, an abnormality detection unit 55, a position information acquisition unit 56, and a second inspection result image generation. The display processing unit 57B including the unit 572, the storage unit 58, the control unit 59, the still image extraction unit 61, and the image synthesis unit 62 are configured.

  The second inspection result image generation unit 572 in the display processing unit 57B inspects the synthesized thermal image (hereinafter referred to as “synthesized thermal image”) 32 (FIG. 10). Since the synthesized thermal image 32 is a thermal image showing the temperature distribution of all the solar panels 21 to be inspected, the display processing means 57B uses the synthesized thermal image 32 for generating a test result image indicating the solar arrangement and the test result.

  The image synthesizing unit 62 has an image synthesizing function of the thermal image 22 and the visible image 23, and includes a plurality of thermal images 22 or visible images 23 obtained by photographing different areas (including overlapping areas). By superimposing the overlapping areas, a thermal image (synthetic thermal image 32) or a visible image (hereinafter referred to as “synthesized visible image”) 33 (FIG. 10) covering a wider area is obtained.

  It should be noted that the control means 59 in the panel inspection apparatus 50B has a control function for components added to the panel inspection apparatus 50A. That is, the control means 59 in the panel inspection apparatus 50B further has a function of transmitting / receiving data to / from the display processing means 57B and the image composition means 62 including the second inspection result image generation unit 572 and controlling them. Yes.

  In the panel inspection apparatus 50B, for a divided area obtained by dividing a predetermined area including the entire range of the solar panel 21 to be inspected, an inspection image such as an individual thermal image 22 obtained by photographing each divided area is acquired. Therefore, a composite image such as a composite thermal image 32 covering the entire range of the solar panel 21 to be inspected is obtained, and using this composite image, the first inspection range detection step (step S2: FIG. 4), hot spot A detection process (step S3: FIG. 4), an abnormal part detection process (step S4: FIG. 4), and a second inspection result image generation process (step S6: FIG. 4) are performed.

  In the panel inspection apparatus 50 </ b> B configured as described above, the second thermal inspection result image generation unit 572 uses the synthetic thermal image 32 in which all the solar panels 21 to be inspected are captured as a panel layout diagram showing the layout of the solar panels 21. A result image can be generated. Therefore, even when there is no map data 11, it is possible to generate an inspection result image indicating a portion where an abnormality has been detected and display the inspection result on the display means.

  The panel inspection device 50B is not limited to the configuration illustrated in FIG. For example, the panel inspection apparatus 50B may not necessarily include the still image extraction unit 61 as with the panel inspection apparatus 50A. In addition, when the image composition processing is performed by the external device and the composite thermal image 32 (FIG. 10) or the composite visible image 33 (FIG. 10) is given, the image composition processing in the panel inspection device 50B is unnecessary. If present, the panel inspection apparatus 50B does not necessarily include the image synthesizing unit 62.

  Furthermore, when it is not necessary to display the solar panel 21 in which an abnormality is detected on the map using the map data 11, the display processing unit 57 </ b> B does not necessarily need to include the first inspection result image generation unit 571. It is not necessary to include the position information acquisition means 56.

  Next, as a panel inspection method according to the second embodiment of the present invention, a second panel inspection procedure performed by the panel inspection apparatus 50B will be described.

  The second panel inspection procedure includes a second inspection result image generation step (step S6) instead of the first inspection result image generation step (step S5) with respect to the first panel inspection procedure. Although different, other processing steps are not substantially different.

  FIG. 10 is a process flowchart showing the flow of the second inspection result image generation step (step S6: FIG. 4) in the second panel inspection procedure.

  The second inspection result image generation step (step S61, step S51 to step S53 and step S57) is a panel layout drawing image acquisition with respect to the first inspection result image generation step (FIG. 8: step S51 to step S57). While further comprising a step (step S61), the difference is that the acquisition step (step S54 and step S55) of the position information of the inspection image such as the thermal image 22 and the position association step (step S56) are omitted. There is no substantial difference in other respects. Therefore, processing steps that are not substantially different from the first inspection result image generation step are assigned the same step numbers, and redundant descriptions are omitted.

  The second inspection result image generation step includes, for example, a panel layout drawing image acquisition step (step S61) for acquiring a thermal composite image 32 that is a composite image of the thermal image 22, an inspection result acquisition step (step S51), A solar panel enhancement step (step S53).

  When the second inspection result image generation process is started (ENTER), first, the second inspection result image generation unit 572 (FIG. 9) acquires the thermal composite image 32 as a panel layout image (step S61). When the second inspection result image generation unit 572 acquires the thermal composite image 32, the second inspection result image generation unit 572 subsequently has the abnormal solar panel 21 in the thermal composite image 32 (step S52). If YES, the abnormal solar panel 21 is highlighted (step S53), and the generation of the inspection result image is completed (step S57).

  When the second inspection result image generation unit 572 completes the generation of the inspection result image (step S57), the second inspection result image generation unit 572 completes the second inspection result image generation step (RETURN).

  If the panel inspection apparatus 50B (FIG. 9) includes the first inspection result image generation unit 571 in the display processing unit 57B, the first inspection result image generation step (FIG. 8) is selected. The selection of whether to select the second inspection result image generation step can be received, and one inspection result image generation step according to the received selection content can be executed.

  According to the panel inspection apparatus 50B, the second panel inspection procedure, and the second panel inspection PG10B, the same effects as those of the panel inspection apparatus 50A, the first panel inspection procedure, and the first panel inspection PG10A can be obtained. In addition, since the second inspection result image generation unit 572 generates the inspection result image using the composite thermal image 32 as a panel layout showing the arrangement of the solar panel 21 without using the map data 11 or the like. Even if there is no map data 11 or the like, the inspection result of the solar panel 21 can be displayed so that an abnormal location can be grasped.

  Further, in the panel inspection apparatus 50B, when the display processing unit 57B includes the first inspection result image generation unit 571, the map data 11 or the like can be used, so that the map data 11 or the like indicates according to the selection of the display method. The examination result can be displayed by selecting whether to display the synthesized thermal image 32 as an example of the thermal image 22 on the image or to display the synthesized thermal image 32 without the image indicated by the map data 11 or the like.

[Third Embodiment]
FIG. 11 is a functional block diagram showing a functional configuration of a panel inspection apparatus 50C which is an example of a panel inspection apparatus according to the third embodiment of the present invention.

  Panel inspection apparatus 50C (FIG. 11) is different from panel inspection apparatus 50A (FIG. 3) in that inspection range detection means 54C and display processing means 57C are provided instead of inspection range detection means 54A and display processing means 57A. Although different, there is no substantial difference in other respects. Therefore, constituent elements that are not substantially different from the panel inspection apparatus 50A are assigned the same reference numerals and redundant description is omitted.

  The panel inspection apparatus 50C includes, for example, an input unit 51, an output unit 52, a communication unit 53, an inspection range detection unit 54C including a third inspection range detection unit 543, an abnormality detection unit 55, and a position information acquisition unit. 56, a display processing unit 57C including a third inspection result image generation unit 573, a storage unit 58, a control unit 59, and a still image extraction unit 61.

  The inspection range detection unit 54C includes, for example, a third inspection range detection unit 543 in addition to the first inspection range detection unit 541 and the second inspection range detection unit 542.

  The third inspection range detection unit 543 projects each solar panel based on the function of projecting an inspection image such as the thermal image 22 used in the abnormality detection process (FIG. 4) onto the panel layout drawing and the outline of the panel layout drawing. And the function of detecting the range of 21, and after projecting an inspection image such as a thermal image 22 used in the abnormality detection process onto the panel layout, the range of each solar panel 21 based on the outline of the panel layout Is detected.

  The display processing unit 57C includes a third inspection result image generation unit 573 instead of the first inspection result image generation unit 571 with respect to the display processing unit 57A.

  The third inspection result image generation unit 573 has a function of reading out the panel layout drawing data 15 (FIG. 11) that is a basis of the panel layout drawing image (background image) used for displaying the inspection result, and acquiring the panel layout drawing image. And an inspection image such as a thermal image 22 used in the abnormality detection process and a function for specifying which solar panel 21 in the panel layout image each of the solar panels 21 in the inspection image is specified. The solar panel 21 has a function of reflecting the determination result of the presence / absence of the abnormality in the panel layout image.

  The third inspection result image generation unit 573 sequentially acquires inspection images such as the thermal image 22 used in the abnormality detection process, and sequentially determines the determination result of the presence or absence of abnormality of the solar panel 21 reflected in the acquired image. The inspection result image is generated by reflecting the result.

  The control means 59 in the panel inspection apparatus 50C is provided with a control function for components added to the panel inspection apparatus 50A. That is, the control means 59 in the panel inspection apparatus 50C further has a function of exchanging data with the inspection range detection means 54C and the display processing means 57C and controlling them.

  The panel inspection apparatus 50C is not limited to the configuration illustrated in FIG. For example, the panel inspection apparatus 50C does not necessarily include the still image extraction unit 61, like the panel inspection apparatus 50A. Further, if the display processing means 57 in the panel inspection apparatus 50C includes at least the third inspection result image generation unit 573, the display unit 571 further includes the first inspection result image generation unit 571 and the second inspection result image generation unit 572. The structure provided may be sufficient.

  Next, a third panel inspection procedure performed by the panel inspection apparatus 50C will be described as a panel inspection method according to the third embodiment of the present invention. In the description of the third panel inspection procedure, processing steps that are not substantially different from the first and second panel inspection procedures described above are denoted by the same step numbers, and redundant description is omitted.

  The third panel inspection procedure (FIG. 4) is different from the first panel inspection procedure (FIG. 4) in the first inspection range detection step (step S2) and the first inspection result image generation step (step S5). Instead, the second inspection range detection step (step S7) and the third inspection result image generation step (step S8) are different, but the other processing steps are not substantially different.

  FIG. 12 is a process flowchart showing a process flow of the second inspection range detection step (step S7: FIG. 4).

  The second inspection range detection step further includes an image projection step (step S71) and a panel range detection step (step S72) with respect to the first inspection range detection step (FIG. 5). The difference is that step S26) is omitted, but the other points are not substantially different.

  When the second inspection range detection process is started (ENTER), the inspection range detection unit 54C performs the processing steps from step S21 to step S25 in the same manner as the first inspection range detection process, and the subsequent abnormality detection process. An inspection image such as a thermal image 22 used for (FIG. 4) is prepared. Subsequently, the third inspection range detection unit 543 projects the prepared inspection image for projection onto the panel layout (step S71).

  Projection of the inspection image used in the abnormality detection step (FIG. 4) onto the panel layout diagram is performed, for example, by referring to the inspection image used in the abnormality detection step (FIG. 4) with reference to the plane position information of the inspection image. Temporarily decide on the panel layout drawing, search for the feature quantity extracted from the inspection image in the panel layout drawing, and find the closest position where the feature quantity matches from the provisioned position as the final panel. This is done by determining and projecting the position in the layout drawing.

  When the projection to the panel layout drawing is completed, the third inspection range detection unit 543 specifies the range of each solar panel 21 based on the outline of each solar panel 21 in the panel layout diagram, and each solar panel 21 The range is detected (step S72). When the third inspection range detection unit 543 detects each range of the solar panels 21, the panel identification of each solar panel 21 included in the panel layout diagram data 15 (FIG. 11) is detected for each detected solar panel 21. The second inspection range detection step is completed by attaching the information and associating it with the image identification information of the inspection image (RETURN).

  FIG. 13 is a process flowchart showing the flow of the third inspection result image generation step (step S8: FIG. 4).

  The third inspection result image generation process (steps S81 to S83, step S52, step S53, step S84, and step S57) is performed with respect to the first inspection result image generation process (FIG. 8: steps S51 to S57). The apparatus further includes a panel layout drawing image acquisition step (step S81), a panel identification step (step S82), and an abnormality presence / absence determination result acquisition step (step S83). The difference is that the acquisition step (step S54 and step S55) and the position association step (step S56) are omitted, but the other points are not substantially different.

  When the third inspection result image generation step is started (ENTER), first, a base layout image (background image) used by the third inspection result image generation unit 573 (FIG. 11) to display inspection results is displayed. The panel layout diagram data 15 (FIG. 11) is read out to obtain a panel layout map image (step S81).

  When the third inspection result image generation unit 573 acquires the panel layout image, the third inspection result image generation unit 573 subsequently detects abnormality by referring to the identification information of the inspection image and the panel identification information. Each solar panel 21 in the inspection image used in the process (step S3 and step S4: FIG. 4) is identified as a solar panel 21 in the panel layout image (step S82).

  When the third inspection result image generation unit 573 identifies the solar panel 21 (FIG. 2) in the panel layout image, the determination result of the presence / absence of abnormality of the identified solar panel 21 is acquired (step S83), and the abnormal solar is detected. If there is a panel 21 (YES in step S52), the abnormal solar panel 21 is highlighted (step S53).

  When the determination result of the presence / absence of abnormality is reflected on all the solar panels 21 specified by the third inspection result image generation unit 573, the third inspection result image generation unit 573 reflects the determination result of the presence / absence of abnormality of the solar panel 21. When an incomplete image remains (in the case of NO in step S84), the remaining image is read, and all the determination results of the presence / absence of abnormality of the solar panel 21 are reflected (step S82, step S83, step S52 and step S53). .

  On the other hand, when the third inspection result image generation unit 573 reflects all the inspection results from all the images giving the determination result of the presence / absence of the solar panel 21 (YES in step S84), the third inspection result image generation is performed. The unit 573 completes the generation of the inspection result image (step S57), and completes the third inspection result image generation process (RETURN).

  According to the panel inspection apparatus 50C, the third panel inspection procedure, and the third panel inspection PG10C, the same effects as those of the panel inspection apparatus 50A, the first panel inspection procedure, and the first panel inspection PG10A can be obtained. In addition, since the inspection result can be displayed on the panel layout indicated by the panel layout data 15, the inspection result can be provided more easily by the user. In addition, the inspection result image data has a layer structure and is layered for each information to be displayed, so that desired information to be displayed can be selected and displayed on the panel layout drawing.

  For example, by setting the hot spot detection result based on the thermal image 22 and the non-normal detection result based on the visible image 23 as separate layers, the hot spot detection result and the non-normal detection result may be simultaneously or on the panel layout drawing. It can be displayed individually on the panel layout.

  As described above, according to the panel inspection apparatus 50 (50A to 50C), the first to third panel inspection procedures, and the panel inspection PG10 (10A to 10C), the thermal image 22 obtained by photographing the solar panel 21 to be inspected from above. The range of each solar panel 21 is automatically detected using the inspection image such as, and it is detected whether or not there is a location where an abnormality has occurred in each detected solar panel 21. The burden on the inspector required for the 21 inspections can be reduced.

  Moreover, in the panel inspection apparatus 50, the 1st-3rd panel inspection procedure, and panel inspection PG10, the outline of each solar panel 21 is detected from the visible image 23 used when detecting a crack etc., and the detected outline is detected. By enabling projection onto the thermal image 22 including the same range as the visible image 23, it is possible to detect the range of each solar panel 21 even when the thermal image 22 alone cannot sufficiently detect the outline of each solar panel 21. It is possible to automatically detect an abnormal part appearing on each solar panel 21 with higher accuracy than in the past.

  Further, in the panel inspection apparatus 50, the first to third panel inspection procedures, and the panel inspection PG10, it is possible to detect whether or not an unusual location exists in the solar panel 21, so that damage such as cracks is caused. In addition, abnormalities other than hot spots can be detected. In addition, since an unusual location other than a location where damage such as a crack has occurred can also be detected, an abnormal standby state can also be detected. Therefore, it is possible to detect not only the currently occurring abnormality but also an event that may become an abnormality in the future, and prevent future abnormality.

  According to the panel inspection apparatus 50, the first to third panel inspection procedures, and the panel inspection PG10, by using the communication means 53, the thermal image 22 and the like can be received from the UAS 30 and the panel inspection can be performed in real time. Even if the UAS 30 continues to fly after the start of photography, the inspection of the solar panel 21 can be started. Moreover, when an abnormal location is detected on site, repair can be started at an earlier timing.

  According to the panel inspection apparatus 50, the first to third panel inspection procedures, and the panel inspection PG10, the threshold t for determining the presence / absence of a hot spot is determined in consideration of the average value μ and the standard deviation value σ. Hot spots can be detected more accurately by eliminating the effects of temperature, solar radiation, and power generation.

  In addition, as the standard deviation value σ used for the threshold value t, a small area is set in one solar panel 21, and the standard deviation value σ giving the minimum value among the standard deviation values σ obtained based on the luminance in the area is given. If this is used, the variation of the standard deviation value σ between the solar panels 21 can be reduced, and the hot spot detection accuracy can be further increased.

  Further, according to the panel inspection apparatus 50, the first to third panel inspection procedures, and the panel inspection PG10, it is possible to use a moving image such as the thermal moving image 22 as the inspection image, so that the frame rate is higher than that of the still image. Moving image shooting can be performed, and the solar panel 21 to be inspected can be shot with the flight speed of the UAS 30 increased. Therefore, it is possible to capture a wider range or to capture a predetermined range in a shorter time by one aerial photography for acquiring the inspection image.

  According to the panel inspection apparatus 50 including the second inspection result image generation unit 572, the panel inspection procedure performed by the panel inspection apparatus 50, and the panel inspection PG10 in the panel inspection procedure computer, the inspection result can be obtained without the map data 11 or the like. Images can be generated and inspection results can be displayed.

  According to the panel inspection apparatus 50 including the third inspection range detection unit 543 and the third inspection result image generation unit 573, the panel inspection procedure performed by the panel inspection apparatus 50 and the panel inspection procedure computer according to the panel inspection PG10, the panel Since the inspection result can be displayed on the layout drawing, the inspection result can be provided more easily by the user. In addition, the inspection result image data has a layer structure and is layered for each information to be displayed, so that desired information to be displayed can be selected and displayed on the panel layout drawing.

  Note that the method described in each of the above-described embodiments can be applied to various apparatuses by being written in a storage medium such as a magnetic disk, an optical disk, or a semiconductor memory as a program that can be executed by a computer, or transmitted by a communication medium. It can also be applied to various devices. A computer that implements the apparatus reads the program recorded in the storage medium, and executes the above-described processing by controlling the operation by the program.

  In addition, the present invention is not limited to the above-described embodiment as it is, and can be implemented in various forms other than the above-described example in the implementation stage, without departing from the scope of the invention. Various omissions, additions, replacements, and changes can be made. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

1 Computer 2 CPU
3 Main storage device 4 Auxiliary storage device 5 Input device 6 Output device 7 Communication means 8 Calculation server 10 (10A to 10C) Panel inspection PG (program)
11 Map data 13 Ortho image 15 Panel layout data 20 Solar power plant 21 Solar panel 22 Thermal image (thermal still image or thermal movie)
23 Visible image (visible still image or visible video)
24 High-resolution visible image (high-resolution visible still image or high-resolution visible video)
25 Building 26 Thermography 27 Visible camera 28 Integrated camera 29 High-resolution visible camera 30 Unmanned aerial vehicle system (UAS)
50 (50A-50C) Panel inspection apparatus 51 Input means 52 Output means 53 Communication means 54A, 54C Inspection range detection means 541 First inspection range detection section 542 Second inspection range detection section 543 Third inspection range detection section 55 Abnormality detection means 551 Hot spot detection unit (first abnormality detection unit)
552 Unusual location detection unit (second abnormality detection unit)
56 position information acquisition means 57A, 57B, 57C display processing means 571 first inspection result image generation section 572 second inspection result image generation section 573 third inspection result image generation section 58 storage means 59 control means 61 still image extraction Means 62 Image composition means R Flight path

Claims (26)

Inspection range detection means comprising a first inspection range detection unit for detecting the range of each of the solar panels to be inspected based on the temperature distribution appearing in the thermal image obtained by photographing the solar panel to be inspected from above,
A first abnormality detection for detecting an abnormal solar panel by determining that the solar panel is abnormal when it is determined that there is a portion showing a temperature abnormality in each of the ranges of the solar panels detected by the inspection range detection means An abnormality detecting means having a section;
Position information acquisition means for acquiring position information of a photographing position of an image used when the inspection range detection means detects a range of each of the solar panels to be inspected;
Read out map information including position information indicating the position of the solar panel to be inspected, the range of each of the solar panels to be inspected detected by the inspection range detection means, and the image acquired by the position information acquisition means If the abnormality detecting means detects an abnormal solar panel, the inspection information is displayed on the map indicated by the map information based on the abnormal solar panel and the read map information. And a display processing means for generating an inspection result image including inspection result information indicating at least the abnormal solar panel among the solar panels to be inspected. The inspection range detection means further includes a second inspection range detection unit that acquires a visible image taken from above and detects a range of each solar panel to be inspected from the acquired visible image. Item 1. A solar panel inspection apparatus according to item 1. The abnormality detection means is oblique to the visible image and the vertical and horizontal line segments that form the outline of the solar panel within the range of each of the solar panels detected by the inspection range detection means. A second abnormality detection unit is further provided for determining whether the solar panel is abnormal and determining that the solar panel is abnormal when the presence or absence of the line segment vector is determined. The solar panel inspection device described. The abnormality detection means is oblique to the vertical and horizontal line segments that form the outline of the solar panel from within each range of the solar panel detected by the inspection range detection means with respect to the visible image. If the presence or absence of the line segment vector is determined and it is determined that the solar panel is present, the solar panel to be inspected is further provided with a second abnormality detection unit that determines that the solar panel is abnormal and detects the abnormal solar panel If there are multiple visible images with the same resolution including the same range,
Detection of the range of each of the solar panels to be inspected performed by the inspection range detection means, and the abnormality based on a result of determining that the diagonal line segment vector of the solar panel to be inspected by the abnormality detection means is present The detection of the range of each of the solar panels to be inspected performed by at least the inspection range detecting means among the detection of the solar panels is performed using one visible image having the highest resolution. 2. The solar panel inspection apparatus according to 2. 2. The layout of solar panels including all of the solar panels to be inspected given to the display processing means is an ortho image in which the solar panels including all of the solar panels to be inspected are shown. 5. The solar panel inspection apparatus according to any one of 1 to 4. The display processing means is provided with a range of each of the solar panels to be inspected detected by the inspection range detecting means and the abnormal solar panel when the abnormality detecting means detects an abnormal solar panel. Projecting the data of the solar panel layout including all of the inspected solar panels onto the layout of the solar panel to be inspected obtained by reading out the data, and at least the inspection on the layout of the solar panel to be inspected 6. The inspection result image added with a display indicating each solar panel within the range and a display indicating the abnormal solar panel is generated. The solar panel inspection apparatus according to claim 1. For each divided area obtained by dividing the predetermined area including the entire range of the solar panel to be inspected into a plurality of divided areas, when acquiring each divided image, the obtained divided image is based on the acquired divided image. The solar panel inspection according to any one of claims 1 to 6, further comprising image composition means for obtaining one composite image in which at least the entire range of the solar panel to be inspected is photographed. apparatus. The solar panel layout including all of the solar panels to be inspected given to the display processing means is a single composite image obtained by the image composition means. Inspection device. In addition to the layout diagram of the first solar panel based on the data of the layout map of the solar panel provided in advance, the display processing means can display one composite image obtained by the image composition means as a second solar panel. If obtained as a panel layout,
Arrangement of the first solar panel to which an object to which a display indicating each solar panel within the range of the inspection and a display indicating the abnormal solar panel are added when generating the inspection result image is given A function of selecting one of the first solar panel layout and the second solar panel layout based on a command for selecting either the first solar panel layout or the second solar panel layout The solar panel inspection apparatus according to claim 7, further comprising: The display processing means matches the feature amount appearing in the layout drawing of the solar panel with the feature amount reflected in an image used when detecting the range of each of the solar panels to be inspected, thereby The range of each of the solar panels to be inspected detected by the range detector and the abnormal solar panel are projected onto the layout of the solar panel to be inspected when the abnormality detector detects an abnormal solar panel. The solar panel inspection apparatus according to claim 6, wherein the solar panel inspection apparatus is configured as described above. The position information acquisition means includes position information on the shooting position of an image used when detecting the range of each of the solar panels to be inspected, and a predetermined position included in the solar panel layout including all of the solar panels to be inspected. If the location information is obtained from the location information measured by GPS,
When the display processing means detects the range of each of the solar panels to be inspected detected by the inspection range detection means and the abnormality detection means based on the position information measured by the GPS, the abnormal detection means detects an abnormal solar panel. 10. The solar panel inspection apparatus according to claim 6, wherein the abnormal solar panel is configured to project the abnormal solar panel onto the layout of the solar panel to be inspected. 11. As an image used when detecting the range of the solar panel to be inspected, the image processing apparatus further includes a still image extracting unit that generates a still image by cutting out a predetermined frame from a moving image obtained by photographing all the solar panels to be inspected The solar panel inspection apparatus according to claim 1, wherein the solar panel inspection apparatus is a solar panel inspection apparatus. Inspection range detection means comprising a first inspection range detection unit for detecting the range of each solar panel to be inspected based on a temperature distribution appearing in a thermal image obtained by photographing the solar panel to be inspected from above, and the inspection range detection If it is determined that there is a portion indicating a temperature abnormality within the range of each of the solar panels detected by the means, the abnormality having the first abnormality detection unit that determines that the solar panel is abnormal and detects the abnormal solar panel Detection means; position information acquisition means for acquiring information on the photographing position of an image used when the inspection range detection means detects the range of each of the solar panels to be inspected; and the inspection detected by the inspection range detection means The range of each solar panel to be operated, information on the photographing position of the image acquired by the position information acquisition means, and an abnormal solar detector When a panel is detected, based on the abnormal solar panel, an inspection result image including inspection result information indicating the abnormal solar panel among other solar panels to be inspected is generated. It is a solar panel inspection procedure using a solar panel inspection device comprising a display processing means, the solar panel inspection procedure,
An inspection range detection step comprising a first inspection range detection step in which the inspection range detection means detects a range of each of the solar panels to be inspected based on a temperature distribution appearing in the thermal image;
When the abnormality detection means determines that there is a portion indicating a temperature abnormality from each range of the solar panels detected in the inspection range detection step, the solar panel is determined to be abnormal and an abnormal solar panel is detected. An abnormality detection step comprising a first abnormality detection step to perform,
The position information acquisition unit acquires information on the shooting position of the image used when detecting the range of each of the solar panels in the inspection range detection step; and
The display processing means includes a range of each of the solar panels detected in the inspection range detection step, information on a photographing position of the image acquired in the position information acquisition step, and an abnormal solar panel in the abnormality detection step. In the case of the detected solar panel, the inspection result image including the inspection result information indicating the abnormal solar panel among the solar panels to be inspected separately from the other solar panels based on the detected abnormal solar panel And a display processing step for generating a solar panel. The inspection range detection means further includes a second inspection range detection unit that acquires a visible image taken from above and detects a range of each solar panel to be inspected from the acquired visible image,
The inspection range detection step further includes a second inspection range detection step in which the second inspection range detection unit detects a range of the solar panel to be inspected from the acquired visible image. 13. The inspection method of the solar panel of 13. The anomaly detection means is a line segment vector oblique to the vertical and horizontal line segments forming the outline of the solar panel from within the range of each of the solar panels detected by the second inspection range detection unit. When the presence or absence is determined and it is determined that the solar panel is abnormal, the solar panel is determined to be abnormal, and further includes a second abnormality detection unit that detects the abnormal solar panel,
In the abnormality detection step, the line vector of the diagonal direction is defined with respect to the vertical and horizontal line segments forming the outline of the solar panel from the range of the solar panel detected in the second inspection range detection step. The solar panel according to claim 14, further comprising a second abnormality detection step of determining presence / absence and determining that the solar panel is abnormal when the presence / absence is determined, and detecting the abnormal solar panel. Inspection method. The anomaly detection means is a line segment vector oblique to the vertical and horizontal line segments forming the outline of the solar panel from within the range of each of the solar panels detected by the second inspection range detection unit. The same range including the solar panel to be inspected is further provided with a second abnormality detection unit that determines that the solar panel is abnormal and detects the abnormal solar panel. If there are multiple visible images with different resolutions,
Of the second inspection range detection step and the second abnormality detection step, at least the second inspection range detection step is performed using one visible image with the highest resolution. Item 15. A solar panel inspection method according to Item 14. 14. The layout diagram of solar panels including all of the solar panels to be inspected given to the display processing means is an ortho image showing the solar panels including all of the solar panels to be inspected. The inspection method of the solar panel of any one of 1 to 16. The display processing step gives a range of each of the solar panels detected in the inspection range detection step, and an abnormal solar panel detected when an abnormal solar panel is detected in the abnormality detection step. Projecting the data of the solar panel layout including all of the inspected solar panels to be projected onto the layout of the solar panel to be inspected, and obtaining at least the layout of the solar panel to be inspected. 18. The method according to claim 13, further comprising the step of generating the inspection result image to which a display indicating each solar panel within the inspection range and a display indicating the abnormal solar panel are added. The inspection method of the solar panel of 1 item | term. The solar panel inspection procedure is acquired when acquiring individual divided images obtained by photographing each divided area with respect to a divided area obtained by dividing the predetermined area including the entire range of the solar panel to be inspected into a plurality of areas. Based on the divided image, an image composition means for obtaining at least one composite image in which the entire range of the solar panel to be inspected is imaged is obtained by combining one image in which the entire range of the solar panel to be inspected is imaged. And further comprising an image synthesis step for obtaining an image,
In the display processing step, the layout of the solar panel to be inspected is added with a display showing each solar panel within the inspection range and a display showing the abnormal solar panel. The solar panel inspection method according to claim 18, wherein the obtained composite image is one sheet. In addition to the layout diagram of the first solar panel based on the data of the layout map of the solar panel given in advance, the display processing unit displays one composite image obtained by the image composition unit as the second solar panel If obtained as a panel layout,
The solar panel inspection procedure is acquired when acquiring individual divided images obtained by photographing each divided area with respect to a divided area obtained by dividing the predetermined area including the entire range of the solar panel to be inspected into a plurality of areas. Based on the divided image, an image composition means for obtaining at least one composite image in which the entire range of the solar panel to be inspected is imaged is obtained by combining one image in which the entire range of the solar panel to be inspected is imaged. And further comprising an image synthesis step for obtaining an image,
In the display processing step, the layout of the first solar panel selected based on an instruction to select either the layout of the first solar panel or the layout of the second solar panel, and the first An image including at least a display indicating each solar panel within the inspection range and a display indicating the abnormal solar panel is generated as any one of the two solar panel layout diagrams as the inspection result image. The solar panel inspection method according to claim 18, further comprising a step. The display processing step matches the feature amount appearing in the layout view of the solar panel with the feature amount reflected in an image used when detecting the range of each of the solar panels to be inspected. To the layout of the solar panel to be inspected, the range of each of the solar panels detected in the range detection step and the detected abnormal solar panel when an abnormal solar panel is detected in the abnormality detection step The solar panel inspection method according to any one of claims 18 to 20, wherein projection is performed. The position information acquisition means includes position information on the shooting position of an image used when detecting the range of each of the solar panels to be inspected, and a predetermined position included in the solar panel layout including all of the solar panels to be inspected. If the location information is obtained from the location information measured by GPS,
In the display processing step, when each solar panel detected in the inspection range detection step and an abnormal solar panel are detected in the abnormality detection step based on position information measured by the GPS 21. The method for inspecting a solar panel according to claim 18, wherein the detected abnormal solar panel is projected onto a layout view of the solar panel to be inspected. The image used when detecting the range of each of the solar panels in the inspection range detection step is a moving image in which all of the solar panels to be inspected are photographed. Inspection method of the solar panel as described in the item. In the solar panel inspection procedure, as an image used when detecting a range of the solar panel to be inspected, a still frame is generated by cutting out a predetermined frame from a moving image in which each of the solar panels to be inspected is captured. Image extracting means further comprises the step of generating the still image;
The solar panel inspection method according to claim 23, wherein the inspection range detection step is performed using the still image. The thermal image and the visible image that are used when detecting the range of each of the solar panels in the inspection range detection step are moving images that are taken with synchronized timing,
The said 1st test | inspection range detection step and the said 2nd test | inspection range detection step detect the range of each of the solar panels inspected continuously from the said moving image, The any one of Claim 14 to 22 characterized by the above-mentioned. The inspection method of the solar panel of 1 item | term. An inspection range detection step comprising a first inspection range detection step of detecting a range of the solar panel to be inspected based on a temperature distribution appearing in a thermal image obtained by photographing the solar panel to be inspected from above;
When it is determined that there is a portion indicating a temperature abnormality from the range of the solar panel detected in the inspection range detection step, the first abnormality detection step of determining the solar panel as abnormal and detecting an abnormal solar panel An abnormality detection step comprising:
A position information acquisition step of acquiring information of a photographing position of an image used when detecting the range of the solar panel in the inspection range detection step;
When the solar panel range detected in the inspection range detection step, the shooting position information of the image acquired in the position information acquisition step, and an abnormal solar panel detected in the abnormality detection step Based on the detected abnormal solar panel, the abnormal solar panel is differentiated from the solar panel that is not determined to be abnormal in the abnormality detection step, and an inspection result image indicating the solar panel to be inspected is generated. A solar panel inspection program that causes a computer to execute the solar panel inspection procedure including the display processing step.

Images