Disclosure of Invention
The invention provides a method, a terminal and a system for detecting foreign matters in a transmission conductor, which can replace a manual line patrol mode to realize detection of the foreign matters in the transmission conductor and improve the detection efficiency.
In a first aspect, an embodiment of the present invention provides a method for detecting a foreign object in a power transmission conductor, including the following steps:
receiving first video information acquired by a camera and second video information acquired by an unmanned aerial vehicle;
analyzing the first video information and the second video information respectively based on a deep learning model to obtain a first foreign matter detection result and a second foreign matter detection result;
and sending the first foreign matter detection result and the second foreign matter detection result to a server so that the server updates and displays the foreign matter hot spot diagram through a power transmission conductor.
Preferably, the first foreign object detection result and the second foreign object detection result are sent to a server, so that the server updates and displays a foreign object hotspot graph through a power transmission conductor, specifically: and sending the first foreign matter detection result and the second foreign matter detection result to a server so that the server updates and displays the first foreign matter detection result and the second foreign matter detection result through a power transmission conductor foreign matter hotspot graph based on a Storm flow frame.
Preferably, the first foreign object detection result includes a first foreign object type, number, and transmission tower number, and the second foreign object detection result includes a second foreign object type, number, and geographical coordinates at which the second foreign object is detected.
In a second aspect, an embodiment of the present invention provides a power transmission conductor foreign matter detection method, including the following steps:
the terminal receives first video information acquired by a camera and second video information acquired by an unmanned aerial vehicle;
the terminal analyzes the first video information and the second video information respectively based on a deep learning model to obtain a first foreign matter detection result and a second foreign matter detection result;
the terminal sends the first foreign matter detection result and the second foreign matter detection result to a server;
and the server updates and displays the first foreign matter detection result and the second foreign matter detection result through a power transmission conductor foreign matter hot spot diagram.
Preferably, the first foreign matter detection result includes a first foreign matter type, number, and transmission tower number, the second foreign matter detection result includes a second foreign matter type, number, and geographical coordinates at which the second foreign matter is detected, and correspondingly, the server updates and displays the first foreign matter type, number, and transmission tower number and the second foreign matter type, number, and geographical coordinates at which the second foreign matter is detected on a transmission conductor foreign matter hotspot graph based on a Storm flow frame.
Preferably, the method further comprises the steps of: and the server determines the frequent foreign matter area according to the foreign matter hot spot diagram and analyzes the reason causing the frequent foreign matter.
Preferably, the method further comprises the steps of: and the server adjusts the unmanned aerial vehicle inspection strategy according to the foreign matter hotspot graph.
In a third aspect, an embodiment of the present invention provides a terminal, including: one or more processors, one or more memories; the one or more memories coupled to the one or more processors, the one or more memories for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the terminal to perform the power conductor foreign object detection method described above.
In a fourth aspect, embodiments of the present invention provide a power transmission conductor foreign object detection system, comprising a terminal and a server, the terminal and the server being connected in wireless communication, wherein,
the terminal is used for receiving first video information acquired by the camera and second video information acquired by the unmanned aerial vehicle; analyzing the first video information and the second video information respectively based on a deep learning model to obtain a first foreign matter detection result and a second foreign matter detection result; sending the first foreign object detection result and the second foreign object detection result to the server;
the server is used for updating and displaying the first foreign matter detection result and the second foreign matter detection result through a power transmission conductor foreign matter hot spot diagram.
Preferably, the first foreign matter detection result includes a first foreign matter type, number, and transmission tower number, the second foreign matter detection result includes a second foreign matter type, number, and geographical coordinates at which the second foreign matter is detected, and correspondingly, the server updates and displays the first foreign matter type, number, and transmission tower number and the second foreign matter type, number, and geographical coordinates at which the second foreign matter is detected on a transmission conductor foreign matter hotspot graph based on a Storm flow frame.
By adopting the technical scheme, the terminal receives the first video information acquired by the camera and the second video information acquired by the unmanned aerial vehicle; analyzing the first video information and the second video information respectively based on the deep learning model to obtain a first foreign matter detection result and a second foreign matter detection result; and then the first foreign matter detection result and the second foreign matter detection result are sent to a server, so that the server updates and displays through a transmission conductor foreign matter hotspot graph, related personnel can know the condition of the transmission conductor foreign matter through the transmission conductor foreign matter hotspot graph without manual inspection, the detection efficiency is improved, the labor cost is reduced, video information of the transmission conductor is acquired through a camera on a transmission tower, the video information of the transmission conductor is acquired through an unmanned aerial vehicle, the foreign matter detection result is obtained by combining the video information of the two aspects, and the foreign matter detection accuracy is higher.
Detailed Description
The following further describes embodiments of the present invention with reference to the drawings. It should be noted that the description of the embodiments is provided to help understanding of the present invention, but the present invention is not limited thereto. In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more than two.
In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present application, "a plurality" means two or more unless otherwise specified.
In a first aspect, as shown in fig. 1, an embodiment of the present invention provides a power transmission conductor foreign object detection method, including the following steps:
s101, receiving first video information acquired by a camera and second video information acquired by an unmanned aerial vehicle;
the camera is arranged on the power transmission tower, the camera can be a camera arranged on the power transmission tower independently, and the camera can also be a camera arranged on a terminal, and the terminal is arranged on the power transmission tower. The camera is in wireless communication connection with the terminal, and the camera can be controlled by the terminal to acquire video information of the transmission conductor.
In addition, the unmanned aerial vehicle that can patrol and examine can gather transmission line video information.
Step S102, analyzing the first video information and the second video information respectively based on a deep learning model to obtain a first foreign matter detection result and a second foreign matter detection result;
deep learning provides a method for enabling a computer to automatically learn mode characteristics, and the characteristic learning is integrated into the process of establishing a model, so that incompleteness caused by artificial design of characteristics is reduced. And under the application scene that satisfies specific condition, the discernment or classification performance that surpasses current algorithm has been reached.
The first video information and the second video information are respectively subjected to video decoding, the decoded images are respectively input into the deep learning model, foreign matters on a power transmission line in the images, including but not limited to bird nests, plastic films and the like, are detected through the deep learning model, and a first foreign matter detection result and a second foreign matter detection result are respectively obtained.
And step S103, sending the first foreign matter detection result and the second foreign matter detection result to a server so that the server updates and displays the foreign matter hot spot diagram through the power transmission conductor.
The terminal sends the obtained first foreign matter detection result and the second foreign matter detection result to the server, the server can conveniently analyze and process the first foreign matter detection result and the second foreign matter detection result, and the server can display the first foreign matter detection result and the second foreign matter detection result through a power transmission conductor foreign matter hot spot diagram.
By adopting the technical scheme, the terminal receives the first video information acquired by the camera and the second video information acquired by the unmanned aerial vehicle; analyzing the first video information and the second video information respectively based on the deep learning model to obtain a first foreign matter detection result and a second foreign matter detection result; then send first foreign matter testing result and second foreign matter testing result for the server, so that the server passes through transmission line foreign matter hotspot graph update display, can make relevant personnel know the condition of transmission line foreign matter through transmission line foreign matter hotspot graph like this, do not need the manual work to patrol and examine, the detection efficiency is improved, the labor cost is reduced, and transmission line video information has been gathered through the camera on the transmission tower promptly, gather transmission line video information through unmanned aerial vehicle again, combine the video information of two aspects to obtain the foreign matter testing result, it is higher to detect the foreign matter degree of accuracy.
Preferably, in step S103: sending the first foreign matter detection result and the second foreign matter detection result to a server so that the server updates and displays a foreign matter hotspot graph through a power transmission conductor, specifically: and sending the first foreign matter detection result and the second foreign matter detection result to a server so that the server updates and displays the first foreign matter detection result and the second foreign matter detection result through a power transmission conductor foreign matter hotspot graph based on a Storm flow frame.
Storm flow framework: storm is a free-sourced, distributed, highly fault-tolerant real-time computing system. Storm makes continuous stream computation easy, making up real-time requirements that Hadoop batch processing cannot meet. Storm has prominent effect in the fields of real-time analysis, online machine learning, continuous calculation, distributed remote invocation, ETL and the like. Storm deployment management is very simple and Storm performance is superior in homogeneous streaming tools.
In the application, the transmission conductor foreign matter heat point diagram is updated and displayed in real time through the Storm flow frame according to the first foreign matter detection result and the second foreign matter detection result, the efficiency is higher, and the speed is higher.
Preferably, the first foreign object detection result includes a first foreign object type, number, and transmission tower number, and the second foreign object detection result includes a second foreign object type, number, and geographical coordinates at which the second foreign object is detected.
Therefore, the power transmission tower number, the type and the number of the foreign matters at the power transmission conductor can be displayed through the foreign matter heat point diagram of the power transmission conductor, and the specific geographic position, the type and the number of the foreign matters at the power transmission conductor can be displayed, so that the foreign matter detection condition of the power transmission conductor can be clear by related workers watching the foreign matter heat point diagram of the power transmission conductor.
In a second aspect, as shown in fig. 2, an embodiment of the present invention provides a power transmission conductor foreign matter detection method, including the following steps:
step S201, a terminal receives first video information acquired by a camera and second video information acquired by an unmanned aerial vehicle;
step S202, the terminal analyzes the first video information and the second video information respectively based on a deep learning model to obtain a first foreign matter detection result and a second foreign matter detection result;
step S203, the terminal sends the first foreign matter detection result and the second foreign matter detection result to a server;
and step S204, the server updates and displays the first foreign matter detection result and the second foreign matter detection result through a power transmission conductor foreign matter hot spot diagram.
The method is applied to a power transmission conductor foreign matter detection system, and the power transmission conductor foreign matter detection system comprises a terminal and a server. The terminals are arranged on the transmission towers, and the terminals can be arranged on each transmission tower or some transmission towers.
Preferably, the first foreign matter detection result includes a first foreign matter type, number, and transmission tower number, and the second foreign matter detection result includes a second foreign matter type, number, and geographical coordinates at which the second foreign matter is detected, and correspondingly, the server updates and displays the first foreign matter type, number, and transmission tower number and the second foreign matter type, number, and geographical coordinates at which the second foreign matter is detected on the transmission conductor foreign matter hotspot map based on the Storm flow frame.
Preferably, the method further comprises the steps of: the server determines the frequent foreign matter area according to the foreign matter hotspot graph and analyzes the reason causing the frequent foreign matter. Therefore, related personnel can carry out the next treatment or remedial action according to the analysis results, and more serious results are avoided.
Preferably, the method further comprises the steps of: and the server adjusts the unmanned aerial vehicle inspection strategy according to the foreign matter hotspot graph.
Preferably, the method further comprises the steps of: and the server sends the first foreign matter detection result and the second foreign matter detection result to the client. Therefore, related personnel holding the client can conveniently know the detection condition of the foreign matters in the power transmission conductor, so that timely treatment measures are carried out, and loss and more serious consequences are avoided.
In a third aspect, an embodiment of the present invention provides a terminal, including: one or more processors, one or more memories; the one or more memories coupled to the one or more processors, the one or more memories for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the terminal to perform the power conductor foreign object detection method described above.
The memory may be, but is not limited to, a read-only memory (ROM) or other type of static storage device that may store static information and instructions, a Random Access Memory (RAM) or other type of dynamic storage device that may store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), a magnetic disc storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory may be self-contained and coupled to the processor via a bus. The memory may also be integral to the processor.
The memory is used for storing application program codes for executing the scheme of the application and is controlled by the processor to execute. The processor is configured to execute the application code stored in the memory to implement the functions of the method of the present patent.
In particular implementations, a processor may include one or more CPUs and GPUs, as one embodiment.
In particular implementations, the terminal may include multiple processors, as one embodiment. Each of the processors may be a single-Core (CPU) processor, a multi-core (multi-CPU) processor, or a GPU. A processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (e.g., computer program instructions).
In a fourth aspect, as shown in fig. 3, an embodiment of the present invention provides a power transmission conductor foreign object detection system, which comprises a terminal 300 and a server 400, wherein the terminal 300 and the server 400 are connected in wireless communication, wherein,
the terminal 300 is used for receiving first video information acquired by a camera and second video information acquired by an unmanned aerial vehicle; analyzing the first video information and the second video information respectively based on a deep learning model to obtain a first foreign matter detection result and a second foreign matter detection result; sending the first foreign matter detection result and the second foreign matter detection result to a server;
the server 400 is configured to update and display the first foreign object detection result and the second foreign object detection result by using a power transmission line foreign object hotspot map.
Preferably, the first foreign matter detection result includes a first foreign matter type, number, and transmission tower number, and the second foreign matter detection result includes a second foreign matter type, number, and geographical coordinates at which the second foreign matter is detected, and correspondingly, the server updates and displays the first foreign matter type, number, and transmission tower number and the second foreign matter type, number, and geographical coordinates at which the second foreign matter is detected on the transmission conductor foreign matter hotspot map based on the Storm flow frame.
The embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to the described embodiments. It will be apparent to those skilled in the art that various changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, and the scope of protection is still within the scope of the invention.