CN111339347A - Management method and device for inspection photos - Google Patents

Management method and device for inspection photos Download PDF

Info

Publication number
CN111339347A
CN111339347A CN202010422539.1A CN202010422539A CN111339347A CN 111339347 A CN111339347 A CN 111339347A CN 202010422539 A CN202010422539 A CN 202010422539A CN 111339347 A CN111339347 A CN 111339347A
Authority
CN
China
Prior art keywords
photo
information
waypoint
shooting
photos
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010422539.1A
Other languages
Chinese (zh)
Other versions
CN111339347B (en
Inventor
熊文韬
其他发明人请求不公开姓名
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Digital Green Earth Technology Co.,Ltd.
Original Assignee
Beijing Greenvalley Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Greenvalley Technology Co ltd filed Critical Beijing Greenvalley Technology Co ltd
Priority to CN202010422539.1A priority Critical patent/CN111339347B/en
Publication of CN111339347A publication Critical patent/CN111339347A/en
Application granted granted Critical
Publication of CN111339347B publication Critical patent/CN111339347B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/587Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/20Administration of product repair or maintenance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/06Energy or water supply

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • General Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Library & Information Science (AREA)
  • Quality & Reliability (AREA)
  • Operations Research (AREA)
  • Software Systems (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Public Health (AREA)
  • Water Supply & Treatment (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Navigation (AREA)

Abstract

The application provides a management method and device for inspection photos. The method comprises the following steps: acquiring photos acquired by an unmanned aerial vehicle in a routing inspection process according to a preset power routing inspection route, and determining photo information carried in the photos; wherein the photo information includes time information of the photo taking and GPS position information; acquiring a route file corresponding to the unmanned aerial vehicle, wherein the route file comprises the preset power patrol route which comprises a certain number of waypoints; matching waypoint information of a target shooting waypoint corresponding to the picture from the power patrol route of the unmanned aerial vehicle based on the time information and the GPS position information; and naming and storing the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo. Therefore, the photo data can be conveniently managed and inquired by the staff in the follow-up process.

Description

Management method and device for inspection photos
Technical Field
The application relates to the technical field of electric data processing, in particular to a management method and device for polling photos.
Background
Because the extended distance of the power transmission line is very long and the power transmission line can be deployed in a remote place, fine inspection of a power transmission line tower is always important in operation and maintenance work of a power grid, the traditional fine inspection work is always in a mode of on-site inspection by personnel, and the efficiency is low, the labor amount is high and certain dangerousness is achieved. Because many rotor unmanned aerial vehicle can be close to and patrol and examine the target and shoot, the operating efficiency is high, personnel intensity of labour characteristics lower relatively, consequently in recent years, many rotor unmanned aerial vehicle are patrolling and examining the application of work in refining more and more extensively.
However, the new inspection operation mode also causes new problems. When many rotor unmanned aerial vehicle dredged the original photo data transmission that forms to terminal equipment more meticulously, because terminal equipment can receive a large amount of photos simultaneously, and then make the staff hardly judge information such as the concrete position that the photo gathered, be unfavorable for staff's later stage data to use.
In the related technology, the bar code information on a picture is extracted by acquiring pictures of a plurality of groups of objects to be processed, each bar code information is analyzed into the number of the object to be processed by a bar code analysis technology, and then the picture file name of each object to be processed is renamed to the number of the object to be processed; although this method is very effective, it also has the disadvantage of being labor intensive.
Disclosure of Invention
In view of this, the present application provides a method and an apparatus for managing polling photos, which enable efficient and accurate storage and management of photo data collected by an unmanned aerial vehicle during power polling operation.
Specifically, the method is realized through the following technical scheme:
in a first aspect, an embodiment of the present application provides a method for managing polling photos, where the method includes:
acquiring photos acquired by an unmanned aerial vehicle in a routing inspection process according to a preset power routing inspection route, and determining photo information carried in the photos; wherein the photo information includes time information of the photo taking and GPS position information;
acquiring a route file corresponding to the unmanned aerial vehicle, wherein the route file comprises the preset power patrol route which comprises a certain number of waypoints; matching waypoint information of a target shooting waypoint corresponding to the picture from the power patrol route of the unmanned aerial vehicle based on the time information and the GPS position information;
and naming and storing the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo.
Optionally, matching, from the power inspection route of the unmanned aerial vehicle, waypoint information of a target shooting waypoint corresponding to the picture based on the time information and the GPS location information includes:
sequencing the photos according to the shooting time according to the time information of the photo shooting, and further determining the shooting sequence of the photos;
and comparing the pictures with the sequence numbers of the waypoints on the power inspection route according to the shooting sequence, determining a target shooting waypoint corresponding to the pictures, and acquiring waypoint information of the target shooting waypoint from the route file.
Optionally, after preliminarily determining the target shooting waypoint corresponding to the picture, the method further includes:
and respectively calculating the distance error between the photo and the preliminarily determined target shooting waypoint according to the shooting sequence of the photo, and taking the shooting waypoint with the minimum distance error as the target shooting waypoint of the photo.
Optionally, the photo information further includes: line name, operation unit, line voltage grade and pole tower number related to the photo; the waypoint information comprises: part point information, a shooting direction and a shooting angle;
the naming and storing of the photo with reference to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo includes:
determining the name of a hierarchical folder for storing the photo and the name of the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo;
and storing the photos according to the path of the grading folder.
Optionally, before referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo, naming and storing the photo, the method further includes:
analyzing the defects of the target shooting component of the photo to generate a description text of the photo;
the naming and storing of the photo with reference to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo includes:
and naming and storing the photo according to the description text, the photo information and the waypoint information of the target shooting waypoint corresponding to the photo.
Optionally, the performing a defect analysis on the target shooting component on the photo to generate a description text of the photo includes:
dividing the photo into at least two sub-images, and extracting an interested area of each sub-image;
and identifying the region of interest according to the trained attention model to obtain an identification result, and taking the identification result as the description text.
In a second aspect, an embodiment of the present application provides a management device for polling photos, the device includes:
the determining module is used for acquiring photos acquired by the unmanned aerial vehicle in the process of routing inspection according to a preset power routing inspection route and determining photo information carried in the photos; wherein the photo information includes time information of the photo taking and GPS position information;
the matching module is used for acquiring a route file corresponding to the unmanned aerial vehicle, wherein the route file comprises the preset power patrol route which comprises a certain number of waypoints; matching waypoint information of a target shooting waypoint corresponding to the picture from the power patrol route of the unmanned aerial vehicle based on the time information and the GPS position information;
and the naming storage module is used for naming and storing the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo.
Optionally, the matching module specifically includes:
the sorting unit is used for sorting the photos according to the shooting time according to the time information of the photos so as to determine the shooting sequence of the photos;
and the comparison unit is used for comparing the pictures with the serial numbers of the waypoints on the power inspection route according to the shooting sequence, determining a target shooting waypoint corresponding to the pictures, and acquiring waypoint information of the target shooting waypoint from the route file.
Optionally, the matching module further includes:
and the calculating unit is used for respectively calculating the distance errors between the photos and the preliminarily determined target shooting waypoints according to the shooting sequence of the photos, and taking the shooting waypoint with the minimum distance error as the target shooting waypoint of the photos.
In a third aspect, an embodiment of the present application provides a machine-readable storage medium, on which computer instructions are stored, and when the computer instructions are executed, the method according to the first aspect is implemented.
In a fourth aspect, an embodiment of the present application provides a computer device, including: a machine-readable storage medium and a processor, the machine-readable storage medium: storing instruction code, the processor: communicating with a machine-readable storage medium, reading and executing instruction code in the machine-readable storage medium, to implement a method as described in the first aspect.
According to the management method and device for the inspection photo, after the photo collected by the unmanned aerial vehicle in the inspection process according to the preset power inspection route is obtained, the time information and the GPS position information of photo shooting carried in the photo are determined; acquiring a route file corresponding to the unmanned aerial vehicle, wherein the route file comprises the power patrol route, and matching waypoint information of a target shooting waypoint corresponding to the picture from the power patrol route of the unmanned aerial vehicle based on the time information and the GPS position information; the photo is named and stored according to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo, so that the huge number of disordered photos returned by the unmanned aerial vehicle can be named and stored respectively, workers can manage and inquire photo data conveniently, and compared with the prior art that the photo data are stored and named in a barcode information analyzing mode, the method has the advantages of being simple, efficient and positive.
Drawings
Fig. 1 is a flowchart illustrating a method for managing polling photos according to an exemplary embodiment of the present application;
FIG. 2 is a schematic diagram of a target shooting waypoint matching method shown in an exemplary embodiment of the present application;
FIG. 3 is a schematic diagram illustrating the storage of a patrol print in accordance with an exemplary embodiment of the present application;
fig. 4 is a flowchart illustrating another method for managing polling photos according to an exemplary embodiment of the present application;
fig. 5 is a schematic structural diagram of a management apparatus for inspecting photos according to an exemplary embodiment of the present application;
fig. 6 is a schematic structural diagram of a computer device according to an exemplary embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
When using unmanned aerial vehicle to carry out the power line and patrolling and examining, carry out the photo by unmanned aerial vehicle along electric power airline flight and shoot to the photo that will shoot is real-time or non-real-time transmission to indoor supervisory equipment, and the staff need arrange the special messenger and interpret the arrangement to the photo at indoor photo data processing in-process, and rename again, work efficiency is low and make mistakes easily. Based on this, the embodiment of the application provides a management method for polling photos, so as to realize automatic renaming of the photos through the information carried by the photos and the route files for fine polling, generate standard archived photo data, improve the working efficiency of workers, and facilitate management and query of the photos.
Fig. 1 is a flowchart illustrating a method for managing polling photos according to an exemplary embodiment of the present application; referring to fig. 1, the method includes the following steps:
s10, acquiring photos acquired by the unmanned aerial vehicle in the routing inspection process according to the preset power routing inspection route, and determining photo information carried in the photos; wherein the photo information includes time information of the photo taking and GPS position information.
The method comprises the steps that a power line is subjected to a fine inspection process through an unmanned aerial vehicle power inspection software system, the flight line of the unmanned aerial vehicle needs to be planned at first, part points needing to be shot are selected in a man-machine interaction mode, waypoints are automatically generated through software, a flight route is formed, and finally flight safety inspection is carried out.
When planning a route, an operator analyzes information in a route task file, and fills related information of part points and waypoints (shooting points), wherein the specific contents of the part points comprise parts such as a tower overall view, a tower head, a tower body, an insulator, a pole number plate, each hanging point, a channel, hardware fittings and the like. The waypoint shooting positions comprise left, right, upper and lower positions facing the large-size side, left, right, upper and lower positions facing the small-size side and the like; the shooting angles of the waypoints comprise overlook, look-up and head-up; and also contains other custom content. Wherein the part points and the waypoints are in a one-to-many relationship.
Illustratively, the manner in which the flight path is generated includes: firstly, adding component points, namely selecting tower parts to be shot on high-precision laser point cloud through a power inspection software system, and filling the component names, the number of pictures, the phase sequence and the shooting positions to be shot. And the second step of the air route planning is that the air route is automatically generated, and the air route points are generated through the part points and connected into the air route. Generating a flight route according to a rule generated in sequence or according to the shortest path; after generating the airline, further carrying out waypoint editing, mainly checking the shooting angle and the shooting position of each waypoint in software according to the results of airline safety detection and waypoint interval detection, and modifying the waypoints which do not meet the requirements. Generating a route file based on the generated route and the waypoint information of each waypoint, wherein the route file adopts a uniform format, and a data structure comprises the longitude and latitude, the altitude, the aircraft course, the camera angle and other information of the waypoint (photographing point).
Exporting the planned route file, inputting the planned route file into unmanned aerial vehicle flight control equipment, enabling the unmanned aerial vehicle to execute path flight according to the specific planned route file to obtain original photo information of a power line pole tower and a section under the path, and scanning the power line pole tower and the section through an unmanned aerial vehicle power inspection software/hardware system to obtain original photo data; the original photo data here is usually a hash file, the name of which is unordered, meaningless. For example, DSG-0001.JPG, DSG-1201.JPG, etc. In the embodiment of the application, the original photo data are classified and stored.
S20, acquiring a route file corresponding to the unmanned aerial vehicle, wherein the route file comprises the preset power patrol route which comprises a certain number of waypoints; and matching the waypoint information of the target shooting waypoint corresponding to the picture from the electric power inspection route of the unmanned aerial vehicle based on the time information and the GPS position information.
In this embodiment, the shooting time (accurate to millisecond) and the three-dimensional space coordinates of the GPS are obtained by reading the Exif (Exchangeable Image File) information of the photo.
FIG. 2 is a schematic diagram of a target shooting waypoint matching method shown in an exemplary embodiment of the present application; referring to fig. 2, step S20 includes:
s201, sequencing the photos according to the shooting time sequence according to the time information of the photo shooting, and further determining the shooting sequence of the photos;
s202, comparing the pictures with the sequence numbers of the waypoints on the power inspection route according to the shooting sequence, determining a target shooting waypoint corresponding to the pictures, and acquiring waypoint information of the target shooting waypoint from the route file.
Optionally, the method further includes: and respectively calculating the distance error between the photo and the preliminarily determined target shooting waypoint according to the shooting sequence of the photo, and taking the shooting waypoint with the minimum distance error as the target shooting waypoint of the photo.
Furthermore, in the embodiment, the flight point sequence number and the three-dimensional space coordinate in the flight line file are read. And ordering the photos according to the shooting time, and ordering the waypoints according to the sequence numbers to form two ordered lists. And then matching the three-dimensional space coordinates in the two lists according to a minimum error distance method to find out the corresponding relation between the picture and the navigation point.
Because the unmanned aerial vehicle flies to the waypoint position and then takes a picture, the GPS position in the picture should be completely consistent with the waypoint (the picture taking point), but in the actual flying process, because the unmanned aerial vehicle receives various factors such as the speed of flight, the wind speed and the GPS signal, the GPS position and the waypoint (the picture taking point) of the picture have errors. And calculating the distance error between the photos and the waypoints according to the sequence of the photos, and selecting the point with the minimum error as the waypoint associated with the photos. And calculating all the photos in sequence, associating all the photos with corresponding waypoints, and matching the photos to corresponding waypoint coordinates and the like through the association matching.
It should be noted that some waypoints are flight assistance points to be removed, a threshold (usually 1 m) is set, and if the error between all photo points and the point is greater than the threshold, which indicates that the waypoint does not need to be photographed, the waypoint is filtered.
And S30, naming and storing the picture by referring to the picture information and the waypoint information of the target shooting waypoint corresponding to the picture.
The above-mentioned photo information further includes: line name, operation unit, line voltage grade and pole tower number related to the photo; the waypoint information comprises: part point information, a shooting direction and a shooting angle;
in the step S30, the naming and storing the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo includes the following steps a10-a 20:
step A10, referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo, and determining the name of a hierarchical folder for storing the photo and the name of the photo;
and A20, storing the photos according to the path of the hierarchical folder.
The data structure of the navigation points and the part points corresponding to the photos is obtained in the navigation line file, so that information such as line names, operation units, line voltage grades, pole tower numbers, part point names and shooting time related to the photos can be obtained through analysis, and then regular photo naming is prepared by using the information. Exemplarily, reference is made to the embodiment shown in fig. 3.
The photos are renamed according to the above information. Exporting the data of the inspection photo to a specified directory, and carrying out hierarchical folder management according to the specification (the specific folder organization mode is customized according to the requirements of customers), for example:
folder first layer: XXkV XXX line unmanned aerial vehicle inspection data of XX company;
folder second floor: unmanned aerial vehicle inspection data of X month and X day in X year;
third layer of folder: data of # XXX tower unmanned aerial vehicle inspection;
fig. 4 is a flowchart illustrating another method for managing polling photos according to an exemplary embodiment of the present application; before naming and storing the picture by referring to the picture information and the waypoint information of the target shooting waypoint corresponding to the picture, the method further includes step S30':
s30', carrying out defect analysis on the picture by the target shooting component to generate a description text of the picture;
the naming and storing of the picture with reference to the picture information and the waypoint information of the target shooting waypoint corresponding to the picture includes step S40:
and S40, naming and storing the photo according to the description text, the photo information and the waypoint information of the target shooting waypoint corresponding to the photo.
In an embodiment of the present application, the performing defect analysis on the target shooting component on the photo to generate a description text of the photo includes:
dividing the photo into at least two sub-images, and extracting an interested area of each sub-image;
and identifying the region of interest according to the trained attention model to obtain an identification result, and generating the description text by referring to the identification result.
The above description text may be "rust severe", "leakage risk", etc., for example.
In this embodiment, specifically, when the defect analysis of the target shooting component is performed on the picture, the picture is cut to obtain a plurality of sub-images; the method comprises the steps of obtaining a first feature vector of each sub-image, calculating an attention allocation probability value of each sub-image through a trained attention allocation model, determining a second feature vector for identifying a target image according to the first feature vector of each sub-image and the attention allocation probability value of each sub-image, and identifying the target image by using the second feature vector to obtain an identification result.
The method provided by the embodiment of the application solves the problem that the naming of the fine routing inspection photo data is undefined, has high automatic renaming accuracy, cannot make mistakes, improves the standardization degree and the standardization degree, and facilitates the subsequent use of the photo data.
Fig. 5 is a schematic structural diagram of a management apparatus for inspecting photos according to an exemplary embodiment of the present application; referring to fig. 5, the memory device 400 includes:
the determining module 401 is configured to acquire a photo collected by the unmanned aerial vehicle in the routing inspection process according to a predetermined power routing inspection route, and determine photo information carried in the photo; wherein the photo information includes time information of the photo taking and GPS position information;
a matching module 402, configured to obtain a route file corresponding to the unmanned aerial vehicle, where the route file includes the predetermined power inspection route, and the power inspection route includes a certain number of waypoints; matching waypoint information of a target shooting waypoint corresponding to the picture from the power patrol route of the unmanned aerial vehicle based on the time information and the GPS position information;
and a naming storage module 403, configured to refer to the photo information and waypoint information of the target shooting waypoint corresponding to the photo, and name and store the photo.
Optionally, the matching module 402 specifically includes:
the sorting unit is used for sorting the photos according to the shooting time according to the time information of the photos so as to determine the shooting sequence of the photos;
and the comparison unit is used for comparing the pictures with the serial numbers of the waypoints on the power inspection route according to the shooting sequence, determining a target shooting waypoint corresponding to the pictures, and acquiring waypoint information of the target shooting waypoint from the route file.
Optionally, the matching module 402 further includes:
and the calculating unit is used for respectively calculating the distance errors between the photos and the preliminarily determined target shooting waypoints according to the shooting sequence of the photos, and taking the shooting waypoint with the minimum distance error as the target shooting waypoint of the photos.
Optionally, the photo information further includes: line name, operation unit, line voltage grade and pole tower number related to the photo; the waypoint information comprises: part point information, a shooting direction and a shooting angle;
the named storage module 403 is configured to:
determining the name of a hierarchical folder for storing the photo and the name of the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo;
and storing the photos according to the path of the grading folder.
Optionally, the apparatus further comprises:
an analysis module (not shown in the figure) for analyzing the defects of the target shooting component on the photo and generating a description text of the photo;
the named storage module 403 is specifically configured to:
and naming and storing the photo according to the description text, the photo information and the waypoint information of the target shooting waypoint corresponding to the photo.
Optionally, the analysis module (not shown in the figure) is specifically configured to:
dividing the photo into at least two sub-images, and extracting an interested area of each sub-image;
and identifying the region of interest according to the trained attention model to obtain an identification result, and generating the description text by referring to the identification result.
In another embodiment of the present application, a machine-readable storage medium is further provided, on which a computer program is stored, and the program, when executed by a processor, implements the steps of the method for managing polling photos as described above. The method comprises the steps that after a photo collected by an unmanned aerial vehicle in the process of routing inspection according to a preset power routing inspection route is obtained, time information and GPS position information of photo shooting carried in the photo are determined; acquiring a route file corresponding to the unmanned aerial vehicle, wherein the route file comprises the power patrol route, and matching waypoint information of a target shooting waypoint corresponding to the picture from the power patrol route of the unmanned aerial vehicle based on the time information and the GPS position information; naming and storing the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo; the method has the positive effects of simplicity, high efficiency and convenience for management and query by workers.
Fig. 6 is a schematic structural diagram of a computer device according to an embodiment of the present application. Referring to fig. 6, the computer device 500 includes at least a memory 502 and a processor 501; the memory 502 is connected to the processor 501 through a communication bus 503, and is used for storing instruction codes executable by the processor 501; the processor 501 is configured to read and execute instruction codes from the memory 502 to implement the steps of the method for managing polling photos according to any of the above embodiments. The method comprises the steps that after a photo collected by an unmanned aerial vehicle in the process of routing inspection according to a preset power routing inspection route is obtained, time information and GPS position information of photo shooting carried in the photo are determined; acquiring a route file corresponding to the unmanned aerial vehicle, wherein the route file comprises the power patrol route, and matching waypoint information of a target shooting waypoint corresponding to the picture from the power patrol route of the unmanned aerial vehicle based on the time information and the GPS position information; naming and storing the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo; the method has the positive effects of simplicity, high efficiency and convenience for management and query by workers.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application. One of ordinary skill in the art can understand and implement it without inventive effort.
Computers suitable for executing computer programs include, for example, general and/or special purpose microprocessors, or any other type of central processing unit. Generally, a central processing unit will receive instructions and data from a read-only memory and/or a random access memory. The basic components of a computer include a central processing unit for implementing or executing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks. However, a computer does not necessarily have such a device. Moreover, a computer may be embedded in another device, e.g., a mobile telephone, a Personal Digital Assistant (PDA), a mobile audio or video player, a game console, a Global Positioning System (GPS) receiver, or a portable storage device such as a Universal Serial Bus (USB) flash drive, to name a few.
Computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices (e.g., EPROM, EEPROM, and flash memory devices), magnetic disks (e.g., an internal hard disk or a removable disk), magneto-optical disks, and CD ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
While this specification contains many specific implementation details, these should not be construed as limitations on the scope of any invention or of what may be claimed, but rather as descriptions of features specific to particular embodiments of particular inventions. Certain features that are described in this specification in the context of separate embodiments can also be implemented in combination in a single embodiment. In other instances, features described in connection with one embodiment may be implemented as discrete components or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In some cases, multitasking and parallel processing may be advantageous. Moreover, the separation of various system modules and components in the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
Thus, particular embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. Further, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some implementations, multitasking and parallel processing may be advantageous.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims (10)

1. A management method for polling photos is characterized by comprising the following steps:
acquiring photos acquired by an unmanned aerial vehicle in a routing inspection process according to a preset power routing inspection route, and determining photo information carried in the photos; wherein the photo information includes time information of the photo taking and GPS position information;
acquiring a route file corresponding to the unmanned aerial vehicle, wherein the route file comprises the preset power patrol route which comprises a certain number of waypoints; matching waypoint information of a target shooting waypoint corresponding to the picture from the power patrol route of the unmanned aerial vehicle based on the time information and the GPS position information;
and naming and storing the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo.
2. The method of claim 1, wherein matching the waypoint information of the target shooting waypoint corresponding to the photograph from the power patrol route of the unmanned aerial vehicle based on the time information and the GPS location information comprises:
sequencing the photos according to the shooting time according to the time information of the photo shooting, and further determining the shooting sequence of the photos;
and comparing the pictures with the sequence numbers of the waypoints on the power inspection route according to the shooting sequence, preliminarily determining the target shooting waypoint corresponding to the pictures, and acquiring the waypoint information of the target shooting waypoint from the route file.
3. The method of claim 2, wherein after initially determining the target shooting waypoint corresponding to the photograph, the method further comprises:
and respectively calculating the distance error between the photo and the preliminarily determined target shooting waypoint according to the shooting sequence of the photo, and taking the shooting waypoint with the minimum distance error as the target shooting waypoint of the photo.
4. The method of claim 1, wherein the photo information further comprises: line name, operation unit, line voltage grade and pole tower number related to the photo; the waypoint information comprises: part point information, a shooting direction and a shooting angle;
the naming and storing of the photo with reference to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo includes:
determining the name of a hierarchical folder for storing the photo and the name of the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo;
and storing the photos according to the path of the grading folder.
5. The method of claim 4, wherein prior to naming and storing the picture with reference to the picture information and waypoint information of the target shooting waypoint to which the picture corresponds, the method further comprises:
analyzing the defects of the target shooting component of the photo to generate a description text of the photo;
the naming and storing of the photo with reference to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo includes:
and naming and storing the photo according to the description text, the photo information and the waypoint information of the target shooting waypoint corresponding to the photo.
6. The method of claim 5, wherein the performing a defect analysis of the target capture component on the photo to generate a description text of the photo comprises:
dividing the photo into at least two sub-images, and extracting an interested area of each sub-image;
and identifying the region of interest according to the trained attention model to obtain an identification result, and generating the description text by referring to the identification result.
7. The utility model provides a management device who patrols and examines photo, its characterized in that, the device includes:
the determining module is used for acquiring photos acquired by the unmanned aerial vehicle in the process of routing inspection according to a preset power routing inspection route and determining photo information carried in the photos; wherein the photo information includes time information of the photo taking and GPS position information;
the matching module is used for acquiring a route file corresponding to the unmanned aerial vehicle, wherein the route file comprises the preset power patrol route which comprises a certain number of waypoints; matching waypoint information of a target shooting waypoint corresponding to the picture from the power patrol route of the unmanned aerial vehicle based on the time information and the GPS position information;
and the naming storage module is used for naming and storing the photo by referring to the photo information and the waypoint information of the target shooting waypoint corresponding to the photo.
8. The apparatus according to claim 7, wherein the matching module specifically includes:
the sorting unit is used for sorting the photos according to the shooting time according to the time information of the photos so as to determine the shooting sequence of the photos;
and the comparison unit is used for comparing the pictures with the serial numbers of the waypoints on the power inspection route according to the shooting sequence, determining a target shooting waypoint corresponding to the pictures, and acquiring waypoint information of the target shooting waypoint from the route file.
9. The apparatus of claim 8, wherein the matching module further comprises:
and the calculating unit is used for respectively calculating the distance errors between the photos and the preliminarily determined target shooting waypoints according to the shooting sequence of the photos, and taking the shooting waypoint with the minimum distance error as the target shooting waypoint of the photos.
10. A machine-readable storage medium having stored thereon computer instructions which, when executed, perform the method of any one of claims 1-6.
CN202010422539.1A 2020-05-19 2020-05-19 Management method and device for inspection photos Active CN111339347B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010422539.1A CN111339347B (en) 2020-05-19 2020-05-19 Management method and device for inspection photos

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010422539.1A CN111339347B (en) 2020-05-19 2020-05-19 Management method and device for inspection photos

Publications (2)

Publication Number Publication Date
CN111339347A true CN111339347A (en) 2020-06-26
CN111339347B CN111339347B (en) 2020-09-08

Family

ID=71186522

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010422539.1A Active CN111339347B (en) 2020-05-19 2020-05-19 Management method and device for inspection photos

Country Status (1)

Country Link
CN (1) CN111339347B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111797332A (en) * 2020-07-31 2020-10-20 国网北京市电力公司 Image display method, device and system
CN112073681A (en) * 2020-07-14 2020-12-11 中国电力科学研究院有限公司 Processing method and system for routing inspection, positioning and shooting images of overhead power line unmanned aerial vehicle
CN112114731A (en) * 2020-09-09 2020-12-22 广东电网有限责任公司 Transformer substation inspection equipment
CN112256060A (en) * 2020-10-29 2021-01-22 广东电网有限责任公司 Method for automatically naming pictures for automatic inspection of power transmission line unmanned aerial vehicle in real time
CN113534846A (en) * 2021-08-22 2021-10-22 内蒙古电力(集团)有限责任公司航检分公司 Unmanned aerial vehicle autonomous intelligent inspection system for power transmission line
CN113597603A (en) * 2020-10-14 2021-11-02 深圳市大疆创新科技有限公司 Data processing method, device, equipment and storage medium
CN113656619A (en) * 2021-08-16 2021-11-16 普宙科技(深圳)有限公司 Management method and management system for power grid inspection photos
CN113707000A (en) * 2021-08-31 2021-11-26 贵州电网有限责任公司 Pole number plate convenient for machine patrol operation and mounting tool thereof
CN113762132A (en) * 2021-09-01 2021-12-07 国网浙江省电力有限公司金华供电公司 Automatic classification and automatic naming system for unmanned aerial vehicle inspection image
CN115062178A (en) * 2022-08-17 2022-09-16 广东电网有限责任公司佛山供电局 Method and device for arranging inspection images of unmanned aerial vehicle equipment and computer equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104101332A (en) * 2014-07-19 2014-10-15 国家电网公司 Automatic matching method for inspection photos of transmission lines
US9589473B1 (en) * 2015-11-05 2017-03-07 Korea Meteorological Administration Method and system for automatically displaying flight path, seeding path and weather data
CN109002055A (en) * 2018-06-11 2018-12-14 广州中科云图智能科技有限公司 A kind of High Precision Automatic method for inspecting and system based on unmanned plane
CN109085850A (en) * 2018-09-10 2018-12-25 国网电力科学研究院武汉南瑞有限责任公司 The autonomous method for inspecting of unmanned plane based on passway for transmitting electricity three-dimensional thunder total number evidence
CN110533766A (en) * 2019-08-06 2019-12-03 陕西土豆数据科技有限公司 It is a kind of based on exempt from as control PPK data oblique photograph image intelligence wiring method
CN110597768A (en) * 2019-08-13 2019-12-20 中国南方电网有限责任公司超高压输电公司昆明局 Unmanned aerial vehicle power transmission channel inspection data processing method and system, storage medium and equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104101332A (en) * 2014-07-19 2014-10-15 国家电网公司 Automatic matching method for inspection photos of transmission lines
US9589473B1 (en) * 2015-11-05 2017-03-07 Korea Meteorological Administration Method and system for automatically displaying flight path, seeding path and weather data
CN109002055A (en) * 2018-06-11 2018-12-14 广州中科云图智能科技有限公司 A kind of High Precision Automatic method for inspecting and system based on unmanned plane
CN109085850A (en) * 2018-09-10 2018-12-25 国网电力科学研究院武汉南瑞有限责任公司 The autonomous method for inspecting of unmanned plane based on passway for transmitting electricity three-dimensional thunder total number evidence
CN110533766A (en) * 2019-08-06 2019-12-03 陕西土豆数据科技有限公司 It is a kind of based on exempt from as control PPK data oblique photograph image intelligence wiring method
CN110597768A (en) * 2019-08-13 2019-12-20 中国南方电网有限责任公司超高压输电公司昆明局 Unmanned aerial vehicle power transmission channel inspection data processing method and system, storage medium and equipment

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112073681A (en) * 2020-07-14 2020-12-11 中国电力科学研究院有限公司 Processing method and system for routing inspection, positioning and shooting images of overhead power line unmanned aerial vehicle
CN111797332A (en) * 2020-07-31 2020-10-20 国网北京市电力公司 Image display method, device and system
CN112114731A (en) * 2020-09-09 2020-12-22 广东电网有限责任公司 Transformer substation inspection equipment
CN113597603A (en) * 2020-10-14 2021-11-02 深圳市大疆创新科技有限公司 Data processing method, device, equipment and storage medium
WO2022077297A1 (en) * 2020-10-14 2022-04-21 深圳市大疆创新科技有限公司 Data processing method, apparatus and device, and storage medium
CN112256060A (en) * 2020-10-29 2021-01-22 广东电网有限责任公司 Method for automatically naming pictures for automatic inspection of power transmission line unmanned aerial vehicle in real time
CN113656619A (en) * 2021-08-16 2021-11-16 普宙科技(深圳)有限公司 Management method and management system for power grid inspection photos
CN113534846A (en) * 2021-08-22 2021-10-22 内蒙古电力(集团)有限责任公司航检分公司 Unmanned aerial vehicle autonomous intelligent inspection system for power transmission line
CN113707000A (en) * 2021-08-31 2021-11-26 贵州电网有限责任公司 Pole number plate convenient for machine patrol operation and mounting tool thereof
CN113762132A (en) * 2021-09-01 2021-12-07 国网浙江省电力有限公司金华供电公司 Automatic classification and automatic naming system for unmanned aerial vehicle inspection image
CN115062178A (en) * 2022-08-17 2022-09-16 广东电网有限责任公司佛山供电局 Method and device for arranging inspection images of unmanned aerial vehicle equipment and computer equipment

Also Published As

Publication number Publication date
CN111339347B (en) 2020-09-08

Similar Documents

Publication Publication Date Title
CN111339347B (en) Management method and device for inspection photos
CN108109437B (en) Unmanned aerial vehicle autonomous route extraction and generation method based on map features
CN109324337B (en) Unmanned aerial vehicle route generation and positioning method and device and unmanned aerial vehicle
CN103824340B (en) Unmanned plane power transmission line intelligent cruising inspection system and method for inspecting
WO2018207173A1 (en) System and method for construction 3d modeling and analysis
US11531833B2 (en) Creating a ground control point file using an existing landmark shown in images
US20240112586A1 (en) Methods and devices for unmanned aerial vehicle based site inspection and scale rendered analysis
CN110969719A (en) Automatic inspection method, system, terminal equipment and storage medium
WO2019061111A1 (en) Path adjustment method and unmanned aerial vehicle
US20200174503A1 (en) Database of drone flight plans for aircraft inspection using relative mapping
CN112947485A (en) Path planning method and system
US20240110809A1 (en) System and method for asset identification and mapping
CN110989678A (en) Oil field inspection fixed point data acquisition system and method based on multiple unmanned aerial vehicles
CN113920419A (en) Image data processing method and system
CN114020043A (en) Unmanned aerial vehicle building project supervision system and method, electronic equipment and storage medium
CN113343016A (en) System and method for supervising building materials
CN117557931B (en) Planning method for meter optimal inspection point based on three-dimensional scene
CN115375864B (en) Unmanned aerial vehicle-based high-speed railway completion acceptance method
CN112180982B (en) Unmanned aerial vehicle air route management system and method
Stemmler et al. Multisource-data-fusion for the digitization of critical infrastructural elements
Ansari Use of point cloud with a low-cost UAV system for 3D mapping
CN117389303B (en) Unmanned aerial vehicle remote inspection processing system and method
CN113741413B (en) Operation method of unmanned equipment, unmanned equipment and storage medium
De Winter et al. Digitisation in road construction: Automation of as-built models
JP7442467B2 (en) Photographed image classification device and photographed image classification method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: Room 2301-2308, third floor, building 2, incubator, Zhongguancun Software Park, Dongbeiwang, Haidian District, Beijing 100094

Patentee after: Beijing Digital Green Earth Technology Co.,Ltd.

Address before: Room 2301-2308, third floor, building 2, incubator, Zhongguancun Software Park, Dongbeiwang, Haidian District, Beijing 100094

Patentee before: BEIJING GREENVALLEY TECHNOLOGY Co.,Ltd.