CN116486125A - Equipment detection method, device, equipment and medium - Google Patents
Equipment detection method, device, equipment and medium Download PDFInfo
- Publication number
- CN116486125A CN116486125A CN202310457392.3A CN202310457392A CN116486125A CN 116486125 A CN116486125 A CN 116486125A CN 202310457392 A CN202310457392 A CN 202310457392A CN 116486125 A CN116486125 A CN 116486125A
- Authority
- CN
- China
- Prior art keywords
- image
- target
- equipment
- template
- shooting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title abstract description 25
- 238000000034 method Methods 0.000 claims abstract description 65
- 230000002159 abnormal effect Effects 0.000 claims abstract description 28
- 230000008569 process Effects 0.000 claims abstract description 23
- 238000004590 computer program Methods 0.000 claims description 16
- 238000003860 storage Methods 0.000 claims description 13
- 230000005856 abnormality Effects 0.000 claims description 8
- 238000012545 processing Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 238000004458 analytical method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000005520 cutting process Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003062 neural network model Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000010248 power generation Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30164—Workpiece; Machine component
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the application discloses a detection method, a detection device and a detection medium of equipment. Wherein the method comprises the following steps: acquiring a shooting image obtained by a shooting device in the process of collecting equipment images and a target image template corresponding to the shooting device; the target image template comprises a transparent area corresponding to the position of the equipment in the photographed image and a non-transparent area corresponding to the area of the background in the photographed image; determining a device image of at least one target device according to the target image template and the photographed image; and identifying the equipment image, and determining whether the target equipment is abnormal according to the identification result. According to the technical scheme, the equipment image of at least one target equipment is determined according to the target image template and the shooting image, so that the influence of the image background on the identification result can be avoided when the equipment image of the target equipment is identified, and the accuracy of the detection result is improved.
Description
Technical Field
The present invention relates to the field of device detection technologies, and in particular, to a device detection method, a device, and a medium.
Background
With the development of society, the power consumption of the power grid is increased, and the power equipment is increased, so that how to detect the power equipment is a technical problem to be solved.
The prior proposal mainly carries out fault analysis on related images of the power equipment to obtain a detection result of the power equipment, however, when the fault analysis is carried out, the related images comprise not only the power equipment, but also a background irrelevant to the power equipment, and the background can influence the fault analysis on the power equipment, so that the determined detection result of the power equipment is inaccurate.
Disclosure of Invention
The invention provides a device detection method, a device, equipment and a medium, which can avoid the influence of an image background on fault analysis and improve the accuracy of a detection result when the fault analysis is carried out on a shot image of power equipment.
According to an aspect of the present invention, there is provided a method of detecting a device, the method comprising:
acquiring a shooting image obtained by a shooting device in the process of collecting equipment images and a target image template corresponding to the shooting device; the target image template comprises a transparent area corresponding to the position of the equipment in the photographed image and a non-transparent area corresponding to the area of the background in the photographed image;
determining a device image of at least one target device according to the target image template and the photographed image;
and identifying the equipment image, and determining whether the target equipment is abnormal according to the identification result.
According to another aspect of the present invention, there is provided a detection apparatus for a device, comprising:
the shooting image and target image template determining module is used for acquiring shooting images obtained by the shooting device in the process of collecting the equipment images and target image templates corresponding to the shooting device; the target image template comprises a transparent area corresponding to the position of the equipment in the photographed image and a non-transparent area corresponding to the area of the background in the photographed image;
the device image determining module is used for determining a device image of at least one target device according to the target image template and the shooting image;
and the abnormality judging module is used for identifying the equipment image and determining whether the target equipment is abnormal according to the identification result.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the method of detecting a device according to any one of the embodiments of the present invention.
According to another aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute a method for detecting an apparatus according to any of the embodiments of the present invention.
The technical scheme of the embodiment of the application comprises the following steps: acquiring a shooting image obtained by a shooting device in the process of collecting equipment images and a target image template corresponding to the shooting device; the target image template comprises a transparent area corresponding to the position of the equipment in the photographed image and a non-transparent area corresponding to the area of the background in the photographed image; determining a device image of at least one target device according to the target image template and the photographed image; and identifying the equipment image, and determining whether the target equipment is abnormal according to the identification result. According to the technical scheme, the equipment image of at least one target equipment is determined according to the target image template and the shooting image, so that the influence of the image background on the identification result can be avoided when the equipment image of the target equipment is identified, and the accuracy of the detection result is improved.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of a detection method of a device according to an embodiment of the present application;
fig. 2 is a flowchart of a method for detecting a device according to a second embodiment of the present application;
fig. 3 is a schematic structural diagram of a detection device of an apparatus according to a third embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device implementing a method for detecting a device according to an embodiment of the present application.
Detailed Description
In order to make the present invention better understood by those skilled in the art, the following description will be made in detail, with reference to the accompanying drawings, in which embodiments of the present invention are shown, and it is apparent that the described embodiments are only some, but not all, embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," "target," and the like in the description and claims of the present invention and in the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
Fig. 1 is a flowchart of a method for detecting a device according to an embodiment of the present application, where the method may be applied to a case of detecting a power device, and the method may be performed by a detection apparatus of the device, where the detection apparatus of the device may be implemented in hardware and/or software, and the detection apparatus of the device may be configured in an electronic device with data processing capability. As shown in fig. 1, the method includes:
s110, acquiring a shooting image obtained by a shooting device in the process of collecting equipment images and a target image template corresponding to the shooting device; the target image template includes a transparent region corresponding to a location of the device in the captured image and a non-transparent region corresponding to a region of the background in the captured image.
The photographing device may photograph the apparatus and obtain a photographed image, and the photographing device may collect a plurality of frequency bands of electromagnetic waves, and the photographing device may be an infrared photographing device. The device described in the embodiments of the present application may be any device such as a transformer, a generator, a lightning arrester, a fuse, or the like, such as substation devices, test devices, power generation devices, or the like. The target image template may be a predetermined template in which an area corresponding to a position of a device in the captured image is a transparent area and an area corresponding to a position of a background (non-device) in the captured image is a non-transparent area.
Specifically, the image template may be predetermined, after the relative position and the shooting angle of the shooting device and the equipment are determined, the shooting device shoots the equipment to obtain a preliminary template, the area corresponding to the equipment in the preliminary template is set to be a transparent area, and the area corresponding to the background is set to be a non-transparent area, so as to obtain the image template.
Further, there is a correspondence between each photographing device and the image template, and based on the correspondence, a target image template corresponding to the photographing device can be determined.
In this embodiment of the present application, an exemplary process of acquiring a captured image obtained by a capturing device in a process of capturing an image of a device may be: and adjusting the relative positions and the shooting angles of the shooting device and the equipment to be preset positions and angles, wherein the preset positions and angles refer to the relative positions and angles of the shooting device and the equipment when the target image template is determined, and then the shooting device is used for acquiring shooting images of the equipment, so that the obtained shooting images are identical to the field of view of the target image template.
It should be noted that the number of devices existing in the captured image and the target image template may be one or more, and the contours of the devices existing in the captured image and the target image template may be complete contours or incomplete contours.
S120, determining a device image of at least one target device according to the target image template and the shot image.
The target device may be any device included in the captured image. The device image may display only the target device, not the background unrelated to the target device, and may be truncated from the captured image.
Specifically, since the fields of view of the target image template and the photographed image are the same, the target image template and the photographed image can be overlapped, and the photographed image is intercepted according to a transparent area corresponding to the position of the device in the photographed image in the target image template, so as to obtain the device image; or, overlapping the target image template and the photographed image, cutting the photographed image according to a non-transparent area corresponding to the position of the background in the photographed image in the target image template, and taking the remaining photographed image after cutting as the device image. Since the position in the target image template corresponding to the area of the background in the photographed image is a non-transparent area, the background information is not included in the device image.
S130, identifying the equipment image, and determining whether the target equipment is abnormal according to the identification result.
Specifically, the device image may reflect state information of the device, such as radiant heat, shape change conditions, etc., may identify the device image through an identification algorithm, and determine whether the target device is abnormal and specific abnormality information according to the identification result.
In one possible scheme, a comparison image of the target device in various working states is obtained in advance, the device image is matched with each comparison image, a comparison image which is matched with the device image best is obtained, the working state of the comparison image is determined to be the working state corresponding to the target device, and whether the target device is abnormal or not is further determined.
In another possible scheme, based on a pre-trained neural network model, the device image is identified, and an identification result is obtained, wherein the identification result comprises whether the target device is abnormal or not and specific abnormality information; the pre-trained neural network model is obtained by training images of target equipment in various working states.
The technical scheme of the embodiment of the application comprises the following steps: acquiring a shooting image obtained by a shooting device in the process of collecting equipment images and a target image template corresponding to the shooting device; the target image template comprises a transparent area corresponding to the position of the equipment in the photographed image and a non-transparent area corresponding to the area of the background in the photographed image; determining a device image of at least one target device according to the target image template and the photographed image; and identifying the equipment image, and determining whether the target equipment is abnormal according to the identification result. According to the technical scheme, the equipment image of at least one target equipment is determined according to the target image template and the shooting image, so that the influence of the image background on the identification result can be avoided when the equipment image of the target equipment is identified, and the accuracy of the detection result is improved.
Example two
Fig. 2 is a flowchart of a method for detecting a device according to a second embodiment of the present application, where the method is optimized based on the foregoing embodiment. The concrete optimization is as follows: identifying the equipment image, determining whether the target equipment is abnormal according to the identification result, and comprising the following steps: determining whether the target equipment is abnormal according to a matching result of the equipment image of the target equipment and the comparison image of the target equipment; the contrast image reflects image information of the device in various operating states.
As shown in fig. 2, the method in the embodiment of the application specifically includes the following steps:
s210, acquiring a shooting image obtained by a shooting device in the process of collecting equipment images and a target image template corresponding to the shooting device; the target image template includes a transparent region corresponding to a location of the device in the captured image and a non-transparent region corresponding to a region of the background in the captured image.
In an embodiment of the present application, optionally, the method further includes: and determining the image template corresponding to the target mark of the shooting device as the target image template corresponding to the shooting device based on the corresponding relation between the preset image template and the mark.
The identifier may be any type of identifier, for example, a link type identifier, a text type identifier, etc., which is not limited in the embodiment of the present application.
Specifically, since fields of view photographed by different photographing devices may be different, different photographing devices correspond to different image templates, a correspondence between an image template and an identifier and a correspondence between an identifier and a photographing device may be established in advance, in the process of executing the method, a target identifier corresponding to the photographing device may be determined according to the correspondence between the photographing device and the identifier, then a target image template corresponding to the target identifier may be determined according to the correspondence between the image template and the identifier, and the target image template may be determined as the image template corresponding to the photographing device. It should be noted that, the same device may also correspond to a plurality of image templates, for example, in a case where the same device photographs different devices at different angles, in this case, it is necessary to establish in advance a correspondence between the image templates and the identifiers, and a correspondence between the identifiers and the photographed parties (the photographed parties refer to the photographing device and the photographed device), and in the process of executing the method, the target identifier corresponding to the photographed parties may be determined according to the correspondence between the photographed parties and the identifiers, and then the target image template corresponding to the target identifier may be determined according to the correspondence between the image templates and the identifiers, and the target image template may be determined as the image template corresponding to the photographed parties.
The identification may be a number, for example.
And S220, covering the target image template on the shot image to obtain a superimposed image which is used for displaying equipment in the shot image through the transparent area of the target image template and covering the background in the shot image through the non-transparent area of the target image template.
In the superimposed image, the device in the photographed image can be displayed through the transparent region of the target image template, and the background in the photographed image is covered by the non-transparent region of the target image template.
Specifically, after the target image template is determined, the target image template is covered on the photographed image, so that the target image template is overlapped with the photographed image, and a superimposed template is obtained, and obviously, as the area corresponding to the equipment in the target image template is a transparent area and the area corresponding to the background is a non-transparent area, the superimposed template can display the image of the equipment and does not display the image of the background.
S230, based on the transparent area corresponding to the equipment, the superimposed image is intercepted, and the equipment image of at least one target equipment is obtained.
Specifically, in the superimposed image, an image of the device in the captured image may be displayed, and the device image of at least one target device may be cut out along a frame of the image of the device, where the device image may not include background information.
S240, determining whether the target equipment is abnormal according to a matching result of the equipment image of the target equipment and the comparison image of the target equipment; the contrast image reflects image information of the device in various operating states.
The comparison image of each device may be predetermined, and the specific determining process may be: the method comprises the steps of collecting state images of a certain device in various working states (a specific collecting process can be the same as the process of collecting a shot image in S210), intercepting part of the state images, which are related to the device, to obtain an image which does not comprise background information, taking the intercepted image as a comparison image, and finally determining that the comparison image and the device image can be the same in outline. It should be noted that, the acquiring modes of the status image and the shooting image may be the same, for example, the status image and the shooting image may be acquired under the condition that the relative positions of the shooting device and the equipment are unchanged and the shooting angle is unchanged, so that the finally obtained contrast image and the equipment image are consistent in terms of image size, resolution, and the like, and further, the determined result of whether the target equipment is abnormal is more accurate.
Specifically, the device image of the target device is matched with each contrast image of the target device to obtain a matching result, and the working state corresponding to the contrast image in the matching result can be determined to be the working state of the target device because the contrast image matched with the device image corresponds to the working state, so that whether the target device is abnormal or not is determined according to the working state of the target device. Optionally, the working state of the target device and the comparison image in the matching result are displayed, so that the staff can carry out subsequent processing on the target device in a targeted manner.
In this embodiment of the present application, optionally, determining whether the target device is abnormal according to a matching result of the device image of the target device and the comparison image of the target device includes: in each contrast image, determining that the image with the similarity meeting the preset requirement with the equipment image is a similar image; and determining whether the target equipment is abnormal or not according to the working state corresponding to the similar image.
The preset requirements can be determined according to actual situations, and the embodiment of the application is not limited to this.
Specifically, in the process of determining the similarity between the device image and each contrast image, one possible scheme is as follows: and calculating the similarity between the device image and each contrast image through a convolutional neural network. Another possible solution is: and calculating the similarity of the device image and each contrast image based on indexes such as Structural Similarity (SSIM) and peak signal-to-noise ratio (PSNR) which can reflect the characteristics of brightness, contrast, structure and the like of the image.
Further, after the similarity between the equipment image and each contrast image is obtained, the contrast image with the highest similarity can be determined to be the similar image; or determining one or more images with similarity greater than a preset threshold value as similar images. In this embodiment, optionally, if the similarity in the comparison image does not meet the preset requirement, the device image and each similar image may be marked, so that the staff may perform corresponding processing.
Further, the working state corresponding to the similar images is determined as the working state of the target device (the number of the working states is determined by the number of the similar images), whether the target device is abnormal is determined according to the working state of the target device, and the similar images and the working state of the target device are output, so that a worker can process the target device in a targeted manner.
In this embodiment, optionally, in each comparison image, it is determined that an image with similarity to the device image meeting a preset requirement is a similar image, including steps A1-A3:
step A1, calculating hash values of the device image based on the discrete cosine transform.
A2, determining the Hamming distance between the equipment image and each contrast image according to the Hash value of the equipment image and the Hash value of each contrast image; the hash value of the contrast image is calculated in advance based on discrete cosine transform.
And A3, determining that the contrast image with the minimum Hamming distance and/or the Hamming distance smaller than a preset value is a similar image.
The preset value may be determined according to an actual situation, which is not limited in the embodiment of the present application.
Specifically, in the embodiment of the present application, the hash value of the device image may be calculated based on the discrete cosine transform, and according to the hash value of the device image and the hash value of each contrast image (the hash value of the contrast image may be calculated in advance, the calculation manner may be the same as the calculation manner of the hash value of the device image), the hamming distance between the device image and each contrast image is determined, and in one possible scheme, the contrast image with the smallest hamming distance is determined as the similar image; in another possible scheme, a contrast image with a hamming distance smaller than a preset value is determined as a similar image; in still another possible solution, among the contrast images having a hamming distance smaller than the preset value, the contrast image having the smallest hamming distance is determined as the similar image.
Illustratively, a low-frequency component of the device image is extracted by discrete cosine transformation, the device image is firstly converted into a gray scale image with standard size, then discrete cosine transformation is carried out on the gray scale image, a 64-bit hash value is extracted from a coefficient matrix to serve as a fingerprint, and then the Hamming distance between the hash value of the device image and the hash value of each contrast image is calculated.
In the embodiment of the present application, calculating the hash value of the image based on the discrete cosine transform is merely a specific example, and the embodiment of the present application is not limited to the calculation manner of the hash value and the calculation manner of the hamming distance.
In this embodiment of the present application, optionally, the captured image is an infrared captured image, and the device image is an infrared device image.
Specifically, in the embodiment of the present application, the photographed image, the device image, the comparison image, the similar image, and the like may be infrared images, and the corresponding photographing device may also be an infrared photographing device. When the images are infrared images, the method disclosed by the embodiment of the application can be called an infrared detection method, has the advantages of no disassembly, no contact, no sampling, no power failure and the like, is simple and convenient in operation process, and can be used for rapidly and accurately acquiring the temperature field distribution of the power equipment through the infrared images, so that the latent defects in the power equipment are discovered, corresponding repair measures are adopted, and the safe and stable operation of the power grid is ensured.
According to the technical scheme, the equipment image and the comparison image are matched to obtain the similar image capable of reflecting the working state of the target equipment, so that the working state of the target equipment and the detection result reflecting whether the target equipment is abnormal are obtained, and the effect of rapidly and accurately determining whether the target equipment is abnormal is achieved.
Example III
Fig. 3 is a schematic structural diagram of a device for detecting equipment according to a third embodiment of the present application, where the device may execute the method for detecting equipment according to any embodiment of the present invention, and the device has functional modules and beneficial effects corresponding to the execution method. As shown in fig. 3, the apparatus includes:
the shot image and target image template determining module 310 is configured to obtain a shot image obtained by the shooting device in the process of collecting the device image, and a target image template corresponding to the shooting device; the target image template comprises a transparent area corresponding to the position of the equipment in the photographed image and a non-transparent area corresponding to the area of the background in the photographed image;
a device image determining module 320, configured to determine a device image of at least one target device according to the target image template and the captured image;
and the abnormality judging module 330 is configured to identify the device image, and determine whether the target device is abnormal according to the identification result.
Optionally, the anomaly determination module 330 includes:
the abnormality judging unit is used for determining whether the target equipment is abnormal or not according to a matching result of the equipment image of the target equipment and the comparison image of the target equipment; the contrast image reflects image information of the device in various operating states.
Optionally, the abnormality determination unit includes:
a similar image determining subunit, configured to determine, in each comparison image, an image whose similarity with the device image satisfies a preset requirement as a similar image;
and the abnormality judging subunit is used for determining whether the target equipment is abnormal or not according to the working state corresponding to the similar image.
Optionally, the similar image determining subunit is specifically configured to:
calculating a hash value of the device image based on the discrete cosine transform;
determining the Hamming distance between the equipment image and each contrast image according to the Hash value of the equipment image and the Hash value of each contrast image; the hash value of the contrast image is obtained by calculating the contrast image based on discrete cosine transform in advance;
and determining that the contrast image with the minimum Hamming distance and/or the Hamming distance smaller than the preset value is a similar image.
Optionally, the apparatus further includes:
the target image template determining module is used for determining that the image template corresponding to the target mark of the shooting device is the target image template corresponding to the shooting device based on the corresponding relation between the preset image template and the mark.
Optionally, the device image determining module 320 includes:
the superimposed image determining unit is used for covering the target image template on the shooting image to obtain a superimposed image which is used for displaying equipment in the shooting image through a transparent area of the target image template and covering the background in the shooting image through a non-transparent area of the target image template;
and the device image determining unit is used for intercepting the superimposed image based on the transparent area corresponding to the device to obtain the device image of at least one target device.
Optionally, the photographed image is an infrared photographed image, and the device image is an infrared device image.
The device for detecting the equipment provided by the embodiment of the application can execute the method for detecting the equipment provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example IV
Fig. 4 shows a schematic diagram of the structure of an electronic device 10 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 4, the electronic device 10 includes at least one processor 11, and a memory, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, etc., communicatively connected to the at least one processor 11, in which the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 may also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.
Various components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, etc.; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as the detection method of the device.
In some embodiments, the method of detecting a device may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the detection method of the apparatus described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the detection method of the device by any other suitable means (e.g. by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.
Claims (10)
1. A method for detecting a device, comprising:
acquiring a shooting image obtained by a shooting device in the process of collecting equipment images and a target image template corresponding to the shooting device; the target image template comprises a transparent area corresponding to the position of the equipment in the photographed image and a non-transparent area corresponding to the area of the background in the photographed image;
determining a device image of at least one target device according to the target image template and the photographed image;
and identifying the equipment image, and determining whether the target equipment is abnormal according to the identification result.
2. The method of claim 1, wherein identifying the device image, and determining whether the target device is abnormal based on the identification result, comprises:
determining whether the target equipment is abnormal according to a matching result of the equipment image of the target equipment and the comparison image of the target equipment; the contrast image reflects image information of the device in various operating states.
3. The method of claim 2, wherein determining whether the target device is abnormal based on a result of matching the device image of the target device with the comparison image of the target device, comprises:
in each contrast image, determining that the image with the similarity meeting the preset requirement with the equipment image is a similar image;
and determining whether the target equipment is abnormal or not according to the working state corresponding to the similar image.
4. A method according to claim 3, wherein determining, in each of the comparison images, that the image having a similarity to the device image satisfying a preset requirement is a similar image comprises:
calculating a hash value of the device image based on the discrete cosine transform;
determining the Hamming distance between the equipment image and each contrast image according to the Hash value of the equipment image and the Hash value of each contrast image; the hash value of the contrast image is obtained by calculating the contrast image based on discrete cosine transform in advance;
and determining that the contrast image with the minimum Hamming distance and/or the Hamming distance smaller than the preset value is a similar image.
5. The method according to claim 1, wherein the method further comprises:
and determining the image template corresponding to the target mark of the shooting device as the target image template corresponding to the shooting device based on the corresponding relation between the preset image template and the mark.
6. The method of claim 1, wherein determining a device image of at least one target device from the target image template and the captured image comprises:
covering the target image template on the photographed image to obtain a superimposed image which is used for displaying equipment in the photographed image through a transparent area of the target image template and covering the background in the photographed image through a non-transparent area of the target image template;
and intercepting the superimposed image based on the transparent area corresponding to the device to obtain a device image of at least one target device.
7. The method of any one of claims 1 to 6, wherein the captured image is an infrared captured image and the device image is an infrared device image.
8. A device for detecting an apparatus, comprising:
the shooting image and target image template determining module is used for acquiring shooting images obtained by the shooting device in the process of collecting the equipment images and target image templates corresponding to the shooting device; the target image template comprises a transparent area corresponding to the position of the equipment in the photographed image and a non-transparent area corresponding to the area of the background in the photographed image;
the device image determining module is used for determining a device image of at least one target device according to the target image template and the shooting image;
and the abnormality judging module is used for identifying the equipment image and determining whether the target equipment is abnormal according to the identification result.
9. An electronic device, the electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the method of detecting a device of any one of claims 1-7.
10. A computer readable storage medium storing computer instructions for causing a processor to perform the method of detecting a device according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310457392.3A CN116486125A (en) | 2023-04-24 | 2023-04-24 | Equipment detection method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310457392.3A CN116486125A (en) | 2023-04-24 | 2023-04-24 | Equipment detection method, device, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116486125A true CN116486125A (en) | 2023-07-25 |
Family
ID=87215238
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310457392.3A Pending CN116486125A (en) | 2023-04-24 | 2023-04-24 | Equipment detection method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116486125A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117750196A (en) * | 2024-02-10 | 2024-03-22 | 苔花科迈(西安)信息技术有限公司 | Data acquisition method and device of underground drilling site mobile camera device based on template |
-
2023
- 2023-04-24 CN CN202310457392.3A patent/CN116486125A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117750196A (en) * | 2024-02-10 | 2024-03-22 | 苔花科迈(西安)信息技术有限公司 | Data acquisition method and device of underground drilling site mobile camera device based on template |
| CN117750196B (en) * | 2024-02-10 | 2024-05-28 | 苔花科迈(西安)信息技术有限公司 | Data acquisition method and device of underground drilling site mobile camera device based on template |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116596854A (en) | Equipment defect identification method, device, equipment and medium | |
| CN116486125A (en) | Equipment detection method, device, equipment and medium | |
| KR102496334B1 (en) | Method and device for detecting body temperature, electronic apparatus and storage medium | |
| CN113627361B (en) | Training method and device for face recognition model and computer program product | |
| CN112729884A (en) | Equipment fault diagnosis method and device based on big data | |
| CN116226644A (en) | Method and device for determining equipment fault type, electronic equipment and storage medium | |
| CN116450176A (en) | Version updating method and device, electronic equipment and storage medium | |
| CN117765701A (en) | Information detection method and device, electronic equipment and storage medium | |
| CN118052877A (en) | Positioning method, device, equipment and medium for strand breakage defect of power cable | |
| CN117150215B (en) | Assessment result determining method and device, electronic equipment and storage medium | |
| CN115327497B (en) | Radar detection range determining method, radar detection range determining device, electronic equipment and readable medium | |
| CN116883488B (en) | Method, device, equipment and medium for determining center position of circular pipe | |
| CN117743396A (en) | Data quality detection method, device, equipment and storage medium | |
| CN117422861A (en) | Method, device, equipment and medium for evaluating risk of maintaining power equipment | |
| CN117434403A (en) | Partial discharge detection method and device for electric appliance | |
| CN115359275A (en) | Fault identification method and device, electronic equipment and storage medium | |
| CN118212275A (en) | Local registration method, device, equipment and medium of electric power image | |
| CN117935129A (en) | Method, device, equipment and storage medium for detecting power distribution network line disaster damage | |
| CN117092451A (en) | Fault power grid node positioning method, device, equipment and storage medium | |
| CN117709276A (en) | Busbar generation method, device, equipment and medium in electrical equipment | |
| CN116630863A (en) | Power distribution network safety identification recognition method, device, equipment and storage medium | |
| CN118279728A (en) | Fingerprint quality assessment method and device and computer equipment | |
| CN116909994A (en) | Image naming method, device, equipment and storage medium | |
| CN117554748A (en) | Method, device, equipment and storage medium for detecting fault line of power distribution network | |
| CN116502841A (en) | Event processing method and device, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |