CN112257500A - Intelligent image recognition system and method for power equipment based on cloud edge cooperation technology - Google Patents
Intelligent image recognition system and method for power equipment based on cloud edge cooperation technology Download PDFInfo
- Publication number
- CN112257500A CN112257500A CN202010972865.XA CN202010972865A CN112257500A CN 112257500 A CN112257500 A CN 112257500A CN 202010972865 A CN202010972865 A CN 202010972865A CN 112257500 A CN112257500 A CN 112257500A
- Authority
- CN
- China
- Prior art keywords
- equipment
- edge
- cloud
- intelligent
- target detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Molecular Biology (AREA)
- General Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Computing Systems (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses an intelligent image recognition system and method for electric equipment based on a cloud edge cooperation technology, wherein the intelligent image recognition system for the electric equipment comprises the following components: the system comprises image acquisition equipment, edge equipment and a cloud platform, wherein an embedded target detection algorithm runs on the image acquisition equipment; an embedded target detection algorithm is operated on the edge equipment, and a ZEUS AI intelligent computing hardware platform is arranged on the edge equipment; an embedded target detection algorithm runs on the cloud platform; the image acquisition equipment, the edge equipment and the cloud platform are electrically connected with each other and transmit data through a network. According to the technical scheme, a ZEUS AI intelligent computing hardware platform and a CAFFE algorithm frame are selected, and artificial intelligence deep learning is adopted to finish algorithm training and performance tuning of target detection such as safety helmet detection, personnel falling and trajectory tracking of a power distribution network.
Description
Technical Field
The invention relates to the field of electrical engineering science, in particular to an intelligent image recognition system and method for power equipment based on a cloud edge cooperation technology.
Background
Along with the development of related artificial intelligence at home and abroad, except that the human face recognition technology and the license plate recognition technology tend to be mature and start to be commercially used in a large scale in each subdivision field, other related technologies are slowly developed due to various factors, particularly countless subdivision application scenes exist in countless subdivision industry fields, and the development speed of the technology is greatly limited by the customization difficulty and the large-scale market effect.
With the deep development of the power internet of things technology, tens of thousands of power devices generate massive data, especially in the field of computer vision, the amount of pictures and video data generated by front-end devices is huge, if all the data are gathered to a cloud for intelligent analysis, infinite pressure is brought to the bandwidth requirement, the real-time requirement and the like of communication, especially in some scenes with high requirements on real-time performance and privacy safety, for example, it is unrealistic to transmit a large amount of video data to the cloud for processing and then return decision results, so that we are required to provide edge intelligent services nearby on a device node side or a network edge side close to a data source, and move AI calculation power (inference power) from the cloud to the edge side gradually. The cloud is focused on the training of the non-real-time and large-data-volume deep learning algorithm, optimizes the algorithm model, and provides services such as algorithm scheduling for the edge. The technology combining edge computing and cloud computing is more and more emphasized, and the edge computing and the cloud computing are widely applied to various application scenes in various AI + IOT scenes.
According to the safety standard of the electric power construction site, all constructors must wear safety helmets and patrol according to the specified lines. In order to supervise whether all constructors meet the requirements of safe construction, the current methods generally include: firstly, a manual monitoring method: transmitting the monitoring video of the personnel in the construction site to a supervision center through a camera installed on site, and manually checking the video; secondly, a monitoring method based on cloud intelligence comprises the following steps: the method comprises the steps of installing a camera on site, transmitting a monitoring video of a construction site to a supervision center, deploying a computing server in the supervision center, processing the received video through an AI algorithm deployed on the server, analyzing whether a constructor meets the safety management requirement and giving an alarm to the supervisors.
The first method completely does not adopt an intelligent means, and completely depends on manual identification, so that the first method has the following defects: 1) manual inspection is carried out, and the efficiency is low; 2) when a plurality of construction sites are simultaneously carved, monitoring omission or inspection by more supervision personnel is possibly caused, so that the cost is high and the effect is poor; 3) the construction site and the monitoring center generally adopt wireless transmission real-time video, the bandwidth requirement is high, the video quality is difficult to guarantee, and meanwhile, a large amount of redundant video causes bandwidth waste. In the second method, artificial intelligence recognition processing is added on the basis of the first method, so that efficiency is greatly improved, but the cost is high due to the adoption of a cloud server, and meanwhile, a complete video needs to be transmitted to a cloud in real time on a construction site, so that the defects of long time delay, waste of bandwidth and the like exist.
Disclosure of Invention
Aiming at the problems, the invention provides an intelligent image recognition system and method for power equipment based on a cloud edge cooperation technology.
In order to achieve the object of the present invention, the present invention provides an intelligent image recognition system for an electrical device based on a cloud-edge coordination technology, comprising: the system comprises image acquisition equipment, edge equipment and a cloud platform, wherein a ZEUS AI intelligent computing hardware platform and an embedded target detection algorithm software platform are arranged on the edge equipment, and the image acquisition equipment, the edge equipment and the cloud platform transmit data through a network.
Further, the invention provides an intelligent image recognition method for power equipment based on a cloud edge coordination technology, which comprises the following steps:
s1: the image acquisition equipment acquires and analyzes image sample data of the power equipment;
s2: selecting a detection recognition model, and training the model;
s3: summarizing a monitoring range of the operation and maintenance of the power equipment according to the analysis of the application scene;
s4: calibrating the model training result according to the acquired image sample, and performing deep learning on a ZEUS AI intelligent computing hardware platform of the edge device and the embedded target detection algorithm software platform;
s5: carrying out model training again in S2 according to the deep learning to obtain a model training result;
s6: and adjusting parameters according to the model training result to complete the simulation test.
Further, the implementation process of the embedded target detection algorithm includes:
extracting an input video stream, and selecting a frame of data to perform preprocessing operation;
inputting the data after the preprocessing operation into a pre-trained classification network, and fixing corresponding network parameters;
and performing the following operation on the obtained feature map through the last convolutional layer of the pre-training classification network:
a. performing region generation network operation on the feature map and obtaining a corresponding region of interest;
b. acquiring a plurality of position sensitivity score mapping graphs with K X K (C +1) dimensions on the feature graph and carrying out classification operation;
c. acquiring a plurality of position sensitivity score maps with dimensions of 4 x K on the feature map and performing regression operation;
d. and respectively executing position sensitive ROI pooling operation on the K-by-K (C +1) -dimensional position sensitive score mapping graph and the 4-by-K-dimensional position sensitive score mapping graph, and acquiring corresponding category and position information, wherein K is the size of the sub-region of the region of interest, and C is the number of the identified target categories.
Further, K is 3 or more and 5 or less; c is not less than 2 and not more than 3.
Compared with the prior art, the invention has the following beneficial technical effects:
based on a high-performance ZEUS AI intelligent computing hardware platform and a CAFFE algorithm framework (an embedded target detection algorithm framework), the invention completes image acquisition, image processing, target detection, deep learning, target key feature extraction, structured video extraction and other processing at an equipment end through an advanced embedded target detection algorithm running at the equipment end, completes safety helmet detection, personnel falling down and track tracking at the equipment end and a cloud platform in real time according to the acquired video at the site, starts alarm linkage in real time for the situation that the safety management is not met, transmits an identification result and a structured alarm video to the cloud platform for display processing, and supervisors only pay attention to the alarm result and the alarm segment without checking a large amount of redundant videos, thereby greatly improving the management efficiency. The artificial intelligence video detection method has the advantages of intelligence, high efficiency, real time, low occupied transmission bandwidth and the like, is very convenient to deploy, and is particularly suitable for mobile or fixed deployment in various power construction places.
Drawings
Fig. 1 is a schematic flowchart of an intelligent image recognition method for an electrical device based on a cloud edge coordination technology according to an embodiment;
FIG. 2 is a schematic diagram of an embedded target detection algorithm framework of an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The invention provides an intelligent image recognition system of power equipment based on a cloud edge coordination technology, which comprises the following components: the system comprises image acquisition equipment, edge equipment and a cloud platform, wherein a ZEUS AI intelligent computing hardware platform and an embedded target detection algorithm software platform are arranged on the edge equipment, and the image acquisition equipment, the edge equipment and the cloud platform transmit data through a network.
In one embodiment, an intelligent image recognition method for an electric power device based on a cloud edge coordination technology is provided, as shown in fig. 1, including the following steps:
s1: the image acquisition equipment acquires and analyzes image sample data of the power equipment;
s2: selecting a detection recognition model, and training the model;
s3: summarizing a monitoring range of the operation and maintenance of the power equipment according to the analysis of the application scene, thereby determining the activity range of the monitored operation and maintenance personnel;
s4: calibrating the model training result according to the acquired image sample, and performing deep learning on a ZEUS AI intelligent computing hardware platform of the edge device and the embedded target detection algorithm software platform;
s5: carrying out model training again in S2 according to the deep learning to obtain a model training result;
s6: and adjusting parameters according to the model training result to complete the simulation test.
In one embodiment, as shown in fig. 2, the implementation process of the embedded target detection algorithm includes:
extracting an input video stream, and selecting a frame of data to perform preprocessing operation;
inputting the data after the preprocessing operation into a pre-trained classification network, and fixing corresponding network parameters;
and performing the following operation on the obtained feature map through the last convolutional layer of the pre-training classification network:
a. performing region generation network operation on the feature map and obtaining a corresponding region of interest;
b. acquiring a plurality of position sensitivity score mapping graphs with K X K (C +1) dimensions on the feature graph and carrying out classification operation;
c. acquiring a plurality of position sensitivity score maps with dimensions of 4 x K on the feature map and performing regression operation;
d. and respectively executing position sensitive ROI pooling operation on the K-by-K (C +1) -dimensional position sensitive score mapping graph and the 4-by-K-dimensional position sensitive score mapping graph, and acquiring corresponding category and position information, wherein K is the size of the sub-region of the region of interest, and C is the number of the identified target categories.
The embedded target detection algorithm is a full convolution neural network framework algorithm based on a region, when the algorithm is identified, firstly, image features are extracted and a feature map is generated, then, the region is used for generating a network RPN, regions of interest with different proportions are generated on the feature map, meanwhile, a position sensitivity score mapping map is generated by using the feature map, and the algorithm identifies different types of targets according to the position sensitivity score mapping map.
In one embodiment, according to the characteristics of an electric power application scene, the value range of K is set to be 3-5, and the value range of C is set to be 2-3.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
It should be noted that the terms "first \ second \ third" referred to in the embodiments of the present application merely distinguish similar objects, and do not represent a specific ordering for the objects, and it should be understood that "first \ second \ third" may exchange a specific order or sequence when allowed. It should be understood that "first \ second \ third" distinct objects may be interchanged under appropriate circumstances such that the embodiments of the application described herein may be implemented in an order other than those illustrated or described herein.
The terms "comprising" and "having" and any variations thereof in the embodiments of the present application are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device that comprises a list of steps or modules is not limited to the listed steps or modules but may alternatively include other steps or modules not listed or inherent to such process, method, product, or device.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (4)
1. The utility model provides an electrical equipment intelligence image recognition system based on cloud limit cooperation technique which characterized in that includes: the system comprises image acquisition equipment, edge equipment and a cloud platform, wherein a ZEUS AI intelligent computing hardware platform and an embedded target detection algorithm software platform are arranged on the edge equipment, and the image acquisition equipment, the edge equipment and the cloud platform transmit data through a network.
2. An intelligent image recognition method for electric power equipment based on a cloud edge cooperation technology is characterized by comprising the following steps:
s1: the image acquisition equipment acquires and analyzes image sample data of the power equipment;
s2: selecting a detection recognition model, and training the model;
s3: summarizing a monitoring range of the operation and maintenance of the power equipment according to the analysis of the application scene;
s4: calibrating the model training result according to the acquired image sample, and performing deep learning on a ZEUS AI intelligent computing hardware platform of the edge device and the embedded target detection algorithm software platform;
s5: carrying out model training again in S2 according to the deep learning to obtain a model training result;
s6: and adjusting parameters according to the model training result to complete the simulation test.
3. The intelligent image recognition method for the power equipment based on the cloud edge coordination technology as claimed in claim 2, wherein the implementation process of the embedded target detection algorithm comprises:
extracting an input video stream, and selecting a frame of data to perform preprocessing operation;
inputting the data after the preprocessing operation into a pre-trained classification network, and fixing corresponding network parameters;
and performing the following operation on the obtained feature map through the last convolutional layer of the pre-training classification network:
a. performing region generation network operation on the feature map and obtaining a corresponding region of interest;
b. acquiring a plurality of position sensitivity score mapping graphs with K X K (C +1) dimensions on the feature graph and carrying out classification operation;
c. acquiring a plurality of position sensitivity score maps with dimensions of 4 x K on the feature map and performing regression operation;
d. and respectively executing position sensitive ROI pooling operation on the K-by-K (C +1) -dimensional position sensitive score mapping graph and the 4-by-K-dimensional position sensitive score mapping graph, and acquiring corresponding category and position information, wherein K is the size of the sub-region of the region of interest, and C is the number of the identified target categories.
4. The intelligent image recognition method for the power equipment based on the cloud edge coordination technology as claimed in claim 3, wherein: k is greater than or equal to 3 and less than or equal to 5; c is not less than 2 and not more than 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010972865.XA CN112257500A (en) | 2020-09-16 | 2020-09-16 | Intelligent image recognition system and method for power equipment based on cloud edge cooperation technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010972865.XA CN112257500A (en) | 2020-09-16 | 2020-09-16 | Intelligent image recognition system and method for power equipment based on cloud edge cooperation technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112257500A true CN112257500A (en) | 2021-01-22 |
Family
ID=74233081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010972865.XA Withdrawn CN112257500A (en) | 2020-09-16 | 2020-09-16 | Intelligent image recognition system and method for power equipment based on cloud edge cooperation technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112257500A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113011297A (en) * | 2021-03-09 | 2021-06-22 | 全球能源互联网研究院有限公司 | Power equipment detection method, device, equipment and server based on edge cloud cooperation |
| CN113242271A (en) * | 2021-03-17 | 2021-08-10 | 北京大学 | Digital retina-based end, edge and cloud cooperation system, method and equipment |
| CN114140447A (en) * | 2021-12-06 | 2022-03-04 | 国网新疆电力有限公司信息通信公司 | Cloud edge cooperation technology-based power equipment image identification method and system |
| CN114359781A (en) * | 2021-12-02 | 2022-04-15 | 国家石油天然气管网集团有限公司 | Intelligent recognition system for cloud-side collaborative autonomous learning |
| CN114500536A (en) * | 2022-01-27 | 2022-05-13 | 京东方科技集团股份有限公司 | Cloud edge cooperation method, system, device, cloud platform, equipment and medium |
| CN114612825A (en) * | 2022-03-09 | 2022-06-10 | 云南大学 | Target detection method based on edge equipment |
-
2020
- 2020-09-16 CN CN202010972865.XA patent/CN112257500A/en not_active Withdrawn
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113011297A (en) * | 2021-03-09 | 2021-06-22 | 全球能源互联网研究院有限公司 | Power equipment detection method, device, equipment and server based on edge cloud cooperation |
| CN113242271A (en) * | 2021-03-17 | 2021-08-10 | 北京大学 | Digital retina-based end, edge and cloud cooperation system, method and equipment |
| CN114359781A (en) * | 2021-12-02 | 2022-04-15 | 国家石油天然气管网集团有限公司 | Intelligent recognition system for cloud-side collaborative autonomous learning |
| CN114140447A (en) * | 2021-12-06 | 2022-03-04 | 国网新疆电力有限公司信息通信公司 | Cloud edge cooperation technology-based power equipment image identification method and system |
| CN114500536A (en) * | 2022-01-27 | 2022-05-13 | 京东方科技集团股份有限公司 | Cloud edge cooperation method, system, device, cloud platform, equipment and medium |
| CN114500536B (en) * | 2022-01-27 | 2024-03-01 | 京东方科技集团股份有限公司 | Cloud edge cooperation method, cloud edge cooperation system, cloud device, cloud platform equipment and cloud medium |
| CN114612825A (en) * | 2022-03-09 | 2022-06-10 | 云南大学 | Target detection method based on edge equipment |
| CN114612825B (en) * | 2022-03-09 | 2024-03-19 | 云南大学 | Target detection method based on edge equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112257500A (en) | Intelligent image recognition system and method for power equipment based on cloud edge cooperation technology | |
| CN110879989B (en) | Ads-b signal target identification method based on small sample local machine learning model | |
| CN110070530A (en) | A kind of powerline ice-covering detection method based on deep neural network | |
| CN112927464A (en) | Job site macro-chain safety management and control system based on edge intelligence | |
| Zhao et al. | Detection and location of safety protective wear in power substation operation using wear-enhanced YOLOv3 algorithm | |
| CN113284144B (en) | Tunnel detection method and device based on unmanned aerial vehicle | |
| CN113252701A (en) | Cloud edge cooperation-based power transmission line insulator self-explosion defect detection system and method | |
| CN112528825A (en) | Station passenger recruitment service method based on image recognition | |
| CN112885014A (en) | Early warning method, device, system and computer readable storage medium | |
| CN118297755B (en) | Building construction analysis management and control method and system based on Internet of things and big data technology | |
| CN115408941A (en) | Intelligent fire early warning system based on multi-source data | |
| CN116912774A (en) | Infrared image target identification method, electronic device and storage medium of power transmission and transformation equipment based on edge calculation | |
| CN116822939A (en) | Three-dimensional spatial relationship-based transformer substation live area risk identification method and system | |
| CN114821486B (en) | Personnel identification method in power operation scene | |
| CN113591323B (en) | Embedded image dynamic scene simulation imaging system and method | |
| CN113139476A (en) | Data center-oriented human behavior attribute real-time detection method and system | |
| CN113936300A (en) | Construction site personnel identification method, readable storage medium and electronic device | |
| CN112200030A (en) | Power system field operation action risk identification method based on graph convolution | |
| Cao et al. | FOD detection using a multi-channel information fusion method | |
| Zhao et al. | SceneNet: A Multi-Feature Joint Embedding Network With Complexity Assessment for Power Line Scene Classification | |
| CN117437188B (en) | Insulator defect detection system for smart power grid | |
| Zhan | Electric equipment inspection on high voltage transmission line via Mobile Net-SSD | |
| CN118243213B (en) | Vibration noise monitoring analysis method and vibration noise monitoring system | |
| LU501401B1 (en) | Action risk identification method for power system field operation based on graph convolution | |
| Pu et al. | Anomaly detection of substation engineering video object based on cloud platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210122 |
|
| WW01 | Invention patent application withdrawn after publication |