CN110493574B - Security monitoring visualization system based on streaming media and AI technology - Google Patents

Security monitoring visualization system based on streaming media and AI technology Download PDF

Info

Publication number
CN110493574B
CN110493574B CN201910798218.9A CN201910798218A CN110493574B CN 110493574 B CN110493574 B CN 110493574B CN 201910798218 A CN201910798218 A CN 201910798218A CN 110493574 B CN110493574 B CN 110493574B
Authority
CN
China
Prior art keywords
video image
video
noise
image
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910798218.9A
Other languages
Chinese (zh)
Other versions
CN110493574A (en
Inventor
宁柏锋
孙蓉蓉
田松林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Southern Power Grid Digital Platform Technology Guangdong Co ltd
Shenzhen Power Supply Bureau Co Ltd
Original Assignee
Shenzhen Power Supply Bureau Co Ltd
Shenzhen Digital Power Grid Research Institute of China Southern Power Grid Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Power Supply Bureau Co Ltd, Shenzhen Digital Power Grid Research Institute of China Southern Power Grid Co Ltd filed Critical Shenzhen Power Supply Bureau Co Ltd
Priority to CN201910798218.9A priority Critical patent/CN110493574B/en
Publication of CN110493574A publication Critical patent/CN110493574A/en
Application granted granted Critical
Publication of CN110493574B publication Critical patent/CN110493574B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Alarm Systems (AREA)

Abstract

本发明公开了一种基于流媒体和AI技术的安监可视化系统,该安监可视化系统包括:依次进行数据通信连接的视频数据采集平台、数据转发服务器和可视化管理终端计算机。该安监可视化系统通过视频数据采集平台可以获取电力作业现场的视频图像,通过数据转发服务器将视频数据采集平台获取的电力作业现场的视频图像传输至可视化管理终端计算机,使得检修人员能够通过该可视化管理终端计算机可以远程了解电力作业现场的作业情况以及各电力设备是否存在缺陷,以便于及时采取有效措施,消除隐患;同时也无需检修人员深入到电力作业现场进行人工巡检,提高了巡检效率,也避免了由于人工巡检带来的巡检不到位、巡检不完善等情况的发生。

Figure 201910798218

The invention discloses a safety monitoring visualization system based on streaming media and AI technology. The safety monitoring visualization system includes: a video data acquisition platform, a data forwarding server and a visualization management terminal computer which are sequentially connected by data communication. The safety monitoring visualization system can obtain the video images of the electric power operation site through the video data collection platform, and transmit the video images of the electric power operation site obtained by the video data collection platform to the visual management terminal computer through the data forwarding server, so that the maintenance personnel can pass the visualization The management terminal computer can remotely understand the operation status of the power operation site and whether there are defects in each power equipment, so that effective measures can be taken in time to eliminate hidden dangers; at the same time, there is no need for maintenance personnel to go to the power operation site for manual inspection, which improves the inspection efficiency. It also avoids the occurrence of incomplete inspections and imperfect inspections caused by manual inspections.

Figure 201910798218

Description

Security monitoring visualization system based on streaming media and AI technology
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a safety supervision visualization system based on streaming media and AI technology.
Background
The electric power operation is closely related to the life of people and the production of enterprises, and the necessary condition of normal power supply is ensured when the electric power equipment normally works, so that the safety supervision of the electric power operation is very important, the running conditions of circuits and the electric power equipment are mastered through safety supervision, the hidden danger in the electric power operation process and the hidden danger of the safety of the electric power equipment are discovered, and the hidden danger is eliminated in time.
Traditional electric power safety supervision mainly relies on the manual work to accomplish at the scene, and the labour consumes greatly in electric power safety supervision, and the manual work is patrolled and examined and is appeared patrolling and examining not in place easily, is patrolled and examined imperfectly the circumstances such as, leads to work efficiency low.
Disclosure of Invention
Aiming at the problems, the invention provides a safety supervision visualization system based on streaming media and AI technology.
The purpose of the invention is realized by adopting the following technical scheme:
a safety supervision visualization system based on streaming media and AI technology, the safety supervision visualization system comprising: the system comprises a video data acquisition platform, a data forwarding server and a visual management terminal computer which are sequentially connected in a data communication manner;
the video data acquisition platform is arranged in the electric power operation site and used for acquiring video images of the electric power operation site and transmitting the acquired video images to the data forwarding server in real time; the video image includes: a first video image regarding a scene of the electric power work site and a second video image regarding each electric power equipment in the electric power work site;
the data forwarding server is used for caching the received video image;
the visual management terminal computer is used for acquiring a first video image from the data forwarding server and displaying the first video image through a video window; and the video window is also used for acquiring a second video image from the data forwarding server, processing the second video image, judging whether each electric power device has defects and corresponding defect types, and presenting the defect condition of each electric power device through the video window.
In an alternative embodiment, the video data collection platform comprises: the monitoring camera is arranged at a specified position in the electric power operation field, and the image sensor is arranged near each electric power device.
In an optional embodiment, the safety supervision visualization system further comprises: and the terminal control equipment is in communication connection with the visual management terminal computer and is used for sending an instruction to the visual management terminal computer so as to enable the visual management terminal computer to execute corresponding operation.
In an optional embodiment, the visualization management terminal computer is further configured to obtain weather information from a weather distribution center and present the weather information through the video window.
In an optional embodiment, the visualization management terminal computer includes: the system comprises a first video image acquisition module, a second video image acquisition module, a meteorological information acquisition module, a second video image processing module, a power equipment defect monitoring module and a video window;
the first video image acquisition module is used for acquiring a first video image from the data forwarding server and presenting the first video image through the video window;
the second video image acquisition module is used for acquiring a second video image from the data forwarding server and transmitting the second video image to the second video image processing module;
the weather information acquisition module is used for acquiring weather information from a weather release center and displaying the weather information through the video window;
the second video image processing module is used for processing the second video image to acquire characteristic data of each power device;
and the power equipment defect monitoring module is used for judging whether each power equipment has a defect and a corresponding defect type according to the characteristic data of each power equipment and the pre-stored characteristic data about the defect type of each power equipment, and presenting the judgment result through the video window.
In an optional embodiment, the second video image processing module includes an image denoising unit, an edge detection unit, an image enhancement unit and a feature extraction unit;
the image denoising unit is used for denoising the second video image;
the edge detection unit is used for carrying out edge detection and segmentation on the denoised second video image to obtain a video image only containing the power equipment;
the image enhancement unit is used for enhancing the video image obtained by segmentation;
the feature extraction unit is used for extracting feature data describing the electric power equipment in the video image from the enhanced video image.
In an optional embodiment, the denoising the second video image includes:
(1) carrying out noise detection on pixel points in the second video image to obtain a noise point set of the second video image
Figure BDA0002181553580000021
And a set of non-noise points { Ψ }N
(2) Graying the second video image, and estimating the gray value of each noise point to obtain the estimated value of the gray value of each noise point; wherein, the estimation value of the gray value of the noise point A is obtained by the following formula:
Figure BDA0002181553580000022
in the formula (I), the compound is shown in the specification,
Figure BDA0002181553580000023
is an estimated value of the gray value of the noise point A, G (A) is the gray value of the noise point A, gamma is a sliding window with the noise point A as the center, ZΓ、WΓRespectively the number of non-noise points and the number of noise points in the sliding window gamma, Gz、GwRespectively the gray value of the non-noise point z and the gray value of the noise point w in the sliding window Γ,
Figure BDA0002181553580000031
is the mean value of the gray values of all the non-noise points in the grayed second video image, gamma1、γ2Is a preset weight coefficient;
(3) and the set formed by the estimation value of the gray value of each noise point and the gray value of the non-noise point is the denoised second video image data.
The invention has the beneficial effects that: the invention provides a safety supervision visualization system based on streaming media and AI (artificial intelligence) technology, which can acquire a video image of an electric power operation site through a video data acquisition platform and transmit the video image of the electric power operation site acquired by the video data acquisition platform to a visualization management terminal computer through a data forwarding server, so that a maintainer can remotely know the operation condition of the electric power operation site and whether each electric power device has defects through the visualization management terminal computer, thereby being convenient to take effective measures in time and eliminating hidden dangers; meanwhile, a maintainer does not need to go deep into an electric power operation field to carry out manual inspection, inspection efficiency is improved, and the situations of insufficient inspection, incomplete inspection and the like caused by manual inspection are avoided.
Drawings
The invention is further illustrated by means of the attached drawings, but the embodiments in the drawings do not constitute any limitation to the invention, and for a person skilled in the art, other drawings can be obtained on the basis of the following drawings without inventive effort.
Fig. 1 is a frame structure diagram of a safety supervision visualization system according to an embodiment of the present invention;
fig. 2 is a block diagram of a second video image processing module 340 according to an embodiment of the present invention.
Reference numerals: the system comprises a video data acquisition platform 100, a data forwarding server 200, a visualization management terminal computer 300, a terminal control device 400, a first video image acquisition module 310, a second video image acquisition module 320, a meteorological information acquisition module 330, a second video image processing module 340, an electrical equipment defect monitoring module 350, a video window 360, an image denoising unit 341, an edge detection unit 342, an image enhancement unit 343 and a feature extraction unit 344.
Detailed Description
The invention is further described with reference to the following examples.
Fig. 1 shows a safety supervision visualization system based on streaming media and AI technology, which includes: the video data acquisition platform 100, the data forwarding server 200 and the visualization management terminal computer 300 are sequentially connected in data communication.
The video data acquisition platform 100 is arranged in an electric power operation site, and is used for acquiring a video image of the electric power operation site and transmitting the acquired video image to the data forwarding server 200 in real time; the video image includes: a first video image regarding a scene of the electric power work site and a second video image regarding each electric power equipment in the electric power work site;
the data forwarding server 200 is configured to cache the received video image;
the visualization management terminal computer 300 is configured to obtain a first video image from the data forwarding server 200, and present the first video image through a video window 360; the video processing module is further configured to obtain a second video image from the data forwarding server 200, process the second video image, determine whether each electrical device has a defect and a corresponding defect type, and present the defect condition of each electrical device through the video window 360.
The embodiment of the invention has the following beneficial effects: the invention provides a safety supervision visualization system based on streaming media and AI (Artificial intelligence) technology, which can acquire a video image of an electric power operation field through a video data acquisition platform 100, and transmit the video image of the electric power operation field acquired by the video data acquisition platform to a visualization management terminal computer 300 through a data forwarding server 200, so that a maintainer can remotely know the operation condition of the electric power operation field and whether each electric power device has defects through the visualization management terminal computer 300, thereby being convenient to take effective measures in time and eliminating hidden dangers; meanwhile, a maintainer does not need to go deep into an electric power operation field to carry out manual inspection, inspection efficiency is improved, and the situations of insufficient inspection, incomplete inspection and the like caused by manual inspection are avoided.
In an alternative embodiment, the video data capture platform 100 comprises: the monitoring camera is arranged at a specified position in the electric power operation field, and the image sensor is arranged near each electric power device.
In an optional embodiment, the safety supervision visualization system further comprises: and a terminal control device 400 which is connected with the visualization management terminal computer 300 in a communication way. The terminal control device 400 is configured to issue an instruction to the visualization management terminal computer 300, so that the visualization management terminal computer 300 executes a corresponding operation.
In an alternative embodiment, the visualization management terminal computer 300 is further configured to obtain weather information from a weather distribution center and to present the weather information through the video window 360.
In an alternative embodiment, the following contents may also be presented through the video window 360 of the visualization management terminal computer 300:
1) operation information: and displaying the on-site operation information which is being developed. Including the geographic location and distribution of the site operation, the specific tasks and implementation units of the site operation, etc.
2) Supervising and checking the operation information: and displaying the ongoing supervision operation information. Including supervising the geographic location and distribution of the jobs.
3) Integrating the risk information of the power grid: the current power grid risk taking effect and management and control conditions are displayed.
4) Defect information: the defect types of the current power equipment and the processing conditions of the current power equipment by a maintainer are displayed.
5) Video information: a. the video window 360 can select videos collected by the monitoring camera of the designated power operation site to view at any time; b. video window 360 may select a designated live law enforcement video for viewing at any time.
6) Photo and short video information: the photo and short video information of the field operation can be displayed, and the checking of a plurality of photos is supported.
7) And (3) statistical analysis information: background data model calculation for supporting the video window 360 is achieved, the background data model calculation comprises a field operation information analysis model, various levels of safety supervision plan analysis models, violation record analysis models, a power grid risk analysis model, a defect data analysis model, an equipment evaluation analysis model and an operation data analysis model, calculation results are displayed on a large screen in a chart form to facilitate decision analysis, and specifically displayed charts comprise operation risk statistics, operation condition statistics, operation in-place condition statistics, equipment defect condition statistics, equipment state evaluation condition statistics, violation condition statistics and the like.
In an optional embodiment, the visualization management terminal computer 300 may further integrate all the obtained data in a unified manner, and may use a customized interface to classify and process the data related to the service concerned by the security supervision departments, such as field operation, supervision plan, and defects, instead of the conventional data visualization interface, to implement the highly intuitive visualization of the content of the video window 360 in a three-dimensional graphical manner, so that the boring data becomes more flexible and has a more magnificent visual effect.
In an alternative embodiment, the visualization management terminal computer 300 includes: a first video image acquisition module 310, a second video image acquisition module 320, a meteorological information acquisition module 330, a second video image processing module 340, an electrical equipment defect monitoring module 350 and a video window 360;
the first video image obtaining module 310 is configured to obtain a first video image from the data forwarding server 200, and present the first video image through the video window 360;
the second video image obtaining module 320 is configured to obtain a second video image from the data forwarding server 200, and transmit the second video image to the second video image processing module 340;
the weather information acquiring module 330 is configured to acquire weather information from a weather distribution center and present the weather information through the video window 360;
the second video image processing module 340 is configured to process the second video image to obtain feature data of each power device;
the power device defect monitoring module 350 is configured to determine whether each power device has a defect and a corresponding defect type according to the feature data of each power device and pre-stored feature data about the defect type of each power device, and present a determination result through the video window 360.
In an alternative embodiment, referring to fig. 2, the second video image processing module 340 includes an image denoising unit 341, an edge detection unit 342, an image enhancement unit 343, and a feature extraction unit 344;
the image denoising unit 341 is configured to denoise the second video image;
the edge detection unit 342 is configured to perform edge detection on the denoised second video image and segment the second video image to obtain a video image only including the power device;
the image enhancement unit 343 is configured to perform enhancement processing on the video image obtained by segmentation;
the feature extraction unit 344 is configured to extract feature data describing the power devices in the video image from the enhanced video image.
In an optional embodiment, the denoising the second video image includes:
(1) carrying out noise detection on pixel points in the second video image to obtain a noise point set of the second video image
Figure BDA0002181553580000061
And a set of non-noise points { Ψ }N
(2) Graying the second video image, and estimating the gray value of each noise point to obtain the estimated value of the gray value of each noise point; wherein, the estimation value of the gray value of the noise point A is obtained by the following formula:
Figure BDA0002181553580000062
in the formula (I), the compound is shown in the specification,
Figure BDA0002181553580000063
is an estimated value of the gray value of the noise point A, G (A) is the gray value of the noise point A, gamma is a sliding window with the noise point A as the center, ZΓ、WΓRespectively the number of non-noise points and the number of noise points in the sliding window gamma, Gz、GwRespectively the gray value of the non-noise point z and the gray value of the noise point w in the sliding window Γ,
Figure BDA0002181553580000064
is the mean value of the gray values of all the non-noise points in the grayed second video image, gamma1、γ2Is a preset weight coefficient;
(3) and the set formed by the estimation value of the gray value of each noise point and the gray value of the non-noise point is the denoised second video image data.
Has the advantages that: the applicant innovatively proposes the above embodiment based on which noise is required to be reduced due to the influence of factors such as environment, damage of an image sensor, packet loss in a video image transmission process, and the like, so as to improve image quality of the second video image and facilitate accurate subsequent identification of various defects of the power equipment
Figure BDA0002181553580000065
The method has the advantages that the method can accurately estimate the gray value of the noise point due to the influence of the absolute value difference of the gray value of each noise point in the sliding window, improves the denoising effect, improves the image quality of the image, and reduces the influence caused by factors such as environment, self damage of an image sensor, packet loss in the video image transmission process and the like, so that the subsequent processing of the image is facilitated.
In an optional embodiment, the noise detection is performed on the pixel points in the second video image to obtain a noise point set of the second video image
Figure BDA0002181553580000066
And a set of non-noise points { Ψ }NThe method specifically comprises the following steps:
(1) calculating the brightness value of the pixel point p and the lighting of other pixels in the neighborhood thereof by using the following formulaRelative difference of values, wherein pixel point p (x)p,yp) The calculation formula of the relative difference value with the brightness values of other pixel points in the neighborhood is as follows:
Figure BDA0002181553580000067
in the formula, Qq(p) is the relative difference between the brightness value of the pixel point p and the brightness value of the pixel point q in the neighborhood, L (p), L (q) are the brightness values of the pixel point p and the pixel point q, LmaxIs the maximum value, sigma, of the brightness values of other pixels in the neighborhood1、σ2For a set adjustment factor, ΘpThe method is a set formed by removing a pixel point p from a window with the size of (2B +1) × (2B +1) by taking the pixel point p as a center and remaining pixel points;
(2) arranging the obtained relative difference values of the pixel point p and the brightness values of other pixel points in the neighborhood in a descending order, calculating the accumulated value of K relative differences in the front order,
Figure BDA0002181553580000071
and is
Figure BDA0002181553580000072
In the formula, RLK(p) is the accumulated value of the K relative difference values in the top order, Rk(p) is the K-th value after sequencing, wherein the value of K can be set according to the actual requirement;
(3) RL to be obtainedK(p) comparing the noise point with a preset noise threshold value T, if the noise point is larger than T, taking the pixel point p as a noise point, and adding the noise point into the set
Figure BDA0002181553580000073
Otherwise, add it to the set { Ψ }N
(4) Traversing all the pixel points to obtain the noise point set of the second video image
Figure BDA0002181553580000074
And a set of non-noise points { Ψ }N
Has the advantages that: if the noise reduction processing is directly performed on all the pixel points of the second video image, not only is the burden of the image denoising unit 341 increased, but also the denoising efficiency of the image denoising unit 341 is reduced, the applicant innovatively performs noise point detection on the second video image first, divides the pixel points in the second video image, and obtains a noise point set of the second video image
Figure BDA0002181553580000075
And a set of non-noise points { Ψ }NTherefore, when the subsequent denoising is performed, only the denoising processing is performed on the noise point, so that the denoising efficiency of the image denoising unit 341 is improved, the burden of the image denoising unit 341 is reduced, and the service life of the image denoising unit 341 is prolonged. When dividing the pixel points in the second video image, calculating relative difference values of the pixel points and brightness values of other pixel points in the neighborhood of the pixel points, descending the obtained relative difference values, calculating an accumulated value of K relative difference values arranged in the front, comparing the accumulated value with a preset noise threshold value, and further judging whether the noise point is a non-noise point or a noise point. The value of K is set according to actual requirements, when the value of K is larger, the accumulated value of K is larger, the probability of dividing the pixel point into noise points is larger, and although noise reduction processing needs to be carried out on more pixel points to a certain extent, the noise reduction effect is improved, the image quality of the image is better improved, the image is more beneficial to follow-up processing of the image, and whether each power device has defects or not and the defect type of each power device is analyzed.
In an optional embodiment, the edge detection and segmentation are performed on the denoised second video image to obtain a video image only including the power equipment, specifically;
(1) by pixel point s (x)s,ys) Selecting a sliding window with the size of (2t +1) × (2t +1) as the center, and respectively calculating the transverse edge characteristic value and the longitudinal edge of the pixel point s by using a following formulaAn edge characteristic value, a left diagonal edge characteristic value and a right diagonal edge characteristic value;
Figure BDA0002181553580000081
Figure BDA0002181553580000082
Figure BDA0002181553580000083
Figure BDA0002181553580000084
in the formula (I), the compound is shown in the specification,
Figure BDA0002181553580000085
respectively representing a transverse edge characteristic value, a longitudinal edge characteristic value, a left oblique diagonal edge characteristic value and a right oblique diagonal edge characteristic value of a pixel point; g (-) is the gray value of the pixel point, and sigma is a preset Gaussian weighting coefficient;
(3) calculating a comprehensive value reflecting the edge feature based on the calculation result of the step (2) by using the following formula
Figure BDA0002181553580000086
Figure BDA0002181553580000087
If it is
Figure BDA0002181553580000088
If the pixel point s is an edge point, otherwise, the pixel point is a non-edge point;
(4) traversing all pixel points in the denoised second video image, and segmenting the denoised second video image according to the obtained edge detection result to obtain a video image only containing the power equipment.
Has the advantages that: in the embodiment of the present invention, the denoised second video image is subjected to edge detection and segmentation to obtain a video image only including the power device, so that only the segmented video image needs to be processed during the subsequent feature extraction, which reduces the burden of the subsequent image enhancement unit 343 and the feature extraction unit 344 on the one hand, and improves the processing efficiency of the subsequent image enhancement unit 343 and the feature extraction unit 344 on the other hand, thereby enabling faster identification of the defect condition of each power device and facilitating an overhaul personnel to overhaul the power device with defects more quickly. When the edge detection is carried out, the applicant innovatively introduces the transverse edge characteristic value, the longitudinal edge characteristic value, the left oblique diagonal edge characteristic value and the right oblique diagonal edge characteristic value of each pixel point, firstly calculates the transverse edge characteristic value, the longitudinal edge characteristic value, the left oblique diagonal edge characteristic value and the right oblique diagonal edge characteristic value of each pixel point respectively, and then obtains a comprehensive value capable of reflecting the edge characteristic of each pixel point according to the obtained transverse edge characteristic value, the longitudinal edge characteristic value, the left oblique diagonal edge characteristic value and the right oblique diagonal edge characteristic value, thereby accurately detecting whether each pixel point belongs to an edge point.
Finally, it should be noted that the above embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the protection scope of the present invention, although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions can be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.

Claims (3)

1.一种基于流媒体和AI技术的安监可视化系统,其特征在于,包括:依次进行数据通信连接的视频数据采集平台、数据转发服务器和可视化管理终端计算机;1. a safety monitoring visualization system based on streaming media and AI technology, is characterized in that, comprises: the video data acquisition platform, data forwarding server and visual management terminal computer that carry out data communication connection successively; 所述视频数据采集平台设于电力作业现场中,用于采集电力作业现场的视频图像,并将采集的视频图像实时传输至所述数据转发服务器;所述视频图像包括:关于电力作业现场场景的第一视频图像和关于电力作业现场中各电力设备的第二视频图像;The video data acquisition platform is set in the electric power operation site, and is used to collect the video images of the electric power operation site, and transmit the collected video images to the data forwarding server in real time; the video images include: a first video image and a second video image about each electrical device in the electrical work site; 所述数据转发服务器,用于将接收到的视频图像加以缓存;The data forwarding server is used for buffering the received video images; 所述可视化管理终端计算机,用于从所述数据转发服务器获取第一视频图像,并通过视频窗口进行呈现;还用于从所述数据转发服务器获取第二视频图像,之后对所述第二视频图像进行处理,判断各电力设备是否存在缺陷以及对应的缺陷类型,并通过所述视频窗口呈现各电力设备的缺陷情况;The visual management terminal computer is used to obtain the first video image from the data forwarding server and present it through a video window; it is also used to obtain the second video image from the data forwarding server, and then the second video image is obtained from the data forwarding server. Image processing to determine whether each power device has defects and the corresponding defect type, and present the defect status of each power device through the video window; 所述可视化管理终端计算机包括:第一视频图像获取模块、第二视频图像获取模块、气象信息获取模块、第二视频图像处理模块、电力设备缺陷监测模块和视频窗口;The visual management terminal computer includes: a first video image acquisition module, a second video image acquisition module, a meteorological information acquisition module, a second video image processing module, a power equipment defect monitoring module and a video window; 所述第一视频图像获取模块用于从所述数据转发服务器获取第一视频图像,并通过所述视频窗口进行呈现;The first video image acquisition module is configured to acquire the first video image from the data forwarding server and present it through the video window; 所述第二视频图像获取模块用于从所述数据转发服务器获取第二视频图像,并传输至所述第二视频图像处理模块;The second video image acquisition module is configured to acquire a second video image from the data forwarding server and transmit it to the second video image processing module; 所述气象信息获取模块用于从气象发布中心获取气象信息,并通过所述视频窗口进行呈现;The meteorological information acquisition module is used to acquire the meteorological information from the meteorological release center and present it through the video window; 所述第二视频图像处理模块用于对所述第二视频图像进行处理,获取各电力设备的特征数据;The second video image processing module is configured to process the second video image to obtain characteristic data of each power device; 所述电力设备缺陷监测模块,用于根据各电力设备的特征数据和预存的关于各电力设备缺陷类型的特征数据,判断各电力设备是否存在缺陷以及对应的缺陷类型,并将判断结果通过所述视频窗口进行呈现;The power equipment defect monitoring module is used to judge whether each power equipment has a defect and the corresponding defect type according to the characteristic data of each power equipment and the pre-stored characteristic data about the defect type of each power equipment, and pass the judgment result through the The video window is rendered; 所述第二视频图像处理模块包括图像去噪单元、边缘检测单元、图像增强单元和特征提取单元;The second video image processing module includes an image denoising unit, an edge detection unit, an image enhancement unit and a feature extraction unit; 所述图像去噪单元用于对所述第二视频图像进行去噪;The image denoising unit is used for denoising the second video image; 所述边缘检测单元用于对去噪后的第二视频图像进行边缘检测并分割,得到只包含电力设备的视频图像;The edge detection unit is used to perform edge detection and segmentation on the denoised second video image to obtain a video image that only includes power equipment; 所述图像增强单元用于对分割得到的视频图像进行增强处理;The image enhancement unit is used for enhancing the segmented video image; 所述特征提取单元用于从增强后的视频图像中提取描述视频图像中电力设备的特征数据;The feature extraction unit is used for extracting feature data describing the power equipment in the video image from the enhanced video image; 其中,所述的对所述第二视频图像进行去噪,具体是:Wherein, the denoising of the second video image is specifically: (1)对所述第二视频图像中的像素点进行噪声检测,得到所述第二视频图像的噪声点集合
Figure FDA0003039065680000021
和非噪声点集合{Ψ}N
(1) Perform noise detection on pixels in the second video image to obtain a set of noise points in the second video image
Figure FDA0003039065680000021
and the set of non-noise points {Ψ} N ;
(2)对所述第二视频图像进行灰度化处理,并对各噪声点的灰度值进行估计,得到各噪声点灰度值的估计值;其中,噪声点A的灰度值的估计值利用下式求得:(2) Performing grayscale processing on the second video image, and estimating the grayscale value of each noise point to obtain the estimated value of the grayscale value of each noise point; wherein, the estimation of the grayscale value of the noise point A is The value is obtained using the following formula:
Figure FDA0003039065680000022
Figure FDA0003039065680000022
式中,
Figure FDA0003039065680000023
为噪声点A的灰度值的估计值,G(A)为噪声点A的灰度值,Γ为以噪声点A为中心的滑动窗口,ZΓ、WΓ分别为滑动窗口Γ内非噪声点数和噪声点数,Gz、Gw分别为滑动窗口Γ内非噪声点z的灰度值和噪声点w的灰度值,
Figure FDA0003039065680000024
为灰度化后第二视频图像中所有非噪声点灰度值均值,γ1、γ2为预设的权重系数;
In the formula,
Figure FDA0003039065680000023
is the estimated value of the gray value of the noise point A, G(A) is the gray value of the noise point A, Γ is the sliding window centered on the noise point A, Z Γ and W Γ are the non-noise in the sliding window Γ respectively The number of points and the number of noise points, G z , G w are the gray value of the non-noise point z and the gray value of the noise point w in the sliding window Γ, respectively,
Figure FDA0003039065680000024
is the mean value of the grayscale values of all non-noise points in the second video image after grayscale, and γ 1 and γ 2 are preset weight coefficients;
(3)各噪声点灰度值的估计值和非噪声点灰度值构成的集合即为去噪后的第二视频图像数据。(3) The set formed by the estimated value of the gray value of each noise point and the gray value of the non-noise point is the second video image data after denoising.
2.根据权利要求1所述的安监可视化系统,其特征在于,所述视频数据采集平台包括:部署于所述电力作业现场中指定位置的监控摄像头和部署于各电力设备附近的图像传感器。2 . The safety monitoring visualization system according to claim 1 , wherein the video data collection platform comprises: a surveillance camera deployed at a designated position in the electric power operation site and an image sensor deployed near each electric equipment. 3 . 3.根据权利要求1所述的安监可视化系统,其特征在于,还包括:与所述可视化管理终端计算机通信连接的终端控制设备,所述终端控制设备,用于向所述可视化管理终端计算机发出指令,以使所述可视化管理终端计算机执行相应的操作。3. The safety monitoring visualization system according to claim 1, further comprising: a terminal control device connected in communication with the visual management terminal computer, and the terminal control device is used for reporting to the visual management terminal computer An instruction is issued to cause the visual management terminal computer to perform corresponding operations.
CN201910798218.9A 2019-08-27 2019-08-27 Security monitoring visualization system based on streaming media and AI technology Active CN110493574B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910798218.9A CN110493574B (en) 2019-08-27 2019-08-27 Security monitoring visualization system based on streaming media and AI technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910798218.9A CN110493574B (en) 2019-08-27 2019-08-27 Security monitoring visualization system based on streaming media and AI technology

Publications (2)

Publication Number Publication Date
CN110493574A CN110493574A (en) 2019-11-22
CN110493574B true CN110493574B (en) 2021-06-11

Family

ID=68553600

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910798218.9A Active CN110493574B (en) 2019-08-27 2019-08-27 Security monitoring visualization system based on streaming media and AI technology

Country Status (1)

Country Link
CN (1) CN110493574B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111476537B (en) * 2020-03-31 2021-01-15 广州高新工程顾问有限公司 BIM-based engineering cost dynamic control system and method
CN112415922B (en) * 2020-10-21 2023-05-12 深圳供电局有限公司 Substation monitoring system based on streaming media
CN112491968B (en) * 2020-11-05 2023-02-07 深圳供电局有限公司 Edge-end operation method of AI camera in power grid
CN113299025A (en) * 2021-04-28 2021-08-24 金卯新能源集团有限公司 Personnel climbing warning method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1761285A (en) * 2005-09-14 2006-04-19 上海广电(集团)有限公司中央研究院 Method for removing isolated noise point in video
CN106790538A (en) * 2016-12-22 2017-05-31 逯帅 Power system is set up and fault solution method for pushing with O&M fault database
CN108174165A (en) * 2018-01-17 2018-06-15 重庆览辉信息技术有限公司 Electric power safety operation and O&M intelligent monitoring system and method
CN109117855A (en) * 2018-08-06 2019-01-01 深圳众厉电力科技有限公司 Abnormal power equipment image identification system
CN109145789A (en) * 2018-08-09 2019-01-04 炜呈智能电力科技(杭州)有限公司 Power supply system safety work support method and system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5274769B2 (en) * 2006-12-25 2013-08-28 株式会社東芝 Equipment usage status management system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1761285A (en) * 2005-09-14 2006-04-19 上海广电(集团)有限公司中央研究院 Method for removing isolated noise point in video
CN106790538A (en) * 2016-12-22 2017-05-31 逯帅 Power system is set up and fault solution method for pushing with O&M fault database
CN108174165A (en) * 2018-01-17 2018-06-15 重庆览辉信息技术有限公司 Electric power safety operation and O&M intelligent monitoring system and method
CN109117855A (en) * 2018-08-06 2019-01-01 深圳众厉电力科技有限公司 Abnormal power equipment image identification system
CN109145789A (en) * 2018-08-09 2019-01-04 炜呈智能电力科技(杭州)有限公司 Power supply system safety work support method and system

Also Published As

Publication number Publication date
CN110493574A (en) 2019-11-22

Similar Documents

Publication Publication Date Title
CN110493574B (en) Security monitoring visualization system based on streaming media and AI technology
CN108416294B (en) Fan blade fault intelligent identification method based on deep learning
CN111047818A (en) Forest fire early warning system based on video image
CN112149543B (en) Building dust recognition system and method based on computer vision
CN110726725A (en) Transmission line hardware corrosion detection method and device
CN110096945B (en) Indoor monitoring video key frame real-time extraction method based on machine learning
CN115035088A (en) Helmet wearing detection method based on yolov5 and posture estimation
CN110781853A (en) Crowd abnormality detection method and related device
CN115065798A (en) Big data-based video analysis monitoring system
CN117768610B (en) High-speed railway perimeter intrusion risk monitoring method and system based on multi-target recognition
CN108961247A (en) Section insulator damage diagnostic system and method based on arc image detection
CN108174198B (en) Video image quality diagnosis analysis detection device and application system
CN110728212A (en) Road well lid monitoring device and method based on computer vision
CN119339247A (en) Transmission line anti-extrinsic damage monitoring method based on deep learning target detection and tracking
CN117935452A (en) Workshop security system and method based on visual multi-mode analysis
CN109325956A (en) An image processing-based feature extraction method for ice-coated cross-sections of power transmission lines
CN112241707A (en) Wind-powered electricity generation field intelligence video identification device
CN112489018A (en) Intelligent power line inspection method and inspection line
CN110798680B (en) Single-frame no-reference self-adaptive video snowflake noise detection method
CN118200470A (en) Video detection system of power transmission equipment
CN109255793B (en) A monitoring and early warning system based on visual features
CN117252840A (en) A photovoltaic array defect elimination assessment method, device and computer equipment
CN117274884B (en) Construction dust pollution event detection method and system based on image recognition
CN112232307A (en) Safety helmet wearing detection method in night vision environment
CN118379049B (en) Communication pipeline maintenance system based on intelligent AI cooperation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Luohu District Shenzhen Shennan Road 518000 No. 4020 Guangdong provincial power dispatching center building

Applicant after: Shenzhen Power Supply Co.,Ltd.

Applicant after: China Southern Power Grid Shenzhen Digital Power Grid Research Institute Co.,Ltd.

Address before: Luohu District Shenzhen Shennan Road 518000 No. 4020 Guangdong provincial power dispatching center building

Applicant before: Shenzhen Power Supply Co.,Ltd.

Applicant before: SHENZHEN COMTOP INFORMATION TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: 518000 electric power dispatching and communication building, 4020 Shennan East Road, Luohu District, Shenzhen, Guangdong

Patentee after: Shenzhen Power Supply Co.,Ltd.

Country or region after: China

Patentee after: China Southern Power Grid Digital Platform Technology (Guangdong) Co.,Ltd.

Address before: 518000 electric power dispatching and communication building, 4020 Shennan East Road, Luohu District, Shenzhen, Guangdong

Patentee before: Shenzhen Power Supply Co.,Ltd.

Country or region before: China

Patentee before: China Southern Power Grid Shenzhen Digital Power Grid Research Institute Co.,Ltd.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20240321

Address after: 518000 electric power dispatching and communication building, 4020 Shennan East Road, Luohu District, Shenzhen, Guangdong

Patentee after: Shenzhen Power Supply Co.,Ltd.

Country or region after: China

Address before: 518000 electric power dispatching and communication building, 4020 Shennan East Road, Luohu District, Shenzhen, Guangdong

Patentee before: Shenzhen Power Supply Co.,Ltd.

Country or region before: China

Patentee before: China Southern Power Grid Digital Platform Technology (Guangdong) Co.,Ltd.