CN117789131B - Risk monitoring method, risk monitoring device, risk monitoring equipment and storage medium - Google Patents
Risk monitoring method, risk monitoring device, risk monitoring equipment and storage medium Download PDFInfo
- Publication number
- CN117789131B CN117789131B CN202410179357.4A CN202410179357A CN117789131B CN 117789131 B CN117789131 B CN 117789131B CN 202410179357 A CN202410179357 A CN 202410179357A CN 117789131 B CN117789131 B CN 117789131B
- Authority
- CN
- China
- Prior art keywords
- target
- image
- transmission line
- basic
- graph
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 71
- 238000012544 monitoring process Methods 0.000 title claims abstract description 58
- 238000012806 monitoring device Methods 0.000 title claims abstract description 13
- 230000005540 biological transmission Effects 0.000 claims abstract description 153
- 239000011159 matrix material Substances 0.000 claims abstract description 98
- 238000004364 calculation method Methods 0.000 claims description 16
- 230000009466 transformation Effects 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 21
- 238000004891 communication Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 229910003460 diamond Inorganic materials 0.000 description 1
- 239000010432 diamond Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000012212 insulator Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000005491 wire drawing Methods 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/50—Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
Landscapes
- Image Analysis (AREA)
Abstract
The application discloses a risk monitoring method, a risk monitoring device, risk monitoring equipment and a risk monitoring storage medium, wherein a target object is determined by acquiring each initial image of a target scene, and the target object comprises a target power transmission line and each first object; performing basic graph replacement operation on target objects in each initial image to obtain each first basic image; establishing a pixel matrix of each target object; determining an association relationship between each first object and the target transmission line based on the pixel matrix; judging whether a first object with the incidence relation reaching a preset warning relation threshold value exists or not according to the incidence relation; if yes, determining the target power transmission line as a risk power transmission line. According to the scheme, the accuracy of monitoring can be improved, each target object is determined, the process of determining the association relationship can be simplified and quickened by replacing the basic graph, so that whether the target power transmission line has risks or not is judged, the safety of the power transmission line is ensured, and the risk monitoring efficiency is improved.
Description
Technical Field
The present application relates to the field of risk monitoring technologies, and in particular, to a risk monitoring method, apparatus, device, and storage medium.
Background
The transmission line is generally classified into an overhead transmission line and a cable line in terms of structural form, wherein the overhead transmission line is composed of a line tower, a wire, an insulator, a line fitting, a wire drawing, a tower foundation, a grounding device, etc., and is erected above the ground, and they are generally fixedly disposed in a road.
However, in both urban roads and rural roads, tower cranes, trees, large vehicles passing by and the like can occur, if the tower cranes, the vehicles or the continuously growing trees with huge body touch the power transmission line, potential safety hazards can be formed, and even the power transmission line can be caused to fail, so that the electric power stability is not facilitated.
Disclosure of Invention
In view of the above, the application provides a risk monitoring method, a risk monitoring device, risk monitoring equipment and a risk monitoring storage medium, which are used for solving the problems that potential safety hazards are formed, even faults are caused to the power transmission line, and electric power stability is not facilitated when a tower crane, a vehicle or a tree growing continuously touches the power transmission line.
In order to achieve the above object, the following schemes are proposed:
In a first aspect, a risk monitoring method includes:
Responding to a request instruction for risk monitoring of a target scene, acquiring initial images of the target scene, and determining target objects in the initial images, wherein each target object comprises a target power transmission line and each first object;
Performing basic graph replacement operation on each target object in each initial image to obtain each first basic image corresponding to each initial image;
establishing a pixel matrix of each target object in each first basic image;
determining an association relationship between each first object in each first basic image and a target power transmission line based on the pixel matrix;
Judging whether a first object with the incidence relation reaching a preset warning relation threshold value exists or not according to the incidence relation;
if yes, determining the target power transmission line in the target scene as a risk power transmission line.
Preferably, the performing a basic graph replacement operation on each target object in each initial image to obtain each first basic image corresponding to each initial image includes:
For each initial image, respectively matching each first object in the initial image with a pre-constructed basic graph library, and calculating the matching degree;
Taking each first object with the matching degree larger than a first preset threshold value as each second object;
Determining each first graph corresponding to each second object from the basic graph library;
selecting a second graph corresponding to the target transmission line from the basic graph library;
An image corresponding to the initial image is determined based on each of the first graphic and the second graphic, and is used as a first basic image.
Preferably, the determining an image corresponding to the initial image based on each of the first graphic and the second graphic, and serving as a first base image, includes:
Respectively determining the corresponding sizes and positions of the target transmission line and each second object in the initial image;
scaling the first graph and the second graph according to the size and the position;
and summarizing the first graph and the second graph after the scaling to form an image, and taking the image as a first basic image.
Preferably, the determining, based on the pixel matrix, an association relationship between each first object in each first base image and a target transmission line includes:
For each pixel matrix of the target object, performing convolution calculation, fourier transformation, cross-correlation calculation and entropy calculation on the pixel matrix of the target object to obtain a time domain feature matrix, a frequency domain feature matrix, a cross-correlation matrix and an entropy matrix;
summarizing the pixel matrix, the time domain feature matrix, the frequency domain feature matrix, the cross correlation matrix and the entropy matrix to obtain a target matrix of the target object;
inputting a target matrix of each target object in each first basic image into a pre-trained association relation model to obtain an association relation between each first object in each first basic image and a target power transmission line.
Preferably, the determining, according to the association relationship, whether the first object with which the association relationship between the target power transmission line and the target power transmission line reaches the preset warning relationship threshold value includes:
Constructing a three-dimensional space initial perspective view of the target scene according to the association relation between each first object in each first basic image and the target transmission line;
Correcting the initial three-dimensional space stereogram to obtain a three-dimensional space target stereogram corresponding to the target scene;
determining real three-dimensional coordinate information of a target power transmission line and each first object in the target scene based on the three-dimensional space target stereogram;
Judging whether a first object with the association relation between the first object and the target power transmission line reaching a preset warning relation threshold value exists or not according to the real three-dimensional coordinate information.
Preferably, the constructing a three-dimensional space initial perspective view of the target scene according to the association relationship between each first object in each first basic image and the target transmission line includes:
comparing the association relation between each first object in each first basic image and the target transmission line with respect to each first object;
the association relationship with the largest number is used as a target association relationship;
and placing each first object and the target transmission line in a pre-constructed three-dimensional space coordinate system according to the target association relation corresponding to each first object so as to form a three-dimensional space initial stereogram of the target scene.
In a second aspect, a risk monitoring apparatus includes:
the target object determining module is used for responding to a request instruction for risk monitoring of a target scene, acquiring initial images of the target scene and determining target objects in the initial images, wherein each target object comprises a target power transmission line and each first object;
the replacing module is used for carrying out basic graph replacing operation on each target object in each initial image to obtain each first basic image corresponding to each initial image;
the pixel matrix building module is used for building a pixel matrix of each target object in each first basic image;
the incidence relation determining module is used for determining the incidence relation between each first object in each first basic image and the target transmission line based on the pixel matrix;
The judging module is used for judging whether a first object with the incidence relation reaching a preset warning relation threshold value exists or not according to the incidence relation;
and the risk determination module is used for determining that the target power transmission line in the target scene is a risk power transmission line if the target power transmission line is the risk power transmission line.
Preferably, the replacing module includes:
The matching module is used for respectively matching each first object in each initial image with a pre-constructed basic graph library and calculating the matching degree;
The second object determining module is used for taking each first object with the matching degree larger than a first preset threshold value as each second object;
the first graph determining module is used for determining each first graph corresponding to each second object from the basic graph library;
The second graph determining module is used for selecting a second graph corresponding to the target power transmission line from the basic graph library;
and the first basic image determining module is used for determining an image corresponding to the initial image based on the first graph and the second graph and taking the image as a first basic image.
In a third aspect, a risk monitoring device includes a memory and a processor;
the memory is used for storing programs;
the processor is configured to execute the program to implement the steps of the risk monitoring method according to the first aspect.
In a fourth aspect, a storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the risk monitoring method according to the first aspect.
According to the technical scheme, the method and the device for risk monitoring of the target scene obtain initial images of the target scene by responding to a request instruction for risk monitoring of the target scene, and determine target objects in the initial images, wherein the target objects comprise a target power transmission line and first objects; performing basic graph replacement operation on each target object in each initial image to obtain each first basic image corresponding to each initial image; establishing a pixel matrix of each target object in each first basic image; determining an association relationship between each first object in each first basic image and a target power transmission line based on the pixel matrix; judging whether a first object with the incidence relation reaching a preset warning relation threshold value exists or not according to the incidence relation; if yes, determining the target power transmission line in the target scene as a risk power transmission line. According to the method, the subsequent risk monitoring step is carried out by acquiring a plurality of initial images of the target scene, so that the environmental condition of the target scene can be acquired more comprehensively and finely, the accuracy of monitoring can be improved, each first object which possibly affects the target power transmission line is determined in the initial images, the first object which possibly affects the target power transmission line is prevented from being missed, all potential safety hazards are accurately determined, as the problems of complex modeling, disordered lines, overlapping objects and the like possibly exist in the target power transmission line and the first object, the process of monitoring can be complicated by judging the association relationship directly according to the original form of the target power transmission line and the first object, therefore, the application replaces basic graphics of each target object, simplifies and quickens the process of determining the association relationship, establishes a pixel matrix according to the basic graphics, and the pixel matrix can more intuitively represent the environment and the situation of the target scene and is used for judging the association relationship, so that the risk monitoring efficiency is improved, and finally, the risk of the target power transmission line is judged according to the association relationship, so that the safety of the power transmission line is ensured, and the power stability is maintained.
The method can solve the requirement of the existing risk monitoring method on the distance between the cameras by acquiring a plurality of initial images and is not limited to the distance between equipment (such as the cameras) used for acquiring the initial images and the equipment.
In addition, the existing method for risk monitoring of the target scene, such as the traditional binocular vision positioning method, usually adopts a mathematical analysis mode to calculate the distance or association relation between the object and the power transmission line, but the method has low calculation precision and large measurement error, and often cannot be accurately monitored.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
FIG. 1 is an alternative flow chart of a risk monitoring method according to an embodiment of the present application;
FIG. 2 is an alternative flow chart of another risk monitoring method provided by an embodiment of the present application;
Fig. 3 is a schematic structural diagram of a risk monitoring apparatus according to an embodiment of the present application;
Fig. 4 is a schematic structural diagram of a risk monitoring device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The embodiment of the invention provides a risk monitoring method, which can be applied to various computer terminals or intelligent terminals, wherein an execution subject of the method can be a processor or a server of the computer terminal or the intelligent terminal, and a flow chart of the method is shown in fig. 1, and specifically comprises the following steps:
S1: and responding to a request instruction for risk monitoring of a target scene, acquiring each initial image of the target scene, and determining each target object in each initial image, wherein each target object comprises a target power transmission line and each first object.
The target scene in the application can be various engineering scenes and daily scenes, such as construction sites, roads and the like, especially the target scene mainly comprising the construction sites, and large-scale mechanical appliances such as cranes, cranes and the like usually appear in the target scene, and the large-scale mechanical appliances can influence a power transmission line in the running and moving processes with high probability, and even can cause damage of the power transmission line.
Therefore, in the risk monitoring method provided by the application, a plurality of cameras, cameras and the like can be installed in the target scene, pictures of the target scene are shot in real time, and it is necessary to take the whole of the power transmission line into the target scene to ensure that the obtained target scene is comprehensive and complete, meanwhile, a plurality of pictures of different angles of the target scene are selected from the pictures to serve as initial images of the target scene, and the relative relation with higher accuracy between the first object in the target scene and the target power transmission line can be determined by analyzing the pictures of different angles.
After each initial image of the target scene is obtained, determining all objects in the initial image, including the target transmission line and other objects, for each initial image, wherein in the process, objects which cannot touch the target transmission line in a short time can be disregarded according to a pre-established experience library, and the objects which can influence the target transmission line and the target transmission line are taken as all target objects in the target scene together, wherein other screened objects except the target transmission line are taken as first objects.
S2: and performing basic graph replacement operation on each target object in each initial image to obtain each first basic image corresponding to each initial image.
In this step, each target object (including the target transmission line and the first object) in each initial image may be replaced with a simple pattern, and each target object may be replaced in the initial image. Alternatively, the replaced graphic may be formed into a new image as the first base image.
It can be understood that the basic graphics are very concise and clear compared with the real shape of the target objects, so that the efficiency can be improved by replacing each target object with the basic graphics, the subsequent association relationship determination process can be quickened, and therefore, the basic graphics replacing operation is carried out on each target object in each initial image, and each obtained first basic image contains the basic graphics corresponding to each target object.
S3: and establishing a pixel matrix of each target object in each first basic image.
The pixel matrix is a digital image formed by a certain number of pixels, and the pixel matrix is established for each target object in the first basic image, so that the first basic image is more visual and visual, and the association relationship between each first object and the target power transmission line can be enhanced and displayed.
Meanwhile, the pixel matrix is also a matrix capable of carrying out optimization and multiple operations, and can support the determination process of the depth association relation.
S4: and determining the association relation between each first object in each first basic image and the target transmission line based on the pixel matrix.
Because the application monitors whether the object capable of causing the safety fault exists around the target power transmission line, after the pixel matrix is acquired, the pixel matrix is needed to be utilized to determine the association relationship between each first object in each first basic image and the target power transmission line.
For example, if there is no association relationship between some first objects and the target transmission line, i.e. the association relationship is null or zero, it can be determined that the first objects do not cause the fault of the target transmission line, but the first objects having the association relationship with the target transmission line, although there is the association relationship, may not reach the extent of affecting the target transmission line, so that the association relationship needs to be determined, and then the first objects are judged according to the association relationship, so as to improve the accuracy of warning.
The association relationship may be understood as a distance, a relative position, etc. between the first object and the target transmission line.
S5: judging whether a first object with the incidence relation reaching a preset warning relation threshold value exists or not according to the incidence relation.
In the application, a warning relation threshold value is preset, and if the corresponding relation between the first objects with the relation with the target transmission line reaches the warning relation threshold value and even exceeds the warning relation threshold value, the first objects can influence the normal operation of the target transmission line and even endanger the safety of the transmission line to form a safety fault. It is therefore necessary to make a separate judgment for each first object to ensure that there is no omission. For example, the association relationship between a certain first object and a target transmission line is: the proximity and relative distance is 5 meters, and the warning relationship threshold is: within ten meters of the square circle of the target power transmission line, the first object is the first object with the incidence relation with the target power transmission line reaching the warning relation threshold value.
S6: if yes, determining the target power transmission line in the target scene as a risk power transmission line.
If it is determined that the association relationship between at least one first object and the target power transmission line reaches the warning relationship threshold, it can be determined that the target power transmission line in the target scene is a risk power transmission line, and the target power transmission line is in a dangerous state at the moment, warning can be performed so that workers can cut off the power transmission line in time to ensure the safety of the workers, and meanwhile, the safety of the workers in the target scene can also be ensured. If the first object with the association relation reaching the preset warning relation threshold value does not exist, the fact that the target power transmission line in the target scene is free of risks is indicated.
According to the technical scheme, the subsequent risk monitoring step is carried out by acquiring a plurality of initial images of the target scene, so that the environmental condition of the target scene can be acquired more comprehensively and finely, the monitoring accuracy can be improved, each first object which possibly affects the target transmission line is determined in the initial images, the first object which possibly affects the target transmission line is prevented from being missed, all potential safety hazards are accurately determined, the problems of complex modeling, disordered lines, overlapping objects and the like are possibly caused in the target transmission line and the first object, the process of monitoring can be complicated by judging the association relationship directly according to the original form of the target transmission line and the first object, therefore, the application replaces the basic graph of each target object, simplifies and quickens the process of determining the association relationship, establishes a pixel matrix according to the basic graph, the pixel matrix can more intuitively represent the environment and the situation of the target scene, is used for judging the association relationship, the risk monitoring efficiency is improved, finally, whether the target transmission line has risks or not is judged according to the association relationship, and the safety of the power transmission line is ensured, and the power stability is maintained.
The method can solve the requirement of the existing risk monitoring method on the distance between the cameras by acquiring a plurality of initial images and is not limited to the distance between equipment (such as the cameras) used for acquiring the initial images and the equipment.
In addition, the existing method for risk monitoring of the target scene, such as the traditional binocular vision positioning method, usually adopts a mathematical analysis mode to calculate the distance or association relation between the object and the power transmission line, but the method has low calculation precision and large measurement error, and often cannot be accurately monitored.
In the method provided by the embodiment of the invention, basic graph replacement operation is performed on each target object in each initial image, and the flow of obtaining each first basic image corresponding to each initial image is shown in fig. 2, and specific description is as follows:
s21: and matching each first object in each initial image with a pre-constructed basic graph library, and calculating the matching degree.
S22: and taking each first object with the matching degree larger than a first preset threshold value as each second object.
Specifically, the base graphic library includes base graphics corresponding to various objects in various different scenes, such as triangle, square, rectangle, circle, ellipse, and diamond, and may also include stereo graphics, which is not limited in this embodiment.
For each initial image, matching each first object in the initial image with the basic graph library, in the process, for each first object, matching the first object with each basic graph in the basic graph library, calculating the matching degree, and setting a matching threshold value, if the matching degree of the first object with each basic graph in the basic graph library is smaller than the matching threshold value, taking the first object as an irrelevant object, namely, considering that the irrelevant object does not belong to an object which can affect a target transmission line; if the matching degree of the first object and each basic graph in the basic graph library is not smaller than the matching threshold, the first object can be determined to be a second object. The process can reduce the difficulty of subsequent monitoring, and only the second object which is most likely to influence the target transmission line is reserved.
S23: and determining each first graph corresponding to each second object from the basic graph library.
For each second object, selecting a basic graph corresponding to the matching degree with the largest value from the matching degree of the second object and each basic graph as the basic graph of the second object, namely the first graph.
S24: and selecting a second graph corresponding to the target transmission line from the basic graph library.
In the above process, in addition to matching the first object, the target power transmission line needs to be matched at the same time, so as to replace the target power transmission line as the corresponding basic pattern, namely the second pattern.
S25: an image corresponding to the initial image is determined based on each of the first graphic and the second graphic, and is used as a first basic image.
Specifically, the pattern of the first object in the initial image and the pattern of the target transmission line may be replaced by the first pattern and the second pattern determined in the above steps, or a new image may be constructed by using the first pattern and the second pattern, which is specifically as follows:
Respectively determining the corresponding sizes and positions of the target transmission line and each second object in the initial image;
scaling the first graph and the second graph according to the size and the position;
and summarizing the first graph and the second graph after the scaling to form an image, and taking the image as a first basic image.
The real situation simulation of the target transmission line and each second object in the target scene can be displayed in the first basic image through the process.
The above embodiment describes the process of performing the basic pattern replacement operation on each target object in each initial image to obtain each first basic image corresponding to each initial image, and the following describes the step of determining the association relationship between each first object in each first basic image and the target transmission line based on the pixel matrix in the present application in detail.
For each pixel matrix of the target object, performing convolution calculation, fourier transformation, cross-correlation calculation and entropy calculation on the pixel matrix of the target object to obtain a time domain feature matrix, a frequency domain feature matrix, a cross-correlation matrix and an entropy matrix;
summarizing the pixel matrix, the time domain feature matrix, the frequency domain feature matrix, the cross correlation matrix and the entropy matrix to obtain a target matrix of the target object;
inputting a target matrix of each target object in each first basic image into a pre-trained association relation model to obtain an association relation between each first object in each first basic image and a target power transmission line.
Specifically, the association relation model is obtained by training a target matrix set of each object in countless real scenes as a training sample set and the real association relation between each object in the real scenes and the power transmission line as a label. The association relation model comprises a convolution module, and the convolution module can carry out convolution calculation on various matrixes, namely a pixel matrix, a time domain feature matrix, a frequency domain feature matrix, a cross-correlation matrix and an entropy value matrix, so as to extract features and relations of various different information, and further determine the association relation between each first object and a target power transmission line.
The above embodiment describes the process of determining the association relationship between each first object in each first base image and the target transmission line based on the pixel matrix in the present application, and the following describes the step of determining whether there is a first object whose association relationship with the target transmission line reaches the preset warning relationship threshold according to the association relationship in the present application.
Constructing a three-dimensional space initial perspective view of the target scene according to the association relation between each first object in each first basic image and the target transmission line;
Correcting the initial three-dimensional space stereogram to obtain a three-dimensional space target stereogram corresponding to the target scene;
determining real three-dimensional coordinate information of a target power transmission line and each first object in the target scene based on the three-dimensional space target stereogram;
Judging whether a first object with the association relation between the first object and the target power transmission line reaching a preset warning relation threshold value exists or not according to the real three-dimensional coordinate information.
Specifically, a distance relationship, a position relationship, and the like between the first object and the target transmission line may be calculated according to the real three-dimensional coordinate information, and then the distance relationship or the position relationship is used as the association relationship.
Optionally, the process of constructing the three-dimensional space initial stereogram of the target scene according to the association relationship between each first object in each first basic image and the target transmission line may specifically include:
comparing the association relation between each first object in each first basic image and the target transmission line with respect to each first object;
the association relationship with the largest number is used as a target association relationship;
and placing each first object and the target transmission line in a pre-constructed three-dimensional space coordinate system according to the target association relation corresponding to each first object so as to form a three-dimensional space initial stereogram of the target scene.
Specifically, the three-dimensional space initial stereogram may be corrected by using a bayesian prior probability calculation method, for example, according to different points among the plurality of first base images. In addition, since a plurality of first basic images are determined and the angles of each first basic image are different, the association relationships contained in different first basic images may be different, so that the association relationship with the largest number is taken as the target association relationship, and the target association relationship can be considered to be a true and correct association relationship.
Corresponding to the method shown in fig. 1, the embodiment of the present invention further provides a risk monitoring device, which is used for implementing the method shown in fig. 1, where the risk monitoring device provided in the embodiment of the present invention may be introduced in a computer terminal or various mobile devices with reference to fig. 3, and as shown in fig. 3, the risk monitoring device may include:
A target object determining module 10, configured to obtain each initial image of a target scene in response to a request instruction for risk monitoring of the target scene, and determine each target object in each initial image, where each target object includes a target power transmission line and each first object;
the replacing module 20 is configured to perform a basic graphics replacing operation on each target object in each initial image, so as to obtain each first basic image corresponding to each initial image;
a pixel matrix building module 30, configured to build a pixel matrix of each target object in each of the first base images;
An association determining module 40, configured to determine, based on the pixel matrix, an association between each first object in each first base image and a target transmission line;
the judging module 50 is configured to judge whether a first object whose association relationship with the target power transmission line reaches a preset warning relationship threshold exists according to the association relationship;
And the risk determining module 60 is configured to determine that the target power transmission line in the target scenario is a risk power transmission line if the target power transmission line is a risk power transmission line.
According to the technical scheme, the subsequent risk monitoring step is carried out by acquiring a plurality of initial images of the target scene, so that the environmental condition of the target scene can be acquired more comprehensively and finely, the monitoring accuracy can be improved, each first object which possibly affects the target transmission line is determined in the initial images, the first object which possibly affects the target transmission line is prevented from being missed, all potential safety hazards are accurately determined, the problems of complex modeling, disordered lines, overlapping objects and the like are possibly caused in the target transmission line and the first object, the process of monitoring can be complicated by judging the association relationship directly according to the original form of the target transmission line and the first object, therefore, the application replaces the basic graph of each target object, simplifies and quickens the process of determining the association relationship, establishes a pixel matrix according to the basic graph, the pixel matrix can more intuitively represent the environment and the situation of the target scene, is used for judging the association relationship, the risk monitoring efficiency is improved, finally, whether the target transmission line has risks or not is judged according to the association relationship, and the safety of the power transmission line is ensured, and the power stability is maintained.
In one example, the replacement module 20 may include:
The matching module is used for respectively matching each first object in each initial image with a pre-constructed basic graph library and calculating the matching degree;
The second object determining module is used for taking each first object with the matching degree larger than a first preset threshold value as each second object;
the first graph determining module is used for determining each first graph corresponding to each second object from the basic graph library;
The second graph determining module is used for selecting a second graph corresponding to the target power transmission line from the basic graph library;
and the first basic image determining module is used for determining an image corresponding to the initial image based on the first graph and the second graph and taking the image as a first basic image.
Further, the embodiment of the application provides risk monitoring equipment. Optionally, fig. 4 shows a block diagram of a hardware structure of the risk monitoring device, and referring to fig. 4, the hardware structure of the risk monitoring device may include: at least one processor 01, at least one communication interface 02, at least one memory 03 and at least one communication bus 04.
In the embodiment of the present application, the number of the processor 01, the communication interface 02, the memory 03 and the communication bus 04 is at least one, and the processor 01, the communication interface 02 and the memory 03 complete communication with each other through the communication bus 04.
The processor 01 may be a central processing unit CPU, or an Application-specific integrated Circuit ASIC (Application SPECIFIC INTEGRATED Circuit), or one or more integrated circuits configured to implement embodiments of the present invention, or the like.
The memory 03 may include a high-speed RAM memory, and may further include a nonvolatile memory (non-volatile memory) or the like, such as at least one magnetic disk memory.
The memory stores a program, and the processor can call the program stored in the memory, and the program is used for executing the following risk monitoring method, which comprises the following steps:
Responding to a request instruction for risk monitoring of a target scene, acquiring initial images of the target scene, and determining target objects in the initial images, wherein each target object comprises a target power transmission line and each first object;
Performing basic graph replacement operation on each target object in each initial image to obtain each first basic image corresponding to each initial image;
establishing a pixel matrix of each target object in each first basic image;
determining an association relationship between each first object in each first basic image and a target power transmission line based on the pixel matrix;
Judging whether a first object with the incidence relation reaching a preset warning relation threshold value exists or not according to the incidence relation;
if yes, determining the target power transmission line in the target scene as a risk power transmission line.
Alternatively, the refinement function and the extension function of the program may refer to the description of the risk monitoring method in the method embodiment.
The embodiment of the application also provides a storage medium, which can store a program suitable for being executed by a processor, and when the program runs, the device where the storage medium is controlled to execute the following risk monitoring method, comprising the following steps:
Responding to a request instruction for risk monitoring of a target scene, acquiring initial images of the target scene, and determining target objects in the initial images, wherein each target object comprises a target power transmission line and each first object;
Performing basic graph replacement operation on each target object in each initial image to obtain each first basic image corresponding to each initial image;
establishing a pixel matrix of each target object in each first basic image;
determining an association relationship between each first object in each first basic image and a target power transmission line based on the pixel matrix;
Judging whether a first object with the incidence relation reaching a preset warning relation threshold value exists or not according to the incidence relation;
if yes, determining the target power transmission line in the target scene as a risk power transmission line.
In particular, the storage medium may be a computer-readable storage medium, which may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM.
Alternatively, the refinement function and the extension function of the program may refer to the description of the risk monitoring method in the method embodiment.
In addition, functional modules in various embodiments of the present disclosure may be integrated together to form a single portion, or each module may exist alone, or two or more modules may be integrated to form a single portion. The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored on a computer readable storage medium. Based on such understanding, the technical solution of the present disclosure may be embodied in essence or a part contributing to the prior art or a part of the technical solution, or in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a live device, or a network device, etc.) to perform all or part of the steps of the methods of the embodiments of the present disclosure.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, and identical and similar parts between the embodiments are all enough to refer to each other.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (9)
1. A risk monitoring method, comprising:
Responding to a request instruction for risk monitoring of a target scene, acquiring initial images of the target scene, and determining target objects in the initial images, wherein each target object comprises a target power transmission line and each first object;
Performing basic graph replacement operation on each target object in each initial image to obtain each first basic image corresponding to each initial image; the method specifically comprises the following steps: each target object in each initial image is replaced by a corresponding basic image, and each replaced basic image forms a new image to be used as each first basic image corresponding to each initial image; the basic graph is a simple graph corresponding to different object shapes;
establishing a pixel matrix of each target object in each first basic image; the pixel matrix is a digital image composed of a plurality of pixels;
Determining an association relationship between each first object in each first basic image and a target power transmission line based on the pixel matrix; the method specifically comprises the following steps: for each pixel matrix of the target object, performing convolution calculation, fourier transformation, cross-correlation calculation and entropy calculation on the pixel matrix of the target object to obtain a time domain feature matrix, a frequency domain feature matrix, a cross-correlation matrix and an entropy matrix; summarizing the pixel matrix, the time domain feature matrix, the frequency domain feature matrix, the cross correlation matrix and the entropy matrix to obtain a target matrix of the target object; inputting a target matrix of each target object in each first basic image into a pre-trained association relation model to obtain an association relation between each first object in each first basic image and a target power transmission line;
Judging whether a first object with the incidence relation reaching a preset warning relation threshold value exists or not according to the incidence relation;
if yes, determining the target power transmission line in the target scene as a risk power transmission line.
2. The method according to claim 1, wherein the performing the basic image replacement operation on each target object in each initial image to obtain each first basic image corresponding to each initial image includes:
For each initial image, respectively matching each first object in the initial image with a pre-constructed basic graph library, and calculating the matching degree; the basic graph library comprises basic graphs corresponding to various objects in various different scenes;
Taking each first object with the matching degree larger than a first preset threshold value as each second object;
Determining each first graph corresponding to each second object from the basic graph library;
selecting a second graph corresponding to the target transmission line from the basic graph library;
An image corresponding to the initial image is determined based on each of the first graphic and the second graphic, and is used as a first basic image.
3. The method according to claim 2, wherein the determining an image corresponding to the initial image based on the respective first and second graphics and serving as a first base image includes:
Respectively determining the corresponding sizes and positions of the target transmission line and each second object in the initial image;
scaling the first graph and the second graph according to the size and the position;
and summarizing the first graph and the second graph after the scaling to form an image, and taking the image as a first basic image.
4. The method according to claim 1, wherein the determining, according to the association relationship, whether there is a first object whose association relationship with the target transmission line reaches a preset warning relationship threshold value includes:
Constructing a three-dimensional space initial perspective view of the target scene according to the association relation between each first object in each first basic image and the target transmission line;
Correcting the initial three-dimensional space stereogram to obtain a three-dimensional space target stereogram corresponding to the target scene;
determining real three-dimensional coordinate information of a target power transmission line and each first object in the target scene based on the three-dimensional space target stereogram;
Judging whether a first object with the association relation between the first object and the target power transmission line reaching a preset warning relation threshold value exists or not according to the real three-dimensional coordinate information.
5. The method according to claim 4, wherein constructing the three-dimensional spatial initial perspective view of the target scene according to the association relationship between each first object in the respective first base image and the target transmission line comprises:
comparing the association relation between each first object in each first basic image and the target transmission line with respect to each first object;
the association relationship with the largest number is used as a target association relationship;
and placing each first object and the target transmission line in a pre-constructed three-dimensional space coordinate system according to the target association relation corresponding to each first object so as to form a three-dimensional space initial stereogram of the target scene.
6. A risk monitoring device, comprising:
the target object determining module is used for responding to a request instruction for risk monitoring of a target scene, acquiring initial images of the target scene and determining target objects in the initial images, wherein each target object comprises a target power transmission line and each first object;
the replacing module is used for carrying out basic graph replacing operation on each target object in each initial image to obtain each first basic image corresponding to each initial image; the method specifically comprises the following steps: each target object in each initial image is replaced by a corresponding basic image, and each replaced basic image forms a new image to be used as each first basic image corresponding to each initial image; the basic graph is a simple graph corresponding to different object shapes;
The pixel matrix building module is used for building a pixel matrix of each target object in each first basic image; the pixel matrix is a digital image composed of a plurality of pixels;
The incidence relation determining module is used for determining the incidence relation between each first object in each first basic image and the target transmission line based on the pixel matrix; the method specifically comprises the following steps: for each pixel matrix of the target object, performing convolution calculation, fourier transformation, cross-correlation calculation and entropy calculation on the pixel matrix of the target object to obtain a time domain feature matrix, a frequency domain feature matrix, a cross-correlation matrix and an entropy matrix; summarizing the pixel matrix, the time domain feature matrix, the frequency domain feature matrix, the cross correlation matrix and the entropy matrix to obtain a target matrix of the target object; inputting a target matrix of each target object in each first basic image into a pre-trained association relation model to obtain an association relation between each first object in each first basic image and a target power transmission line;
The judging module is used for judging whether a first object with the incidence relation reaching a preset warning relation threshold value exists or not according to the incidence relation;
and the risk determination module is used for determining that the target power transmission line in the target scene is a risk power transmission line if the target power transmission line is the risk power transmission line.
7. The apparatus of claim 6, wherein the replacement module comprises:
The matching module is used for respectively matching each first object in each initial image with a pre-constructed basic graph library and calculating the matching degree; the basic graph library comprises basic graphs corresponding to various objects in various different scenes;
The second object determining module is used for taking each first object with the matching degree larger than a first preset threshold value as each second object;
the first graph determining module is used for determining each first graph corresponding to each second object from the basic graph library;
The second graph determining module is used for selecting a second graph corresponding to the target power transmission line from the basic graph library;
and the first basic image determining module is used for determining an image corresponding to the initial image based on the first graph and the second graph and taking the image as a first basic image.
8. A risk monitoring device comprising a memory and a processor;
the memory is used for storing programs;
The processor being configured to execute the program to implement the steps of the risk monitoring method according to any one of claims 1-5.
9. A storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the risk monitoring method of any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410179357.4A CN117789131B (en) | 2024-02-18 | 2024-02-18 | Risk monitoring method, risk monitoring device, risk monitoring equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410179357.4A CN117789131B (en) | 2024-02-18 | 2024-02-18 | Risk monitoring method, risk monitoring device, risk monitoring equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117789131A CN117789131A (en) | 2024-03-29 |
| CN117789131B true CN117789131B (en) | 2024-05-28 |
Family
ID=90394761
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410179357.4A Active CN117789131B (en) | 2024-02-18 | 2024-02-18 | Risk monitoring method, risk monitoring device, risk monitoring equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117789131B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106874942A (en) * | 2017-01-21 | 2017-06-20 | 江苏大学 | A kind of object module fast construction method semantic based on regular expression |
| CN108259770A (en) * | 2018-03-30 | 2018-07-06 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN108520493A (en) * | 2018-03-30 | 2018-09-11 | 广东欧珀移动通信有限公司 | Processing method, device, storage medium and the electronic equipment that image is replaced |
| CN111415355A (en) * | 2020-04-08 | 2020-07-14 | 贵州电网有限责任公司 | Image processing-based method, system and device for measuring safety distance of power transmission line |
| CN114219194A (en) * | 2021-08-30 | 2022-03-22 | 海南电网有限责任公司电力科学研究院 | Power transmission line risk warning method and device based on front-end AI (Artificial Intelligence) identification |
| WO2022170878A1 (en) * | 2021-02-09 | 2022-08-18 | 国网江苏省电力有限公司泰州供电分公司 | System and method for measuring distance between transmission line and image by unmanned aerial vehicle |
| CN116577788A (en) * | 2023-07-12 | 2023-08-11 | 南方电网数字电网研究院有限公司 | Power transmission line foreign matter intrusion monitoring method, device and computer equipment |
| CN117058518A (en) * | 2023-08-03 | 2023-11-14 | 南方电网数字电网研究院有限公司 | Deep learning target detection method and device based on YOLO improvement and computer equipment |
| CN117274177A (en) * | 2023-09-11 | 2023-12-22 | 国网新疆电力有限公司电力科学研究院 | Power transmission line external damage prevention method and device based on image recognition |
-
2024
- 2024-02-18 CN CN202410179357.4A patent/CN117789131B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106874942A (en) * | 2017-01-21 | 2017-06-20 | 江苏大学 | A kind of object module fast construction method semantic based on regular expression |
| CN108259770A (en) * | 2018-03-30 | 2018-07-06 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN108520493A (en) * | 2018-03-30 | 2018-09-11 | 广东欧珀移动通信有限公司 | Processing method, device, storage medium and the electronic equipment that image is replaced |
| CN111415355A (en) * | 2020-04-08 | 2020-07-14 | 贵州电网有限责任公司 | Image processing-based method, system and device for measuring safety distance of power transmission line |
| WO2022170878A1 (en) * | 2021-02-09 | 2022-08-18 | 国网江苏省电力有限公司泰州供电分公司 | System and method for measuring distance between transmission line and image by unmanned aerial vehicle |
| CN114219194A (en) * | 2021-08-30 | 2022-03-22 | 海南电网有限责任公司电力科学研究院 | Power transmission line risk warning method and device based on front-end AI (Artificial Intelligence) identification |
| CN116577788A (en) * | 2023-07-12 | 2023-08-11 | 南方电网数字电网研究院有限公司 | Power transmission line foreign matter intrusion monitoring method, device and computer equipment |
| CN117058518A (en) * | 2023-08-03 | 2023-11-14 | 南方电网数字电网研究院有限公司 | Deep learning target detection method and device based on YOLO improvement and computer equipment |
| CN117274177A (en) * | 2023-09-11 | 2023-12-22 | 国网新疆电力有限公司电力科学研究院 | Power transmission line external damage prevention method and device based on image recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117789131A (en) | 2024-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113345019B (en) | Method, equipment and medium for measuring potential hazards of transmission line channel target | |
| CN111339692A (en) | Laser point cloud data-based power line sag determination method and device | |
| CN110148147A (en) | Image detecting method, device, storage medium and electronic device | |
| CN112598797B (en) | Method, system, medium and equipment for assimilating complex multi-source heterogeneous data of nuclear power plant | |
| CN115375868B (en) | Map display method, remote sensing map display method, computing device and storage medium | |
| CN115830010B (en) | Method and device for detecting crossing distance of transmission wires and computer equipment | |
| CN112084453A (en) | Three-dimensional virtual display system, method, computer equipment, terminal and storage medium | |
| CN113822892B (en) | Evaluation method, device and equipment of simulated radar and computer storage medium | |
| CN112380894A (en) | Video overlapping area target duplicate removal method and system based on three-dimensional geographic information system | |
| CN117789131B (en) | Risk monitoring method, risk monitoring device, risk monitoring equipment and storage medium | |
| CN114721419A (en) | Tower inspection method, device and equipment for power transmission line based on unmanned aerial vehicle | |
| CN113223155A (en) | Distance prediction method, device, equipment and medium | |
| CN109493423B (en) | Method and device for calculating midpoint positions of two points on surface of three-dimensional earth model | |
| CN115908318A (en) | Power line sag determination method, device, equipment, medium and product | |
| CN115546148A (en) | Method, device, equipment and medium for measuring length of overhead conductor in digital twin station area | |
| CN113744396B (en) | Method, device, equipment and storage medium for establishing model based on three-dimensional map | |
| CN109377483A (en) | Porcelain insulator crack detecting method and device | |
| CN116188587A (en) | Positioning method and device and vehicle | |
| CN111210590B (en) | Early warning method and device for children lost in intelligent community and readable storage medium | |
| CN116597390B (en) | Method and device for detecting construction hidden danger around power transmission line and computer equipment | |
| CN112053365A (en) | Method for extracting laser point cloud data of power transmission line conductor based on linear characteristics | |
| CN113435802B (en) | Power transmission network monitoring planning scheme construction method, device, equipment and storage medium | |
| CN118052024B (en) | Method and system for intelligent layout based on contact diagram and graphic model | |
| CN115063619B (en) | Cost aggregation method and system based on binocular stereo matching algorithm | |
| CN112598160B (en) | Electric power Internet of things shape display method and device, medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |