CN110874866A - Transformer substation three-dimensional monitoring method and system based on videos - Google Patents
Transformer substation three-dimensional monitoring method and system based on videos Download PDFInfo
- Publication number
- CN110874866A CN110874866A CN201911137148.9A CN201911137148A CN110874866A CN 110874866 A CN110874866 A CN 110874866A CN 201911137148 A CN201911137148 A CN 201911137148A CN 110874866 A CN110874866 A CN 110874866A
- Authority
- CN
- China
- Prior art keywords
- transformer substation
- equipment
- dimensional
- dimensional model
- abnormal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 53
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000002159 abnormal effect Effects 0.000 claims abstract description 56
- 230000002950 deficient Effects 0.000 claims abstract description 26
- 230000007547 defect Effects 0.000 claims abstract description 25
- 230000001815 facial effect Effects 0.000 claims abstract description 11
- 239000000463 material Substances 0.000 claims description 3
- 239000000654 additive Substances 0.000 claims description 2
- 239000000779 smoke Substances 0.000 claims description 2
- 238000001514 detection method Methods 0.000 claims 2
- 238000004458 analytical method Methods 0.000 abstract description 10
- 238000007689 inspection Methods 0.000 abstract description 8
- 238000005516 engineering process Methods 0.000 description 6
- 238000011161 development Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- -1 abnormal light Substances 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/50—Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Resources & Organizations (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Quality & Reliability (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Tourism & Hospitality (AREA)
- Strategic Management (AREA)
- Multimedia (AREA)
- Geometry (AREA)
- Primary Health Care (AREA)
- Water Supply & Treatment (AREA)
- Public Health (AREA)
- Software Systems (AREA)
- Entrepreneurship & Innovation (AREA)
- Operations Research (AREA)
- Computer Graphics (AREA)
- Image Analysis (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses a video-based transformer substation three-dimensional monitoring method and a video-based transformer substation three-dimensional monitoring system, which comprise the following steps: acquiring video image information inside the transformer substation in real time, and establishing a three-dimensional model of the transformer substation; if the appearance defect of the equipment is detected, obtaining the coordinate of the abnormal part by positioning the defective equipment at multiple angles, establishing an equipment three-dimensional model with abnormal appearance according to the obtained abnormal equipment image, and superposing the newly-established equipment three-dimensional model to the corresponding position area of the transformer substation three-dimensional model; and if the person is detected to enter, identifying the facial features and the appearance features of the person, establishing a three-dimensional human body model with a real face image and the appearance features, and placing the three-dimensional human body model at the corresponding position of the three-dimensional transformer substation model according to the position coordinates of the person. According to the invention, the result of video analysis can be added on the three-dimensional model of the transformer substation in real time, so that the timeliness of the three-dimensional model is greatly improved, and inspection personnel can more intuitively master the operation information of the transformer substation.
Description
Technical Field
The invention relates to the technical field of transformer substation monitoring, in particular to a transformer substation three-dimensional monitoring method and system based on videos.
Background
The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art.
With the development of technology and the improvement of social labor cost, unattended operation of a transformer substation is always the development key point of each power company. The data size of a single substation is continuously increased due to network upgrading and continuous hardware development. Therefore, for the operators on duty in the power system in the future, a few people often view a huge amount of operation and maintenance data of the transformer substation. Therefore, how to more effectively display data and help decision-making personnel to master key data is the key point of upgrading the monitoring system of the transformer substation at present.
The existing transformer substation auxiliary monitoring system mainly adopts the modes of light character boards, remote measuring curves, configuration wiring diagrams and the like to display transformer substation data. A three-dimensional model system is adopted in a few schemes, so that the building structure and the equipment distribution condition of the transformer substation can be displayed in an auxiliary mode. The individual three-dimensional models can display real-time data collected by the monitoring system in an animation mode. The toggle point of the existing scheme is that the three-dimensional model is required to be completely built at the beginning of building of the transformer substation, and all related data points are bound to actual data points. Therefore, the three-dimensional model can only display the state of the fixed monitoring point by adopting a preset animation scheme, and if the emergency is not acquired by the information acquisition unit, the emergency cannot be displayed by the three-dimensional model. For example, when people break in or fire alarms occur, it is difficult to establish a corresponding animation effect when establishing a three-dimensional model due to uncertainty of time and place.
Disclosure of Invention
In order to solve the problems, the invention provides a video-based transformer substation three-dimensional monitoring method and system, which can display data acquired by a video system and analyzed conclusions in real time in a three-dimensional model mode.
In some embodiments, the following technical scheme is adopted:
a three-dimensional monitoring method of a transformer substation based on videos comprises the following steps:
acquiring video image information inside the transformer substation in real time, and establishing a three-dimensional model of the transformer substation;
identifying the appearance defects of the transformer substation equipment, if the appearance defects of the equipment are detected, obtaining coordinates of abnormal parts by positioning the defective equipment at multiple angles, establishing an equipment three-dimensional model with abnormal appearance according to the obtained abnormal equipment image, and overlaying the newly-established equipment three-dimensional model to a corresponding position area of the transformer substation three-dimensional model;
and detecting the abnormal state of the scene of the transformer substation, identifying the facial features and the appearance features of the personnel if the personnel enter the transformer substation, establishing a three-dimensional human body model with a real face image and the appearance features, and placing the three-dimensional human body model at the corresponding position of the three-dimensional transformer substation model according to the position coordinates of the personnel.
In other embodiments, a video-based substation three-dimensional monitoring system is disclosed, comprising:
the device is used for acquiring video image information inside the transformer substation in real time; the device comprises: the system comprises at least two cameras which are arranged in a monitoring area set by a transformer substation and have different shooting angles;
means for building a three-dimensional model of the substation; the device comprises a transformer substation three-dimensional model library;
the device is used for identifying appearance defects of the substation equipment;
the device is used for obtaining the coordinates of the abnormal part by positioning the defective equipment at multiple angles when the appearance defects of the equipment are detected;
the device is used for establishing a device three-dimensional model with an abnormal appearance according to the acquired abnormal device image;
the device is used for superposing the newly-built equipment three-dimensional model to a corresponding position area of the transformer substation three-dimensional model;
the device is used for detecting the abnormal state of the scene of the transformer substation;
the device is used for identifying the facial features and the appearance features of the personnel and establishing a human body three-dimensional model with a real face image and the appearance features when the personnel are detected to enter;
and the device is used for placing the human body three-dimensional model at a corresponding position of the transformer substation three-dimensional model according to the position coordinates of the personnel.
In other embodiments, a terminal device is disclosed that includes a processor and a computer-readable storage medium, the processor to implement instructions; the computer readable storage medium is used for storing a plurality of instructions which are suitable for being loaded by a processor and executing the video-based substation three-dimensional monitoring method.
In other embodiments, a computer-readable storage medium is disclosed having stored therein a plurality of instructions adapted to be loaded by a processor of a terminal device and to perform the above-described video-based substation three-dimensional monitoring method.
Compared with the prior art, the invention has the beneficial effects that:
the invention combines the advantage of intuitive display of the three-dimensional transformer substation and the characteristics of omnibearing real-time monitoring and analysis of the video system, can increase the result of video analysis on the three-dimensional model of the transformer substation in real time, greatly improves the timeliness of the three-dimensional model, and enables inspection personnel to more intuitively master the operation information of the transformer substation.
The real-time viewing and real-time analysis characteristics of the video system are utilized, the defect that the three-dimensional model system can only view the fixed model file is overcome, and the real-time state of the transformer substation can be displayed more intuitively and effectively. Through the technology, key data can be effectively mastered in cross-level and cross-regional inspection of the unmanned inspection substation.
The invention achieves the dead-angle-free monitoring of the transformer substation through multi-camera multi-point positioning; the three-dimensional visual tracking of the abnormal state of the transformer substation can be realized, and the real-time monitoring capability of the three-dimensional monitoring system of the transformer substation is improved.
Drawings
Fig. 1 is a flowchart of a video-based transformer substation three-dimensional monitoring method according to an embodiment of the present invention.
Detailed Description
It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the disclosure. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments according to the present application. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, and it should be understood that when the terms "comprises" and/or "comprising" are used in this specification, they specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof, unless the context clearly indicates otherwise.
Example one
Along with the increase of unattended transformer substations, operation and inspection personnel increasingly use a remote inspection mode to inspect various data of the transformer substations. The display modes mainly include forms, curve graphs, video pictures, wiring diagrams and the like. With the gradual increase of data quantity, the traditional display mode hardly reflects the relevance and the position characteristics of data, and also hardly extracts a main interface, so that all key information can be visually displayed. The three-dimensional model of the transformer substation is constructed as a real transformer substation, and real-time data configured in advance are superposed, so that the actual operation condition of the transformer substation can be visually displayed, but the situation that the real-time data is not configured in advance is not restrained.
With the increasing maturity of the existing video monitoring technology and the continuous reduction of the network cost, a video monitoring network without dead angles is easy to deploy in a transformer substation. Theoretically, through video, the monitoring system can obtain visible data of any area. Therefore, it is a technical difficulty to display the result analyzed by the video system to the operation and maintenance staff through the three-dimensional model.
Based on the above, in one or more embodiments, a three-dimensional monitoring method for a transformer substation based on videos is disclosed, and in a video monitoring design stage, multiple cameras and multi-angle monitoring are equipped in an important monitoring area to achieve a three-dimensional positioning effect on equipment and faults.
And in the operation and inspection stage of the video system, the camera continuously collects image information for analysis. The system is mainly composed of two intelligent analysis engines.
The appearance defect recognition engine is arranged, the appearance of the main analysis device is damaged, and abnormal additives, abnormal light, smoke, fire light and the like exist.
The scene analysis engine mainly analyzes personnel behaviors, such as face recognition, helmet monitoring, abnormal actions, loitering, gathering, and region monitoring, such as intrusion of foreign objects, leaving of articles, crossing of warning lines, and the like.
Referring to fig. 1, the video-based transformer substation three-dimensional monitoring method specifically includes the following steps:
(1) acquiring video image information inside the transformer substation in real time, and establishing a three-dimensional model of the transformer substation;
(2) identifying the appearance defects of the transformer substation equipment, if the appearance defects of the equipment are detected, obtaining coordinates of abnormal parts by positioning the defective equipment at multiple angles, establishing an equipment three-dimensional model with abnormal appearance according to the obtained abnormal equipment image, and overlaying the newly-established equipment three-dimensional model to a corresponding position area of the transformer substation three-dimensional model;
wherein, according to the multi-angle location of camera to abnormal area, reachs the coordinate of abnormal part, and specific process includes:
linking at least two cameras near the defective equipment in the transformer substation, and acquiring images of the defective equipment from different shooting angles;
the method comprises the steps of positioning coordinates of defective equipment in an image acquired by a camera, and adjusting the shooting angle of the camera to enable the defective position of the equipment to be located at the center of a picture shot by each camera;
for each linked camera, respectively obtaining a ray which takes the camera as an end point and takes the direction corresponding to the central position of the camera as an extension direction;
and in the three-dimensional model of the transformer substation, solving the intersection point of all the rays, namely the three-dimensional coordinate point of the defect position of the equipment.
According to the obtained abnormal equipment image, establishing an equipment three-dimensional model with an abnormal appearance, and overlaying the newly-established equipment three-dimensional model to a corresponding position area of the transformer substation three-dimensional model, wherein the specific process is as follows:
the camera identifies the part with the appearance defect of the equipment by a video identification technology and captures the picture of the part. And (5) calling cameras at other angles to obtain screenshots of abnormal parts at different angles.
Meanwhile, the space coordinates of the abnormal part and the three-dimensional model of the equipment can be obtained through the intersection point of the rays. And calling the model file from a three-dimensional model library, and replacing a default normal three-dimensional model map with a screenshot of an abnormal part to obtain the equipment three-dimensional model with the abnormal appearance.
The camera identifies an abnormal part through a video identification technology, and captures a picture of the part. And calling other cameras, and screenshot the abnormal part. And obtaining the space coordinates of the abnormal part by a ray crossing method, namely the coordinates of the model needing to be superposed in the three-dimensional model of the transformer substation. And processing the coordinates and the direction of the three-dimensional model of the equipment with the abnormal appearance through the deformation matrix, and superposing the coordinates and the direction to the corresponding area of the original model.
(3) And detecting the abnormal state of the scene of the transformer substation, identifying the facial features and the appearance features of the personnel if the personnel enter the transformer substation, establishing a three-dimensional human body model with a real face image and the appearance features, and placing the three-dimensional human body model at the corresponding position of the three-dimensional transformer substation model according to the position coordinates of the personnel.
If the scene analysis engine detects the abnormal state of the scene, the corresponding model is called according to the specifically analyzed abnormal type, and the model is updated according to the real-time video.
For example, a person intrusion is detected in an area. The video monitoring system automatically calls the standby camera to track the behavior and the walking route of the personnel. The camera uploads the real-time picture of the person. The three-dimensional system calls the human body model from the three-dimensional library and carries out the following processing:
1) collecting facial features of a person to form a chartlet, and displaying the chartlet on the face of the three-dimensional human body model;
specifically, the camera analyzes the personnel in the picture, calculates the coordinates of the personnel relative to the central point of the picture, controls the horizontal rotation and the vertical rotation of the camera holder, and adjusts the angle of the camera until the relative coordinates of the personnel in the picture are (0, 0).
The face is identified by face identification technology, and the face picture is intercepted. And calling other cameras in the working range of the personnel, and intercepting facial photos of the personnel from multiple angles. And (4) pasting the intercepted face picture on a three-dimensional model of a worker to obtain the three-dimensional human body model with the real face picture.
2) Collecting appearance characteristics of personnel, such as whether safety helmets are not worn, working clothes and safety shoes are worn, and loading corresponding parts in the human body model;
the human body model, the safety helmet model, the work clothes model and the safety shoe model are all used as material models and are stored in a model library; after the video recognition camera shoots the worker, the dressing characteristics of the worker are analyzed, if the worker wears a safety helmet or wears a work garment, corresponding three-dimensional model materials are taken from the model library to assemble a complete three-dimensional model which truly reflects the dressing of the worker, and the three-dimensional model is placed in the three-dimensional model of the transformer substation.
3) Face recognition, comparing a face library, checking the authority of the personnel, dressing requirements, and if an unauthorized part or a part not meeting the requirements exists, highlighting and alarming the three-dimensional model;
4) and solving the real-time position of the person according to the positioning data of the camera, and placing the human body three-dimensional model on the corresponding position of the three-dimensional model of the total station.
In addition, the model provides a clickable advanced option, and after clicking, the three-dimensional monitoring system pops up a window to display a real-time video of the person.
According to the transformer substation three-dimensional monitoring method based on the video, the advantages of visual display of the three-dimensional transformer substation and the characteristics of all-dimensional real-time monitoring and analysis of the video system are combined, the result of video analysis can be added to the transformer substation three-dimensional model in real time, the timeliness of the three-dimensional model is greatly improved, and inspection personnel can intuitively master the transformer substation operation information.
Example two
In one or more embodiments, a video-based substation three-dimensional monitoring system is disclosed, comprising:
the device is used for acquiring video image information inside the transformer substation in real time; the device comprises: the system comprises at least two cameras which are arranged in a monitoring area set by a transformer substation and have different shooting angles;
means for building a three-dimensional model of the substation; the device comprises a transformer substation three-dimensional model library;
the device is used for identifying appearance defects of the substation equipment;
the device is used for obtaining the coordinates of the abnormal part by positioning the defective equipment at multiple angles when the appearance defects of the equipment are detected;
the device is used for establishing a device three-dimensional model with an abnormal appearance according to the acquired abnormal device image;
the device is used for superposing the newly-built equipment three-dimensional model to a corresponding position area of the transformer substation three-dimensional model;
the device is used for detecting the abnormal state of the scene of the transformer substation;
the device is used for identifying the facial features and the appearance features of the personnel and establishing a human body three-dimensional model with a real face image and the appearance features when the personnel are detected to enter;
and the device is used for placing the human body three-dimensional model at a corresponding position of the transformer substation three-dimensional model according to the position coordinates of the personnel.
Further, a device for obtaining coordinates of an abnormal part by multi-angle positioning of defective equipment when detecting appearance defects of the equipment specifically includes:
the device is used for linking at least two cameras near the defective equipment in the transformer substation and acquiring images of the defective equipment from different shooting angles;
the device is used for positioning the coordinates of the defective equipment in the images acquired by the cameras and adjusting the shooting angles of the cameras so that the defective positions of the equipment are positioned at the central position of the shot pictures of each camera;
the device is used for respectively obtaining a ray which takes the camera as an end point and takes the direction corresponding to the central position of the camera as an extension direction for each linked camera;
and the device is used for solving the intersection points of all the rays in the three-dimensional model of the transformer substation, wherein the intersection points are the three-dimensional coordinate points of the defect positions of the equipment.
EXAMPLE III
In one or more embodiments, a terminal device is disclosed that includes a processor and a computer-readable storage medium, the processor to implement instructions; the computer readable storage medium is used for storing a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the video-based substation three-dimensional monitoring method in the first embodiment.
In other embodiments, a computer-readable storage medium is disclosed, in which a plurality of instructions are stored, the instructions being adapted to be loaded by a processor of a terminal device and to perform the video-based substation three-dimensional monitoring method described in the first embodiment.
Although the embodiments of the present invention have been described with reference to the accompanying drawings, it is not intended to limit the scope of the present invention, and it should be understood by those skilled in the art that various modifications and variations can be made without inventive efforts by those skilled in the art based on the technical solution of the present invention.
Claims (10)
1. A three-dimensional monitoring method of a transformer substation based on videos is characterized by comprising the following steps:
acquiring video image information inside the transformer substation in real time, and establishing a three-dimensional model of the transformer substation;
identifying the appearance defects of the transformer substation equipment, if the appearance defects of the equipment are detected, obtaining coordinates of abnormal parts by positioning the defective equipment at multiple angles, establishing an equipment three-dimensional model with abnormal appearance according to the obtained abnormal equipment image, and overlaying the newly-established equipment three-dimensional model to a corresponding position area of the transformer substation three-dimensional model;
and detecting the abnormal state of the scene of the transformer substation, identifying the facial features and the appearance features of the personnel if the personnel enter the transformer substation, establishing a three-dimensional human body model with a real face image and the appearance features, and placing the three-dimensional human body model at the corresponding position of the three-dimensional transformer substation model according to the position coordinates of the personnel.
2. The video-based three-dimensional substation monitoring method according to claim 1, wherein performing substation equipment appearance defect identification comprises: the device is used for identifying the appearance damage condition of the device, identifying whether the device has abnormal additives or not and identifying abnormal light, smoke and fire.
3. The video-based transformer substation three-dimensional monitoring method according to claim 1, wherein coordinates of an abnormal part are obtained by multi-angle positioning of defective equipment, specifically:
linking at least two cameras near the defective equipment in the transformer substation, and acquiring images of the defective equipment from different shooting angles;
the method comprises the steps of positioning coordinates of defective equipment in an image acquired by a camera, and adjusting the shooting angle of the camera to enable the defective position of the equipment to be located at the center of a picture shot by each camera;
for each linked camera, respectively obtaining a ray which takes the camera as an end point and takes the direction corresponding to the central position of the camera as an extension direction;
and in the three-dimensional model of the transformer substation, solving the intersection point of all the rays, namely the three-dimensional coordinate point of the defect position of the equipment.
4. The video-based transformer substation three-dimensional monitoring method according to claim 1, wherein a device three-dimensional model with an abnormal appearance is established according to the obtained abnormal device image, specifically:
acquiring an appearance defect position image of equipment;
calling a file of the three-dimensional model of the equipment from a three-dimensional model library, and replacing the three-dimensional model map at the corresponding position in the original file with the appearance defect position image to obtain the three-dimensional model of the equipment with abnormal appearance;
and according to the position of the equipment in the three-dimensional model of the transformer substation, superposing the obtained equipment three-dimensional model with abnormal appearance to the three-dimensional model of the transformer substation.
5. The video-based transformer substation three-dimensional monitoring method according to claim 1, wherein the transformer substation scene abnormal state detection specifically comprises:
personnel behavior detection, comprising: face recognition, safety helmet monitoring and abnormal action monitoring;
regional monitoring, comprising: and (4) the foreign matters break into the article, and the article is left or passes through a warning line for monitoring.
6. The video-based transformer substation three-dimensional monitoring method according to claim 1, wherein a human body three-dimensional model with a real face image and appearance features is established, specifically:
identifying human face characteristics, intercepting a human face image, and replacing the intercepted human face image with a facial image of a human body three-dimensional model;
identifying dressing characteristics of personnel including safety helmets, safety clothes and safety shoes, and calling corresponding three-dimensional model materials from a three-dimensional model library to form a human body three-dimensional model capable of truly reflecting facial characteristics and dressing characteristics of the personnel.
7. A three-dimensional monitored control system of transformer substation based on video, its characterized in that includes:
the device is used for acquiring video image information inside the transformer substation in real time; the device comprises: the system comprises at least two cameras which are arranged in a monitoring area set by a transformer substation and have different shooting angles;
means for building a three-dimensional model of the substation; the device comprises a transformer substation three-dimensional model library;
the device is used for identifying appearance defects of the substation equipment;
the device is used for obtaining the coordinates of the abnormal part by positioning the defective equipment at multiple angles when the appearance defects of the equipment are detected;
the device is used for establishing a device three-dimensional model with an abnormal appearance according to the acquired abnormal device image;
the device is used for superposing the newly-built equipment three-dimensional model to a corresponding position area of the transformer substation three-dimensional model;
the device is used for detecting the abnormal state of the scene of the transformer substation;
the device is used for identifying the facial features and the appearance features of the personnel and establishing a human body three-dimensional model with a real face image and the appearance features when the personnel are detected to enter;
and the device is used for placing the human body three-dimensional model at a corresponding position of the transformer substation three-dimensional model according to the position coordinates of the personnel.
8. The video-based three-dimensional substation monitoring system according to claim 7, wherein the means for obtaining the coordinates of the abnormal portion by multi-angle positioning of the defective device when the device appearance defect is detected specifically comprises:
the device is used for linking at least two cameras near the defective equipment in the transformer substation and acquiring images of the defective equipment from different shooting angles;
the device is used for positioning the coordinates of the defective equipment in the images acquired by the cameras and adjusting the shooting angles of the cameras so that the defective positions of the equipment are positioned at the central position of the shot pictures of each camera;
the device is used for respectively obtaining a ray which takes the camera as an end point and takes the direction corresponding to the central position of the camera as an extension direction for each linked camera;
and the device is used for solving the intersection points of all the rays in the three-dimensional model of the transformer substation, wherein the intersection points are the three-dimensional coordinate points of the defect positions of the equipment.
9. A terminal device comprising a processor and a computer-readable storage medium, the processor being configured to implement instructions; a computer readable storage medium for storing a plurality of instructions adapted to be loaded by a processor and to perform the method of video-based three-dimensional monitoring of a substation according to any of claims 1-6.
10. A computer readable storage medium having stored therein a plurality of instructions, characterized in that said instructions are adapted to be loaded by a processor of a terminal device and to perform the video-based substation three-dimensional monitoring method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911137148.9A CN110874866B (en) | 2019-11-19 | 2019-11-19 | Video-based three-dimensional monitoring method and system for transformer substation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911137148.9A CN110874866B (en) | 2019-11-19 | 2019-11-19 | Video-based three-dimensional monitoring method and system for transformer substation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110874866A true CN110874866A (en) | 2020-03-10 |
| CN110874866B CN110874866B (en) | 2023-09-01 |
Family
ID=69718044
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911137148.9A Active CN110874866B (en) | 2019-11-19 | 2019-11-19 | Video-based three-dimensional monitoring method and system for transformer substation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110874866B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111583334A (en) * | 2020-05-26 | 2020-08-25 | 广东电网有限责任公司培训与评价中心 | Three-dimensional space positioning method, device and equipment for transformer substation personnel |
| CN111629184A (en) * | 2020-06-17 | 2020-09-04 | 内蒙古京海煤矸石发电有限责任公司 | Video monitoring alarm system and method capable of identifying personnel in monitoring area |
| CN112073679A (en) * | 2020-05-26 | 2020-12-11 | 许继集团有限公司 | Transformer substation equipment monitoring system based on three-dimensional technology and control method thereof |
| CN114510099A (en) * | 2022-02-16 | 2022-05-17 | 国网北京市电力公司 | Monitoring system |
| CN115695736A (en) * | 2022-12-14 | 2023-02-03 | 广东泰一高新技术发展有限公司 | Intelligent security command system and security command method based on three-dimensional model analysis |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0545118A (en) * | 1991-08-19 | 1993-02-23 | Hitachi Zosen Corp | Detecting method of surface position and shape of object |
| CN201750512U (en) * | 2010-06-30 | 2011-02-16 | 重庆市电力公司 | Intelligent recognition video analysis system for safety production |
| CN103809460A (en) * | 2012-11-14 | 2014-05-21 | 国家电网公司 | Monitoring center simulation method, device and system |
| CN105425698A (en) * | 2015-11-09 | 2016-03-23 | 国网重庆市电力公司电力科学研究院 | Integrated management and control method and system for three-dimensional digital transformer station |
| CN110417120A (en) * | 2019-06-26 | 2019-11-05 | 广东康云科技有限公司 | A kind of substation's outdoor scene 3 D intelligent cruising inspection system and method |
-
2019
- 2019-11-19 CN CN201911137148.9A patent/CN110874866B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0545118A (en) * | 1991-08-19 | 1993-02-23 | Hitachi Zosen Corp | Detecting method of surface position and shape of object |
| CN201750512U (en) * | 2010-06-30 | 2011-02-16 | 重庆市电力公司 | Intelligent recognition video analysis system for safety production |
| CN103809460A (en) * | 2012-11-14 | 2014-05-21 | 国家电网公司 | Monitoring center simulation method, device and system |
| CN105425698A (en) * | 2015-11-09 | 2016-03-23 | 国网重庆市电力公司电力科学研究院 | Integrated management and control method and system for three-dimensional digital transformer station |
| CN110417120A (en) * | 2019-06-26 | 2019-11-05 | 广东康云科技有限公司 | A kind of substation's outdoor scene 3 D intelligent cruising inspection system and method |
Non-Patent Citations (1)
| Title |
|---|
| 刘辉等: "变电站全景视频融合方法研究" * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111583334A (en) * | 2020-05-26 | 2020-08-25 | 广东电网有限责任公司培训与评价中心 | Three-dimensional space positioning method, device and equipment for transformer substation personnel |
| CN112073679A (en) * | 2020-05-26 | 2020-12-11 | 许继集团有限公司 | Transformer substation equipment monitoring system based on three-dimensional technology and control method thereof |
| CN111583334B (en) * | 2020-05-26 | 2023-03-14 | 广东电网有限责任公司培训与评价中心 | Three-dimensional space positioning method, device and equipment for transformer substation personnel |
| CN111629184A (en) * | 2020-06-17 | 2020-09-04 | 内蒙古京海煤矸石发电有限责任公司 | Video monitoring alarm system and method capable of identifying personnel in monitoring area |
| CN114510099A (en) * | 2022-02-16 | 2022-05-17 | 国网北京市电力公司 | Monitoring system |
| CN115695736A (en) * | 2022-12-14 | 2023-02-03 | 广东泰一高新技术发展有限公司 | Intelligent security command system and security command method based on three-dimensional model analysis |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110874866B (en) | 2023-09-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110874866A (en) | Transformer substation three-dimensional monitoring method and system based on videos | |
| CN104618694B (en) | A kind of method and system of computer room Three-Dimensional Dynamic monitoring | |
| CN107767673A (en) | A kind of Roadside Parking management method based on multiple-camera, apparatus and system | |
| CN107145851A (en) | Constructions work area dangerous matter sources intelligent identifying system | |
| CN112288984A (en) | Three-dimensional visual unattended substation intelligent linkage system based on video fusion | |
| CN109271872A (en) | A kind of judgement of high voltage isolator division state and trouble-shooter and method | |
| CN110012268A (en) | Pipe network AI intelligent control method, system, readable storage medium storing program for executing and equipment | |
| CN106875081A (en) | A kind of enhancing virtual reality method for electricity substation | |
| CN113225212A (en) | Data center monitoring system, method and server | |
| CN110047092B (en) | multi-target real-time tracking method in complex environment | |
| CN109660761A (en) | The personal identification of band conveyer corridor complex environment and alarm system and method based on SSD | |
| CN112184773A (en) | Helmet wearing detection method and system based on deep learning | |
| CN209088626U (en) | Intelligent substation patrol monitoring system | |
| WO2023061239A1 (en) | Intelligent power distribution room safety management system | |
| CN115100813B (en) | Intelligent community system based on digital twins | |
| CN110796754A (en) | Machine room inspection method based on image processing technology | |
| CN115410354A (en) | Safety early warning method, device and system for industrial plant | |
| CN115567690A (en) | Intelligent monitoring system capable of automatically identifying dangerous points of field operation | |
| CN115880722A (en) | Intelligent identification method, system and medium worn by power distribution operating personnel | |
| CN105095891A (en) | Human face capturing method, device and system | |
| CN116665419B (en) | Intelligent fault early warning system and method based on AI analysis in power production operation | |
| CN114067244A (en) | Safety operation violation behavior video analysis method and system | |
| CN105869330A (en) | Security protection monitor for preventing illegal encroachment on office building | |
| CN112532927A (en) | Intelligent safety management and control system for construction site | |
| CN112633157A (en) | AGV working area safety real-time detection method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210120 Address after: Room 902, 9 / F, block B, Yinhe building, 2008 Xinluo street, hi tech Zone, Jinan City, Shandong Province Applicant after: Shandong Luneng Software Technology Co.,Ltd. intelligent electrical branch Address before: 250101 power intelligent robot production project 101 south of Feiyue Avenue and east of No.26 Road (in ICT Industrial Park) in Suncun District of Gaoxin, Jinan City, Shandong Province Applicant before: National Network Intelligent Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| CB02 | Change of applicant information |
Address after: Room 902, 9 / F, block B, Yinhe building, 2008 Xinluo street, hi tech Zone, Jinan City, Shandong Province Applicant after: Shandong luruan Digital Technology Co.,Ltd. smart energy branch Address before: Room 902, 9 / F, block B, Yinhe building, 2008 Xinluo street, hi tech Zone, Jinan City, Shandong Province Applicant before: Shandong Luneng Software Technology Co.,Ltd. intelligent electrical branch |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |