CN115150589A - Video monitoring operation and maintenance management system for coal mine enterprise - Google Patents
Video monitoring operation and maintenance management system for coal mine enterprise Download PDFInfo
- Publication number
- CN115150589A CN115150589A CN202210762504.1A CN202210762504A CN115150589A CN 115150589 A CN115150589 A CN 115150589A CN 202210762504 A CN202210762504 A CN 202210762504A CN 115150589 A CN115150589 A CN 115150589A
- Authority
- CN
- China
- Prior art keywords
- monitoring
- module
- scene
- description
- production service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 112
- 239000003245 coal Substances 0.000 title claims abstract description 28
- 238000012423 maintenance Methods 0.000 title claims abstract description 25
- 238000004519 manufacturing process Methods 0.000 claims abstract description 83
- 230000006399 behavior Effects 0.000 claims abstract description 41
- 238000009434 installation Methods 0.000 claims abstract description 20
- 230000007246 mechanism Effects 0.000 claims abstract description 6
- 238000007726 management method Methods 0.000 claims description 66
- 238000012549 training Methods 0.000 claims description 41
- 238000012806 monitoring device Methods 0.000 claims description 17
- 230000000007 visual effect Effects 0.000 claims description 17
- 238000000034 method Methods 0.000 claims description 15
- 238000004458 analytical method Methods 0.000 claims description 12
- 238000002372 labelling Methods 0.000 claims description 12
- 238000001514 detection method Methods 0.000 claims description 9
- 238000010276 construction Methods 0.000 claims description 6
- 238000003032 molecular docking Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 4
- 230000003321 amplification Effects 0.000 claims description 3
- 238000012550 audit Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 3
- 238000007619 statistical method Methods 0.000 claims description 3
- 230000002159 abnormal effect Effects 0.000 claims 1
- 230000007547 defect Effects 0.000 abstract description 3
- 210000001503 joint Anatomy 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 238000003745 diagnosis Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- E—FIXED CONSTRUCTIONS
- E21—EARTH OR ROCK DRILLING; MINING
- E21F—SAFETY DEVICES, TRANSPORT, FILLING-UP, RESCUE, VENTILATION, OR DRAINING IN OR OF MINES OR TUNNELS
- E21F17/00—Methods or devices for use in mines or tunnels, not covered elsewhere
- E21F17/18—Special adaptations of signalling or alarm devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/02—Agriculture; Fishing; Forestry; Mining
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/70—Labelling scene content, e.g. deriving syntactic or semantic representations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/22—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks comprising specially adapted graphical user interfaces [GUI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Mining & Mineral Resources (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Emergency Management (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Life Sciences & Earth Sciences (AREA)
- Human Computer Interaction (AREA)
- Primary Health Care (AREA)
- Psychiatry (AREA)
- Animal Husbandry (AREA)
- Economics (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Agronomy & Crop Science (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Computer Networks & Wireless Communication (AREA)
- Marine Sciences & Fisheries (AREA)
- General Life Sciences & Earth Sciences (AREA)
- Geochemistry & Mineralogy (AREA)
- Geology (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- Medical Informatics (AREA)
- Social Psychology (AREA)
- Alarm Systems (AREA)
Abstract
The invention relates to operation and maintenance supervision, in particular to a video monitoring operation and maintenance management system for coal mine enterprises, which comprises a server, a multi-dimensional overview module, an intelligent alarm module, a monitoring management module and a monitoring identification unit, wherein the server is connected with the intelligent alarm module; the intelligent alarm module is used for timely acquiring accurate alarm information, quickly positioning alarm equipment and displaying the alarm information in a chart form through an alarm mechanism and the setting of an alarm threshold; the monitoring management module is used for monitoring the installation position and the installation quantity of the monitoring equipment and diagnosing the monitoring equipment and the monitoring picture in real time; the monitoring identification unit is used for deeply fusing AI identification with the management rule of a production service scene in combination with an actual application scene and supporting dangerous behavior identification by taking the scene as a unit; the technical scheme provided by the invention can effectively overcome the defects that the video monitoring system cannot be effectively managed and dangerous behaviors cannot be accurately identified in the prior art.
Description
Technical Field
The invention relates to operation and maintenance supervision, in particular to a video monitoring operation and maintenance management system for coal mine enterprises.
Background
The safety production is the foundation of coal mine enterprises, the safety cannot be guaranteed, and the coal mine enterprises cannot normally operate. The video monitoring system is an important means of modern safety management, the field operation condition and the equipment running condition can be checked in real time through monitoring, and the behavior of an operator can be more standard in a place with video monitoring.
However, the video monitoring system has multiple points and wide range, and more devices are arranged on a system link, so that the effect of video monitoring is affected when any link is in a problem, meanwhile, the video monitoring pictures need to be manually judged one by one, and the dangerous behavior identification efficiency is reduced. In addition, underground personnel do not know whether network transmission of nearby monitoring points is normal or not during operation, ground personnel cannot focus on video monitoring in 24 hours, and problems cannot be timely and effectively treated.
Disclosure of Invention
Technical problem to be solved
Aiming at the defects in the prior art, the invention provides a video monitoring operation and maintenance management system for coal mine enterprises, which can effectively overcome the defects that the video monitoring system cannot be effectively managed and dangerous behaviors cannot be accurately identified in the prior art.
(II) technical scheme
In order to achieve the purpose, the invention is realized by the following technical scheme:
a video monitoring operation and maintenance management system for coal mine enterprises comprises a server, a multi-dimensional overview module, an intelligent alarm module, a monitoring management module and a monitoring identification unit;
the multidimensional overview module provides a default display view of a login homepage, and after logging in the system, the operation and maintenance personnel master the current operation and maintenance state through a statistical analysis chart and provide data support for work arrangement;
the intelligent alarm module is used for timely acquiring accurate alarm information, quickly positioning alarm equipment and displaying the alarm information in a chart form through an alarm mechanism and the setting of an alarm threshold;
the monitoring management module is used for monitoring the installation position and the installation quantity of the monitoring equipment and diagnosing the monitoring equipment and the monitoring picture in real time;
and the monitoring identification unit is used for deeply fusing AI identification with the management rule of the production service scene in combination with the actual application scene and supporting the identification of dangerous behaviors by taking the scene as a unit.
Preferably, the monitoring management module compares the installation points and the installation number of the installed monitoring devices according to the working scene and the related monitoring standards, and automatically reminds or gives an alarm if the installation points where the monitoring devices are not installed or the installation number of the monitoring devices is insufficient.
Preferably, the monitoring management module supports performance state monitoring and picture real-time snapshot screenshot of the monitoring equipment, receives, processes and analyzes online and offline events of the monitoring equipment, and generates a corresponding visual analysis chart;
the monitoring management module provides a monitoring device ONVIF protocol topology page fast query function, queries monitoring device shading and monitoring picture quality data, configures monitoring device indexes and tasks in a user-defined mode according to an ONVIF protocol query result, and provides performance state monitoring and picture abnormity monitoring.
Preferably, the monitoring and recognizing unit comprises an image acquisition module, an image annotation module, a training data set construction module, an image description module, a description vocabulary entry library construction module and an analysis and recognition module;
the image acquisition modules are distributed in the mine and are used for acquiring various historical production service scenes and real-time production service scenes;
the image annotation module is used for labeling characters, equipment and environments in the historical production service scene and performing scene semantic description on the historical production service scene;
a training data set building block for building a training data set, building a training data set by utilizing semantic descriptions of various historical production service scenes and corresponding scenes;
the image description module is used for constructing a scene recognition model, carrying out model training based on a training data set, taking a real-time production service scene as model input, and outputting semantic description of a corresponding scene;
the description entry database building module is used for building a dangerous behavior database, and building a description entry database related to the dangerous behavior database based on scene semantic description of the historical production service scene by the image annotation module;
and the analysis and identification module is used for comparing the scene semantic description output by the image description module with the description entry library, matching the description entries conforming to the scene semantic description and identifying dangerous behaviors in the real-time production service scene.
Preferably, the image description module constructs a scene recognition model, performs model training based on a training data set, and outputs corresponding scene semantic descriptions by using a real-time production service scene as a model input, including:
constructing a target detection network model, carrying out model training based on a training data set, and carrying out target feature extraction on characters, equipment and environment in a real-time production business scene;
constructing a classification detection network model, performing model training based on a training data set, generating a region classification frame in a real-time production service scene, and dividing respective positions or regions of characters, equipment and an environment;
and constructing a visual relation detection network model, performing model training based on a training data set, and generating object description, attribute description, region description and relation description about a region classification frame in a real-time production service scene on the basis of target classification and identification.
Preferably, the dangerous behavior database is constructed by the description entry database construction module, and the description entry database about the dangerous behavior database is constructed based on scene semantic description of the historical production service scene by the image annotation module, including:
performing dangerous behavior summarization based on a relevant management manual and an operation rule, and constructing a dangerous behavior database;
setting a relevant description entry for the dangerous behavior in the dangerous behavior database according to scene semantic description of the image annotation module on the historical production service scene, and constructing a description entry database related to the dangerous behavior database.
Preferably, the image annotation module labels characters, devices and environments in the historical production service scene, and performs scene semantic description on the historical production service scene, including:
carrying out underground operator labeling, equipment machine componentization labeling and environment labeling on a historical production service scene;
respectively generating object description, attribute description, area description and relation description for the historical production service scene according to a set strategy;
the object description, the attribute description, the area description and the relation description are determined according to the related instruction manual and the management manual.
Preferably, the image acquisition module acquires various historical production service scenes, including:
acquiring a scene image of the production service in the mine through network search; the method comprises the steps that monitoring equipment which is distributed in a mine on site is used for collecting production service scene images in the mine for a long time; and carrying out image amplification by simulating and replacing characters, equipment and environment in the collected mine internal production service scene images.
Preferably, the system also comprises a visual display module, a closed-loop management module and a cross-platform docking module;
the visual display module provides a large screen with multiple dimensions for observing the related production conditions of coal mine enterprises;
the closed-loop management module comprises admission control management, access security management, universal control management, flow strategy management and security audit management;
and the cross-platform butt joint module is used for butt joint of the coal mine enterprise monitoring center and the industrial ring network, performing cross-network cross-platform seamless butt joint, and pushing actual report information to the AI visual platform in time.
(III) advantageous effects
Compared with the prior art, the video monitoring operation and maintenance management system for the coal mine enterprises, provided by the invention, has the following beneficial effects:
1) The system fully utilizes and exerts the potential of each monitoring device, adjusts and updates the existing monitoring device in a planned, stepped and emphasized manner according to the actual production condition of a coal mine enterprise and the hidden trouble problems, improves the use benefit of the existing device by adjusting the use area of the monitoring device, and can appropriately supplement the new monitoring device into the original video monitoring system on the premise of increasing marginal benefit;
2) AI identification is deeply integrated with management rules of production service scenes, safety supervision is assisted, supervision efficiency is improved, each monitoring device is an electronic safety worker working for 7 x 24 hours, the traditional eye checking mode is thoroughly changed, safety supervision personnel and enterprise management personnel can be separated from daily patrol and other work, and supervision work is more efficiently put into;
3) This system is one set of wisdom fortune dimension management system to coal mine enterprise research and development specially, can let each production link of enterprise all have the data can rely on, have the data to look into to can lay the basis for safety in production, realize that safe operation is parallel with high-efficient operation, when guaranteeing safety in production, drive reduction of manufacturing cost and the promotion of productivity, bring direct economic benefits for the enterprise.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the invention, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.
FIG. 1 is a schematic diagram of the system of the present invention;
fig. 2 is a schematic flow chart of the process of identifying dangerous behaviors by the monitoring and identifying unit according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
A video monitoring operation and maintenance management system for coal mine enterprises is shown in figure 1 and comprises a server, a multi-dimensional overview module, an intelligent alarm module, a monitoring management module and a monitoring identification unit.
(1) And the multidimensional overview module provides a default display view for logging in a home page, and after logging in the system, the operation and maintenance personnel master the operation and maintenance states of the current equipment and service through multidimensional statistical analysis charts of network, alarm, performance and the like, thereby providing data support for work arrangement.
(2) The intelligent alarm module supports various alarm mechanisms and custom configuration of alarm thresholds, comprehensively collects alarm information of equipment, application, service and the like through the setting of the alarm mechanisms and the alarm thresholds, quickly positions the alarm equipment, displays the alarm information in a chart form according to various dimensions such as time, resources, performance and the like, and supports quick marking of the alarm information which is subjected to relevant operation.
The intelligent alarm module timely acquires accurate alarm information through an alarm mechanism and the setting of an alarm threshold value, and rapidly positions alarm equipment, so that the alarm information processing efficiency is effectively improved, and the loss of enterprises caused by equipment faults is greatly reduced.
(3) And the monitoring management module is used for monitoring the installation position and the installation number of the monitoring equipment and diagnosing the monitoring equipment and the monitoring picture in real time. The method supports real-time diagnosis based on the ONVIF protocol, and the diagnosis content comprises monitoring equipment configuration information, monitoring equipment working state, connectivity and monitoring picture quality.
1) The monitoring management module compares the installation positions and the installation quantity of the installed monitoring equipment according to the working scene and the related monitoring standard, and automatically reminds or gives an alarm if the installation positions of the unmounted monitoring equipment or the installation quantity of the monitoring equipment is insufficient.
2) The monitoring management module supports performance state monitoring and picture real-time snapshot screenshots (snapshot intervals can be defined by taking a second level as a unit), receives and processes online and offline events of the monitoring equipment, and generates a corresponding visual analysis chart;
the monitoring management module provides a monitoring device ONVIF protocol topology page fast query function, queries monitoring device shading and monitoring picture quality data, configures monitoring device indexes and tasks in a user-defined mode according to an ONVIF protocol query result, and provides performance state monitoring and picture abnormity monitoring.
The monitoring management module supports node information, configuration information, video source information, storage information, a user list, a device gateway, a DNS, a network port and other related data of the monitoring device.
(4) And the monitoring identification unit is used for deeply fusing AI identification with the management rule of the production service scene in combination with the actual application scene and supporting the identification of dangerous behaviors by taking the scene as a unit.
The setting of the monitoring identification unit meets the requirement of real-time intelligent analysis of the customized production service scene of a coal mine enterprise, multidimensional, visual and intelligent monitoring experience is provided for a user, scene monitoring data is recorded and stored in a video (image) form, behavior identification and object identification of the production service scene are realized through a video analysis algorithm, massive video contents are effectively distinguished and identified, invalid videos are automatically rejected, effective video fragments are screened and uploaded, thereby the intellectualization of front-end image acquisition and the accurate analysis of middle and rear-end data are realized, the investment of a large number of traditional monitoring personnel is reduced, and the traditional supervision mode mainly based on 'human eye' checking and inspection is overturned.
In the technical scheme, the system further comprises a visual display module, a closed-loop management module and a cross-platform docking module.
(5) The visual display module provides a large visual screen with multiple dimensions, covers a network large screen, a comprehensive large screen, an alarm large screen, a monitoring large screen, a Top large screen and the like, and is used for observing the related production conditions of coal mine enterprises.
(6) And the closed-loop management module comprises admission control management, access security management, universal control management, flow strategy management and security audit management. Through closed-loop management, the risk generated in enterprise production can be effectively reduced, and the safety of an enterprise network system and the integrity and confidentiality of data information are guaranteed.
(7) And the cross-platform butt joint module is used for butt joint of private networks such as a coal mine enterprise monitoring center and an industrial ring network, cross-network and cross-platform seamless butt joint is carried out, actual report information is timely pushed to the AI visual platform, and video information resource sharing and application benefit maximization are realized.
As shown in fig. 1 and fig. 2, the monitoring and recognizing unit includes an image collecting module, an image annotating module, a training data set constructing module, an image describing module, a description vocabulary entry library constructing module, and an analysis and recognition module.
The image acquisition modules are distributed in the mine and are used for acquiring various historical production service scenes and real-time production service scenes;
the image annotation module is used for labeling characters, equipment and environments in the historical production service scene and performing scene semantic description on the historical production service scene;
the training data set construction module is used for constructing a training data set by utilizing semantic descriptions of various historical production service scenes and corresponding scenes;
the image description module is used for constructing a scene recognition model, carrying out model training based on a training data set, taking a real-time production service scene as model input, and outputting semantic description of a corresponding scene;
the description entry database building module is used for building a dangerous behavior database, and building a description entry database related to the dangerous behavior database based on scene semantic description of the historical production service scene by the image annotation module;
and the analysis and identification module is used for comparing the scene semantic description output by the image description module with the description entry library, matching the description entries conforming to the scene semantic description and identifying dangerous behaviors in the real-time production service scene.
(1) The image acquisition module acquires various historical production service scenes, and the method comprises the following steps:
collecting mine through network search an internal production business scene image; the method comprises the steps that monitoring equipment which is distributed in a mine on site is used for collecting production service scene images in the mine for a long time; and carrying out image amplification by simulating and replacing characters, equipment and environment in the collected mine internal production service scene images.
(2) The image annotation module labels characters, equipment and environments in the historical production service scene and performs scene semantic description on the historical production service scene, and the method comprises the following steps:
carrying out underground operator labeling, equipment machine componentization labeling and environment labeling on a historical production service scene;
respectively generating object description, attribute description, area description and relation description for the historical production service scene according to a set strategy;
the object description, the attribute description, the area description and the relation description are determined according to the related instruction manual and the management manual.
(3) The image description module builds a scene recognition model, carries out model training based on a training data set, takes a real-time production service scene as model input, and outputs corresponding scene semantic description, and the method comprises the following steps:
constructing a target detection network model, performing model training based on a training data set, and performing target feature extraction on characters, equipment and environments in a real-time production service scene;
constructing a classification detection network model, carrying out model training based on a training data set, generating a region classification frame in a real-time production business scene, and dividing respective positions or regions of characters, equipment and environment;
and constructing a visual relation detection network model, carrying out model training based on a training data set, and generating object description, attribute description, region description and relation description about a region classification frame in a real-time production business scene on the basis of target classification identification.
(4) The method comprises the following steps of constructing a dangerous behavior database by a description entry database construction module, constructing a description entry database related to the dangerous behavior database based on scene semantic description of a historical production service scene by an image annotation module, and comprising the following steps of:
performing dangerous behavior summarization based on a relevant management manual and an operation rule, and constructing a dangerous behavior database;
setting a relevant description entry for the dangerous behavior in the dangerous behavior database according to scene semantic description of the image annotation module on the historical production service scene, and constructing a description entry database related to the dangerous behavior database.
The above examples are only intended to illustrate the technical solution of the present invention, and not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the corresponding technical solutions.
Claims (9)
1. The utility model provides a video monitoring operation and maintenance management system for coal mine enterprise which characterized in that: the system comprises a server, a multi-dimensional overview module, an intelligent alarm module, a monitoring management module and a monitoring identification unit;
the multidimensional overview module provides a default display view of a login homepage, and after logging in the system, the operation and maintenance personnel master the current operation and maintenance state through a statistical analysis chart and provide data support for work arrangement;
the intelligent alarm module is used for timely acquiring accurate alarm information, quickly positioning alarm equipment and displaying the alarm information in a chart form through an alarm mechanism and the setting of an alarm threshold;
the monitoring management module is used for monitoring the installation position and the installation quantity of the monitoring equipment and diagnosing the monitoring equipment and the monitoring picture in real time;
and the monitoring identification unit is used for deeply fusing AI identification with the management rule of the production service scene in combination with the actual application scene and supporting the identification of dangerous behaviors by taking the scene as a unit.
2. The video monitoring operation and maintenance management system for the coal mine enterprises according to claim 1, wherein: the monitoring management module compares the installation positions and the installation quantity of the installed monitoring equipment according to the working scene and the related monitoring standard, and automatically reminds or gives an alarm if the installation positions of the unmounted monitoring equipment or the installation quantity of the monitoring equipment is insufficient.
3. The video monitoring operation and maintenance management system for the coal mine enterprises according to claim 2, characterized in that: the monitoring management module supports performance state monitoring and picture real-time snapshot screenshot of the monitoring equipment, receives and processes online and offline events of the monitoring equipment, and generates a corresponding visual analysis chart;
the monitoring management module provides a monitoring device ONVIF protocol topology page fast query function, queries the shielding and monitoring picture quality data of the monitoring device, and configuring the index and task of the monitoring equipment by self according to the query result of the ONVIF protocol, and providing performance state monitoring and abnormal picture monitoring.
4. The video monitoring operation and maintenance management system for the coal mine enterprises according to claim 1, wherein: the monitoring and recognizing unit comprises an image acquisition module, an image annotation module, a training data set building module, an image description module, a description entry library building module and an analysis and recognition module;
the image acquisition modules are distributed in the mine and are used for acquiring various historical production service scenes and real-time production service scenes;
the image annotation module is used for labeling characters, equipment and environments in the historical production service scene and performing scene semantic description on the historical production service scene;
a training data set building block for building a training data set, building a training data set by using semantic descriptions of various historical production service scenes and corresponding scenes;
the image description module is used for constructing a scene recognition model, carrying out model training based on a training data set, taking a real-time production service scene as model input, and outputting semantic description of a corresponding scene;
the description entry database building module is used for building a dangerous behavior database, and building a description entry database related to the dangerous behavior database based on scene semantic description of the image annotation module on the historical production service scene;
and the analysis and identification module is used for comparing the scene semantic description output by the image description module with the description entry library, matching the description entries conforming to the scene semantic description and identifying dangerous behaviors in the real-time production service scene.
5. The video monitoring operation and maintenance management system for the coal mine enterprises according to claim 4, wherein: the image description module constructs a scene recognition model, carries out model training based on a training data set, takes a real-time production service scene as model input, and outputs corresponding scene semantic description, and the method comprises the following steps:
constructing a target detection network model, performing model training based on a training data set, and performing target feature extraction on characters, equipment and environments in a real-time production service scene;
constructing a classification detection network model, performing model training based on a training data set, generating a region classification frame in a real-time production service scene, and dividing respective positions or regions of characters, equipment and an environment;
and constructing a visual relation detection network model, carrying out model training based on a training data set, and generating object description, attribute description, region description and relation description about a region classification frame in a real-time production business scene on the basis of target classification identification.
6. The video monitoring operation and maintenance management system for the coal mine enterprises according to claim 4, wherein: the dangerous behavior database construction module constructs a dangerous behavior database, constructs a description entry database related to the dangerous behavior database based on scene semantic description of the image annotation module on the historical production service scene, and comprises the following steps:
performing dangerous behavior summarization based on a relevant management manual and an operation rule, and constructing a dangerous behavior database;
setting a relevant description entry for the dangerous behavior in the dangerous behavior database according to scene semantic description of the image annotation module on the historical production service scene, and constructing a description entry database related to the dangerous behavior database.
7. The video monitoring operation and maintenance management system for the coal mine enterprises according to claim 4, wherein: the image annotation module labels characters, equipment and environments in the historical production service scene and performs scene semantic description on the historical production service scene, and the method comprises the following steps:
carrying out underground operator labeling, equipment machine componentization labeling and environment labeling on a historical production business scene;
respectively generating object description, attribute description, area description and relation description for the historical production service scene according to a set strategy;
the object description, the attribute description, the area description and the relation description are determined according to the related instruction manual and the management manual.
8. The video monitoring operation and maintenance management system for the coal mine enterprises according to claim 7, wherein: the image acquisition module acquires various historical production service scenes, and the method comprises the following steps:
acquiring a scene image of the production service in the mine through network search; the method comprises the steps that monitoring equipment which is distributed in a mine on site is used for collecting production service scene images in the mine for a long time; and carrying out image amplification by simulating and replacing characters, equipment and environment in the collected mine internal production service scene images.
9. The video monitoring operation and maintenance management system for the coal mine enterprises according to claim 1, wherein: the system also comprises a visual display module, a closed-loop management module and a cross-platform docking module;
the visual display module provides a large screen with multiple dimensions for observing the related production conditions of coal mine enterprises;
the closed-loop management module comprises admission control management, access security management, universal control management, flow strategy management and security audit management;
and the cross-platform docking module is used for docking the coal mine enterprise monitoring center and the industrial ring network, performing cross-network cross-platform seamless docking, and timely pushing the actual report information to the AI visual platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210762504.1A CN115150589A (en) | 2022-06-30 | 2022-06-30 | Video monitoring operation and maintenance management system for coal mine enterprise |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210762504.1A CN115150589A (en) | 2022-06-30 | 2022-06-30 | Video monitoring operation and maintenance management system for coal mine enterprise |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115150589A true CN115150589A (en) | 2022-10-04 |
Family
ID=83410122
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210762504.1A Withdrawn CN115150589A (en) | 2022-06-30 | 2022-06-30 | Video monitoring operation and maintenance management system for coal mine enterprise |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115150589A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116066668A (en) * | 2022-12-12 | 2023-05-05 | 贵州省矿山安全科学研究院有限公司 | Camera convenient to install and management analysis system using same |
| CN116166813A (en) * | 2022-12-15 | 2023-05-26 | 深圳银兴智能数据有限公司 | Management method, system, equipment and storage medium for big data automation operation and maintenance |
| CN116580294A (en) * | 2023-03-29 | 2023-08-11 | 中国安全生产科学研究院 | Mine dynamic monitoring risk early warning method and system based on big data |
| CN117035419A (en) * | 2023-08-16 | 2023-11-10 | 浙江蓝城萧立建设管理有限公司 | Intelligent management system and method for enterprise project implementation |
| CN117151675A (en) * | 2023-03-16 | 2023-12-01 | 杭州水务数智科技股份有限公司 | Remote operation and maintenance method and system based on video monitoring and encryption |
| CN117156107A (en) * | 2023-10-31 | 2023-12-01 | 天津市城市规划设计研究总院有限公司 | Community monitoring semantic description method and system |
| CN117456708A (en) * | 2023-12-22 | 2024-01-26 | 山东省邱集煤矿有限公司 | Coal mine underground early warning method, system and equipment based on image key information identification |
| CN117556978A (en) * | 2023-12-29 | 2024-02-13 | 天地(常州)自动化股份有限公司北京分公司 | Underground coal mine operation and maintenance method and system based on big data analysis |
| CN118071112A (en) * | 2024-04-17 | 2024-05-24 | 中网华信科技股份有限公司 | Command scheduling system based on voice interaction and large model |
-
2022
- 2022-06-30 CN CN202210762504.1A patent/CN115150589A/en not_active Withdrawn
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116066668A (en) * | 2022-12-12 | 2023-05-05 | 贵州省矿山安全科学研究院有限公司 | Camera convenient to install and management analysis system using same |
| CN116166813A (en) * | 2022-12-15 | 2023-05-26 | 深圳银兴智能数据有限公司 | Management method, system, equipment and storage medium for big data automation operation and maintenance |
| CN117151675A (en) * | 2023-03-16 | 2023-12-01 | 杭州水务数智科技股份有限公司 | Remote operation and maintenance method and system based on video monitoring and encryption |
| CN117151675B (en) * | 2023-03-16 | 2024-04-09 | 杭州水务数智科技股份有限公司 | Remote operation and maintenance method and system based on video monitoring and encryption |
| CN116580294B (en) * | 2023-03-29 | 2024-03-29 | 中国安全生产科学研究院 | Mine dynamic monitoring risk early warning method and system based on big data |
| CN116580294A (en) * | 2023-03-29 | 2023-08-11 | 中国安全生产科学研究院 | Mine dynamic monitoring risk early warning method and system based on big data |
| CN117035419A (en) * | 2023-08-16 | 2023-11-10 | 浙江蓝城萧立建设管理有限公司 | Intelligent management system and method for enterprise project implementation |
| CN117035419B (en) * | 2023-08-16 | 2024-02-13 | 浙江蓝城萧立建设管理有限公司 | Intelligent management system and method for enterprise project implementation |
| CN117156107A (en) * | 2023-10-31 | 2023-12-01 | 天津市城市规划设计研究总院有限公司 | Community monitoring semantic description method and system |
| CN117456708A (en) * | 2023-12-22 | 2024-01-26 | 山东省邱集煤矿有限公司 | Coal mine underground early warning method, system and equipment based on image key information identification |
| CN117556978A (en) * | 2023-12-29 | 2024-02-13 | 天地(常州)自动化股份有限公司北京分公司 | Underground coal mine operation and maintenance method and system based on big data analysis |
| CN117556978B (en) * | 2023-12-29 | 2024-06-25 | 天地(常州)自动化股份有限公司北京分公司 | Underground coal mine operation and maintenance method and system based on big data analysis |
| CN118071112A (en) * | 2024-04-17 | 2024-05-24 | 中网华信科技股份有限公司 | Command scheduling system based on voice interaction and large model |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115150589A (en) | Video monitoring operation and maintenance management system for coal mine enterprise | |
| CN110048878B (en) | Three-span visual management system for power transmission line | |
| CN105515180A (en) | Intelligent substation communication network dynamic monitoring system and monitoring method thereof | |
| CN109066971A (en) | Intelligent substation fortune inspection managing and control system and method based on whole station business datum | |
| EP4155974A1 (en) | Knowledge graph construction method and apparatus, check method and storage medium | |
| CN110689148A (en) | Metering equipment fault detection method based on AR technology | |
| CN105262210A (en) | System and method for analysis and early warning of substation network security | |
| CN105260866A (en) | Locker box-opening fault detection method | |
| CN112839200B (en) | Power plant violation behavior identification method and system based on 5G technology and network server | |
| CN104917803A (en) | Autonomous inspection system based on user behavior control | |
| CN113449959A (en) | Mine personnel behavior governance system and platform | |
| CN112416872A (en) | Cloud platform log management system based on big data | |
| CN114137302B (en) | Electric energy metering instrument verification whole process monitoring system | |
| CN107563523A (en) | Operation management platform and method based on unstructured stream video management system | |
| CN108718108A (en) | A kind of distant monitoring of photovoltaic power station based on UDP and intelligent decision system | |
| CN110728381A (en) | Intelligent power plant inspection method and system based on RFID and data processing | |
| CN110765087A (en) | User account abuse auditing method and system based on network security device log data | |
| CN116185757B (en) | Intelligent monitoring system for energy consumption of machine room | |
| CN116986246A (en) | Intelligent inspection system and method for coal conveying belt | |
| CN117114420B (en) | Image recognition-based industrial and trade safety accident risk management and control system and method | |
| CN117240594B (en) | Multi-dimensional network security operation and maintenance protection management system and method | |
| CN117129796A (en) | Power grid fault identification system based on big data | |
| CN117331802A (en) | Middle-station data monitoring and analyzing system based on industrial Internet | |
| CN116859804A (en) | Safety situation monitoring and early warning system for ship manufacturing workshop | |
| CN111709597A (en) | Power grid production domain operation monitoring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20221004 |
|
| WW01 | Invention patent application withdrawn after publication |