CN109271881B - Safety management and control method and device for personnel in transformer substation and server - Google Patents
Safety management and control method and device for personnel in transformer substation and server Download PDFInfo
- Publication number
- CN109271881B CN109271881B CN201810982585.XA CN201810982585A CN109271881B CN 109271881 B CN109271881 B CN 109271881B CN 201810982585 A CN201810982585 A CN 201810982585A CN 109271881 B CN109271881 B CN 109271881B
- Authority
- CN
- China
- Prior art keywords
- operator
- control device
- information
- head
- safety control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000003287 optical effect Effects 0.000 claims description 24
- 238000004590 computer program Methods 0.000 claims description 18
- 230000015654 memory Effects 0.000 claims description 15
- 238000013527 convolutional neural network Methods 0.000 claims description 13
- 230000001788 irregular Effects 0.000 claims description 12
- 238000013136 deep learning model Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 5
- 238000005070 sampling Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 2
- 230000009471 action Effects 0.000 description 17
- 230000008569 process Effects 0.000 description 14
- 230000006870 function Effects 0.000 description 6
- 238000013528 artificial neural network Methods 0.000 description 5
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 239000002699 waste material Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000006403 short-term memory Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/44—Event detection
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Economics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Health & Medical Sciences (AREA)
- Entrepreneurship & Innovation (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Primary Health Care (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Signal Processing (AREA)
- Development Economics (AREA)
- Educational Administration (AREA)
- Water Supply & Treatment (AREA)
- Game Theory and Decision Science (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Alarm Systems (AREA)
Abstract
The invention is applicable to the technical field of transformer substation safety, and provides a method, a device and a server for safely managing and controlling personnel in a transformer substation, wherein the method comprises the following steps: acquiring an image of an operator in an operation area captured by a camera, performing image recognition on the image of the operator, and judging whether the operator wears a head-mounted safety control device; if the operator does not wear the head-mounted safety control device, sending voice reminding information to a voice reminding device arranged in the operation area; if the operator wears the head-wearing safety control device, acquiring an operation video of the operator, which is acquired by the head-wearing safety control device; and performing image recognition on the operation video, and if the operation of the operator is recognized as non-standard operation, generating and sending standard prompt information to the head-mounted safety control device. The invention can remind the operating personnel in time when the operation of the operating personnel is not standard, thereby avoiding causing serious electric power accidents and ensuring the safety of the operating personnel and electric power equipment thereof.
Description
Technical Field
The invention belongs to the technical field of transformer substation safety, and particularly relates to a method, a device and a server for safely managing and controlling personnel in a transformer substation.
Background
The operation management of the transformer substation has higher safety requirements, and larger safety accidents can occur due to carelessness in work. Therefore, safety is a permanent theme of power enterprises, and the general management rules of modern power enterprises all realize systematization, standardization and normalization. However, in reality, due to a lot of management links, personnel participation links are also numerous, and careless management is easy to occur. Especially, the safety management and control of the field operation, the carelessness of the management and the occurrence of safety accidents are easy to cause.
At present, a manual observation mode is adopted for field safety control of a transformer substation, a safety supervisor is arranged when the transformer substation works to observe the working field condition in real time, whether a field operator keeps a sufficient distance from a live device or not and whether the basic operation of the field operator is standard or not are observed, but a large number of safety supervisors need to be distributed in the operation process to ensure the safety of the field operator to be primarily ensured, so that the talent waste is caused, and the manual supervision method is often not in place to supervise, so that the power accident is easily caused.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method, an apparatus, and a server for managing and controlling safety of personnel in a substation, so as to solve the problems in the prior art that safety management and supervision in the substation are not in place and power accidents occur frequently.
The first aspect of the embodiment of the invention provides a method for safely managing and controlling personnel in a transformer substation, which comprises the following steps:
acquiring an image of an operator in an operation area captured by a camera, performing image recognition on the image of the operator, and judging whether the operator in the image of the operator wears a head-mounted safety control device or not;
if the operator in the operator image does not wear the head-mounted safety control device, sending voice reminding information to a voice reminding device arranged in the operation area, wherein the voice reminding information is used for indicating the voice reminding device to broadcast the voice reminding information;
if the operator in the operator image wears the head-mounted safety control device, acquiring an operation video of the operator, which is acquired by the head-mounted safety control device;
and performing image recognition on the operation video, and if the operation of the operator in the operation video is recognized to be an irregular operation, generating and sending a standard prompt message to the head-mounted safety control device.
A second aspect of the embodiments of the present invention provides a device for managing and controlling personnel safety in a substation, including:
the image acquisition module of the operator is used for acquiring the image of the operator in the operation area captured by the camera, carrying out image recognition on the image of the operator and judging whether the operator in the image of the operator wears the head-mounted safety control device or not;
the voice reminding information sending module is used for sending voice reminding information to the voice reminding device arranged in the operation area if the operation personnel in the operation personnel image do not wear the head-mounted safety control device, and the voice reminding information is used for indicating the voice reminding device to broadcast the voice reminding information;
the operation video acquisition module is used for acquiring the operation video of the operator, which is acquired by the head-mounted safety control device, if the operator in the operator image wears the head-mounted safety control device;
and the standard prompt information sending module is used for carrying out image recognition on the operation video, and if the operation of the operator in the operation video is recognized to be an irregular operation, generating and sending standard prompt information to the head-mounted safety control device.
A third aspect of the embodiments of the present invention provides a server, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the method for controlling security of personnel in a substation as described above when executing the computer program.
A fourth aspect of embodiments of the present invention provides a computer-readable storage medium, in which a computer program is stored, which, when executed by a processor, implements the steps of the method for personnel safety control in a substation as described above.
Compared with the prior art, the embodiment of the invention has the following beneficial effects: the method comprises the steps of firstly acquiring an image of an operator in an operation area captured by a camera, carrying out image recognition on the image of the operator, and judging whether the operator wears a safety management and control device or not; if the operator in the operator image does not wear the head-mounted safety control device, sending voice reminding information to a voice reminding device arranged in the operation area; if the operator in the operator image wears the head-mounted safety control device, acquiring an operation video of the operator, which is acquired by the head-mounted safety control device; and performing image recognition on the operation video, and if the operation of the operator in the operation video is recognized to be an irregular operation, generating and sending a standard prompt message to the head-mounted safety control device. According to the embodiment of the invention, the operation personnel can recognize the operation action of the operation personnel by wearing the head-mounted safety control device, and can be reminded in time when the operation of the operation personnel is not standard, so that serious electric power accidents are avoided, and the safety of the operation personnel and electric power equipment thereof is ensured.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a schematic flow chart illustrating an implementation of a method for managing and controlling personnel safety in a substation according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a specific implementation of S104 in fig. 1 according to an embodiment of the present invention;
fig. 3 is a schematic flow chart illustrating an implementation of a method for managing and controlling personnel safety in a transformer substation according to an embodiment of the present invention;
fig. 4 is a schematic flow chart illustrating an implementation of a method for managing and controlling personnel safety in a transformer substation according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a personnel safety management and control device in a transformer substation according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a server provided in an embodiment of the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
The terms "comprises" and "comprising," and any variations thereof, in the description and claims of this invention and the above-described drawings are intended to cover non-exclusive inclusions. For example, a process, method, or system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus. Furthermore, the terms "first," "second," and "third," etc. are used to distinguish between different objects and are not used to describe a particular order.
In order to explain the technical means of the present invention, the following description will be given by way of specific examples.
Example 1:
fig. 1 shows an implementation process of a method for safely managing and controlling personnel in a substation, which is provided by an embodiment of the present invention, where a main process body may be a server, and a process of the method is detailed as follows:
in S101, an image of a worker in a work area captured by a camera is acquired, image recognition is performed on the image of the worker, and it is determined whether the worker in the image of the worker wears a head-mounted safety control device.
In this embodiment, the server acquires images of the operators in real time, which are sent by the cameras, and the cameras include a plurality of cameras, which are arranged around the operation area and used for shooting the operation area from different directions, so that the server can observe the operation area in all directions. Preferably, can arrange the camera in operation area exit position for whether the operation personnel that the inspection got into operation area wears safety control device, wear safety control device can be the safety helmet.
In this embodiment, the server identifies whether the worker wears the head-mounted safety control device on the head in the worker image, may store a preset standard sample in the server, and determines whether the worker wears the head-mounted safety control device by determining the similarity between the preset standard sample and the worker image, where the influence factor of the similarity is mainly the head-mounted safety control device and the position thereof.
In S102, if the worker in the worker image does not wear the head-mounted safety control device, sending voice reminding information to a voice reminding device arranged in the work area, where the voice reminding information is used to instruct the voice reminding device to broadcast the voice reminding information.
In this embodiment, if the server recognizes that the worker in the image of the worker does not wear the safety control device, the server sends the voice reminding voice to the voice reminding device, for example, if it is detected that the worker in the working area does not wear the head safety control device, the server reports "please the worker who does not wear the head safety control device to leave the working area" through the voice reminding device, and after the server detects that the worker who does not wear the head safety control device in the working area does not exist, the server sends a report stop instruction to the voice reminding device, and the voice reminding device stops reporting the voice reminding information.
In S103, if the worker in the worker image wears the head-mounted safety control device, an operation video of the worker collected by the head-mounted safety control device is acquired.
In this embodiment, if an operator in an image of the operator wears the head-mounted safety control device, an operation video of the operator is shot by the front camera of the head-mounted safety control device, and the operation video is sent to the server in real time, where the front camera of the head-mounted safety control device may be a manually rotated camera or an intelligent camera that automatically captures a moving object closest to the head-mounted safety control device.
In S104, image recognition is performed on the operation video, and if it is recognized that the operation of the operator in the operation video is an irregular operation, a regular prompt message is generated and sent to the head-mounted safety control device.
In this embodiment, the server identifies some basic operation actions in the operation video, and if the operation actions are identified as irregular operations, sends the regular prompt information to the head-mounted security management and control device.
As can be seen from the above embodiments, in the embodiments of the present invention, firstly, an image of an operator in an operation area captured by a camera is obtained, and the image of the operator is subjected to image recognition, so as to determine whether the operator wears a head-mounted security management and control device; if the operator in the operator image does not wear the head-mounted safety control device, sending voice reminding information to a voice reminding device arranged in the operation area; if the operator in the operator image wears the head-mounted safety control device, acquiring an operation video of the operator, which is acquired by the head-mounted safety control device; and performing image recognition on the operation video, and if the operation of the operator in the operation video is recognized to be an irregular operation, generating and sending a standard prompt message to the head-mounted safety control device. According to the embodiment of the invention, the operation personnel wear the head-mounted safety control device to identify the operation action of the operation personnel, so that the operation personnel can be timely reminded when the operation of the operation personnel is not standard, serious electric power accidents are avoided, and the safety of the operation personnel and electric power equipment thereof is ensured.
As shown in fig. 2, in an embodiment of the present invention, fig. 2 shows a specific implementation flow of S104 in fig. 1, and the process thereof is detailed as follows:
in S201, an operation video sub-segment is obtained at a preset time interval, and a frame of image is sampled from the operation video sub-segment as a representative frame of the operation video sub-segment.
In this embodiment, the preset time interval may be 0.5s, and one section of the operation video sub-segment is obtained every 0.5s, and one frame in the operation video sub-segment is obtained as a representative frame of the operation video sub-segment.
In S202, the optical flows between the representative frame image and the adjacent frame images before and after the representative frame image are calculated to obtain the optical flow intensity image corresponding to the operation video sub-segment.
In the present embodiment, the optical flow refers to the velocity of mode motion in the time-varying image. Because when an object moves, the brightness pattern of its corresponding point on the image also moves, the optical flow has very important applications in target object segmentation, recognition, tracking, robot navigation, shape information recovery, and the like.
In this embodiment, in an operation video subsection, a representative frame image and a previous frame image and a next frame image adjacent to the representative frame image are acquired, and an inter-frame optical flow of the representative frame image and the previous frame image and an inter-frame optical flow of the representative frame image and the next frame image are calculated to obtain an optical flow intensity image of the operation video subsection. And acquiring the optical flow intensity image of each operation video sub-segment in the operation video according to the method.
In S203, a convolutional neural network feature of the operation video subsegment is obtained based on the representative frame image and the optical flow intensity image.
In this embodiment, an image convolution feature is obtained according to a representative frame image, an optical flow convolution feature is obtained according to an optical flow intensity image, the image feature and the optical flow convolution feature are fused, and a convolution neural network feature is obtained, where the convolution neural network feature is used to represent an operation action of each operation video sub-segment, and when the convolution neural network feature of each operation video sub-segment is obtained, an operation action set corresponding to an operation video is obtained.
In S204, convolutional neural network features corresponding to the multiple operation video subsections are obtained, and the convolutional neural network features corresponding to the multiple operation video subsections are input into the deep learning model to obtain an operation recognition result of the operation video.
In this embodiment, the deep learning model includes an LSTM (Long Short-Term Memory) neural network, and before identifying the operation video, the LSTM needs to be trained through a large number of operation motion samples. And then, performing action recognition on the convolutional neural network characteristics corresponding to the plurality of operation video subsections through the LSTM neural network to obtain an operation recognition result.
In S205, it is determined whether the operation of the operator is normative or not based on the operation recognition result and the preset normative operation information.
In S206, if the operation of the operator in the operation video is not standard, the non-standard operation of the operator in the operation video is determined, and corresponding standard prompt information is generated according to the non-standard operation and the preset standard operation information.
In S207, the specification prompt information is sent to the head-mounted safety control device of the worker, so that the head-mounted safety control device displays the specification prompt information.
In this embodiment, whether the operation action of the operator is normative or not is determined according to the comparison between the operation identification result and the operation action in the preset normative operation information. The operation identification result can be a motion identification result of a single operation video or a motion identification result of multiple operation videos.
For example: the safety operation regulation of the transformer substation records that the disconnecting link is not allowed to run with load, the disconnecting link can be pulled open after the oil switch is pulled open, and the disconnecting link is closed before the oil switch is closed during power transmission. If the operation personnel have the action trend of pulling open the switch when the oil switch is not pulled open, then can judge that the operation of operation personnel is the operation of not standardizing to wear safe management and control device and send "need pull open the oil switch before pulling open the switch" standard tip information, wear safe management and control device and broadcast standard tip information through voice broadcast's mode.
According to the embodiment, the actions in the operation video are identified through the deep learning model, whether the actions of the operating personnel are standard or not can be quickly identified, and prompt is carried out on irregular actions in time, so that the occurrence of electric power accidents is avoided, and the personal safety of the operating personnel is guaranteed.
In an embodiment of the present invention, the method for safely managing and controlling the operators in the substation further includes:
the method comprises the steps of obtaining a remote video request sent by a head-mounted safety control device of an operator, and sending the remote video request to terminal equipment of related workers, wherein the remote video request is used for indicating the terminal equipment of the related workers to carry out video communication with the head-mounted safety control device of the operator.
In an embodiment of the invention, if the on-site operator has problems during operation, the head-mounted safety management and control device can be used for sending a remote video request to the server, and the server sends the remote video request to the corresponding terminal equipment of the relevant operator, so that the relevant operator can remotely video the on-site operator, and the relevant operator can remotely guide the on-site operator to complete electric power operation.
As shown in fig. 3, fig. 3 shows another implementation flow of the method for managing and controlling the safety of the personnel in the substation provided by the embodiment of the present invention, and in addition to the above embodiment, the process further includes:
in S301, positioning information of the operator sent by the head-mounted safety control device is acquired, and whether the operator is in a dangerous area is determined according to pre-stored dangerous area information.
In S302, if the worker is in a dangerous area, the driving away warning information is generated and sent to the head-mounted safety control device, so that the head-mounted safety control device plays the driving away warning information in a voice manner.
In this embodiment, wear safety management and control device embeds GPS positioning chip, acquire the locating information of operation personnel in the transformer substation through high accuracy GPS positioning chip, and send locating information to the server, there are safe operation area and danger area according to the work ticket mark in the server, if operation personnel's locating information is in the danger area, then generate and drive away warning information to wear safety management and control device, it can be for "please leave the danger area immediately to drive away warning information, wear safety management and control device and remind the staff to leave the danger area as early as possible through reporting and driving away warning information, thereby operation personnel's personal safety has been protected.
As shown in fig. 4, fig. 4 shows another implementation flow of the method for managing and controlling the safety of the personnel in the substation provided by the embodiment of the present invention, and in addition to the above embodiment, the process further includes:
in S401, security operation query information sent by the head-mounted security management and control device is obtained, and corresponding security operation information is searched in the database according to the security operation query information.
In S402, the safety operation information is sent to the head-mounted safety control device, so that the head-mounted safety control device plays the safety operation information according to a preset rule.
In this embodiment, the head-mounted security control device further includes a voice input module, the worker inputs the security operation query information through the voice input module, and the head-mounted security control device extracts the keyword in the security operation query information, so as to search the corresponding security operation information in the database according to the keyword.
For example, before the power operation, the worker can inquire about the safety operation information related to the power operation through the head-mounted safety control device, and then perform the power operation after looking up the safety operation information, so that the safety operation awareness and the operation proficiency of the worker can be improved.
In one embodiment of the present invention, the preset rules include: broadcasting safety operation information through voice; and/or displaying the safe operation information in a projection mode.
In this embodiment, safe operation information can be reported with the form of pronunciation, also can come out through the projection module projection of wearing safe management and control device to can audio-visually look over safe operation information, optimize operation personnel's experience.
According to the above embodiment, the operation personnel can be timely through wearing the safety control device, the mistake of warning self operation, and simultaneously, when the operation personnel have a problem in the operation process, can look up information or long-range help through wearing the safety control device, thereby timely solution problem, for operation personnel's electric power operation provides convenience, safety supervisor can supervise a plurality of operation personnel operations simultaneously, the waste of talents has been reduced, operation personnel's personal safety and equipment safety have been guaranteed, make transformer substation's power equipment can the operation of safe efficient.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Example 2:
as shown in fig. 5, a device 100 for managing and controlling personnel safety in a substation, provided in an embodiment of the present invention, is configured to execute the method steps in the embodiment corresponding to fig. 1, where the method includes:
the operator image acquisition module 110 is configured to acquire an image of an operator in an operation area captured by the camera, perform image recognition on the image of the operator, and determine whether the operator in the image of the operator wears the head-mounted safety control device;
the voice reminding information sending module 120 is configured to send voice reminding information to a voice reminding device arranged in the operation area if the operator in the operator image does not wear the head-mounted safety control device, where the voice reminding information is used to instruct the voice reminding device to broadcast the voice reminding information;
an operation video acquiring module 130, configured to acquire an operation video of an operator, which is acquired by a head-mounted safety control device, if the operator in an operator image wears the head-mounted safety control device;
and the standard prompt information sending module 140 is configured to perform image recognition on the operation video, and if the operation of the operator in the operation video is recognized as an irregular operation, generate and send standard prompt information to the head-mounted safety control device.
As can be seen from the above embodiments, in the embodiments of the present invention, firstly, an image of an operator in an operation area captured by a camera is obtained, and the image of the operator is subjected to image recognition, so as to determine whether the operator wears a head-mounted security management and control device; if the operator in the operator image does not wear the head-mounted safety control device, sending voice reminding information to a voice reminding device arranged in the operation area; if the operator in the operator image wears the head-mounted safety control device, acquiring an operation video of the operator, which is acquired by the head-mounted safety control device; and performing image recognition on the operation video, and if the operation of the operator in the operation video is recognized to be an irregular operation, generating and sending a standard prompt message to the head-mounted safety control device. According to the embodiment of the invention, the operation personnel wear the head-mounted safety control device to identify the operation action of the operation personnel, so that the operation personnel can be timely reminded when the operation of the operation personnel is not standard, serious electric power accidents are avoided, and the safety of the operation personnel and electric power equipment thereof is ensured.
In an embodiment of the present invention, the operation video includes a plurality of operation video sub-segments, and the canonical prompt information sending module 140 in the embodiment corresponding to fig. 4 further includes a structure for executing the method steps in the embodiment corresponding to fig. 2, which includes:
the representative frame acquiring unit is used for acquiring the operation video subsections according to a preset time interval and sampling a frame image from the operation video subsections as a representative frame image of the operation video subsections;
the optical flow calculation unit is used for calculating optical flows between the representative frame image and the adjacent frame images before and after the representative frame image to obtain an optical flow intensity image corresponding to the operation video subsection;
the characteristic extraction unit is used for obtaining the convolutional neural network characteristics of the operation video subsections based on the representative frame images and the optical flow intensity images;
the recognition result acquisition unit is used for acquiring the convolutional neural network characteristics corresponding to the plurality of operation video subsections and inputting the convolutional neural network characteristics corresponding to the plurality of operation video subsections into the deep learning model to obtain operation recognition results of the operation videos;
the operation standard judging unit is used for judging whether the operation of the operator is standard or not according to the operation identification result and the preset standard operation information;
the standard prompt information generation unit is used for determining the non-standard operation of the operator in the operation video if the operation of the operator in the operation video is not standard, and generating corresponding standard prompt information according to the non-standard operation and preset standard operation information;
and the standard prompt information sending unit is used for sending the standard prompt information to the head-wearing safety control device of the operator so as to enable the head-wearing safety control device to display the standard prompt information.
According to the embodiment, the actions in the operation video are identified through the deep learning model, whether the actions of the operating personnel are standard or not can be quickly identified, and prompt is carried out on irregular actions in time, so that the occurrence of electric power accidents is avoided, and the personal safety of the operating personnel is guaranteed.
In an embodiment of the present invention, the personnel security management and control device 100 in the substation further includes:
and the remote video module is used for acquiring a remote video request sent by the head-mounted safety control device of the operator and sending the remote video request to the terminal equipment of the related worker, and the remote video request is used for indicating the terminal equipment of the related worker to carry out video communication with the head-mounted safety control device of the operator.
In an embodiment of the present invention, the personnel security management and control device 100 in the substation further includes a structure for executing the method steps in the embodiment corresponding to fig. 3, which includes:
the positioning information acquisition module is used for acquiring positioning information of the operating personnel sent by the head-mounted safety control device and judging whether the operating personnel are in a dangerous area or not according to prestored dangerous area information;
and the driving away warning information sending module is used for generating and sending driving away warning information to the head-wearing safety control device if the operating personnel are in a dangerous area, so that the head-wearing safety control device plays the driving away warning information in a voice mode.
In an embodiment of the present invention, the personnel security management and control device 100 in the substation further includes a structure for executing the method steps in the embodiment corresponding to fig. 4, which includes:
the query information acquisition module is used for acquiring the safety operation query information sent by the head-mounted safety control device and searching corresponding safety operation information in a database according to the safety operation query information;
and the safety operation information display module is used for sending the safety operation information to the head-mounted safety control device so that the head-mounted safety control device plays the safety operation information according to a preset rule.
In one embodiment of the present invention, the preset rules include: broadcasting safety operation information through voice; and/or displaying the safe operation information in a projection mode.
In one embodiment, the personnel security management and control 100 in the substation further includes other functional modules/units for implementing the method steps in the embodiments of embodiment 1.
Example 3:
fig. 6 is a schematic diagram of a server according to an embodiment of the present invention. As shown in fig. 6, the server 6 of this embodiment includes: a processor 60, a memory 61, and a computer program 62 stored in the memory 61 and executable on the processor 60. The processor 60, when executing the computer program 62, implements the steps in the various substation personnel safety control method embodiments described above, such as the steps 101 to 104 shown in fig. 1. Alternatively, the processor 60, when executing the computer program 62, implements the functions of the modules/units in the above-mentioned device embodiments, such as the functions of the modules 110 to 140 shown in fig. 5.
Illustratively, the computer program 62 may be partitioned into one or more modules/units that are stored in the memory 61 and executed by the processor 60 to implement the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 62 in the server 6.
The server 6 may be a local server, a cloud server, or a terminal device. The server may include, but is not limited to, a processor 60, a memory 61. Those skilled in the art will appreciate that fig. 6 is merely an example of a server 6 and does not constitute a limitation of the server 6, and may include more or fewer components than shown, or some components in combination, or different components, e.g., the server may also include input output devices, network access devices, buses, etc.
The Processor 60 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 61 may be an internal storage unit of the server 6, such as a hard disk or a memory of the server 6. The memory 61 may also be an external storage device of the server 6, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) and the like provided on the server 6. Further, the memory 61 may also include both an internal storage unit of the server 6 and an external storage device. The memory 61 is used for storing the computer program and other programs and data required by the server. The memory 61 may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. . Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (7)
1. A safety control method for personnel in a transformer substation is characterized by comprising the following steps:
acquiring an image of an operator in an operation area captured by a camera, performing image recognition on the image of the operator, and judging whether the operator in the image of the operator wears a head-mounted safety control device or not;
if the operator in the operator image does not wear the head-mounted safety control device, sending voice reminding information to a voice reminding device arranged in the operation area, wherein the voice reminding information is used for indicating the voice reminding device to broadcast the voice reminding information;
if the operating personnel in the operating personnel image wears the head-mounted safety control device, acquiring an operating video of the operating personnel, which is acquired by the head-mounted safety control device;
performing image recognition on the operation video, and if the operation of the operator in the operation video is recognized to be an irregular operation, generating and sending a regular prompt message to the head-mounted safety control device;
the method further comprises the following steps:
acquiring safety operation query information sent by a head-mounted safety control device, and searching corresponding safety operation information in a database according to the safety operation query information;
sending the safety operation information to the head-mounted safety control device so that the head-mounted safety control device plays the safety operation information according to a preset rule;
the acquiring safety operation query information sent by a head-mounted safety control device, and searching corresponding safety operation information in a database according to the safety operation query information, includes:
acquiring safety operation query information input by a user through a language input module;
extracting key words in the safety operation query information, and searching corresponding safety operation information in a database according to the key words;
the operation video comprises a plurality of operation video subsections, the image recognition is carried out on the operation video, if the operation of an operator in the operation video is recognized to be an irregular operation, a standard prompt message is generated and sent to the head-mounted safety control device, and the method comprises the following steps:
acquiring the operation video subsegment according to a preset time interval, and sampling a frame of image from the operation video subsegment as a representative frame image of the operation video subsegment;
calculating the optical flow between the representative frame image and the adjacent frame images before and after the representative frame image to obtain an optical flow intensity image corresponding to the operation video subsection;
obtaining the convolutional neural network characteristics of the operation video subsegments based on the representative frame images and the optical flow intensity images;
acquiring convolutional neural network characteristics corresponding to a plurality of operation video subsections, and inputting the convolutional neural network characteristics corresponding to the plurality of operation video subsections into a deep learning model to obtain an operation identification result of the operation video;
judging whether the operation of the operator is standard or not according to the operation identification result and preset standard operation information;
if the operation of the operator in the operation video is not standard, determining the non-standard operation of the operator in the operation video, and generating corresponding standard prompt information according to the non-standard operation and preset standard operation information;
and sending the standard prompt information to a head-wearing safety control device of the operator so as to enable the head-wearing safety control device to display the standard prompt information.
2. The method for managing and controlling personnel safety in a substation according to claim 1, further comprising:
the method comprises the steps of obtaining a remote video request sent by a head-mounted safety control device of an operator, and sending the remote video request to terminal equipment of related workers, wherein the remote video request is used for indicating the terminal equipment of the related workers and the head-mounted safety control device of the operator to carry out video communication.
3. The method for managing and controlling personnel safety in a substation according to claim 1, further comprising:
acquiring positioning information of the operating personnel sent by the head-mounted safety control device, and judging whether the operating personnel is in a dangerous area or not according to prestored dangerous area information;
if the operating personnel are in the dangerous area, driving away warning information is generated and sent to the head-mounted safety control device, so that the head-mounted safety control device plays the driving away warning information in a voice mode.
4. The method for managing and controlling personnel safety in a substation according to claim 1, wherein the preset rules comprise:
broadcasting the safety operation information through voice; and/or the presence of a gas in the gas,
and displaying the safety operation information in a projection mode.
5. The utility model provides a personnel's safety management and control device in transformer substation which characterized in that includes:
the image acquisition module of the operator is used for acquiring an image of the operator in an operation area captured by the camera, carrying out image recognition on the image of the operator and judging whether the operator wears the head-mounted safety control device in the image of the operator;
a voice reminding information sending module, configured to send voice reminding information to a voice reminding device arranged in the operation area if an operator in the operator image does not wear the head-mounted safety control device, where the voice reminding information is used to instruct the voice reminding device to broadcast the voice reminding information;
the operation video acquisition module is used for acquiring the operation video of the operator, which is acquired by the head-mounted safety control device, if the head-mounted safety control device is worn by the operator in the operator image;
the standard prompt information sending module is used for carrying out image recognition on the operation video, and if the operation of the operator in the operation video is recognized to be non-standard operation, generating and sending standard prompt information to the head-mounted safety control device;
the device further comprises:
the query information acquisition module is used for acquiring the safety operation query information sent by the head-mounted safety control device and searching corresponding safety operation information in a database according to the safety operation query information;
the safety operation information display module is used for sending safety operation information to the head-mounted safety control device so that the head-mounted safety control device plays the safety operation information according to a preset rule;
the query information acquisition module specifically includes:
acquiring safety operation query information input by a user through a language input module;
extracting key words in the safety operation query information, and searching corresponding safety operation information in a database according to the key words;
the operation video comprises a plurality of operation video subsections, and the canonical prompt information sending module comprises:
the representative frame acquiring unit is used for acquiring the operation video subsegment according to a preset time interval and sampling a frame image from the operation video subsegment as a representative frame image of the operation video subsegment;
the optical flow calculating unit is used for calculating the optical flows between the representative frame image and the adjacent frame images before and after the representative frame image to obtain an optical flow intensity image corresponding to the operation video subsection;
the characteristic extraction unit is used for obtaining the convolutional neural network characteristics of the operation video subsegments based on the representative frame images and the optical flow intensity images;
the recognition result obtaining unit is used for obtaining convolutional neural network characteristics corresponding to a plurality of operation video subsections, and inputting the convolutional neural network characteristics corresponding to the plurality of operation video subsections into a deep learning model to obtain operation recognition results of the operation videos;
an operation specification judging unit, configured to judge whether the operation of the operator is normal according to the operation identification result and preset specification operation information;
the standard prompt information generation unit is used for determining the non-standard operation of the operator in the operation video if the operation of the operator in the operation video is not standard, and generating corresponding standard prompt information according to the non-standard operation and preset standard operation information;
and the standard prompt information sending unit is used for sending the standard prompt information to the head-wearing safety control device of the operator so as to enable the head-wearing safety control device to display the standard prompt information.
6. A server comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the steps of the method according to any of claims 1 to 4 are implemented when the computer program is executed by the processor.
7. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810982585.XA CN109271881B (en) | 2018-08-27 | 2018-08-27 | Safety management and control method and device for personnel in transformer substation and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810982585.XA CN109271881B (en) | 2018-08-27 | 2018-08-27 | Safety management and control method and device for personnel in transformer substation and server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109271881A CN109271881A (en) | 2019-01-25 |
| CN109271881B true CN109271881B (en) | 2021-12-14 |
Family
ID=65154285
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810982585.XA Active CN109271881B (en) | 2018-08-27 | 2018-08-27 | Safety management and control method and device for personnel in transformer substation and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109271881B (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109919505A (en) * | 2019-03-14 | 2019-06-21 | 上海达慧智能科技有限公司 | A kind of mode of operation judgment method, device, system, equipment and storage medium |
| CN109978756B (en) | 2019-03-18 | 2021-03-09 | 腾讯科技（深圳）有限公司 | Target detection method, system, device, storage medium and computer equipment |
| CN110188648A (en) * | 2019-05-23 | 2019-08-30 | 国家电网有限公司 | Anti- based on image is strayed into partitioning method, device and terminal device |
| CN110458108B (en) * | 2019-08-13 | 2023-02-21 | 固安跃盛自动化设备有限公司 | Manual operation real-time monitoring method, system, terminal equipment and storage medium |
| CN112584094A (en) * | 2020-11-23 | 2021-03-30 | 国网浙江省电力有限公司临海市供电公司 | Transformer substation safety supervision system based on intelligent sensing |
| CN113128349A (en) * | 2021-03-25 | 2021-07-16 | 国网江西省电力有限公司上饶供电分公司 | Intelligent control system for preventing and controlling animals in transformer substation |
| CN113065524A (en) * | 2021-04-26 | 2021-07-02 | 深圳市商汤科技有限公司 | Intelligent workbench management system, intelligent workbench, method, device and medium |
| CN113469378B (en) * | 2021-05-31 | 2023-11-24 | 烟台杰瑞石油服务集团股份有限公司 | Maintenance method and maintenance equipment |
| CN113361968B (en) * | 2021-07-05 | 2023-01-20 | 广东电网有限责任公司佛山供电局 | Power grid infrastructure worker safety risk assessment method based on artificial intelligence and big data |
| CN114493332A (en) * | 2022-02-11 | 2022-05-13 | 内蒙古中科装备有限公司 | Hydrogen supply safety control method and device, computer equipment and storage medium |
| CN116796030B (en) * | 2023-08-24 | 2023-11-21 | 北京龙德缘电力科技发展有限公司 | System for normative action flow broadcasting and voice interaction in work ticket |
| CN117893953B (en) * | 2024-03-15 | 2024-06-14 | 四川深蓝鸟科技有限公司 | Soft digestive tract endoscope operation standard action evaluation method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107041590A (en) * | 2017-01-09 | 2017-08-15 | 彭亮 | A kind of intelligent and safe donning system |
| CN107632565A (en) * | 2017-08-28 | 2018-01-26 | 上海欧忆能源科技有限公司 | Power construction building site intellectualized management system and method |
| CN108174165A (en) * | 2018-01-17 | 2018-06-15 | 重庆览辉信息技术有限公司 | Electric power safety operation and O＆M intelligent monitoring system and method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4789511B2 (en) * | 2004-06-04 | 2011-10-12 | キヤノン株式会社 | Status monitoring device and status monitoring system |
| TW200921446A (en) * | 2007-11-01 | 2009-05-16 | Zhong-Yi Li | A wear-type device for environmental surveillance, provision of data inquiry and expert instruction |
-
2018
- 2018-08-27 CN CN201810982585.XA patent/CN109271881B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107041590A (en) * | 2017-01-09 | 2017-08-15 | 彭亮 | A kind of intelligent and safe donning system |
| CN107632565A (en) * | 2017-08-28 | 2018-01-26 | 上海欧忆能源科技有限公司 | Power construction building site intellectualized management system and method |
| CN108174165A (en) * | 2018-01-17 | 2018-06-15 | 重庆览辉信息技术有限公司 | Electric power safety operation and O＆M intelligent monitoring system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109271881A (en) | 2019-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109271881B (en) | Safety management and control method and device for personnel in transformer substation and server | |
| CN109271872B (en) | Device and method for judging on-off state and diagnosing fault of high-voltage isolating switch | |
| CN107181319B (en) | Intelligent inspection method for state of hard pressing plate of transformer substation | |
| CN110428069B (en) | Intelligent management method, system, equipment and medium for electric power tools and appliances | |
| CN106341661B (en) | Patrol robot | |
| CN100485558C (en) | Electrical power system safety operation intelligent monitoring device and monitoring method thereof | |
| CN108515991B (en) | Receiving and dispatching train standardized operation detecting system | |
| CN101789160B (en) | Spacing false-entering prevention system for intelligent video transformer substation | |
| CN111080260A (en) | Wisdom building site management platform | |
| CN112749813B (en) | Data processing system, method, electronic equipment and storage medium | |
| CN110889339A (en) | Head and shoulder detection-based dangerous area grading early warning method and system | |
| CN110874866B (en) | Video-based three-dimensional monitoring method and system for transformer substation | |
| CN110543866A (en) | Safety management system and method for capital construction engineering constructors | |
| CN110956652A (en) | Early warning method for transformer substation personnel crossing line | |
| CN112437255A (en) | Intelligent video monitoring system and method for nuclear power plant | |
| CN112949457A (en) | Maintenance method, device and system based on augmented reality technology | |
| CN115567690A (en) | Intelligent monitoring system capable of automatically identifying dangerous points of field operation | |
| CN115457449A (en) | Early warning system based on AI video analysis and monitoring security protection | |
| CN111652128B (en) | High-altitude power operation safety monitoring method, system and storage device | |
| CN113887310A (en) | Worker standard dressing identification method, system and medium | |
| CN112822440A (en) | Biological sample preparation monitoring method, application server, system and storage medium | |
| CN116258992A (en) | Operation detection method and system | |
| CN110751125A (en) | Wearing detection method and device | |
| CN114997582A (en) | Early warning method and system for distribution network operation risk and computer equipment | |
| CN115860979A (en) | Artificial intelligence management system for field operation of power grid |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |