CN117522351B - Locking and listing method and system based on data analysis - Google Patents
Locking and listing method and system based on data analysis Download PDFInfo
- Publication number
- CN117522351B CN117522351B CN202410016465.XA CN202410016465A CN117522351B CN 117522351 B CN117522351 B CN 117522351B CN 202410016465 A CN202410016465 A CN 202410016465A CN 117522351 B CN117522351 B CN 117522351B
- Authority
- CN
- China
- Prior art keywords
- intelligent lock
- equipment
- maintained
- locking
- lock sleeve
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000007405 data analysis Methods 0.000 title claims abstract description 24
- 230000033001 locomotion Effects 0.000 claims abstract description 26
- 230000011218 segmentation Effects 0.000 claims description 25
- 238000004891 communication Methods 0.000 claims description 17
- 239000000463 material Substances 0.000 claims description 16
- 238000001514 detection method Methods 0.000 claims description 13
- 239000000126 substance Substances 0.000 claims description 12
- 230000004044 response Effects 0.000 claims description 11
- 230000002378 acidificating effect Effects 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 9
- 230000007613 environmental effect Effects 0.000 claims description 8
- 238000012423 maintenance Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 abstract description 16
- 238000012800 visualization Methods 0.000 abstract description 4
- 238000004519 manufacturing process Methods 0.000 description 12
- 239000002253 acid Substances 0.000 description 4
- 230000008859 change Effects 0.000 description 2
- 230000006378 damage Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 238000004886 process control Methods 0.000 description 2
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 239000004063 acid-resistant material Substances 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000008033 biological extinction Effects 0.000 description 1
- 230000007797 corrosion Effects 0.000 description 1
- 238000005260 corrosion Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Abstract
The invention relates to the technical field of equipment safety. In particular to a locking and listing method and a system based on data analysis. The method comprises the following steps: acquiring images of areas near equipment to be maintained in real time; dividing the acquired image into a face area of a worker, a movement area of a movement part of equipment and a power indicator area of the equipment to be maintained; identifying the identity of a worker, and judging whether the movement part of the equipment to be maintained runs or not and whether the power indicator is extinguished or not; performing character recognition on the image of the area to be registered, obtaining the shape and the size of the energy point, and judging whether the intelligent lock sleeve and the intelligent lock are installed on the energy point within a second preset time length; identifying whether an operator uses the mobile terminal to scan the RFID chip; judging whether the intelligent lock sleeve and the intelligent lock are selected correctly. The method can realize the digitization and visualization of the whole process of locking and hanging the cards, thereby greatly improving the operation standardization in the process of locking and hanging the cards.
Description
Technical Field
The present invention relates generally to the field of device security technology. More particularly, the invention relates to a locking and listing method and system based on data analysis.
Background
The industrial manufacturing enterprises need to execute LOTO operation (LOCK OUT/TAG OUT) of the energy points in the production line maintenance process, so as to prompt related personnel that the energy points are temporarily unavailable. In general, the number of electromechanical devices in an enterprise is large, the energy points of different devices are different, each energy point needs to be fixed by an adaptive lock, and each lock needs to be fixed by a lock matched with the energy point, so that workers can easily use wrong locks or locks, or the locks are wrongly and fixedly arranged at the energy points which do not need to be locked and hung; in addition, if the staff does not lock the equipment for a prescribed period of time, security accidents are likely to occur. The existing locking and listing method cannot monitor whether the locking and listing state is executed correctly in real time. If the operator does not execute or execute the operation according to the specified action, for example, the locks installed on the energy points are not matched, the energy points may not be completely closed, and thus the production line may not be capable of quickly recovering production, and even personnel safety accidents may occur.
Disclosure of Invention
In order to solve one or more of the technical problems, the invention provides a method for monitoring the whole process of locking and hanging cards by collecting the video of the locking and hanging card field and automatically identifying the video. To this end, the present invention provides solutions in various aspects as follows.
In a first aspect, the present invention provides a method for locking and hanging a card based on data analysis, comprising: acquiring images of areas near equipment to be maintained in real time; dividing the acquired image into a face area of a worker, a movement area of a movement part of equipment and a power indicator area of the equipment to be maintained; the face area of the staff is subjected to face recognition, the identity of the staff is identified, whether the staff has operation authority is judged, and the movement foreground is detected on the movement area, so that whether the movement part of the equipment to be maintained operates within a first preset time period is judged; identifying the image of the power indicator lamp area by using a YOLO model, so as to judge whether the power indicator lamp of the equipment to be maintained is extinguished within a first preset time period; responding to no operation authority of an operator or the fact that the equipment to be maintained is not stopped in a first preset time period or the power supply of the equipment to be maintained is not closed in the first preset time period, alarming, and sending illegal operation information to a management platform; in response to the fact that an operator has operation authority, the equipment to be maintained stops running and the power supply of the equipment to be maintained is closed, dividing the acquired image into an area to be registered and an energy point area, performing character recognition on the image of the area to be registered by adopting an OCR model, judging whether a warning board is hung in the area to be registered within a second preset time period, recognizing the image of the energy point area by adopting a YOLO model, acquiring the shape and the size of the energy point, and judging whether an intelligent lock sleeve and an intelligent lock are installed on the energy point within the second preset time period; identifying the acquired image in response to the fact that the warning sign is hung in the area to be marked within the second preset time period and the intelligent lock sleeve and the intelligent lock are installed on the energy point, judging whether an operator scans an RFID chip of the intelligent lock sleeve and an RFID chip of the intelligent lock by using the mobile terminal within the third preset time period, and acquiring environmental information of a workshop where equipment to be maintained is located, wherein the environmental information comprises whether acidic substances exist in the air; the mobile terminal is internally provided with a card reader, and the RFID chip of the intelligent lock sleeve and the RFID chip of the intelligent lock can be read, so that identity information of the intelligent lock sleeve and the intelligent lock can be obtained; the identity information is used for representing the shape, the size and the material of the intelligent lock sleeve or the intelligent lock; responding to the fact that an operator uses a mobile terminal to scan an RFID chip of the intelligent lock sleeve and an RFID chip of the intelligent lock, and judging whether the intelligent lock sleeve and the intelligent lock are selected correctly or not according to the concentration information of acidic substances in the air near equipment to be maintained, the shape and the size of energy points and the identity information of the intelligent lock sleeve and the intelligent lock; and responding to incorrect selection of the intelligent lock sleeve or the intelligent lock, alarming, prompting the locking and listing personnel to select an error, and sending illegal operation information to the management platform.
In one embodiment, further comprising: in response to the intelligent lock sleeve or the intelligent lock being selected correctly, identifying the acquired image by adopting a YOLO model within a third preset time period, and judging whether a safety warning belt or a safety guardrail is arranged near the equipment to be maintained; and responding to the condition that no safety warning belt and no safety guardrail are arranged near the equipment to be maintained within the third preset time period, alarming, prompting the locking and listing personnel to perform corresponding operation, and sending illegal operation information to the management platform.
In one embodiment, further comprising: under the condition that an energy point of equipment to be maintained is an air switch and an intelligent lock sleeve is installed on the energy point, identifying an intelligent lock sleeve and an insulating handle of the air switch in an acquired image by adopting a convex hull detection algorithm, projecting the intelligent lock sleeve and the insulating handle to a two-dimensional plane, and judging whether the projected length direction of the insulating handle is perpendicular to the projected length direction of the intelligent lock sleeve; and responding to the fact that the projected length direction of the insulating handle and the projected length direction of the intelligent lock sleeve are not perpendicular to each other, alarming to remind the locking and listing personnel.
In one embodiment, further comprising: under the condition that the equipment to be maintained is maintained, performing foreground detection on the area near the equipment to be maintained, and judging whether staff unlock the energy points within a fourth preset time period; in response to the fact that the staff unlock the energy points within the fourth preset time period, face recognition is conducted on the acquired images, and whether the unlocking staff and the locking staff are the same is judged; and responding to the fact that the unlocking person and the locking person are not the same person, alarming, and sending illegal operation information to the management platform.
In one embodiment, a method for segmentation processing of an acquired image includes: extracting features of the image; selecting a target segmentation algorithm corresponding to the image, and performing rough segmentation on the image by adopting the target segmentation algorithm to obtain a first segmentation result; and carrying out fine segmentation on the first segmentation result to obtain each target region in the picture.
In one embodiment, the foreground detection comprises: setting a threshold value and an updating rate used in background updating; taking the acquired first frame image as a background model, separating three channels of each frame image, and respectively acquiring a foreground image of each channel; and calculating the foreground map of each channel to obtain a final foreground map.
In a second aspect, the invention provides a locking and branding system, which comprises an image acquisition device, a plurality of intelligent lock sleeves, a plurality of intelligent locks, an intelligent branding device, a plurality of energy point positioning accessories and a mobile terminal, wherein the image acquisition device is used for acquiring images of areas nearby equipment to be maintained, the plurality of intelligent lock sleeves are respectively used for fixing energy points of different equipment, the plurality of intelligent locks are respectively used for fixing the intelligent lock sleeves, the intelligent branding device is used for hanging the energy points of the equipment to be locked and branded, and the plurality of energy point positioning accessories are respectively used for being installed at the energy points of the equipment to position the energy points; the mobile terminal is used for executing the locking and listing method based on data analysis; the intelligent lock sleeve, the intelligent lock and the energy point positioning accessories comprise information transmission units for transmitting the identity information and the working state information of the intelligent lock sleeve and the intelligent lock to the mobile terminal; the identity information is used for representing the model or specification of the corresponding component, and the working state information is used for representing whether the corresponding component is installed and used.
The information transmission unit comprises an RFID chip, an IO module, a communication module, a power supply and an IO module triggering device for changing the signal state of an IO module pin, wherein the RFID chip is used for representing the identity information of the part where the RFID chip is located, different signal states of the IO module pin are used for representing different working states of the part where the IO module pin is located, the power supply is used for supplying power to the RFID chip, the IO module and the communication module, the communication module is electrically connected with the signal output end of the IO module, and the signal state of the IO module pin can be transmitted to the mobile terminal in real time through the communication module.
The intelligent lock sleeve, the intelligent lock and the energy point positioning fittings comprise a shell and an inner cavity, wherein an RFID chip, an IO module, a communication module and a power supply of the information transmission unit are arranged inside the inner cavity, and an IO module triggering device is arranged outside the shell so as to be convenient for operation and maintenance personnel to operate.
The invention has the technical effects that: the locking and listing method based on data analysis is adopted to carry out locking and listing operation, video of the locking and listing process is collected and divided for a plurality of times, identification is carried out after each image division, alarming is carried out when the locking and listing operation is identified to be unqualified, and illegal operation information is sent to a management platform, so that the digitization, visualization and automatic detection of whether the locking and listing operation is qualified or not in the whole locking and listing process are realized; according to the acquired identity information of the intelligent lock and the intelligent lock sleeve and the environmental information, whether the intelligent lock and the intelligent lock sleeve are selected correctly or not is automatically judged, so that the operation normalization in the locking and listing process is further improved; the locking and listing method based on data analysis can reduce the overall operation cost of industrial manufacturing enterprises and ensure the safety of enterprise workshops. In addition, through the image to gathering discernment, realize locking the automatic control of hanging the card overall process, need not artifical the participation to the degree of automation of locking the card process control has been improved.
By adopting the locking and listing system to lock and listing the energy points, the digitization and visualization of the whole locking and listing process can be realized, so that the operation standardization in the locking and listing process is greatly improved, and the overall operation cost of industrial manufacturing enterprises is reduced.
Drawings
The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present invention will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. In the drawings, embodiments of the invention are illustrated by way of example and not by way of limitation, and like reference numerals refer to similar or corresponding parts and in which:
FIG. 1 is a flow chart diagram that schematically illustrates a method for locking up a card based on data analysis, in accordance with an embodiment of the present invention;
FIG. 2 is a flow chart II schematically illustrating a data analysis based locking and listing method according to an embodiment of the present invention;
FIG. 3 is a flowchart III schematically illustrating a data analysis based locking and hanging method according to an embodiment of the present invention;
FIG. 4 is a flow chart four schematically illustrating a data analysis based locking and listing method according to an embodiment of the present invention;
fig. 5 is a flowchart schematically illustrating an image segmentation method according to an embodiment of the present invention;
FIG. 6 is a flow chart schematically illustrating a background detection method of an embodiment of the present invention;
fig. 7 is a schematic structural view schematically showing an intelligent lock case according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.
Locking and listing method embodiment based on data analysis:
as shown in fig. 1, the locking and listing method based on data analysis of the present invention includes:
s101, acquiring images of areas near equipment to be maintained in real time.
The camera can be arranged near the equipment to be maintained to collect images of the area near the equipment to be maintained, and the camera is in communication connection with the mobile terminal and sends the images collected in real time to the mobile terminal. The position of the camera is required to ensure that the energy points, the moving parts, the power indicator light areas and the areas nearby the equipment to be maintained can be shot.
S102, performing primary segmentation on the acquired image; the acquired image is divided into a face area of a worker, a movement area of a movement part of equipment and a power indicator area of the equipment to be maintained.
The image is segmented before the image is identified, and each segmented region is identified by a corresponding algorithm model, so that the image identification efficiency is greatly improved.
The image may be segmented using a threshold-based segmentation method, a region-based segmentation method, an edge-based segmentation method, a mathematical model-based method, or a physical model-based method, etc. The acquired image is divided into a plurality of areas so as to identify each area by adopting different models, thereby improving the identification efficiency.
S103, performing primary recognition on the image after primary segmentation; the face area of the staff is subjected to face recognition, the identity of the staff is identified, whether the staff has operation authority is judged, and the movement foreground is detected on the movement area, so that whether the movement part of the equipment to be maintained operates within a first preset time period is judged; and identifying the image of the power indicator lamp area by adopting a YOLO model, so as to judge whether the power indicator lamp of the equipment to be maintained is extinguished within a first preset time length.
In general, in order to ensure production safety, the locking and listing operation of the equipment to be maintained can only be performed by appointed people, and whether the equipment to be maintained has operation authority is judged by identifying the identity of staff, so that irrelevant staff can be prevented from operating the equipment to be maintained.
In general, for the equipment to be maintained, when locking and hanging the equipment, the energy source point of the equipment needs to be ensured to be in a closed state. If the movement part of the equipment to be maintained does not run, the movement part of the equipment to be maintained is indicated to have a fault or the energy point is closed, and if the power indicator lamp of the equipment to be maintained is extinguished, the power of the equipment to be maintained is indicated to be disconnected or the power indicator lamp is indicated to have a fault; the energy point of the equipment to be maintained is ensured to be in a closed state only under the condition that the movement part of the equipment to be maintained does not act and the power indicator lamp is in an off state; therefore, by combining the judging result of whether the movement part of the equipment to be maintained acts and whether the power indicator is extinguished, whether the energy point of the equipment to be maintained is closed can be accurately judged.
S104, performing second segmentation and second recognition on the acquired image; responding to no operation authority of an operator or no stop of the movement part of the equipment to be maintained in a first preset time period or no extinction of a power supply indicator lamp of the equipment to be maintained in the first preset time period, alarming, and sending illegal operation information to a management platform; responding to the situation that an operator has operation authority, the movement part of the equipment to be maintained stops running, the power indicator of the equipment to be maintained is turned off, dividing the acquired image into an area to be hung and an energy point area, and performing character recognition on the image of the area to be hung by adopting an OCR model, so as to judge whether a warning sign is hung in the area to be hung within a second preset time period; and identifying the image of the energy point area by adopting a YOLO model, obtaining the shape and the size of the energy point, and judging whether the intelligent lock sleeve and the intelligent lock are installed on the energy point within a second preset time length.
The warning board hung at the energy point is generally written with words such as danger, forbidden operation and the like, and whether the warning board is hung or not can be accurately judged by adopting an OCR model to carry out word recognition on the region to be hung. The shape and the size of the energy points are obtained, so that whether the intelligent lock sleeve and the intelligent lock sleeve selected by an operator are suitable or not can be judged according to the shape and the size of the energy points.
The on-site staff can be reminded through the alarm, and irregular locking hanging cards can be corrected in time.
S105, carrying out third identification on the image and acquiring environment information; identifying the acquired image in response to the fact that the warning sign is hung in the area to be marked within the second preset time period and the intelligent lock sleeve and the intelligent lock are installed on the energy point, judging whether an operator scans an RFID chip of the intelligent lock sleeve and an RFID chip of the intelligent lock by using the mobile terminal within the third preset time period, and acquiring environmental information of a workshop where equipment to be maintained is located, wherein the environmental information comprises whether acidic substances exist in the air; the mobile terminal is internally provided with a card reader, and the RFID chip of the intelligent lock sleeve and the RFID chip of the intelligent lock can be read, so that identity information of the intelligent lock sleeve and the intelligent lock can be obtained; the identity information is used for representing the shape, the size and the material of the intelligent lock sleeve or the intelligent lock.
Whether the acid substance exists in the workshop air can be judged according to the type of the produced product, for example, if the product produced in the production workshop is a chemical product, the acid chemical substance is needed to be used in the production process of the product, and certain acid substance molecules exist in the air of the workshop where the equipment to be maintained is located.
The intelligent lock sleeve and the intelligent lock are respectively provided with an RFID chip, and model information, shape information, size information and material information of the intelligent lock sleeve or the intelligent lock are stored in the RFID chips. The identity information of the intelligent lock sleeve and the intelligent lock is read, so that whether the intelligent lock sleeve and the intelligent lock are proper or not can be judged.
S106, judging whether the intelligent lock sleeve and the intelligent lock are selected correctly; responding to the fact that an operator uses a mobile terminal to scan an RFID chip of the intelligent lock sleeve and an RFID chip of the intelligent lock, and judging whether the intelligent lock sleeve and the intelligent lock are selected correctly or not according to the concentration information of acidic substances in the air near equipment to be maintained, the shape and the size of energy points and the identity information of the intelligent lock sleeve and the intelligent lock; and responding to incorrect selection of the intelligent lock sleeve or the intelligent lock, alarming, prompting the locking and listing personnel to select an error, and sending illegal operation information to the management platform.
For example: the intelligent lock sleeve is provided with two types of shapes, namely A1 and A2, two types of sizes, namely B1 and B2, two types of materials, namely X material and Y material, wherein the X material is acid-resistant material, the shape of the intelligent lock sleeve matched with an energy point is A1, the size of the intelligent lock sleeve is B2, acidic substances exist in the air near the equipment to be maintained, and the intelligent lock sleeve made of the X material is selected; only when the operator selects the intelligent lock sleeve with the shape of A1, the size of B2 and the material of X, the intelligent lock sleeve is judged to be correctly selected.
Because the equipment energy points in the production workshop are more, different energy points have different shapes and sizes, and the intelligent lock sleeves with different shapes and sizes are needed to be used for fixing, in addition, in different workshop environments, different requirements are made on the materials of the intelligent lock sleeves, for example, in an acidic environment, the materials of the lock sleeves are required to be acid-resistant and corrosion-resistant. Therefore, the locking and hanging device comprises a plurality of intelligent lock sleeves with different shapes, materials and sizes. An intelligent lock is locked to intelligent lock cover adaptation, and different intelligent lock covers need be fixed it by different intelligent locks, therefore include the multiple type intelligent lock that shape and size are different in the device of hanging up the lock. The locking and hanging personnel can easily select the wrong intelligent lock or intelligent lock sleeve when executing the locking and hanging operation, and once the intelligent lock or intelligent lock sleeve is selected wrong, the equipment to be maintained can be damaged or the locking and hanging device can be damaged, and whether the intelligent lock sleeve and the intelligent lock are selected correctly or not can be automatically judged, so that the locking and hanging operation can be corrected in time.
In the acidic environment, if select intelligent lock sleeve or intelligent lock of ordinary material, intelligent lock sleeve or intelligent lock can be corroded, leads to the energy point to become the unblock state by locking state, and other personnel can open this energy point by mistake, through reporting to the police under the wrong condition of material selection, can remind operating personnel to select intelligent lock sleeve or intelligent lock of suitable material again to avoid waiting to repair equipment to lock and hang up during the damage appears in intelligent lock sleeve or intelligent lock.
If the selected intelligent lock sleeve is not matched with the energy source point, the intelligent lock sleeve is forcibly installed at the energy source point, the intelligent lock sleeve or the energy source point can be possibly damaged, and similarly, if the selected intelligent lock and the intelligent lock sleeve are not matched, the intelligent lock is forcibly installed on the intelligent lock sleeve, the intelligent lock sleeve or the intelligent lock can be possibly damaged, and an operator can be reminded to reselect the intelligent lock sleeve or the intelligent lock with proper shape and size by alarming under the condition that the shape and the size of the intelligent lock sleeve or the intelligent lock are selected incorrectly.
In this embodiment, whether the intelligent lock sleeve and the intelligent lock are selected correctly is determined according to the concentration information of acidic substances in the air near the equipment to be maintained and the shape and the size of the energy points, in other embodiments, the pairing information between the intelligent lock sleeve and the equipment energy points can be preset in advance in the mobile terminal, and whether the intelligent lock sleeve is selected correctly can be determined according to the acquired identity information of the intelligent lock and the pairing information between the preset intelligent lock sleeve and the equipment energy points; the mobile terminal can also store pairing information between the intelligent lock and the intelligent lock sleeve in advance, and whether the intelligent lock is selected correctly can be judged according to the acquired identity information of the intelligent lock and the acquired identity information of the intelligent lock sleeve and the preset pairing information between the intelligent lock and the intelligent lock sleeve.
The locking and listing method based on data analysis is adopted to carry out locking and listing operation, video of the locking and listing process is collected and divided for a plurality of times, identification is carried out after each image division, alarming is carried out when the locking and listing operation is identified to be unqualified, and illegal operation information is sent to a management platform, so that the digitization, visualization and automatic detection of whether the locking and listing operation is qualified or not in the whole locking and listing process are realized; according to the acquired identity information of the intelligent lock and the intelligent lock sleeve and the environmental information, whether the intelligent lock and the intelligent lock sleeve are selected correctly or not is automatically judged, so that the operation normalization in the locking and listing process is further improved; the locking and listing method based on data analysis can reduce the overall operation cost of industrial manufacturing enterprises and ensure the safety of enterprise workshops. In addition, through the image to gathering discernment, realize locking the automatic control of hanging the card overall process, need not artifical the participation to the degree of automation of locking the card process control has been improved.
In order to prevent the equipment to be maintained from being started by people to cause personal injury, a safety warning belt or a safety guardrail can be arranged near the equipment to be maintained; thus, as shown in FIG. 2, in one embodiment, further comprises:
and S201, responding to the fact that the intelligent lock sleeve or the intelligent lock is selected correctly, identifying the acquired image by adopting a YOLO model within a third preset time period, and judging whether a safety warning belt or a safety guardrail is arranged near the equipment to be maintained.
S202, responding to the fact that no safety warning belt and no safety guardrail are arranged near the equipment to be maintained within a third preset time period, alarming, prompting locking and listing personnel to perform corresponding operation, and sending illegal operation information to a management platform.
If the energy source point of the device to be maintained is an air switch, the length direction of the intelligent lock sleeve needs to be perpendicular to the insulating handle of the air switch to ensure that the air switch is locked in place, so as shown in fig. 3, in one embodiment, the device further comprises:
s301, judging whether the length direction of the intelligent lock sleeve is mutually perpendicular to an insulating handle of the air switch; under the condition that the energy point of the equipment to be maintained is an air switch and an intelligent lock sleeve is installed on the energy point, a convex hull detection algorithm is adopted to identify the intelligent lock sleeve and an insulating handle of the air switch in the acquired image, the intelligent lock sleeve and the insulating handle are projected to a two-dimensional plane, and whether the projected length direction of the insulating handle is perpendicular to the projected length direction of the intelligent lock sleeve is judged.
S302, alarming to remind a locking and listing person; and responding to the fact that the projected length direction of the insulating handle and the projected length direction of the intelligent lock sleeve are not perpendicular to each other, alarming to remind the locking and listing personnel.
The projected length direction of the insulating handle is perpendicular to the projected length direction of the intelligent lock sleeve, so that the intelligent lock sleeve is mounted in place. If the intelligent lock sleeve is not installed in place, the intelligent lock sleeve can fall off from the insulating handle of the air switch, so that the air switch is in an unlocking state.
After the device is serviced, the same locking and hanging personnel is typically required to remove the locking and hanging device for a predetermined period of time, and thus, as shown in FIG. 4, in one embodiment, further comprises:
s401, performing foreground detection on the area near the equipment to be maintained under the condition that the equipment to be maintained is maintained, and judging whether a worker unlocks an energy point within a fourth preset time period.
S402, in response to the fact that the staff unlock the energy points within the fourth preset time period, face recognition is conducted on the acquired images, and whether the unlocking staff and the locking staff are the same is judged.
S403, alarming in response to the fact that the unlocking person and the locking person are not the same person, and sending illegal operation information to the management platform.
As can be seen from the above embodiments, when the acquired image is identified, the acquired image needs to be divided into a plurality of areas, and each area is identified by a corresponding algorithm model, as shown in fig. 5, in one embodiment, the dividing the acquired image includes:
s501, extracting features of the image.
S502, selecting a target segmentation algorithm corresponding to the image, and performing rough segmentation on the image by adopting the target segmentation algorithm to obtain a first segmentation result.
S503, performing fine segmentation on the first segmentation result to obtain each target region in the picture.
As can be seen from the above embodiments, determining whether the equipment to be repaired is operated within a preset period of time requires performing motion foreground detection on the motion area, as shown in fig. 6, in one embodiment, the foreground detection includes:
s601, setting a threshold value and an updating rate used in background updating.
S602, taking the acquired first frame image as a background model, separating three channels of each frame image, and respectively acquiring a foreground image of each channel.
S603, calculating the foreground map of each channel to obtain a final foreground map.
Locked-up card hanging system embodiment:
in order to realize the locking and listing method based on data analysis in the embodiment, the invention also provides a locking and listing system, which comprises an image acquisition device, a plurality of intelligent lock sleeves, a plurality of intelligent locks, an intelligent listing, a plurality of energy point positioning accessories and a mobile terminal, wherein the image acquisition device is used for acquiring images of areas nearby equipment to be maintained, the plurality of intelligent lock sleeves are respectively used for fixing energy points of different equipment, the plurality of intelligent locks are respectively used for fixing the intelligent lock sleeves, the intelligent listing is used for hanging on the energy points of the equipment needing to be locked and listing, and the plurality of energy point positioning accessories are respectively used for being installed on the energy points of the equipment to position the energy points; wherein the mobile terminal is configured to perform the steps of the locking and branding method based on data analysis in the above embodiments; the intelligent lock sleeve, the intelligent lock and the energy point positioning accessories comprise information transmission units for transmitting the identity information and the working state information of the intelligent lock sleeve and the intelligent lock to the mobile terminal; the identity information is used for representing the model or specification of the corresponding component, and the working state information is used for representing whether the corresponding component is installed and used.
Different intelligent lock sleeves are used for fixing different energy points, and the intelligent lock sleeves are matched with the intelligent locks one by one. The locking and hanging card system in the embodiment is provided with the information transmission units on the intelligent lock sleeve, the intelligent lock, the intelligent hanging card and the energy point positioning accessories, so that whether the intelligent lock sleeve mounted on the energy point is correct or not can be judged according to the identity information and the working state information of each part displayed on the mobile terminal, and whether the intelligent lock mounted on the intelligent lock sleeve is matched with the intelligent lock sleeve or not can be judged.
By adopting the locking and listing system to lock and listing the energy points, the whole locking and listing process can be digitalized and visualized, so that the safety of the operation in the locking and listing process is greatly improved, and the overall operation cost of industrial manufacturing enterprises is reduced.
The information transmission unit comprises an RFID chip, an IO module, a communication module, a power supply and an IO module triggering device for changing the signal state of an IO module pin, wherein the RFID chip is used for representing the identity information of a part where the RFID chip is located, different signal states of the IO module pin are used for representing different working states of the part where the IO module pin is located, for example, if the signal state of the IO module is low level, the corresponding device is not installed and used, and if the signal state of the IO module is high level, the corresponding device is installed and used; the communication module is electrically connected with the signal output end of the IO module, the signal state of the pin of the IO module can be sent to the mobile terminal in real time through the communication module, the power supply is used for supplying power to the RFID chip, the IO module and the communication module, and a card reader for reading radio frequency signals of the RFID chip is arranged in the mobile terminal so as to receive and read identity information of each device. The IO module triggering device can change the level state of the pins of the IO module by pulling the level state of the pins of the IO module high or low.
When the component is installed, the signal state of the corresponding IO module pin can be changed through the corresponding IO module triggering device so as to indicate that the component is installed. The IO module triggering device can change the signal state by switching on or switching off the power supply of the IO module. For example, the IO module triggering device may be a push button switch, and the push button switch is connected between the power supply terminal of the IO module and the power supply.
The intelligent lock sleeve, the intelligent lock and the energy point positioning accessories comprise a shell and an inner cavity, wherein an RFID chip, an IO module, a communication module and a power supply of the information transmission unit are all arranged inside the inner cavity, and an IO module triggering device is arranged outside the shell so as to be convenient for operation and maintenance personnel to operate.
The structure schematic diagram of one of the intelligent lock sleeves is shown in fig. 7, and the intelligent lock sleeve is used for locking a valve and comprises an inner cavity, wherein an RFID chip, an IO module, a communication module and a power supply are all arranged inside the inner cavity.
In the description of the present specification, the meaning of "a plurality", "a number" or "a plurality" is at least two, for example, two, three or more, etc., unless explicitly defined otherwise.
While various embodiments of the present invention have been shown and described herein, it will be obvious to those skilled in the art that such embodiments are provided by way of example only. Many modifications, changes, and substitutions will now occur to those skilled in the art without departing from the spirit and scope of the invention. It should be understood that various alternatives to the embodiments of the invention described herein may be employed in practicing the invention.
Claims (8)
1. A method of locking a card based on data analysis, comprising:
acquiring images of areas near equipment to be maintained in real time;
dividing the acquired image into a face area of a worker, a movement area of a movement part of equipment and a power indicator area of the equipment to be maintained;
the face area of the staff is subjected to face recognition, the identity of the staff is identified, whether the staff has operation authority is judged, and the movement foreground is detected on the movement area, so that whether the movement part of the equipment to be maintained operates within a first preset time period is judged; identifying the image of the power indicator lamp area by using a YOLO model, so as to judge whether the power indicator lamp of the equipment to be maintained is extinguished within a first preset time period; the foreground detection includes: setting a threshold value and an updating rate used in background updating; taking the acquired first frame image as a background model, separating three channels of each frame image, and respectively acquiring a foreground image of each channel; calculating the foreground map of each channel to obtain a final foreground map;
responding to no operation authority of an operator or the fact that the equipment to be maintained is not stopped in a first preset time period or the power supply of the equipment to be maintained is not closed in the first preset time period, alarming, and sending illegal operation information to a management platform; in response to the fact that an operator has operation authority, the equipment to be maintained stops running and the power supply of the equipment to be maintained is closed, dividing the acquired image into an area to be registered and an energy point area, performing character recognition on the image of the area to be registered by adopting an OCR model, judging whether a warning board is hung in the area to be registered within a second preset time period, recognizing the image of the energy point area by adopting a YOLO model, acquiring the shape and the size of the energy point, and judging whether an intelligent lock sleeve and an intelligent lock are installed on the energy point within the second preset time period;
identifying the acquired image in response to the fact that the warning sign is hung in the area to be marked within the second preset time period and the intelligent lock sleeve and the intelligent lock are installed on the energy point, judging whether an operator scans an RFID chip of the intelligent lock sleeve and an RFID chip of the intelligent lock by using the mobile terminal within the third preset time period, and acquiring environmental information of a workshop where equipment to be maintained is located, wherein the environmental information comprises whether acidic substances exist in the air; the mobile terminal is internally provided with a card reader, and the RFID chip of the intelligent lock sleeve and the RFID chip of the intelligent lock can be read, so that identity information of the intelligent lock sleeve and the intelligent lock can be obtained; the identity information is used for representing the shape, the size and the material of the intelligent lock sleeve or the intelligent lock;
responding to the fact that an operator uses a mobile terminal to scan an RFID chip of the intelligent lock sleeve and an RFID chip of the intelligent lock, and judging whether the intelligent lock sleeve and the intelligent lock are selected correctly or not according to the concentration information of acidic substances in the air near equipment to be maintained, the shape and the size of energy points and the identity information of the intelligent lock sleeve and the intelligent lock; and responding to incorrect selection of the intelligent lock sleeve or the intelligent lock, alarming, prompting the locking and listing personnel to select an error, and sending illegal operation information to the management platform.
2. The data analysis-based locking method of claim 1, further comprising:
in response to the intelligent lock sleeve or the intelligent lock being selected correctly, identifying the acquired image by adopting a YOLO model within a third preset time period, and judging whether a safety warning belt or a safety guardrail is arranged near the equipment to be maintained;
and responding to the condition that no safety warning belt and no safety guardrail are arranged near the equipment to be maintained within the third preset time period, alarming, prompting the locking and listing personnel to perform corresponding operation, and sending illegal operation information to the management platform.
3. The data analysis-based locking method of claim 1, further comprising: under the condition that an energy point of equipment to be maintained is an air switch and an intelligent lock sleeve is installed on the energy point, identifying an intelligent lock sleeve and an insulating handle of the air switch in an acquired image by adopting a convex hull detection algorithm, projecting the intelligent lock sleeve and the insulating handle to a two-dimensional plane, and judging whether the projected length direction of the insulating handle is perpendicular to the projected length direction of the intelligent lock sleeve; and responding to the fact that the projected length direction of the insulating handle and the projected length direction of the intelligent lock sleeve are not perpendicular to each other, alarming to remind the locking and listing personnel.
4. The data analysis-based locking method of claim 1, further comprising: under the condition that the equipment to be maintained is maintained, performing foreground detection on the area near the equipment to be maintained, and judging whether staff unlock the energy points within a fourth preset time period;
in response to the fact that the staff unlock the energy points within the fourth preset time period, face recognition is conducted on the acquired images, and whether the unlocking staff and the locking staff are the same is judged;
and responding to the fact that the unlocking person and the locking person are not the same person, alarming, and sending illegal operation information to the management platform.
5. The method for locking and listing based on data analysis of claim 1, wherein the method for segmenting the acquired image comprises:
extracting features of the image;
selecting a target segmentation algorithm corresponding to the image, and performing rough segmentation on the image by adopting the target segmentation algorithm to obtain a first segmentation result;
and carrying out fine segmentation on the first segmentation result to obtain each target region in the picture.
6. The locking and listing system is characterized by comprising an image acquisition device, a plurality of intelligent lock sleeves, a plurality of intelligent locks, an intelligent listing, a plurality of energy point positioning accessories and a mobile terminal, wherein the image acquisition device is used for acquiring images of areas nearby equipment to be maintained, the intelligent lock sleeves are respectively used for fixing energy points of different equipment, the intelligent locks are respectively used for fixing the intelligent lock sleeves, the intelligent listing is used for hanging the energy points of the equipment to be locked and listing, and the energy point positioning accessories are respectively used for being installed at the energy points of the equipment to position the energy points; the mobile terminal is used for executing the locking and listing method based on data analysis according to any one of claims 1-5; the intelligent lock sleeve, the intelligent lock and the energy point positioning accessories comprise information transmission units for transmitting the identity information and the working state information of the intelligent lock sleeve and the intelligent lock to the mobile terminal; the identity information is used for representing the model or specification of the corresponding component, and the working state information is used for representing whether the corresponding component is installed and used.
7. The locking and branding system of claim 6, wherein the information transmission unit comprises an RFID chip, an IO module, a communication module, a power supply and an IO module triggering device for changing the signal state of the pin of the IO module, wherein the RFID chip is used for representing the identity information of the component where the RFID chip is located, the different signal states of the pin of the IO module are used for representing the different working states of the component where the IO module is located, the power supply is used for supplying power to the RFID chip, the IO module and the communication module, the communication module is electrically connected with the signal output end of the IO module, and the signal state of the pin of the IO module can be transmitted to the mobile terminal in real time through the communication module.
8. The locking and branding system of claim 6 or 7, wherein said smart lock sleeve, said smart lock and said energy point location accessory each comprise a housing and an interior cavity, wherein the RFID chip, IO module, communication module and power source of the information transfer unit are disposed within the interior cavity, and the IO module triggering device is disposed outside the housing for operation by an operation and maintenance personnel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410016465.XA CN117522351B (en) | 2024-01-05 | 2024-01-05 | Locking and listing method and system based on data analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410016465.XA CN117522351B (en) | 2024-01-05 | 2024-01-05 | Locking and listing method and system based on data analysis |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117522351A CN117522351A (en) | 2024-02-06 |
| CN117522351B true CN117522351B (en) | 2024-04-05 |
Family
ID=89746011
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410016465.XA Active CN117522351B (en) | 2024-01-05 | 2024-01-05 | Locking and listing method and system based on data analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117522351B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111555446A (en) * | 2020-05-06 | 2020-08-18 | 广东纬德信息科技股份有限公司 | Intelligent lock management system based on electric power distribution |
| CN111927222A (en) * | 2020-07-21 | 2020-11-13 | 立宏安全设备工程(上海)有限公司 | Intelligent locking and listing device, system and method |
| CN112967428A (en) * | 2021-02-25 | 2021-06-15 | 立宏安全设备工程(上海)有限公司 | Linkage type intelligent automatic locking and listing method and system |
| CN114139734A (en) * | 2021-11-01 | 2022-03-04 | 武汉钢铁有限公司 | Maintenance management method, server, medium and equipment |
| CN114926921A (en) * | 2021-02-01 | 2022-08-19 | 中国石油化工股份有限公司 | A intelligent tool to lock for examining maintenance operation |
| CN115411649A (en) * | 2022-09-01 | 2022-11-29 | 北京科技大学 | Method for improving operation safety of picking and hanging cards during maintenance |
| CN218159130U (en) * | 2022-09-30 | 2022-12-27 | 宁波纬诚科技股份有限公司 | Intelligent locking and listing management system |
| CN116844103A (en) * | 2023-06-02 | 2023-10-03 | 上海极标企业管理咨询有限公司 | LOTO informatization intelligent integrated security management method |
| CN117133071A (en) * | 2023-08-18 | 2023-11-28 | 中钢集团武汉安全环保研究院有限公司 | Intelligent energy isolation protection management and control system and method |
-
2024
- 2024-01-05 CN CN202410016465.XA patent/CN117522351B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111555446A (en) * | 2020-05-06 | 2020-08-18 | 广东纬德信息科技股份有限公司 | Intelligent lock management system based on electric power distribution |
| CN111927222A (en) * | 2020-07-21 | 2020-11-13 | 立宏安全设备工程(上海)有限公司 | Intelligent locking and listing device, system and method |
| CN114926921A (en) * | 2021-02-01 | 2022-08-19 | 中国石油化工股份有限公司 | A intelligent tool to lock for examining maintenance operation |
| CN112967428A (en) * | 2021-02-25 | 2021-06-15 | 立宏安全设备工程(上海)有限公司 | Linkage type intelligent automatic locking and listing method and system |
| CN114139734A (en) * | 2021-11-01 | 2022-03-04 | 武汉钢铁有限公司 | Maintenance management method, server, medium and equipment |
| CN115411649A (en) * | 2022-09-01 | 2022-11-29 | 北京科技大学 | Method for improving operation safety of picking and hanging cards during maintenance |
| CN218159130U (en) * | 2022-09-30 | 2022-12-27 | 宁波纬诚科技股份有限公司 | Intelligent locking and listing management system |
| CN116844103A (en) * | 2023-06-02 | 2023-10-03 | 上海极标企业管理咨询有限公司 | LOTO informatization intelligent integrated security management method |
| CN117133071A (en) * | 2023-08-18 | 2023-11-28 | 中钢集团武汉安全环保研究院有限公司 | Intelligent energy isolation protection management and control system and method |
Non-Patent Citations (4)
| Title |
|---|
| 上锁挂牌在项目调试工作中的应用;李昆鹏;项泽强;;水泥;20160710(第07期);第65-66页 * |
| 基于 Ｐ＆ＩＤ 的能量隔离与智能锁具控制系统的研发与应用;窦立爽;山东化工;20230508;第52卷(第9期);第173-175页 * |
| 安全生产中上锁挂牌制度浅议;陆荣峰;阮一晖;裴桦;;建筑机械化;20130515(第05期);第79-80+94页 * |
| 油田设备检维修中的能量隔离探讨;郭世龙;中国设备工程;20231231;第337-338页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117522351A (en) | 2024-02-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200334802A1 (en) | Method for predicting defects in assembly units | |
| CN106845890B (en) | Storage monitoring method and device based on video monitoring | |
| CN110889339B (en) | Head and shoulder detection-based dangerous area grading early warning method and system | |
| CN111310947A (en) | Building facility operation and maintenance method, equipment, storage medium and system based on 5G | |
| KR20160112969A (en) | System and method for tamper detection using rfid devices | |
| CN109996182B (en) | Positioning method, device and system based on combination of UWB positioning and monitoring | |
| CN105488806A (en) | Workpiece position tracking positioning method and positioning system | |
| CN109359712A (en) | Electric operating information dynamic collection monitoring device and its application method | |
| CN104794827A (en) | Method and apparatus for prevention of false alarms in monitoring systems | |
| CN105872065A (en) | Real-time monitoring method and device and monitoring cloud platform | |
| CN115004270A (en) | Monitoring alarm system and method for industrial equipment and device | |
| CN112365015A (en) | Robot collaborative operation and maintenance monitoring method based on RFID active positioning | |
| CN114022767A (en) | Elevator floor positioning method and device, terminal equipment and storage medium | |
| CN109001210B (en) | System and method for detecting aging and cracking of sealing rubber strip of civil air defense door | |
| CN112381435A (en) | Gridding directional pushing management method for dynamic risk in hydropower station operation process | |
| CN117522351B (en) | Locking and listing method and system based on data analysis | |
| CN110675540B (en) | Lock management method and device for equipment maintenance and intelligent electronic lock | |
| CN110047164A (en) | Electromechanical equipment patrolling and checking management system | |
| CN113256166B (en) | Security management system and management method based on Internet of things | |
| CN111554007B (en) | Intelligent personnel identification control cabinet | |
| KR101989376B1 (en) | Integrated track circuit total monitoring system | |
| CN115063921B (en) | Building site intelligent gate system and building method | |
| CN115984770A (en) | Remote monitoring method for converter station based on image recognition | |
| CN208969695U (en) | Electric operating information dynamic collection monitoring device | |
| KR102416751B1 (en) | Smart factory risk factor detection system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |