CN112541661A - Method and device for detecting personnel behavior and environmental specification of network points - Google Patents

Method and device for detecting personnel behavior and environmental specification of network points Download PDF

Info

Publication number
CN112541661A
CN112541661A CN202011384786.3A CN202011384786A CN112541661A CN 112541661 A CN112541661 A CN 112541661A CN 202011384786 A CN202011384786 A CN 202011384786A CN 112541661 A CN112541661 A CN 112541661A
Authority
CN
China
Prior art keywords
area
video stream
stream data
live
detected
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011384786.3A
Other languages
Chinese (zh)
Inventor
高伟
郑广斌
施好健
杨洁琼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202011384786.3A priority Critical patent/CN112541661A/en
Publication of CN112541661A publication Critical patent/CN112541661A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06398Performance of employee with respect to a job function
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/02Banking, e.g. interest calculation or account maintenance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Educational Administration (AREA)
  • Marketing (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Technology Law (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Game Theory and Decision Science (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention provides a method and a device for detecting personnel behavior and environmental specification of a website, which can be used in the financial field or other technical fields, and the method comprises the following steps: calling corresponding live-action video stream data according to the acquired to-be-detected area of the business network and the configured camera stream address; determining a core area in live-action video stream data according to the name of the item to be detected; comparing the video stream data of the core area with pre-stored data information to obtain a comparison result; and judging whether the violation problem exists according to the comparison result. The method and the system have the advantages that real-time pictures in business outlets are obtained by the aid of cameras in all areas of the bank business outlets, the cameras are connected to computing nodes arranged in local places for processing, non-compliance behaviors of personnel in the bank outlets and the outlet environments are detected by the aid of a computer vision method, and the personnel non-compliance behaviors and the outlet environments are reported to relevant departments in time when the outlet environments do not reach standards.

Description

Method and device for detecting personnel behavior and environmental specification of network points
Technical Field
The application belongs to the technical field of video processing, and particularly relates to a method and a device for detecting personnel behaviors and environments of network points.
Background
The business outlets are important places where banks serve outside customers. In order to improve the service quality of the network points, each bank stipulates a uniform service specification. However, at present, the service quality of a network point mainly depends on the subjective performance of staff and the supervision of a superior organization, but the current supervision adopts a manual mode, for example, a supervisor supervises the behavior of staff in a video by looking up a historical video of a business network point, and the mode has the advantages of large workload, low efficiency, lag detection timeliness and reduced experience of customers.
Disclosure of Invention
The application provides a method and a device for detecting the behaviors of staff and the environment of a network point, which at least solve the problem that the behaviors of the staff in the current bank business network point and the network point environment are lack of efficient supervision.
According to one aspect of the application, a method for detecting personnel behavior and environmental specifications of a website is provided, which comprises the following steps:
calling corresponding live-action video stream data according to the acquired to-be-detected area of the business network and the configured camera stream address;
determining a core area in live-action video stream data according to the name of the item to be detected; the names of the items to be detected include: sundry detection, safety guarantee, unauthorized detection and on-duty detection;
comparing the video stream data of the core area with pre-stored data information to obtain a comparison result;
and judging whether the violation problem exists according to the comparison result.
In an embodiment, calling corresponding live-action video stream data according to an acquired to-be-detected area of a business outlet and a configured camera stream address includes:
determining a target camera of a to-be-detected area of a business outlet;
searching a stream address corresponding to a target camera from a preset camera stream address;
and calling live-action video stream data shot by the target camera according to the stream address corresponding to the target camera.
In one embodiment, when the name of the item to be detected is detected as a foreign object, determining a core area in live-action video stream data according to the name of the item to be detected includes:
decoding live-action video stream data;
and determining the ground area inside the business network in the decoded live-action video stream data, and taking the ground area as a core area.
In one embodiment, the data information includes: and standard ground image information, comparing the video stream data of the core area with pre-stored data information to obtain a comparison result, wherein the comparison result comprises the following steps:
intercepting video image data of a ground area;
and comparing the video image data of the detected ground area with the pre-stored standard ground image information to obtain a comparison result.
In an embodiment, when the name of the item to be detected is security assurance and unauthorized detection, determining a core area in live-action video stream data according to the name of the item to be detected includes:
decoding live-action video stream data;
and determining a security authority area in the decoded live-action video stream data, and taking the security authority area as a core area.
In one embodiment, the data information includes: the image information of security personnel is compared with the video stream data in the core area and the pre-stored data information to obtain a comparison result, and the comparison result comprises the following steps:
intercepting video image data of a security authority area;
and comparing the video image data of the security authority detection area with the pre-stored image information of security personnel to obtain a comparison result.
In one embodiment, when the name of the item to be detected is detected on Shift, determining a core area in live-action video stream data according to the name of the item to be detected includes:
decoding live-action video stream data;
and determining a working area in the decoded live-action video stream data, and taking the working area as a core area.
In one embodiment, the data information includes: the image information of the on-duty workers compares the video stream data of the core area with the pre-stored data information to obtain a comparison result, and the comparison result comprises the following steps:
intercepting video image data of a working area;
and comparing the video image data of the detection work area with the pre-stored image information of the on-duty workers to obtain a comparison result.
According to another aspect of the present application, there is also provided a device for detecting personnel behavior and environmental regulations at a website, including:
the video stream data calling unit is used for calling corresponding live-action video stream data according to the acquired to-be-detected area of the business network and the configured camera stream address;
the core area locking unit is used for determining a core area in live-action video stream data according to the name of the item to be detected; the names of the items to be detected include: sundry detection, safety guarantee, unauthorized detection and on-duty detection;
the comparison unit is used for comparing the video stream data of the core area with pre-stored data information to obtain a comparison result;
and the behavior judgment unit is used for judging whether the violation problem exists according to the comparison result.
In one embodiment, the video stream data retrieving unit includes:
the target camera determining module is used for determining a target camera of a to-be-detected area of a business outlet;
the stream address searching module is used for searching a stream address corresponding to a target camera from the preset camera stream addresses;
and the video stream data acquisition module is used for calling the live-action video stream data shot by the target camera according to the stream address corresponding to the target camera.
In one embodiment, when the name of the item to be detected is a foreign object detection, the core region locking unit includes:
the first decoding module is used for decoding live-action video stream data;
and the ground detection module is used for determining the ground area inside the business network in the decoded live-action video stream data and taking the ground area as a core area.
In one embodiment, the data information includes: the standard ground image information, the comparison unit includes:
the first video intercepting module is used for intercepting video image data of a ground area;
the first video comparison module is used for comparing the video image data of the detection ground area with the pre-stored standard ground image information to obtain a comparison result.
In one embodiment, when the name of the item to be detected is security assurance and unauthorized detection, the core region locking unit includes:
the second decoding module is used for decoding the live-action video stream data;
and the security detection module is used for determining a security authority area in the decoded live-action video stream data and taking the security authority area as a core area.
In one embodiment, the data information includes: security personnel image information, the contrast module includes:
the second video intercepting module is used for intercepting video image data of the security authority area;
and the second video comparison module is used for comparing the video image data of the detection security authority area with the pre-stored image information of the security personnel to obtain a comparison result.
In one embodiment, when the name of the item to be detected is detected on Shift, the core region locking unit includes:
the third decoding module is used for decoding the live-action video stream data;
and the on-Shift detection module is used for determining a working area in the decoded live-action video stream data and taking the working area as a core area.
In one embodiment, the data information includes: the on-duty staff image information comparison module comprises:
the third intercepting module is used for intercepting the video image data of the working area;
and the third video comparison module is used for comparing the video image data of the detection working area with the pre-stored image information of the on duty workers to obtain a comparison result.
The method and the system have the advantages that the cameras in all areas of the bank business outlets are used for acquiring real-time pictures in the business outlets, the real-time pictures are accessed to the computing nodes arranged in the local places for processing, the non-compliance behaviors of personnel in the bank outlets and the outlet environments are detected by using a computer vision method, early warning is timely carried out when the non-compliance behaviors occur, and related departments are timely reported when the outlet environments do not reach the standard.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a method for detecting the staff behavior and the environmental specification of a website provided by the present application.
Fig. 2 is a flowchart of a method for retrieving corresponding live-action video stream data according to an embodiment of the present application.
Fig. 3 is a flowchart of a method for determining a core area according to a name of an item to be detected in the embodiment of the present application.
Fig. 4 is a flowchart of a second method for centering a domain according to a name of an item to be detected in an embodiment of the present application.
Fig. 5 is a flowchart of a third method for centering a domain according to a name of an item to be detected in an embodiment of the present application.
Fig. 6 is a block diagram of a structure of a device for detecting a person behavior and an environmental specification at a website according to the present application.
Fig. 7 is a block diagram of a video stream data retrieving unit in the embodiment of the present application.
Fig. 8 is a block diagram of a core region locking unit in the embodiment of the present application.
Fig. 9 is a block diagram of a second core region locking unit in the embodiment of the present application.
Fig. 10 is a block diagram of a third core region locking unit according to an embodiment of the present application.
Fig. 11 is a general block diagram of a system for detecting personnel behavior and environmental specifications of a website in an embodiment of the present application.
Fig. 12 is a specific implementation of an electronic device in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. The method and the device for detecting the personnel behaviors and the environmental specifications of the website provided by the embodiment of the invention can be used in the financial field and can also be used in any technical field except the financial field, and the application field of the invention is not limited.
At present, the service quality of a network point mainly depends on the subjective performance of staff and the supervision of a superior organization, but the current supervision adopts a manual mode, for example, a supervisor supervises the behavior of the staff in a video by looking up a historical video of a business network point, and the mode has the advantages of large workload, low efficiency, lag detection timeliness and incapability of meeting the experience feeling of customers. As shown in fig. 1, the present application provides a method for detecting personnel behavior and environmental specifications of a website, including:
s101: and calling corresponding live-action video stream data according to the acquired to-be-detected area of the business network and the configured camera stream address.
S102: and determining a core area in the live-action video stream data according to the name of the item to be detected. The names of the items to be detected include: sundry detection, safety guarantee, unauthorized detection and on-duty detection;
s103: and comparing the video stream data of the core area with the pre-stored data information to obtain a comparison result.
S104: and judging whether the violation problem exists according to the comparison result.
Firstly, face information registration is carried out on workers and security personnel in a business network, each piece of face information corresponds to a network node area which can be accessed with authority, a plurality of cameras are arranged in the network nodes, the shooting ranges of the cameras completely cover all corners of the network nodes, if an area A in the network nodes is detected, the area A is an area to be detected of the business network nodes, camera stream addresses corresponding to the area A are obtained (the areas monitored by the cameras are different), and then live-action video stream data of the area A are called. And determining a core area in the live-action video stream data according to the acquired name of the item to be detected, and then comparing the acquired video of the core area with data information prestored in a background to obtain a comparison result.
In an embodiment, calling corresponding live-action video stream data according to the acquired to-be-detected area of the business network and the configured camera stream address, as shown in fig. 2, includes:
s201: and determining a target camera of the to-be-detected area of the business network.
S202: and searching a stream address corresponding to the target camera from the preset camera stream addresses.
S203: and calling live-action video stream data shot by the target camera according to the stream address corresponding to the target camera.
In a specific embodiment, if the area to be detected in the mesh point is the area a, the target camera 1 in the area a is acquired, the camera 1 continuously shoots the dynamic video in the area a, and then the stream address corresponding to the camera 1 is searched from the preset camera stream address. And after the stream address corresponding to the camera 1 is found, live-action video stream data of the area A shot by the camera 1 is called according to the stream address.
In an embodiment, when the name of the item to be detected is detected as a foreign object, determining a core area in live-action video stream data according to the name of the item to be detected, as shown in fig. 3, includes:
s301: and decoding the live-action video stream data.
S302: and determining the ground area inside the business network in the decoded live-action video stream data, and taking the ground area as a core area.
In an embodiment, if it is detected whether sundries are piled on the ground in a business office to affect the passing of people, the live-action video stream data of the ground in the business office is firstly obtained according to the flow in fig. 2, and then each frame of ground picture in the live-action video stream data is locked for detection after the live-action video stream data is decoded.
In one embodiment, the data information includes: and standard ground image information, comparing the video stream data of the core area with pre-stored data information to obtain a comparison result, wherein the comparison result comprises the following steps:
intercepting video image data of a ground area;
and comparing the video image data of the detected ground area with the pre-stored standard ground image information to obtain a comparison result.
In a specific embodiment, after each frame of ground image is locked, the ground image is compared with standard ground image information (the standard ground image information is a clean and barrier-free ground image) stored in a background through a learning model, if the ground image information is inconsistent with the standard ground image information, the fact that sundries are piled on the ground of the business outlet is determined, the management regulations are not met, and then the ground image information is reported to relevant departments. When the learning model is trained, firstly, a ground image is collected, sundries on the ground image are calibrated, then the calibrated ground image is used as a training sample to train the learning model, and the type of the sundries on the ground can be rapidly identified by the trained learning model.
In an embodiment, when the name of the item to be detected is the security assurance and the unauthorized detection, the determining the core area in the live-action video stream data according to the name of the item to be detected, as shown in fig. 4, includes:
s401: and decoding the live-action video stream data.
S402: and determining a security authority area in the decoded live-action video stream data, and taking the security authority area as a core area.
In a specific embodiment, the acquired live-action video stream data of the area a is decoded, and then security authority areas such as a website gate and an ATM front (because a security guard is required before the website gate and the ATM front) in the live-action video stream data are locked.
In one embodiment, the data information includes: the image information of security personnel is compared with the video stream data in the core area and the pre-stored data information to obtain a comparison result, and the comparison result comprises the following steps:
intercepting video image data of a security authority area;
and comparing the video image data of the security authority detection area with the pre-stored image information of security personnel to obtain a comparison result.
In a specific embodiment, video image data of a network gate and a front ATM are intercepted, whether a person exists at the network gate is detected, if not, the network gate is determined to be unattended, unattended time is counted, and when the unattended time exceeds a preset value, a relevant management department is reported to perform early warning; when people exist at a network gate, the human face information is acquired through the human face recognition function, then the human face information is compared with the security personnel image information stored in the background, whether the people at the network gate are security personnel of a bank is judged, if not, the network gate is determined to be unattended at the moment, the unattended time is counted, and when the unattended time exceeds a preset value, a relevant management department is reported to perform early warning. Similarly, the same is true before the ATM, the image data before the ATM is obtained, when more than 2 persons exist in front of the ATM, the face information is obtained through the face-face recognition function, then the face information is compared with the image information of security personnel stored in the background to judge whether the business network practitioner or security personnel exist, and if not, the early warning is carried out.
In an embodiment, when the name of the item to be detected is detected on duty, determining the core area in the live-action video stream data according to the name of the item to be detected, as shown in fig. 5, includes:
s501: and decoding the live-action video stream data.
S502: and determining a working area in the decoded live-action video stream data, and taking the working area as a core area.
In one embodiment, the captured live-action video stream data of the a-zone is decoded, and then a work area, such as a counter area, in the live-action video stream data is locked.
In one embodiment, the data information includes: the image information of the on-duty workers compares the video stream data of the core area with the pre-stored data information to obtain a comparison result, and the comparison result comprises the following steps:
intercepting video image data of a working area;
and comparing the video image data of the detection work area with the pre-stored image information of the on-duty workers to obtain a comparison result.
In a specific embodiment, video image data of a counter area in a network point is intercepted, whether a person exists in a video image is judged, if not, the off-duty time of the person is recorded, and when the off-duty time exceeds a preset value, the person is reported to a relevant department for early warning; if a person exists in the counter, the face information is obtained through the face recognition function, then the face information is compared with the image information of the on-duty workers stored in the background to judge whether the person in the counter is a website worker, and if not, an early warning is sent out.
Based on the same inventive concept, the embodiment of the present application further provides a device for detecting the behavior of people and environmental regulations at a website, which can be used to implement the method described in the above embodiments, as described in the following embodiments. Because the principle of solving the problems of the device for detecting the personnel behaviors and the environmental specifications of the website is similar to that of the method for detecting the personnel behaviors and the environmental specifications of the website, the implementation of the device for detecting the personnel behaviors and the environmental specifications of the website can be referred to that of the method for detecting the personnel behaviors and the environmental specifications of the website, and repeated parts are not repeated. As used hereinafter, the term "unit" or "module" may be a combination of software and/or hardware that implements a predetermined function. While the system described in the embodiments below is preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.
As shown in fig. 6, the present application further provides a device for detecting the behavior of people and environmental regulations at a website, which includes:
the video stream data calling unit 601 is used for calling corresponding live-action video stream data according to the acquired to-be-detected area of the business network and the configured camera stream address;
a core area locking unit 602, configured to determine a core area in live-action video stream data according to a name of an item to be detected; the names of the items to be detected include: sundry detection, safety guarantee, unauthorized detection and on-duty detection;
a comparing unit 603, configured to compare the video stream data in the core area with pre-stored data information, and obtain a comparison result;
and a behavior determining unit 604, configured to determine whether there is a violation problem according to the comparison result.
In one embodiment, as shown in fig. 7, the video stream data retrieving unit 601 includes:
a target camera determination module 701, configured to determine a target camera in a to-be-detected area of a business outlet;
a stream address searching module 702, configured to search a stream address corresponding to a target camera from pre-configured camera stream addresses;
the video stream data obtaining module 703 is configured to call live-action video stream data shot by the target camera according to the stream address corresponding to the target camera.
In one embodiment, when the name of the item to be detected is a foreign object detection, as shown in fig. 8, the core region locking unit 602 includes:
a first decoding module 801, configured to decode live-action video stream data;
the ground detection module 802 is configured to determine a ground area inside a business office in the decoded live-action video stream data, and use the ground area as a core area.
In one embodiment, the data information includes: the standard ground image information comparing unit 603 includes:
the first video intercepting module is used for intercepting video image data of a ground area;
the first video comparison module is used for comparing the video image data of the detection ground area with the pre-stored standard ground image information to obtain a comparison result.
In an embodiment, when the name of the item to be detected is security assurance and unauthorized detection, as shown in fig. 9, the core region locking unit 602 includes:
a second decoding module 901, configured to decode live-action video stream data;
a security detection module 902, configured to determine a security authority area in the decoded live-action video stream data, and use the security authority area as a core area.
In one embodiment, the data information includes: the security personnel image information comparing module 603 comprises:
the second video intercepting module is used for intercepting video image data of the security authority area;
and the second video comparison module is used for comparing the video image data of the detection security authority area with the pre-stored image information of the security personnel to obtain a comparison result.
In one embodiment, when the name of the item to be detected is detected on duty, as shown in fig. 10, the core region locking unit 602 includes:
a third decoding module 1001, configured to decode live-action video stream data;
the on-duty detection module 1002 is configured to determine a work area in the decoded live-action video stream data, and use the work area as a core area.
In one embodiment, the data information includes: the on-duty staff image information comparison module 603 includes:
the third intercepting module is used for intercepting the video image data of the working area;
and the third video comparison module is used for comparing the video image data of the detection working area with the pre-stored image information of the on duty workers to obtain a comparison result.
In a specific application, the application also provides a system for detecting personnel behaviors and environmental regulations of the website, and the overall structural block diagram of the system is shown in fig. 11, and the system comprises cameras 11 in all areas of the website, a real-time detection unit 12, a main control unit 13, a video stream analysis unit 14, a sundries detection unit 15, a security guarantee detection unit 16, a one-meter-line detection unit 17, an on duty time detection unit 18, an override detection unit 19, a cleanliness detection unit 20, a shielding curtain detection unit 21, a notice board detection unit 22, a two-hand delivered object detection unit 23, a notification display unit 24, a parameter setting unit 25 and a storage unit 26. Specifically, the method comprises the following steps:
the cameras 11 in each area of the network are used for monitoring staff and customers in the network without dead angles so as to prevent illegal criminal activities.
The real-time detection unit 12 is used for detecting the video recording, and timely notifying corresponding personnel to perform relevant processing when an out-of-compliance point occurs.
The main control unit 13 is used for controlling the operation of the real-time detection unit and interacting with the cameras 11 in each area of the network point, the notification display unit 24 and the parameter setting unit 25.
The video stream parsing unit 14 is configured to perform a decoding operation on the video stream of each area camera 11.
The sundry detection unit 15 is used for detecting whether sundries such as paper scraps and water bottles exist in the internal ground environment (including all areas, such as a guest welcoming area, a waiting area, a guest service area, a self-service equipment service area, and the like) of the network point, and the detection algorithm includes, but is not limited to: yolo series, etc.
The security detection unit 16 is used to detect the guard on duty time, detect whether the guard is in the surveillance video every second time in the whole business hours, and then count the ratio of the time in the surveillance video to the business hours, and the detection algorithm includes but is not limited to: fast-reid, etc.
The one-meter line detection unit 17 is used for detecting windows and self-service equipment, and a one-meter line is not set before the self-service equipment, and detection algorithms include but are not limited to: faster R-CNN, SSD, etc.
The on duty time detecting unit 18 is used for detecting whether the camping consulting station is unattended for a long time (the consulting station must have staff in a bank to watch), and by detecting each frame of the video stream and then counting the proportion of the number of unattended frames to the total number of frames, a detection algorithm includes but is not limited to: RFBNet and the like, because the employees in the bank have uniform dressing, the algorithm can be retrained by marking the historical video data, and the purpose of distinguishing the employees in the bank from the employees in the non-bank is achieved.
The unauthorized detection unit 19 is used to detect whether security personnel are present in the counseling desk and self-service equipment area, and when security personnel are present in the area, it can indicate that non-bank personnel answer or guide the business handling for the client, and the detection algorithm includes but is not limited to: the yolo series and the like can achieve the purpose of distinguishing security guards from staff in banks by marking historical video data and retraining the algorithm because security guards have uniform dressing.
The tidiness detection unit 20 is configured to detect whether there are articles such as newspapers and mobile phones in the consultation area of the guest area, and the detection algorithm includes, but is not limited to: yolov4, and the like.
The curtain detection unit 21 is configured to detect whether a closed window not served outside in the cabinet area has a pull-down curtain, where the detection algorithm includes, but is not limited to: RefineDet, etc., which can perform annotation training according to historical video data.
The notice board detection unit 22 is used to detect whether there is a notice board for placing pause service in the open counter that is not served outside in the counter area, and the detection algorithm includes but is not limited to: yolov4, etc., which can perform annotation training based on historical video data.
The notice board detection unit 23 is configured to detect whether there is a double-hand passing object for physical materials such as a client certificate after the counter business in the counter area is completed, and the detection algorithm includes, but is not limited to: the Faster R-CNN, the SSD and the like can perform annotation training according to historical video data.
The notification display unit 24 is used for notifying the website responsible person in time through a message terminal (including a bracelet, a web computer, a pad, etc.) when the non-compliance behavior occurs, and the website responsible person performs corresponding processing after obtaining the message.
The parameter setting unit 25 is configured to set parameters of non-compliance points, including network business hours, each region division, a camera stream address, and the like, where a detection region defines a frame that can be performed by opencv, and non-compliance detection items in each region are as follows:
Figure BDA0002810726230000111
Figure BDA0002810726230000121
the storage unit 26 is used for storing non-compliance information, storing corresponding segment videos under two conditions of ensuring safety and on-duty time, and keeping pictures at corresponding moments under other non-compliance conditions, so that follow-up reference and verification are facilitated, and video viewing efficiency is improved.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principle and the implementation mode of the invention are explained by applying specific embodiments in the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
An embodiment of the present application further provides a specific implementation manner of an electronic device capable of implementing all steps in the method in the foregoing embodiment, and referring to fig. 12, the electronic device specifically includes the following contents:
a processor (processor)1201, memory 1202, a communication Interface 1203, a bus 1204, and a nonvolatile memory 1205;
the processor 1201, the memory 1202 and the communication interface 1203 complete mutual communication through the bus 1204;
the processor 1201 is configured to call the computer programs in the memory 1202 and the nonvolatile memory 1205, and when the processor executes the computer programs, the processor implements all the steps in the method in the foregoing embodiments, for example, when the processor executes the computer programs, the processor implements the following steps:
s101: and calling corresponding live-action video stream data according to the acquired to-be-detected area of the business network and the configured camera stream address.
S102: and determining a core area in the live-action video stream data according to the name of the item to be detected. The names of the items to be detected include: sundry detection, safety guarantee, unauthorized detection and on-duty detection;
s103: and comparing the video stream data of the core area with the pre-stored data information to obtain a comparison result.
S104: and judging whether the violation problem exists according to the comparison result.
Embodiments of the present application also provide a computer-readable storage medium capable of implementing all the steps of the method in the above embodiments, where the computer-readable storage medium stores thereon a computer program, and the computer program when executed by a processor implements all the steps of the method in the above embodiments, for example, the processor implements the following steps when executing the computer program:
s101: and calling corresponding live-action video stream data according to the acquired to-be-detected area of the business network and the configured camera stream address.
S102: and determining a core area in the live-action video stream data according to the name of the item to be detected. The names of the items to be detected include: sundry detection, safety guarantee, unauthorized detection and on-duty detection;
s103: and comparing the video stream data of the core area with the pre-stored data information to obtain a comparison result.
S104: and judging whether the violation problem exists according to the comparison result.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the hardware + program class embodiment, since it is substantially similar to the method embodiment, the description is simple, and the relevant points can be referred to the partial description of the method embodiment. Although embodiments of the present description provide method steps as described in embodiments or flowcharts, more or fewer steps may be included based on conventional or non-inventive means. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When an actual apparatus or end product executes, it may execute sequentially or in parallel (e.g., parallel processors or multi-threaded environments, or even distributed data processing environments) according to the method shown in the embodiment or the figures. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the presence of additional identical or equivalent elements in a process, method, article, or apparatus that comprises the recited elements is not excluded. For convenience of description, the above devices are described as being divided into various modules by functions, and are described separately. Of course, in implementing the embodiments of the present description, the functions of each module may be implemented in one or more software and/or hardware, or a module implementing the same function may be implemented by a combination of multiple sub-modules or sub-units, and the like. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form. The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
As will be appreciated by one skilled in the art, embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present description may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein. The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment. In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of an embodiment of the specification.
In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction. The above description is only an example of the embodiments of the present disclosure, and is not intended to limit the embodiments of the present disclosure. Various modifications and variations to the embodiments described herein will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments of the present specification should be included in the scope of the claims of the embodiments of the present specification.

Claims (18)

1. A method for detecting personnel behavior and environmental specification of a website is characterized by comprising the following steps:
calling corresponding live-action video stream data according to the acquired to-be-detected area of the business network and the configured camera stream address;
determining a core area in the live-action video stream data according to the name of the item to be detected; the names of the items to be detected comprise: sundry detection, safety guarantee, unauthorized detection and on-duty detection;
comparing the video stream data of the core area with prestored data information to obtain a comparison result;
and judging whether the violation problem exists according to the comparison result.
2. The method for detecting personnel behaviors and environmental specifications of network nodes according to claim 1, wherein the step of calling corresponding live-action video stream data according to the obtained to-be-detected area of the business network node and the configured camera stream address comprises the following steps:
determining a target camera of the to-be-detected area of the business outlet;
searching a stream address corresponding to the target camera from a preset camera stream address;
and calling live-action video stream data shot by the target camera according to the stream address corresponding to the target camera.
3. A method for detecting personnel behavior and environmental norms at a network site according to claim 2, wherein when the name of the item to be detected is detected as a foreign matter, the determining a core area in the live-action video stream data according to the name of the item to be detected comprises:
decoding the live-action video stream data;
and determining the ground area inside the business outlet in the decoded live-action video stream data, and taking the ground area as the core area.
4. The behavioral and environmental specification detection method according to claim 3, wherein the data information includes: and standard ground image information, wherein the comparison of the video stream data of the core area and the pre-stored data information is performed to obtain a comparison result, and the comparison result comprises the following steps:
intercepting video image data of the ground area;
and detecting the video image data of the ground area, and comparing the video image data with pre-stored standard ground image information to obtain a comparison result.
5. A method for detecting personal behavior and environmental norms at a network site according to claim 2, wherein when the name of the item to be detected is security assurance and unauthorized detection, the determining the core area in the live-action video stream data according to the name of the item to be detected comprises:
decoding the live-action video stream data;
and determining a security authority area in the decoded live-action video stream data, and taking the security authority area as a core area.
6. A method for detecting personnel behavior and environmental specifications at a network site according to claim 5, wherein the data information comprises: the image information of security personnel is used for comparing the video stream data of the core area with the pre-stored data information to obtain a comparison result, and the comparison result comprises the following steps:
intercepting video image data of the security authority area;
and detecting video image data of the security authority area, and comparing the video image data with pre-stored image information of security personnel to obtain a comparison result.
7. A method for detecting personnel behavior and environmental specifications at a network site according to claim 2, wherein when the name of the item to be detected is detected on duty, the determining the core area in the live-action video stream data according to the name of the item to be detected comprises:
decoding the live-action video stream data;
and determining a working area in the decoded live-action video stream data, and taking the working area as the core area.
8. A method for detecting personnel behavioral and environmental specifications at a network site according to claim 7, characterized in that said data information comprises: the image information of the on-duty workers, comparing the video stream data of the core area with the pre-stored data information to obtain a comparison result, comprises:
intercepting video image data of the working area;
and detecting the video image data of the working area, and comparing the video image data with the pre-stored image information of the on-duty workers to obtain a comparison result.
9. A device for detecting personnel behavior and environmental specification of a website is characterized by comprising:
the video stream data calling unit is used for calling corresponding live-action video stream data according to the acquired to-be-detected area of the business network and the configured camera stream address;
the core area locking unit is used for determining a core area in the live-action video stream data according to the name of the item to be detected; the names of the items to be detected comprise: sundry detection, safety guarantee, unauthorized detection and on-duty detection;
the comparison unit is used for comparing the video stream data of the core area with prestored data information to obtain a comparison result;
and the behavior judgment unit is used for judging whether the violation problem exists according to the comparison result.
10. A network personnel behavior and environmental specification detection apparatus according to claim 9, wherein said video stream data retrieving unit comprises:
the target camera determining module is used for determining a target camera of the to-be-detected area of the business outlet;
the stream address searching module is used for searching a stream address corresponding to the target camera from a preset camera stream address;
and the video stream data acquisition module is used for calling the live-action video stream data shot by the target camera according to the stream address corresponding to the target camera.
11. A website personnel behavior and environment specification detection apparatus according to claim 10, wherein when the name of the item to be detected is a foreign object detection, the core region locking unit comprises:
the first decoding module is used for decoding the live-action video stream data;
and the ground detection module is used for determining the ground area inside the business outlet in the decoded live-action video stream data and taking the ground area as the core area.
12. A website personnel behavior and environmental specification detection apparatus as defined in claim 11, wherein the data information comprises: standard ground image information, the comparison unit includes:
the first video intercepting module is used for intercepting video image data of the ground area;
and the first video comparison module is used for detecting the video image data of the ground area and comparing the video image data with the pre-stored standard ground image information to obtain a comparison result.
13. The device for detecting personal behavior and environmental norms of a website as claimed in claim 10, wherein when the name of the item to be detected is security assurance and unauthorized detection, the core region locking unit comprises:
the second decoding module is used for decoding the live-action video stream data;
and the security detection module is used for determining a security authority area in the decoded live-action video stream data and taking the security authority area as a core area.
14. A website personnel behavior and environmental specification detection apparatus as defined in claim 13, wherein the data information comprises: security personnel image information, the contrast module includes:
the second video intercepting module is used for intercepting the video image data of the security authority area;
and the second video comparison module is used for detecting that the video image data of the security authority area is compared with the pre-stored image information of security personnel to obtain a comparison result.
15. A website personnel behavior and environment specification detection apparatus as claimed in claim 10, wherein when the name of the item to be detected is detected on duty, the core region locking unit comprises:
the third decoding module is used for decoding the live-action video stream data;
and the on-Shift detection module is used for determining a working area in the decoded live-action video stream data and taking the working area as the core area.
16. A website personnel behavior and environmental specification detection apparatus as defined in claim 15, wherein the data information comprises: the image information of the on-duty workers, the comparison module comprises:
the third intercepting module is used for intercepting the video image data of the working area;
and the third video comparison module is used for detecting that the video image data of the working area is compared with the pre-stored image information of the on duty workers to obtain a comparison result.
17. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the network personnel behavior and environmental specification detection method of any one of claims 1 to 8 when executing the program.
18. A computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the network personnel behavior and environment specification detection method of any one of claims 1 to 8.
CN202011384786.3A 2020-12-01 2020-12-01 Method and device for detecting personnel behavior and environmental specification of network points Pending CN112541661A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011384786.3A CN112541661A (en) 2020-12-01 2020-12-01 Method and device for detecting personnel behavior and environmental specification of network points

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011384786.3A CN112541661A (en) 2020-12-01 2020-12-01 Method and device for detecting personnel behavior and environmental specification of network points

Publications (1)

Publication Number Publication Date
CN112541661A true CN112541661A (en) 2021-03-23

Family

ID=75016890

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011384786.3A Pending CN112541661A (en) 2020-12-01 2020-12-01 Method and device for detecting personnel behavior and environmental specification of network points

Country Status (1)

Country Link
CN (1) CN112541661A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114971199A (en) * 2022-04-28 2022-08-30 中国银行股份有限公司 Internal risk control method and device for bank staff
CN116934273A (en) * 2023-08-15 2023-10-24 上海赛岩信息咨询有限公司 Management control method, device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110719441A (en) * 2019-09-30 2020-01-21 傅程宏 System and method for bank personnel behavior compliance early warning management
CN110826538A (en) * 2019-12-06 2020-02-21 合肥科大智能机器人技术有限公司 Abnormal off-duty identification system for electric power business hall
CN111191523A (en) * 2019-12-11 2020-05-22 秒针信息技术有限公司 Information display method and device, storage medium and electronic device
CN111353426A (en) * 2020-02-28 2020-06-30 山东浪潮通软信息科技有限公司 Abnormal behavior detection method and device
CN111698473A (en) * 2020-06-10 2020-09-22 中国工商银行股份有限公司 Method and device for detecting staff on duty

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110719441A (en) * 2019-09-30 2020-01-21 傅程宏 System and method for bank personnel behavior compliance early warning management
CN110826538A (en) * 2019-12-06 2020-02-21 合肥科大智能机器人技术有限公司 Abnormal off-duty identification system for electric power business hall
CN111191523A (en) * 2019-12-11 2020-05-22 秒针信息技术有限公司 Information display method and device, storage medium and electronic device
CN111353426A (en) * 2020-02-28 2020-06-30 山东浪潮通软信息科技有限公司 Abnormal behavior detection method and device
CN111698473A (en) * 2020-06-10 2020-09-22 中国工商银行股份有限公司 Method and device for detecting staff on duty

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114971199A (en) * 2022-04-28 2022-08-30 中国银行股份有限公司 Internal risk control method and device for bank staff
CN116934273A (en) * 2023-08-15 2023-10-24 上海赛岩信息咨询有限公司 Management control method, device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
WO2020057159A1 (en) Video analysis system and method for food processing violation behavior in university restaurant
WO2020224122A1 (en) Video monitoring method and apparatus, computer device, and storage medium
US10956753B2 (en) Image processing system and image processing method
CN112541661A (en) Method and device for detecting personnel behavior and environmental specification of network points
CN111507574B (en) Security personnel deployment method and device, computer equipment and storage medium
Zin et al. A Markov random walk model for loitering people detection
CN110096606B (en) Foreign roll personnel management method and device and electronic equipment
CN109068105A (en) A kind of prison video monitoring method based on deep learning
US20210364356A1 (en) System and method for using artificial intelligence to enable elevated temperature detection of persons using commodity-based thermal cameras
CN111666915A (en) Monitoring method, device, equipment and storage medium
CN111178241A (en) Intelligent monitoring system and method based on video analysis
CN111950484A (en) High-altitude parabolic information analysis method and electronic equipment
CN110766849A (en) Method, device, equipment and medium for automatically identifying foreign personnel by community access control
CN115001934A (en) Industrial control safety risk analysis system and method
CN111310612A (en) Behavior supervision method and device
CN107301373B (en) Data processing method, device and storage medium
US20160048914A1 (en) Trade surveillance and monitoring systems and/or methods
CN112541410B (en) Method and device for detecting national treasury personnel behavior specification
CN114663834B (en) On-site monitoring method for express storage
CA2933212A1 (en) System and method of smart incident analysis in control system using floor maps
CN110365642A (en) Method, apparatus, computer equipment and the storage medium of monitoring information operation
CN114241400A (en) Monitoring method and device of power grid system and computer readable storage medium
CN112464818A (en) Kitchen supervision method, device, equipment and storage medium
CN110020223B (en) Behavior data analysis method and device
CN112200085A (en) People stream data acquisition method and device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination