CN110807450A - Face attendance system based on MIS system and PTZ camera - Google Patents

Face attendance system based on MIS system and PTZ camera Download PDF

Info

Publication number
CN110807450A
CN110807450A CN202010016665.7A CN202010016665A CN110807450A CN 110807450 A CN110807450 A CN 110807450A CN 202010016665 A CN202010016665 A CN 202010016665A CN 110807450 A CN110807450 A CN 110807450A
Authority
CN
China
Prior art keywords
scanning
attendance
task
ptz camera
face
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010016665.7A
Other languages
Chinese (zh)
Inventor
罗章璞
范家本
田迎春
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Energy Polytron Technologies Inc
Original Assignee
Chengdu Energy Polytron Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Energy Polytron Technologies Inc filed Critical Chengdu Energy Polytron Technologies Inc
Priority to CN202010016665.7A priority Critical patent/CN110807450A/en
Publication of CN110807450A publication Critical patent/CN110807450A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/10—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people together with the recording, indicating or registering of other data, e.g. of signs of identity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Time Recorders, Dirve Recorders, Access Control (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The invention relates to the field of attendance statistics, discloses a face attendance system based on an MIS system and a PTZ camera, and solves the problems of low attendance accuracy, high cost and low attendance efficiency in an attendance scheme based on face recognition in the prior art. The face attendance system comprises an MIS system and a PTZ camera; the MIS system is used for inputting the face characteristics of an attendance object, formulating an attendance task, formulating a scanning task at least according to the attendance task which needs to be executed currently and sending the scanning task to the corresponding PTZ camera, collecting the scanning results of the PTZ camera and summarizing the scanning results to generate an attendance result, wherein the information of the scanning task comprises a staff list corresponding to the attendance task and the face characteristics of corresponding staff; the PTZ camera is used for setting a feature library corresponding to the scanning task according to the received personnel list in the scanning task and the face features of the corresponding personnel, executing scanning after the corresponding scanning task starts, and matching the scanned face images in the feature library corresponding to the scanning task to obtain a scanning result.

Description

Face attendance system based on MIS system and PTZ camera
Technical Field
The invention relates to a face attendance system based on an MIS system and a PTZ camera, and belongs to the field of attendance statistics.
Background
Attendance is required in meeting activity scenes such as meeting sign-in, student class and the like. In addition to the conventional attendance schemes of manual roll call and manual check-in, some automatic attendance schemes are generated along with the technological progress, and attendance based on the face recognition technology is one of the schemes:
a fixed wide-angle camera is deployed at an entrance and an exit of a room, a face image is collected to form a video data stream, the video data stream is transmitted to a GPU (graphics processing unit) server through a network, the GPU server identifies the video data stream through a face identification algorithm and matches a personnel list, and attendance data are obtained.
This solution has the following drawbacks:
(1) because a fixed wide-angle camera without moving and zooming functions is adopted to acquire images, a room with a larger space cannot ensure that a remote face is clearly acquired, and the room cannot be completely covered, so that the attendance accuracy is influenced;
(2) because the face recognition is completed by the GPU server and is limited by the performance of the GPU server, one GPU server can only serve a limited number of cameras, and the GPU server increases the system cost;
(3) the camera is deployed at the entrance and exit of a room and is easily influenced by uncertain factors such as motion, illumination conditions and the like, and a system may not acquire clear and stable face images, so that the accuracy of attendance checking is influenced;
(4) matching recognized faces across organizations in matching lists of people does not take into account how to cope with changes in people in the room, e.g. a corporate meeting room is used by different people at different times, a classroom has different students attending at different times. In the prior art, the face is often matched in the list range of the whole organization (such as a company and a school), so that the matching efficiency is low, and the accuracy is influenced by adding irrelevant matching items.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: the human face attendance system based on the MIS system and the PTZ camera solves the problems of low attendance accuracy, high cost and low attendance efficiency of an attendance scheme based on human face recognition in the prior art.
The technical scheme adopted by the invention for solving the technical problems is as follows:
face attendance system based on MIS system and PTZ camera includes: MIS systems (management information systems) and PTZ cameras; the MIS system is connected with the PTZ camera through a network;
the MIS system is used for inputting the face characteristics of an attendance object, formulating an attendance task, formulating a scanning task at least according to the attendance task which needs to be executed currently and sending the scanning task to the corresponding PTZ camera, collecting the scanning result of the PTZ camera and summarizing the scanning result to generate an attendance result, wherein the information of the scanning task comprises a staff list corresponding to the attendance task and the face characteristics of corresponding staff;
the PTZ camera is used for setting a feature library corresponding to the scanning task according to the received personnel list in the scanning task and the face features of the corresponding personnel, executing scanning after the corresponding scanning task starts, and matching the scanned face images in the feature library corresponding to the scanning task to obtain a scanning result.
As further optimization, when the PTZ camera receives a scanning task, the PTZ camera starts to execute the current scanning task, and finishes the current scanning task by using a scanning end instruction sent by the MIS system;
or, the information of the scanning task further includes the start and end time of the scanning task, and the PTZ camera automatically executes the corresponding scanning task according to the start and end time of the scanning task.
And as further optimization, the PTZ camera only performs face feature matching in a feature library of a current scanning task of the PTZ camera during scanning, and automatically enters a low-power-consumption idle state after the task is finished.
As further optimization, the PTZ camera is arranged on one wall in a room, and the set height and position meet the requirement that when indoor personnel face the wall, the PTZ camera can acquire a face image which is reasonable in angle and suitable for a face characterization algorithm.
As a further optimization, the MIS system may manage multiple PTZ cameras, including the following software modules: the attendance checking system comprises a face feature input module, an attendance checking task formulation module, a task scheduling module and an attendance checking result generation module;
the face feature input module is used for performing feature input on a face image of an attendance object uploaded to the MIS system and storing the face image into a feature database of the MIS system;
the attendance task formulation module is used for formulating an attendance task, wherein the attendance task comprises a list of participants, an execution place of the task and start-stop time of task execution; when the system is applied to a school scene, the attendance task is automatically generated according to a class schedule and a corresponding class-hour student list;
the task scheduling module is used for formulating a scanning task at least according to the current attendance task to be executed, sending the scanning task to the corresponding PTZ camera and controlling the PTZ camera to scan within a specified time period;
and the attendance result generation module is used for collecting the multi-round scanning results of the PTZ camera and collecting the results to generate an attendance result.
As further optimization, the task scheduling module at least formulates a scanning task according to the current attendance task to be executed and sends the scanning task to the corresponding PTZ camera, and specifically comprises:
the task scheduling module is used for positioning to a corresponding PTZ camera according to an execution place of an attendance task, positioning to human face features at least related to the current attendance task according to a participator list, and taking the human face features out of a feature database of an MIS system; and then generating a scanning task according to the list of the participating personnel and the face characteristics of the corresponding personnel and sending the scanning task to the corresponding PTZ camera.
As further optimization, the attendance result generation module comprises a result acquisition sub-module and a summary sub-module;
the result obtaining submodule is used for periodically obtaining a current scanning result from the PTZ camera, or obtaining the scanning result from the PTZ camera once when the scanning task is finished through an instruction or after the scanning task is automatically finished;
and the summarizing submodule is used for summarizing the multi-round scanning results acquired by the result acquisition submodule to generate an attendance result.
As further optimization, the attendance result generation module collects and summarizes the multiple scanning results of the PTZ camera to generate an attendance result, and specifically includes:
(1) setting an accumulation value a for each person i participating in attendance checkingiThis value is initially 0;
(2) the MIS system collects multiple scanning rounds from the PTZ camera, and for one scanning round, the following processing is carried out:
if the identity of person i is not matched, aiKeeping the same;
if the identity of person i is matched exactly once, then pair aiAccumulating for 1;
if the identity of person i is matched multiple times, then pair aiAccumulating a primary value p, wherein p is more than 0 and less than 1;
(3) after the results of each round are combined, for the person i, if aiIf the/k is lower than the set threshold value, the person is judged not to be out of work, and k is the number of rounds scanned by the PTZ camera.
As a further optimization, the PTZ camera includes the following software modules, each of which individually or in combination provides an API interface for external system calls:
the query module is used for providing a query function of one or more scanning results cached in the current PTZ camera, and the scanning result of one round comprises an identity list matched with the face correspondingly found in the scanning of the round;
the face feature library setting module is used for providing a setting function of a face feature library in the PTZ camera: and organizing a face feature library corresponding to the scanning task according to the personnel list in the scanning task sent by the MIS system and the face features of the corresponding personnel.
As a further optimization, the PTZ camera further comprises the following software modules:
the scanning task time setting module is used for providing a starting and ending time setting function of a scanning task;
and the system time setting module is used for providing a function of setting the system time of the PTZ camera.
As a further optimization, the PTZ camera executing scanning specifically includes:
the PTZ camera plans a scanning path which ensures to cover the face position in the room;
the PTZ camera scans the room for one round along a planned path, characterizes the face image captured in the video stream, identifies and matches the face image in a face feature library of the PTZ camera and counts the scanning result of the round;
c. circularly executing the step b or circularly executing the steps a and b until the task ending time is reached or a scanning termination instruction sent by the MIS is received;
and if the steps a and b are executed circularly, updating the currently planned scanning path in the step a according to the scanning result of the previous round.
As a further optimization, the system further comprises an attendance feedback receiving terminal, wherein the attendance feedback receiving terminal is used for receiving an attendance result pushed by the MIS system through a pushing channel.
The invention has the beneficial effects that:
(1) because the PTZ camera has the automatic zooming and zooming functions, the face of a remote angle and the face of a remote angle at a far distance can not be omitted, and the definition of the face is ensured, so that the identification accuracy is improved, and the time for roll calling can be effectively reduced finally.
(2) The face detection and the feature matching are realized in the PTZ camera, and a central server with strong performance is not needed to realize the function, so that the cost is reduced.
(3) The system can sense the personnel object of the current attendance task, so that a personnel list in a scanning task formulated for the PTZ camera can only contain the personnel object of the current attendance task, when the PTZ camera carries out face recognition matching, the matching range is only limited to the face features of the personnel object of the scanning task, but not the face features of the personnel object of the whole organization, thereby reducing a face recognition list and improving the recognition matching efficiency and accuracy.
(4) In the scanning process, the PTZ camera automatically updates and plans the path of the next round of scanning according to the detected face position in the previous round of scanning, so that the coverage of personnel is ensured, the scanning time is saved, and the scanning efficiency is improved.
(5) In the generation of the attendance checking result, the multi-round scanning results of the PTZ camera are synthesized to carry out algorithm statistics, so that the probability of matching errors is reduced, and the attendance checking accuracy is improved.
(6) The PTZ camera and the MIS system respectively perform own functions, the face recognition attendance function of the invention can be realized only by providing a relevant API interface for the MIS system to call, and the MIS system does not need to sense details of how the PTZ camera realizes image processing work and mechanical movement at all, thereby reducing the development difficulty.
(7) The whole system is unmanned from task setting, image acquisition and result feedback, is convenient and quick, reduces manual participation and improves accuracy.
Drawings
FIG. 1 is a structural block diagram of a face attendance system based on a MIS system and a PTZ camera;
FIG. 2 is a block diagram of software modules in a MIS system;
FIG. 3 is a block diagram of software modules in a PTZ camera;
FIG. 4 is a schematic diagram of an interaction process of the MIS system and the PTZ camera;
fig. 5 is a schematic diagram of another interaction process of the MIS system and the PTZ camera.
Detailed Description
The invention aims to provide a face attendance system based on an MIS system and a PTZ camera, and solves the problems of low attendance accuracy, high cost and low attendance efficiency in an attendance scheme based on face recognition in the prior art. The invention relates to a face attendance system which is built by utilizing a PTZ camera and an MIS system based on an organization network, wherein an MIS system formulates an attendance task, when the attendance task is sensed to be about to start, a scanning task is formulated according to the attendance task and is sent to the PTZ camera of a corresponding place, the PTZ camera of the corresponding place carries out face image acquisition, recognition and matching according to the scanning task, and finally, the MIS system carries out comprehensive calculation on the scanning result of the PTZ camera to obtain an attendance result. In addition, through further expansion of the system, the MIS system can feed back the attendance result to the attendance feedback receiving terminal so that related personnel can conveniently check the attendance condition.
The face attendance system is not only suitable for scenes with personnel mobility and conventional classroom roll call requirements in school classrooms (middle and primary schools, high schools, vocational colleges, universities and the like), but also suitable for conference check-in scenes of some organizations.
As shown in fig. 1, the face attendance system based on the MIS system and the PTZ camera in the invention comprises the MIS system and the PTZ camera; the MIS system is connected with the PTZ camera through a network;
the MIS system is used for inputting the face characteristics of an attendance object, formulating an attendance task, formulating a scanning task at least according to the attendance task which needs to be executed currently and sending the scanning task to the corresponding PTZ camera, collecting the scanning result of the PTZ camera and summarizing the scanning result to generate an attendance result, wherein the information of the scanning task comprises a staff list corresponding to the attendance task and the face characteristics of corresponding staff;
the PTZ camera is used for setting a feature library corresponding to the scanning task according to the received personnel list in the scanning task and the face features of the corresponding personnel, executing scanning after the corresponding scanning task starts, and matching the scanned face images in the feature library corresponding to the scanning task to obtain a scanning result.
In the specific implementation, the MIS system is held by an organization (such as a company, a school and the like), the PTZ camera is installed in a room of an attendance checking place, the MIS system and the PTZ camera are connected through a network, and the network can be a wired network or a wireless network inside the organization; one MIS system can manage a plurality of PTZ cameras.
It should be noted that, in the specific implementation, because the shape of the room and the position of the platform are different, the specific installation position of the PTZ camera is not limited in the present invention, and the position selection principle is to ensure that when the indoor person faces forward, the PTZ camera can acquire a face image with a reasonable angle and suitable for a face characterization algorithm. For an application scene that one or more speakers and a series of listeners exist in a room, in a preferred embodiment, the PTZ camera can be installed on a wall of the room, the face of the listener faces uniformly when listening and speaking, and is positioned near the middle of the horizontal direction of the wall and vertically at a position 1.8-3m away from the ground reference height, on the basis of which the PTZ camera can be shifted to the left/right to some extent at the middle of the horizontal direction, but not too far away, and the reference shift amount is not more than 1 m; by adopting the arrangement, when a speaker explains in front of the wall or on one side of the wall, the PTZ camera can acquire a front image with a good angle.
Fig. 2 illustrates a software module configuration of the MIS system, which includes: the attendance checking system comprises a face feature input module, an attendance checking task formulation module, a task scheduling module and an attendance checking result generation module;
the face feature input module is used for performing feature input on a face image of an attendance object uploaded to the MIS system and storing the face image into a feature database of the MIS; the feature database is used for supporting the face features corresponding to the staff providing attendance tasks for the PTZ camera;
the attendance task formulation module is used for formulating an attendance task, wherein the attendance task comprises a list of participants, an execution place of the task and start-stop time of task execution; when the system is applied to a school scene, the attendance task is automatically generated according to a class schedule and a corresponding class-hour student list;
the task scheduling module is used for formulating a scanning task according to at least an attendance task which needs to be executed currently, sending the scanning task to the corresponding PTZ camera and controlling the PTZ camera to scan within a specified time period; when the starting time of the attendance task execution is about to come, the MIS system automatically schedules: positioning to a corresponding PTZ camera according to an execution place of the attendance task, positioning to human face features at least related to the current attendance task according to a participator list, and taking the human face features out of a feature database of an MIS system; then generating a scanning task according to the list of participating personnel and the face characteristics of corresponding personnel and sending the scanning task to the corresponding PTZ camera; the "prescribed time period" herein refers to a period between start and end times of the scanning job.
It should be noted that the scanning task information sent by the task scheduling module to the corresponding PTZ camera may include a plurality of scanning task information of the PTZ camera, such as: for a classroom, the task scheduling module can send the scanning task information of the current class time task (including the list of students currently preparing to attend the classroom and the corresponding facial features) and the scanning task information of the next class time task or tasks (including the list of students preparing to attend the classroom at the next class time or classes and the corresponding facial features) to the PTZ camera of the classroom, so that the PTZ camera can conveniently organize the feature library of the latter scanning tasks of the current scanning task in advance. However, since the storage requirement for the PTZ camera is higher as the number of scanning jobs transmitted at one time is larger, the current scanning job information may be transmitted only to the corresponding PTZ camera in order to reduce the occupation of the storage space of the camera.
And the attendance result generation module is used for collecting the multi-round scanning results of the PTZ camera and collecting the results to generate an attendance result.
The MIS system based on the software module has a feature input function, an attendance task formulation function, a task scheduling function for the PTZ camera and an attendance result generation function. Certainly, in order to realize result feedback, an attendance result feedback module can be further arranged to automatically push attendance results to the attendance feedback receiving terminal.
The software module of the PTZ camera comprises: the system comprises a query module and a face feature library setting module;
the query module is used for providing a query function of one or more scanning results cached in the current PTZ camera, and the scanning result of one round comprises an identity list matched with the face correspondingly found in the scanning of the round;
the face feature library setting module is used for providing a setting function of a face feature library in the PTZ camera: and organizing a face feature library according to the list of the persons in the scanning task sent by the MIS system and the corresponding persons of the face features of the corresponding persons, for example, organizing the face feature library in an < identity-feature value > mode, wherein each face feature corresponds to one person identity in the MIS system.
And the face feature library setting module organizes the face feature library corresponding to the attendance task according to the personnel list corresponding to the scanning task and the face features of corresponding personnel corresponding to one or more scanning tasks sent by the MIS system at one time. It can be understood that one scanning task corresponds to one face feature library, and the same face feature library may correspond to multiple scanning tasks, because the attendance staff lists at different time periods may be the same, such as: for a classroom where a batch of students study a class at 9:00 PM to 9:45 PM and the same batch of students study another class at 3:00 PM to 3:45 PM, the same facial feature library should be used for the scanning task at 9:00 PM to 9:45 PM and the scanning task at 3:00 PM to 3:45 PM.
In addition, the PTZ camera of the present invention may also automatically execute an attendance task based on time sensing, and correspondingly, it may further include a scan task time setting module and a system time setting module, as shown in fig. 3;
the scanning task time setting module is used for providing a starting and ending time setting function of a scanning task;
the system time setting module is used for providing a function of setting the system time of the PTZ camera and providing accurate time reference for automatic execution of a scanning task;
the various software modules described above may provide an API interface for MIS system calls, either alone or in combination. The API interface comprises starting/ending a scanning task, inquiring a scanning result and setting a human face feature library. These API interfaces are independent of the specific network protocol and implementation modality.
The invention realizes the face recognition attendance function in the room based on the combined action of the MIS system and the PTZ camera, and the function is as follows:
1. uploading facial images of people in the organization to an MIS system in advance for characterization; the MIS system adopts a face characterization standard algorithm which is the same as the inner part of the PTZ camera, so that the face characteristics in a face characteristic library in the MIS system can be directly loaded into the PTZ camera. For school scenes, this step is convenient to implement, such as: when a new student enters a handling procedure, the school can take pictures to collect student portrait information and record the portrait information into the MIS system.
2. An attendance task is formulated in the MIS system in advance, and the content of the attendance task comprises the following steps: a list of participants, a location of the task, and a start-stop time of the task. For school scenes, the steps are particularly convenient to implement, attendance tasks can be automatically generated by utilizing the class schedule of the school and the name and number information of students who should go out in corresponding class schedules, and the attendance tasks can be automatically executed periodically without manual participation.
3. The MIS system detects that the attendance task is about to start and then carries out a series of work:
① locating to the corresponding PTZ camera by the place where the task takes place;
② locating the face features related to the current attendance task through the participator list, and taking the features from the feature database;
③, generating a scanning task according to the relevant information of the task (at least including the list of the people of the current attendance task and the face characteristics of the corresponding people), sending the scanning task to the corresponding PTZ camera, and controlling the PTZ camera to scan in a specified time period.
It should be noted that there are two typical strategies for controlling the scanning of the PTZ camera by the MIS system in the present invention, but the present invention is not limited to these two strategies:
(1) PTZ camera built-in clock (time capable of sensing): the MIS system informs the PTZ camera of how to calibrate the clock, the scanning task information sent to the PTZ camera also comprises the starting and ending time of the scanning task, and the PTZ camera can automatically start/end scanning when the corresponding time is reached;
(2) PTZ camera does not need a built-in clock (no sensing time): the scanning task information does not need to contain the starting and ending time of the scanning task, when the MIS system sends the scanning task information to the PTZ camera, the PTZ camera starts scanning after organizing the feature library according to the personnel list in the scanning task information and the face features of corresponding personnel, and after receiving the ending instruction sent by the MIS system, the PTZ camera finishes scanning.
4. At the feedback time or the end time defined by the task, the MIS system integrates the collected scanning results of the PTZ camera to form a roll call result, and automatically reports the roll call result to an attendance check feedback receiving terminal, such as a mobile phone, an organized management report terminal, a classroom lecture computer and the like, in a short message/message pushing mode and the like.
It can be seen that, in the present invention, the MIS system can control the PTZ camera to start/end the scanning task through the instruction, and the PTZ camera can also automatically start/end the scanning task according to the start/end time of the scanning task, so that the interaction process between the PTZ camera and the scanning task corresponds to two cases, which is specifically described as follows:
referring to fig. 4, an interactive process of the MIS system and the PTZ camera (PTZ camera without clock):
a: the MIS system formulates a scanning task according to the current attendance task and sends the scanning task to the corresponding PTZ camera, and informs the corresponding PTZ camera of starting to execute the scanning task; the corresponding PTZ camera starts to scan when organizing a face feature library locally according to the list of the participators in the scanning task and the face features of the corresponding personnel;
and b, periodically scanning the room space by the PTZ camera before receiving the scanning ending instruction of the MIS system. Forming a round of scanning results after each period of scanning and caching the scanning results until the scanning results are read by an external request (sent by an MIS system);
the MIS system obtains the scanning result from the PTZ camera, and the specific realization can be realized in two ways: one method is to obtain all cached scanning results from the PTZ camera once for summarizing when a task is finished; in order to save PTZ cache space and improve reliability, another implementation manner is: the MIS system inquires the current scanning result of the PTZ camera periodically, and the scanning results obtained by the MIS system in a plurality of periods are collected to form an attendance checking result when a task is finished, so that the PTZ camera can clear the scanning results after the MIS system obtains the current scanning result of the PTZ camera each time, and a cache space is provided for subsequent scanning; the method can also avoid that the MIS system cannot acquire any scanning result until the fault is found out finally after the PTZ camera or the network has the fault, so as to improve the reliability;
and d, at the end time defined by the attendance task, the MIS system sends a scanning end request to the PTZ camera (and obtains the final scanning result of the PTZ), and the PTZ camera stops scanning after feeding back the scanning result and enters a low-power-consumption idle state.
Referring to fig. 5, another interaction process for the MIS system and PTZ camera (PTZ camera has clock):
a: the MIS system formulates a scanning task according to the attendance task, the PTZ camera has a time sensing function in the interactive scene and can automatically start/end scanning, the MIS system can send the scanning task to the corresponding PTZ camera in advance (before the attendance task starts), and information in the scanning task comprises a participatory staff list and the face characteristics of corresponding staff and also comprises the starting and ending time of the scanning task; the PTZ camera organizes a face feature library locally according to the list of participating persons and the face features of corresponding persons, and configures the starting and ending time of a scanning task;
and b, when the starting time of the scanning task is up, the PTZ camera automatically executes scanning. Forming a round of scanning results after each period of scanning and caching the scanning results until the scanning results are read by an external request (sent by an MIS system);
the MIS system obtains the scanning result from the PTZ camera, and the specific realization can be realized in two ways: one method is to collect all cached scanning results from the PTZ camera once after the attendance task is finished; in order to save PTZ cache space and improve reliability, another implementation manner is: the MIS system inquires the current scanning result of the PTZ camera periodically, and the scanning results obtained by the MIS system in a plurality of periods are collected after the attendance task is finished to form an attendance result, so that the PTZ camera can clear the scanning results after the MIS system obtains the current scanning result of the PTZ camera each time, and the cache space is provided for the following scanning; the method can also avoid that the MIS system cannot acquire any scanning result until the fault is found out finally after the PTZ camera or the network has the fault, so as to improve the reliability;
and d, when the end time of the scanning task is up, the PTZ camera automatically ends scanning, and enters a low-power-consumption idle state, and the MIS system can send a request to acquire the scanning result of the PTZ camera.
In the aspect of scanning executed by the PTZ camera, when the PTZ camera starts scanning, scanning is carried out according to a pre-planned scanning initial path; automatically planning and updating to generate a next round of scanning path according to the detected face position in the scanning process; when scanning in the next round, scanning is executed according to the scanning path planned and updated in the previous round; and circularly executing the scanning and path planning updating processes until the attendance checking task is finished or a scanning termination instruction is received. The scanning path is continuously adjusted and optimized automatically through the strategy, so that the personnel coverage is ensured, the scanning time is saved, and the scanning efficiency is improved. Of course, as another simplified solution, the PTZ camera may always scan according to a pre-planned scan path.
In the aspect of attendance result generation of the MIS system, in order to ensure the accuracy of attendance, the invention collects the multi-round scanning results of the PTZ camera and carries out summary weighting judgment, and the method specifically comprises the following steps:
(1) setting an accumulation value a for each person i participating in attendance checkingiThis value is initially 0;
(2) the MIS system collects multiple scanning rounds from the PTZ camera, and for one scanning round, the following processing is carried out:
if the identity of person i is not matched, then aiKeeping unchanged, namely indicating that the person is not matched in the current scanning round;
if the identity of the person i is matched exactly once, the match can be considered as an exact match, and then a is matchediAccumulating for 1;
if the identity of the person i is matched multiple times, indicating that at least one face is mismatched to the person
Figure 838997DEST_PATH_IMAGE001
Thus impairing the confidence that the identity is correctly matched, then pair aiAdding a value p less than 1, wherein p is more than 0 and less than 1;
(3) after the results of each round are combined, for the person i, if aiIf the/k is lower than the set threshold value, the person is judged not to be out of work, and k is the number of rounds scanned by the PTZ camera.
In conclusion, the invention realizes the human face attendance system which can be suitable for multiple scenes and can automatically, efficiently and accurately complete attendance tasks, thereby achieving the effect of replacing the conventional roll attendance signing activities or greatly reducing the number of people needing roll attendance signing.

Claims (12)

1. A face attendance system based on an MIS system and a PTZ camera is characterized in that,
the method comprises the following steps: MIS systems and PTZ cameras; the MIS system is connected with the PTZ camera through a network;
the MIS system is used for inputting the face characteristics of an attendance object, formulating an attendance task, formulating a scanning task at least according to the attendance task which needs to be executed currently and sending the scanning task to the corresponding PTZ camera, collecting the scanning result of the PTZ camera and summarizing the scanning result to generate an attendance result, wherein the information of the scanning task comprises a staff list corresponding to the attendance task and the face characteristics of corresponding staff;
the PTZ camera is used for setting a feature library corresponding to the scanning task according to the received personnel list in the scanning task and the face features of the corresponding personnel, executing scanning after the corresponding scanning task starts, and matching the scanned face images in the feature library corresponding to the scanning task to obtain a scanning result.
2. The MIS system and PTZ camera-based face attendance system of claim 1,
when the PTZ camera receives the scanning task, the PTZ camera starts to execute the current scanning task, and the current scanning task is ended by a scanning ending instruction sent by the MIS system;
or, the information of the scanning task further includes the start and end time of the scanning task, and the PTZ camera automatically executes the corresponding scanning task according to the start and end time of the scanning task.
3. The MIS system and PTZ camera-based face attendance system of claim 1,
the PTZ camera only carries out face feature matching in a feature library of a current scanning task of the PTZ camera during scanning, and automatically enters a low-power-consumption idle state after the task is finished.
4. The MIS system and PTZ camera-based face attendance system of claim 1,
the PTZ camera is arranged on one wall in a room, and the height and the position of the PTZ camera meet the requirement that when indoor personnel face the wall, the PTZ camera can acquire a face image which is reasonable in angle and suitable for a face characterization algorithm.
5. The MIS system and PTZ camera-based face attendance system of claim 1,
the MIS system manages a plurality of PTZ cameras, which includes the following software modules: the attendance checking system comprises a face feature input module, an attendance checking task formulation module, a task scheduling module and an attendance checking result generation module;
the face feature input module is used for performing feature input on a face image of an attendance object uploaded to the MIS system and storing the face image into a feature database of the MIS system;
the attendance task formulation module is used for formulating an attendance task, wherein the attendance task comprises a list of participants, an execution place of the task and start-stop time of task execution; when the system is applied to a school scene, the attendance task is automatically generated according to a class schedule and a corresponding class-hour student list;
the task scheduling module is used for formulating a scanning task at least according to the current attendance task to be executed, sending the scanning task to the corresponding PTZ camera and controlling the PTZ camera to scan within a specified time period;
and the attendance result generation module is used for collecting the multi-round scanning results of the PTZ camera and collecting the results to generate an attendance result.
6. The MIS system and PTZ camera-based face attendance system of claim 5,
the task scheduling module at least formulates a scanning task according to the current attendance task to be executed and sends the scanning task to the corresponding PTZ camera, and the method specifically comprises the following steps:
the task scheduling module is used for positioning to a corresponding PTZ camera according to an execution place of an attendance task, positioning to human face features at least related to the current attendance task according to a participator list, and taking the human face features out of a feature database of an MIS system; and then generating a scanning task according to the list of the participating personnel and the face characteristics of the corresponding personnel and sending the scanning task to the corresponding PTZ camera.
7. The MIS system and PTZ camera-based face attendance system of claim 5,
the attendance checking result generating module comprises a result obtaining sub-module and a summarizing sub-module;
the result obtaining submodule is used for periodically obtaining a current scanning result from the PTZ camera, or obtaining the scanning result from the PTZ camera once when the scanning task is finished through an instruction or after the scanning task is automatically finished;
and the summarizing submodule is used for summarizing the multi-round scanning results acquired by the result acquisition submodule to generate an attendance result.
8. The MIS system and PTZ camera-based face attendance system of claim 5,
the attendance result generation module collects the multi-round scanning results of the PTZ camera and collects the results to generate attendance results, and the attendance result generation module specifically comprises:
(1) attendance for each participantSet an accumulation value aiThis value is initially 0;
(2) the MIS system collects multiple scanning rounds from the PTZ camera, and for one scanning round, the following processing is carried out:
if the identity of person i is not matched, then aiKeeping the same;
if the identity of the person i is matched exactly once, then pair aiAccumulating for 1;
if the identity of person i is matched multiple times, then pair aiAccumulating a primary value p, wherein p is more than 0 and less than 1;
(3) after the results of each round are combined, for the person i, if aiIf the/k is lower than the set threshold value, the person is judged not to be out of work, and k is the number of rounds scanned by the PTZ camera.
9. The MIS system and PTZ camera-based face attendance system of claim 5,
the PTZ camera comprises the following software modules, wherein each software module provides an API (application programming interface) for external system calling singly or in a combined mode:
the query module is used for providing a query function of one or more scanning results cached in the current PTZ camera, and the scanning result of one round comprises an identity list matched with the face correspondingly found in the scanning of the round;
the face feature library setting module is used for providing a setting function of a face feature library in the PTZ camera: and organizing a face feature library corresponding to the scanning task according to the personnel list in the scanning task sent by the MIS system and the face features of the corresponding personnel.
10. The MIS system and PTZ camera-based face attendance system of claim 9,
the PTZ camera further comprises the following software modules:
the scanning task time setting module is used for providing a starting and ending time setting function of a scanning task;
and the system time setting module is used for providing a function of setting the system time of the PTZ camera.
11. The MIS system and PTZ camera-based face attendance system of claim 9,
the PTZ camera executing scanning specifically includes:
the PTZ camera plans a scanning path which ensures to cover the face position in the room;
the PTZ camera scans the room for one round along a planned path, characterizes the face image captured in the video stream, identifies and matches the face image in a face feature library of the PTZ camera and counts the scanning result of the round;
c. circularly executing the step b or circularly executing the steps a and b until the task ending time is reached or a scanning termination instruction sent by the MIS is received;
and if the steps a and b are executed circularly, updating the currently planned scanning path in the step a according to the scanning result of the previous round.
12. The MIS system and PTZ camera based face attendance system of any of claims 1-11,
the system further comprises an attendance feedback receiving terminal, and the attendance feedback receiving terminal is used for receiving the attendance result pushed by the MIS system through the pushing channel.
CN202010016665.7A 2020-01-08 2020-01-08 Face attendance system based on MIS system and PTZ camera Pending CN110807450A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010016665.7A CN110807450A (en) 2020-01-08 2020-01-08 Face attendance system based on MIS system and PTZ camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010016665.7A CN110807450A (en) 2020-01-08 2020-01-08 Face attendance system based on MIS system and PTZ camera

Publications (1)

Publication Number Publication Date
CN110807450A true CN110807450A (en) 2020-02-18

Family

ID=69493338

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010016665.7A Pending CN110807450A (en) 2020-01-08 2020-01-08 Face attendance system based on MIS system and PTZ camera

Country Status (1)

Country Link
CN (1) CN110807450A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112489235A (en) * 2020-10-30 2021-03-12 郑州富联智能工坊有限公司 Attendance checking device and method thereof

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105205646A (en) * 2015-08-07 2015-12-30 江苏诚创信息技术研发有限公司 Automatic roll call system and realization method thereof
CN105809595A (en) * 2016-03-14 2016-07-27 河南省阳光智创物联网科技有限公司 College student behavior prediction and management system
CN105869226A (en) * 2016-06-02 2016-08-17 南京安智易达智能科技有限公司 Face-recognition-based automatic roll-call system and method for prisons
US20170295117A1 (en) * 2016-04-08 2017-10-12 Microsoft Technology Licensing, Llc Intelligent personal assistant as a contact
CN108022318A (en) * 2017-12-28 2018-05-11 上海享服信息技术有限公司 More people's recognition of face attendance checking systems and its Work attendance method
CN108830559A (en) * 2018-06-01 2018-11-16 广东蔚海数问大数据科技有限公司 A kind of Work attendance method and device based on recognition of face
CN109840962A (en) * 2018-12-27 2019-06-04 北京智慧云行科技有限责任公司 Recognition of face movable attendance checking system and method
CN110135852A (en) * 2019-04-17 2019-08-16 深圳市雄帝科技股份有限公司 Method of payment, system, payment accept equipment and server by bus

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105205646A (en) * 2015-08-07 2015-12-30 江苏诚创信息技术研发有限公司 Automatic roll call system and realization method thereof
CN105809595A (en) * 2016-03-14 2016-07-27 河南省阳光智创物联网科技有限公司 College student behavior prediction and management system
US20170295117A1 (en) * 2016-04-08 2017-10-12 Microsoft Technology Licensing, Llc Intelligent personal assistant as a contact
CN105869226A (en) * 2016-06-02 2016-08-17 南京安智易达智能科技有限公司 Face-recognition-based automatic roll-call system and method for prisons
CN108022318A (en) * 2017-12-28 2018-05-11 上海享服信息技术有限公司 More people's recognition of face attendance checking systems and its Work attendance method
CN108830559A (en) * 2018-06-01 2018-11-16 广东蔚海数问大数据科技有限公司 A kind of Work attendance method and device based on recognition of face
CN109840962A (en) * 2018-12-27 2019-06-04 北京智慧云行科技有限责任公司 Recognition of face movable attendance checking system and method
CN110135852A (en) * 2019-04-17 2019-08-16 深圳市雄帝科技股份有限公司 Method of payment, system, payment accept equipment and server by bus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
刘洋: "基于人脸识别技术的教室考勤系统的设计和实现", 《中国优秀硕士学位论文全文数据库 社会科学Ⅱ辑》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112489235A (en) * 2020-10-30 2021-03-12 郑州富联智能工坊有限公司 Attendance checking device and method thereof

Similar Documents

Publication Publication Date Title
CN107423947B (en) Conference management method and system
CN102970334A (en) Multi-agenda conflict processing method and system thereof
CN105049812A (en) Unmanned aerial vehicle portable ground station processing method and system
CN102647577A (en) Teleconference management system and management method
CN1694527A (en) Systems and methods for novel real-time audio-visual communication and data collaboration
CN106027960B (en) A kind of positioning system and method
CN113705912B (en) Conference optimization management method and system based on Internet
CN109068090B (en) Wireless video conference system
US11665335B2 (en) Conference room intelligent management method and intelligent conference room system
CN110390934B (en) Information prompting method and voice interaction terminal
CN112008736A (en) Welcome robot allocation method and device, storage medium and electronic device
CN110807450A (en) Face attendance system based on MIS system and PTZ camera
CN101489049B (en) Video camera lens regulation control method and apparatus
CN109936814A (en) A kind of intercommunication terminal, speech talkback coordinated dispatching method and its system
CN102509529B (en) Self-service tour guide method
CN109194916B (en) Movable shooting system with image processing module
CN114943509A (en) Paperless conference management system and method
CN114227702A (en) Intelligent conference guiding method and device based on robot and robot
CN107613256A (en) A kind of monitoring implementation method of smart home
CN102427520A (en) Multi-channel network video monitoring method and system on the basis of two-layered ID (Identification) structure
CN112418116A (en) Roll call method and device, electronic equipment and storage medium
CN109218612B (en) Tracking shooting system and shooting method
KR101026033B1 (en) System and method for providing video service interworking multipoint conference unit
JP6701887B2 (en) Information processing system, information processing method, and program
CN112183945B (en) Station control method, terminal, station control system and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200218

RJ01 Rejection of invention patent application after publication