CN105788018A - Tablet personal computer-based facial speech attendance system - Google Patents

Tablet personal computer-based facial speech attendance system Download PDF

Info

Publication number
CN105788018A
CN105788018A CN201610151272.0A CN201610151272A CN105788018A CN 105788018 A CN105788018 A CN 105788018A CN 201610151272 A CN201610151272 A CN 201610151272A CN 105788018 A CN105788018 A CN 105788018A
Authority
CN
China
Prior art keywords
face
speech
server
app
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610151272.0A
Other languages
Chinese (zh)
Inventor
尚凌辉
黄庆福
蔡振军
马海华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hp Banking Information Service Co Ltd
Original Assignee
Hangzhou Hp Banking Information Service Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hp Banking Information Service Co Ltd filed Critical Hangzhou Hp Banking Information Service Co Ltd
Priority to CN201610151272.0A priority Critical patent/CN105788018A/en
Publication of CN105788018A publication Critical patent/CN105788018A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/10—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people together with the recording, indicating or registering of other data, e.g. of signs of identity
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/117—Identification of persons
    • A61B5/1171—Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • A61B5/1176—Recognition of faces
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4803—Speech analysis specially adapted for diagnostic purposes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Psychiatry (AREA)
  • Computational Linguistics (AREA)
  • Developmental Disabilities (AREA)
  • Educational Technology (AREA)
  • Acoustics & Sound (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Child & Adolescent Psychology (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The invention discloses a tablet personal computer-based facial speech attendance system, comprising an acquisition tablet personal computer with an APP (application) and a database server; the acquisition tablet personal computer runs the APP to acquire facial feature points and speech, feature point and speech data are transmitted to the server, the database server has a facial recognition algorithm module and a speech recognition algorithm module integrated therein, carries out facial and speech recognition comparison by receiving the data transmitted by the APP of the table personal computer and returns comparison results to the APP of the table personal computer, the APP displays the results, the server also saves the results to a database, and during each recognition the server may save facial image and speech data to the database and complete tracking for each operation recording, thus facilitating later export of data. This system can be used for checking on the attendance of staff in enterprises and institutions and analyzing expressions of staff and speech data to preliminarily judge mental conditions of the staff during collection of attendance information.

Description

A kind of face voice attendance checking system based on panel computer
Technical field
The invention belongs to Computer Applied Technology field, relating to panel computer, the face attendance checking system APP being enclosed within panel computer to run and the contrast of backstage face, a speech recognition algorithm server, staff attendance that whole system can be used for realizing in enterprises and institutions, personal information typing, recognition of face registration, In vivo detection, expression detection are analyzed, speech recognition contrast.
Background technology
At present, the face Time Attendance Device abundant species on market, it is widely used, but ubiquity resolution is not high, image acquisition noise is higher, and storage matching characteristic point does not enrich, and causes that the face identification rate to employee cannot break through a height level, and these equipment adopt fixing structural design mostly, structural design compares traditional conservative, and on hardware-software designs, image acquisition time delay is longer, face recognition algorithms is not sufficiently stable, it is impossible to improve the experience of user.The algorithm that a lot of face Time Attendance Devices adopt only has recognition of face to contrast, due to the restriction of hardware handles level and software development difficulty, it is impossible to realize such as In vivo detection, Expression Recognition, speech recognition contrast scheduling algorithm.
Summary of the invention
Present invention aim at: for existing face Time Attendance Device Problems existing, a kind of new face Checking on Work Attendance Mode is proposed, add novel detection algorithm (In vivo detection, speech recognition), the correctness of guarantee personnel's access, add psychological calculation module in the algorithm simultaneously, in life-time service, the mental status of measurable personnel, it can be carried out psychological counselling by occurrences in human life in advance, the purpose of this set of novel face voice attendance checking system is not only in that work attendance, and be in that the duty of whole thing enterprise staff is predicted, feed back to occurrences in human life, prevented by occurrences in human life, improve the work efficiency making business unit, reduce good-for-nothing's power cost output.
Face voice attendance checking system based on panel computer, collection flat board, terminal algorithm and database server two pieces can be divided into according to hardware distribution, flat board APP application, face recognition algorithms server, speech recognition algorithm server, application data base, data can be divided into derive application according to software distribution.
Gather flat board and mainly run APP, complete human face characteristic point collection, voice collecting, afterwards characteristic point, speech data are passed to face recognition algorithms server by http agreement, server completes contrast coupling and obtains result, result is fed back to APP, complete the notice to work attendance personnel, the information such as work attendance information, work attendance personnel's emotional state are sent to database application simultaneously, complete primary information and login.
Terminal algorithm and database server, main integrated face recognition algorithms and speech recognition algorithm, by receiving the flat board APP request data sent, carry out face and speech recognition contrast, and return the result to flat board APP, by its display result, result is saved in data base by server simultaneously, identifies process every time, and server all facial image and speech data can be saved in data base, the tracking completing operation note each time preserves, and after convenient, data derive.
The invention have the advantages that:
The present invention directly uses panel computer, the compatible various panel computers of flat board APP, without carrying out adaptation, different processor and different screen all can adapt to, simultaneously less demanding to flat board processor of the feature point extraction in face recognition algorithms, in use, can quickly performing feature point extraction, voice collecting part can directly use the mike of flat board.
The algorithm that the present invention uses includes recognition of face contrast algorithm and speech recognition algorithm, and recognition of face contrast algorithm is except can extracting human face characteristic point, also can realize In vivo detection, expression detection, ensure that the phenomenon of cheating cannot occur in work attendance, speech recognition algorithm, by contrasting language in-put, improves the accuracy rate of work attendance further.
Present invention uses psychology anticipation algoritic module.Psychology anticipation algoritic module exports based on the result of face recognition algorithms and speech recognition algorithm, by detection, the speech recognition of expressing one's feelings, and then analyze the mental status that work attendance personnel are current, the result of Treatment Analysis is then through the accumulation of a long-term acquisition, thus analyzing anticipation result, this result can be submitted to occurrences in human life, and occurrences in human life according to circumstances can carry out psychological consultation with employee.
Accompanying drawing explanation
Fig. 1 is the functional block diagram of the face voice attendance checking system of the present invention；
Fig. 2 is the operational flow diagram of face voice attendance checking system；
Fig. 3 is recognition of face contrast algorithm and the speech recognition operational flow diagram of face voice attendance checking system；
Fig. 4 is face voice attendance checking system psychological calculation system flow chart.
Detailed description of the invention
Below in conjunction with accompanying drawing, the present invention is described further.
Refer to Fig. 1, the invention provides the functional block diagram of a kind of face voice attendance checking system based on flat board, the staff attendance that can be used for enterprises and institutions should be invented based on the face voice attendance checking system of flat board, simultaneously when collecting work attendance information, analyze expression and the speech data of employee, the mental status of employee is carried out anticipation.
Face voice attendance checking system based on flat board is divided into two parts, flat board APP and contrast algorithm data-base server.
On hardware, only need to meet front-facing camera pixel is not less than 2,000,000 pixels to panel computer, photographing request can be met, flat board APP is internally installed human face characteristic point extraction algorithm, under flat board shooting preview pattern, flat board APP can rapidly process each previewing photos, process this picture simultaneously, extract face characteristic value, exist without face, fast filtering is processed by picture, otherwise, square prompting frame can be shown in human face region, use human face characteristic point extraction algorithm not only to complete human face characteristic point to extract, but also can in gatherer process, the expression collection of employee is analyzed, extract behavior state, voice in this gatherer process also will be sent to the server process on backstage in real time.
Algorithm data-base server is obtaining the flat board APP face characteristic point data sent and other information, employee's face characteristic point data of correction data library storage, obtain comparing result, checking-in result is stored in data base again, and expression data and voice in work attendance process will be directed into anticipation system.
Refer to Fig. 2, for the system operational flow diagram of the present invention.
Step 1: no matter be flat board APP or server, before algorithm runs, all by loading algorithm model, it is achieved feature point extraction algorithm, recognition of face contrast the initialization of algorithm, speech recognition contrast algorithm.
Step 2: flat board APP waits staff attendance, during work attendance, APP extracts human face characteristic point and expression information, and the voice in work attendance process, by collected, is sent to server, parallel processing face and speech data afterwards.
Step 3: result work attendance situation and human face expression, voice after server process all will be stored in data base.
Recognition of face described below contrast algorithm operational flow diagram, speech recognition contrast algorithm operational flow diagram and anticipation system flow chart.
Refer to Fig. 3, contrast algorithm and speech recognition contrast algorithm operational flow diagram for recognition of face of the present invention.
The execution of recognition of face contrast algorithm and speech recognition contrast runs on the server, in order to ensure that recognition of face contrasts algorithm and the quickly process of speech recognition contrast algorithm, also uses and has arrived a large amount of calculating of video card GPU process.
Refer to Fig. 4, for psychology anticipation algorithm operational flow diagram of the present invention.
The psychological anticipation algorithm of the present invention is a maximum bright spot of this system, it is mainly used in the anticipation to employee's mental status, thus the follow-up work for occurrences in human life provides prevention mechanism, the long-term depressed mood of such as employee, this algorithm can be passed through find in long-term, occurrences in human life can carry out psychological consultation for this employee as soon as possible according to this result simultaneously, reduces the loss on human resources.
To sum up, this face voice attendance checking system is except can realizing recognition of face contrast, also this behavior of face work attendance can be acquired, such as shake the head, nod, ensureing that work attendance client is not static object or picture, by expressing one's feelings, detection is analyzed, can mental attitude residing for anticipation client, finally adopting speech recognition contrast, in the end link guarantees the accuracy of client.

Claims (3)

1. the face voice attendance checking system based on panel computer, it is characterised in that: include the collection flat board with APP application and database server, gather flat board and run APP, complete human face characteristic point collection, voice collecting；Afterwards characteristic point, speech data are passed to server by http agreement, described database server is integrated with face recognition algorithms module and speech recognition algorithm module, by receiving the flat board APP request data sent, carry out face and speech recognition contrast, and return the result to flat board APP, by its display result, result is saved in data base by server simultaneously, identify process every time, facial image and speech data all can be saved in data base by server, the tracking completing operation note each time preserves, and after convenient, data derive.
2. a kind of face voice attendance checking system based on panel computer according to claim 1, it is characterised in that: described face recognition algorithms module includes In vivo detection unit and expression detection unit.
3. a kind of face voice attendance checking system based on panel computer according to claim 1 and 2, it is characterised in that: described database server is also integrated with psychology anticipation algoritic module；Psychology anticipation algoritic module exports based on the result of face recognition algorithms module and speech recognition algorithm module, by detection, the speech recognition of expressing one's feelings, and then analyze the mental status that work attendance personnel are current, the result of Treatment Analysis is then through the accumulation of a long-term acquisition, thus analyzing anticipation result, this result can be submitted to occurrences in human life, and employee according to circumstances can be carried out psychological consultation by occurrences in human life.
CN201610151272.0A 2016-05-12 2016-05-12 Tablet personal computer-based facial speech attendance system Pending CN105788018A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610151272.0A CN105788018A (en) 2016-05-12 2016-05-12 Tablet personal computer-based facial speech attendance system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610151272.0A CN105788018A (en) 2016-05-12 2016-05-12 Tablet personal computer-based facial speech attendance system

Publications (1)

Publication Number Publication Date
CN105788018A true CN105788018A (en) 2016-07-20

Family

ID=56392850

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610151272.0A Pending CN105788018A (en) 2016-05-12 2016-05-12 Tablet personal computer-based facial speech attendance system

Country Status (1)

Country Link
CN (1) CN105788018A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110755091A (en) * 2018-07-26 2020-02-07 杨万友 Personal mental health monitoring system and method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130223696A1 (en) * 2012-01-09 2013-08-29 Sensible Vision, Inc. System and method for providing secure access to an electronic device using facial biometric identification and screen gesture
CN103530912A (en) * 2013-09-27 2014-01-22 深圳市迈瑞思智能技术有限公司 Attendance recording system having emotion identification function, and method thereof
CN103699906A (en) * 2013-12-31 2014-04-02 江苏图云智能科技发展有限公司 Mobile face recognition system
CN104239766A (en) * 2014-08-20 2014-12-24 中广核核电运营有限公司 Video and audio based identity authentication method and system for nuclear power plants
CN104282049A (en) * 2013-07-04 2015-01-14 姜羚 Facial recognition attendance checking terminal, attendance checking process authentication system and authentication method
CN104346503A (en) * 2013-07-23 2015-02-11 广州华久信息科技有限公司 Human face image based emotional health monitoring method and mobile phone

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130223696A1 (en) * 2012-01-09 2013-08-29 Sensible Vision, Inc. System and method for providing secure access to an electronic device using facial biometric identification and screen gesture
CN104282049A (en) * 2013-07-04 2015-01-14 姜羚 Facial recognition attendance checking terminal, attendance checking process authentication system and authentication method
CN104346503A (en) * 2013-07-23 2015-02-11 广州华久信息科技有限公司 Human face image based emotional health monitoring method and mobile phone
CN103530912A (en) * 2013-09-27 2014-01-22 深圳市迈瑞思智能技术有限公司 Attendance recording system having emotion identification function, and method thereof
CN103699906A (en) * 2013-12-31 2014-04-02 江苏图云智能科技发展有限公司 Mobile face recognition system
CN104239766A (en) * 2014-08-20 2014-12-24 中广核核电运营有限公司 Video and audio based identity authentication method and system for nuclear power plants

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110755091A (en) * 2018-07-26 2020-02-07 杨万友 Personal mental health monitoring system and method

Similar Documents

Publication Publication Date Title
CN109359548B (en) Multi-face recognition monitoring method and device, electronic equipment and storage medium
CN109976506B (en) Awakening method of electronic equipment, storage medium and robot
CN108509941B (en) Emotion information generation method and device
CN108229376B (en) Method and device for detecting blinking
CN105160318B (en) Lie detecting method based on facial expression and system
US9710695B2 (en) Characterizing pathology images with statistical analysis of local neural network responses
CN107918755A (en) A kind of real-time focus analysis method and system based on face recognition technology
CN109284729A (en) Method, apparatus and medium based on video acquisition human face recognition model training data
WO2019085331A1 (en) Fraud possibility analysis method, device, and storage medium
Vazquez-Fernandez et al. Built-in face recognition for smart photo sharing in mobile devices
CN108549848B (en) Method and apparatus for outputting information
CN111797756A (en) Video analysis method, device and medium based on artificial intelligence
CN110610125A (en) Ox face identification method, device, equipment and storage medium based on neural network
CN111353366A (en) Emotion detection method and device and electronic equipment
CN111160202A (en) AR equipment-based identity verification method, AR equipment-based identity verification device, AR equipment-based identity verification equipment and storage medium
CN109446932A (en) A kind of dressing inspection method, device, terminal device and computer storage medium
Mou et al. Alone versus in-a-group: A multi-modal framework for automatic affect recognition
CN112819548A (en) User portrait generation method and device, readable storage medium and electronic equipment
Nguyen et al. Smart desk in hybrid classroom: Automatic attendance system based on face recognition using mtcnn and arcface
CN108197563B (en) Method and device for acquiring information
CN204102164U (en) A kind of identity information acquisition and demo plant
CN105788018A (en) Tablet personal computer-based facial speech attendance system
CN111258414B (en) Method and device for adjusting screen
CN108334602B (en) Data annotation method and device, electronic equipment and computer storage medium
WO2021217943A1 (en) Method, device, and apparatus for supervising corrective action taken by business, and computer-readable storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 311121 Room 202, Unit 1, Building 7, No. 998 Wenyi West Road, Wuchang Street, Yuhang District, Hangzhou City, Zhejiang Province

Applicant after: Hangzhou Pigeon Zhishang Technology Co., Ltd.

Address before: 311121 Room 941, Building 2, No. 1500 Wenyi West Road, Cangqian Street, Yuhang District, Hangzhou City, Zhejiang Province

Applicant before: HANGZHOU HP BANKING INFORMATION SERVICE CO., LTD.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160720