CN105491355B - A kind of student classroom monitoring system and its monitoring method based on handset image collection - Google Patents

A kind of student classroom monitoring system and its monitoring method based on handset image collection Download PDF

Info

Publication number
CN105491355B
CN105491355B CN201610060519.8A CN201610060519A CN105491355B CN 105491355 B CN105491355 B CN 105491355B CN 201610060519 A CN201610060519 A CN 201610060519A CN 105491355 B CN105491355 B CN 105491355B
Authority
CN
China
Prior art keywords
student
module
image
teacher
system server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610060519.8A
Other languages
Chinese (zh)
Other versions
CN105491355A (en
Inventor
李忠国
迟睿
唐炜
罗元康
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu University of Science and Technology
Original Assignee
Jiangsu University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu University of Science and Technology filed Critical Jiangsu University of Science and Technology
Priority to CN201610060519.8A priority Critical patent/CN105491355B/en
Publication of CN105491355A publication Critical patent/CN105491355A/en
Application granted granted Critical
Publication of CN105491355B publication Critical patent/CN105491355B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/167Detection; Localisation; Normalisation using comparisons between temporally consecutive images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/169Holistic features and representations, i.e. based on the facial image taken as a whole
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The present invention discloses a kind of student classroom monitoring system based on handset image collection, including system server and student client;First data transmission module, authentication module and image capture module are provided with student client, student verifies identity information by authentication module, image capture module gathers the facial image information of student, is transmitted the identity information of student and facial image information into system server by first data transmission module;Include face-image analysis module, the second data transmission module and statistical analysis module in system server, the facial image information that face-image analysis module receives according to the second data transmission module judges the state of listening to the teacher of student, statistical analysis module statistic time of listening to the teacher accounts for whole time in classroom ratio, is then stored in database file and forms report file.The present invention can save the hardware cost of IMAQ, improve the accuracy rate that pupilage confirms and judged student classroom state.

Description

A kind of student classroom monitoring system and its monitoring method based on handset image collection
Technical field
The present invention relates to Computerized Information Processing Tech, and in particular to a kind of student classroom prison based on handset image collection Examining system and its monitoring method.
Background technology
Student's plenty of time has been corroded in current online game such as opium, it is easy to student is can not extricate oneself, causes classroom Time is also often occupied.Document records student's averagely daily surf time in 2-6 hours, has a strong impact on student's school work and body and mind Health.Change this situation in addition to improving teaching method, simple in real time, accurate, reliable monitoring management and control is imperative.Pass through Sensor realizes that automatic monitoring management and control is of great importance for improving Classroom Teaching.But automatic monitoring because student's quantity is more, Information stability is poor, identity validation difficulty, student classroom context identification difficulty etc. problem be present.
The content of the invention
Goal of the invention:It is an object of the invention to solve the deficiencies in the prior art, there is provided one kind is based on mobile phone figure As the student classroom monitoring system and its monitoring method of collection, the present invention can greatly save the hardware cost of IMAQ, lead to Cross mobile phone app and improve the accuracy rate that pupilage confirms and judged student classroom state.
Technical scheme:A kind of student classroom monitoring system based on handset image collection of the present invention, including system service Device and student client;First data transmission module, authentication module and IMAQ are provided with the student client Module, student verify identity information by authentication module, and image capture module gathers the facial image information of student, passed through First data transmission module transmits the identity information of student and facial image information into system server;The system service Include face-image analysis module, the second data transmission module and statistical analysis module, face-image analysis module root in device The facial image information received according to the second data transmission module judges the state of listening to the teacher of student, statistical analysis module statistic Time of listening to the teacher accounts for whole time in classroom ratio deposit database file and forms report file.
Wherein, authentication module can use the technology of registering of existing radio-frequency card (mess card) checking.
For ease of " gathering materials on the spot ", convenient, flexible quick realize monitors purpose, and the system server is the meter in classroom Calculation machine, the student client are the mobile phone with camera function of student.
Further, the first data transmission module and the second data transmission module complete image using bluetooth module The transmission and receiving of data, and then realize and transmit the image information data of student client collection to system server.
Further, inputted by the identity validation module directly in student client student number carry out identity registration and Confirm, and contrasted by image information and carry out identity validation, improve the accuracy of identity validation and be easy to statistical summaries.
Further, face in the two width face-images that the face-image analysis module is continuously scanned according to student client The size of the area (height) in portion judges that student is to listen to the teacher or " bowing ", specific method are:When mobile phone is horizontal positioned, bow When seeing the mobile phone, face area (height) is larger, and face area (height) is smaller when listening to the teacher, and by setting a monitoring numerical value, surpasses It is currently to be in " bowing " state that the student is then thought when crossing the face area monitoring numerical value.
It is relevant with the angle of face when listening to the teacher when above-mentioned monitoring numerical value is placed with mobile phone.Numerical value number can be according to a large amount of systems Count determination.It is probably to record the note because student bows, then needs (such as one minute) collection at regular intervals to send image Once, because judging easily there is larger error when times of collection is less, but the statistical result of mass data is comparatively accurate, example A such as class 45 minutes, one minute run-down, it is more accurate to analyze state of listening to the teacher according to 45 scanning results.
Further, setting gathers the time interval of image in image capture module, and such as 5 minutes once, according to continuous two " bowing " between secondary whether state analysis statistic time of listening to the teacher accounts for whole time in classroom ratio, by adopting at time intervals Collect student's image facial information and greatly reduce the amount of calculation of server.
The invention also discloses a kind of monitoring method of the student classroom monitoring system based on handset image collection, wrap successively Include following steps:
(1) student logs in monitoring system APP by student client with student number, and system server is stepped on by inputting class number Record monitoring system, student client and system server and communication connection is established by bluetooth;
(2) sampling time is set in system server, student client receives the sampling time of host setting;
(3) after student client reaches the sampling time of setting, the facial information of student is gathered, and be sent to system service Device;
(4) after system server receives the facial information of student, image border is extracted, face area is selected and then determines to learn Raw state of listening to the teacher;
(5) listen to the teacher state at different moments of the system server according to student within a period of time, carrys out statistical analysis student Listen to the teacher the time;
(6) after End-of-Course, above-mentioned time data of listening to the teacher is stored in database file and forms report file.
Beneficial effect:The present invention by verifying the identity of each student, and by facial information (whether is " bowing ") come The state of listening to the teacher of student is monitored, analytic statistics student accounts for whole time in classroom ratio at time of listening to the teacher.In a word, the present invention can be very big The hardware cost of the saving IMAQ of degree, pupilage is improved by mobile phone app and confirms and judge student classroom state Accuracy rate.
Brief description of the drawings
Fig. 1 is the program flow diagram of the present invention.
Embodiment
Technical solution of the present invention is described in detail below, but protection scope of the present invention is not limited to the implementation Example.
As shown in figure 1, a kind of student classroom monitoring system based on handset image collection of the present invention, including system service Device and student client;First data transmission module, authentication module and IMAQ are provided with the student client Module, student verify identity information by authentication module, and image capture module gathers the facial image information of student, passed through First data transmission module transmits the identity information of student and facial image information into system server;The system service Include face-image analysis module, the second data transmission module and statistical analysis module, face-image analysis module root in device The facial image information received according to the second data transmission module judges the state of listening to the teacher of student, statistical analysis module statistic Time of listening to the teacher accounts for whole time in classroom ratio deposit database file and forms report file.
Wherein, listen to the teacher state of each student in whole classroom can be counted individually, and the result of the student of whole class is closed To together be exactly whole class.
The monitoring method of the above-mentioned student classroom monitoring system based on handset image collection, comprises the following steps successively:
(1) student logs in monitoring system APP by student client with student number, and system server is stepped on by inputting class number Record monitoring system, student client and system server and communication connection is established by bluetooth;
(2) sampling time is set in system server, student client receives the sampling time of host setting;
(3) after student client reaches the sampling time of setting, the facial information of student is gathered, and be sent to system service Device;
(4) after system server receives the facial information of student, image border is extracted, face area is selected and then determines to learn Raw state of listening to the teacher;
(5) listen to the teacher state at different moments of the system server according to student within a period of time, carrys out statistical analysis student Listen to the teacher the time;
(6) after End-of-Course, above-mentioned time data of listening to the teacher is stored in database file and forms report file.
Embodiment 1:
The setting class period is consistent with time in classroom in server system, can be set as 45 minutes class, student The state of the listening to the teacher number that can bow or come back according to scan-type be divided into the excellent middle several grades of difference of passing, such as:
Every one minute run-down, totally 45 times, if student's new line number>40 times, then to be excellent;New line number is 35-40 Secondary, then to be good;New line number is 25-30 times, then in being chosen as, new line number is 20-25 times, then is chosen as passing, and is come back Number is less than 20 times, is chosen as difference.

Claims (5)

  1. A kind of 1. student classroom monitoring system based on handset image collection, it is characterised in that:Including system server and student Client;
    First data transmission module, authentication module and image capture module, Xue Shengtong are provided with the student client Authentication module checking identity information is crossed, image capture module gathers the facial image information of student, passed by the first data Defeated module transmits the identity information of student and facial image information into system server;
    Include face-image analysis module, the second data transmission module and statistical analysis module, face in the system server The facial image information that portion's image analysis module receives according to the second data transmission module judges the state of listening to the teacher of student, statistics Analysis module statistic time of listening to the teacher accounts for whole time in classroom ratio, is then stored in database file and forms report file;
    The area of face is big in the two width face-images that the face-image analysis module is continuously scanned according to student client Small judgement student is to listen to the teacher or " bowing ", specific method are:When mobile phone is horizontal positioned, bow when seeing the mobile phone, face area Larger, face area is smaller when listening to the teacher, and then thinks this by setting a monitoring numerical value, during more than the face area monitoring numerical value Student is currently to be in " bowing " state;The time interval of setting collection image in image capture module, between twice in succession " bowing " whether state analysis statistic time of listening to the teacher accounts for whole time in classroom ratio.
  2. 2. the student classroom monitoring system according to claim 1 based on handset image collection, it is characterised in that:The system Server of uniting is the computer in classroom, and the student client is the mobile phone with camera function of student.
  3. 3. the student classroom monitoring system according to claim 1 based on handset image collection, it is characterised in that:Described One data transmission module and the second data transmission module complete the transmission and receiving of view data using bluetooth module.
  4. 4. the student classroom monitoring system according to claim 1 based on handset image collection, it is characterised in that:Pass through institute State identity validation module and student number progress identity registration and confirmation are inputted directly in student client, and contrasted by image information Carry out identity validation.
  5. 5. a kind of student classroom monitoring system based on handset image collection according to Claims 1-4 any one Monitoring method, it is characterised in that:Comprise the following steps successively:
    (1) student logs in monitoring system APP by student client with student number, and system server logs in prison by inputting class number Examining system, student client and system server are established by bluetooth and communicated to connect;
    (2) sampling time is set in system server, student client receives the sampling time of host setting;
    (3) after student client reaches the sampling time of setting, the facial information of student is gathered, and be sent to system server;
    (4) after system server receives the facial information of student, image border is extracted, face area is selected and then determines student's Listen to the teacher state;
    (5) listen to the teacher state at different moments of the system server according to student within a period of time, carrys out listening for statistical analysis student Between class hour;
    (6) after End-of-Course, above-mentioned time data of listening to the teacher is stored in database file and forms report file.
CN201610060519.8A 2016-01-28 2016-01-28 A kind of student classroom monitoring system and its monitoring method based on handset image collection Active CN105491355B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610060519.8A CN105491355B (en) 2016-01-28 2016-01-28 A kind of student classroom monitoring system and its monitoring method based on handset image collection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610060519.8A CN105491355B (en) 2016-01-28 2016-01-28 A kind of student classroom monitoring system and its monitoring method based on handset image collection

Publications (2)

Publication Number Publication Date
CN105491355A CN105491355A (en) 2016-04-13
CN105491355B true CN105491355B (en) 2018-04-06

Family

ID=55678032

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610060519.8A Active CN105491355B (en) 2016-01-28 2016-01-28 A kind of student classroom monitoring system and its monitoring method based on handset image collection

Country Status (1)

Country Link
CN (1) CN105491355B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018098733A1 (en) * 2016-11-30 2018-06-07 深圳益强信息科技有限公司 Synchronous processing method and apparatus for education platform
WO2018098732A1 (en) * 2016-11-30 2018-06-07 深圳益强信息科技有限公司 Data processing method and device for education system
CN107169900A (en) * 2017-05-19 2017-09-15 南京信息工程大学 A kind of student listens to the teacher rate detection method
CN107341618A (en) * 2017-07-14 2017-11-10 安徽智星交通科技股份有限公司 Class management method and system
CN108346192B (en) * 2018-02-13 2020-12-15 福州外语外贸学院 Attendance checking method and terminal for computer room course student concentration degree
CN109697551A (en) * 2018-11-29 2019-04-30 合肥工业大学 A kind of government affairs service evaluation system based on big data
CN113065441A (en) * 2021-03-25 2021-07-02 开放智能机器(上海)有限公司 Image processing system and method based on edge device
CN114897647B (en) * 2022-04-27 2023-02-03 合创智能家具(广东)有限公司 Teaching auxiliary system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102013176B (en) * 2010-12-01 2016-04-06 曹乃承 On-line study system
CN103679591A (en) * 2012-09-25 2014-03-26 山东博学教育软件科技有限公司 Remote learning state monitoring system and method
CN102945624A (en) * 2012-11-14 2013-02-27 南京航空航天大学 Intelligent video teaching system based on cloud calculation model and expression information feedback
CN103198724B (en) * 2013-03-26 2014-12-10 闫健 Panorama mode online learning system and pen special for learning system
CN104464406A (en) * 2013-09-12 2015-03-25 郑州学生宝电子科技有限公司 Real-time interactive online learning platform
CN104408782B (en) * 2014-12-04 2017-02-22 重庆晋才富熙科技有限公司 Facial visibility attendance system

Also Published As

Publication number Publication date
CN105491355A (en) 2016-04-13

Similar Documents

Publication Publication Date Title
CN105491355B (en) A kind of student classroom monitoring system and its monitoring method based on handset image collection
CN106228629B (en) A kind of classroom based on recognition of face is registered system
CN105791299A (en) Unattended monitoring type intelligent on-line examination system
CN106250822A (en) Student's focus based on recognition of face monitoring system and method
CN103208212A (en) Anti-cheating remote online examination method and system
CN110164213A (en) A kind of multiple terminals distance education and training system based on AI video analysis
CN106327101A (en) Attendance checking system, terminal and method
CN107301687A (en) A kind of course of personally instructing based on face recognition technology is registered and sign-out system
CN107715435A (en) User movement data gathering system
CN106027544B (en) address information verification method, cloud server and handheld terminal
CN203118082U (en) Network course learning and examination anti-cheating monitoring device
CN110349460A (en) A kind of online education and examination system
CN114881305B (en) Canteen prediction early warning system and prediction method thereof
Murphy et al. A system for detecting interviewer falsification
CN116611964A (en) Intelligent classroom course arrangement and distribution method and system
CN106846198A (en) A kind of computer application examination system
CN205983818U (en) Based on automatic transmission device of sampling monitoring equipment information
CN107958500A (en) A kind of monitoring system for real border real time information sampling of imparting knowledge to students
CN111127967A (en) Intelligent education learning system for primary and secondary school students
CN112766095B (en) System and method for evaluating input degree of participants
CN202600766U (en) Attendance information management monitoring system
CN110708392B (en) Student management system and method based on cloud platform
CN113822586B (en) Task rewarding method and system
CN106791805B (en) A kind of method and device of video traffic assessment
CN212061241U (en) Distributed anti-cheating system and equipment for examination

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20160413

Assignee: Zhenjiang Kaituo Machinery Co., Ltd

Assignor: JIANGSU University OF SCIENCE AND TECHNOLOGY

Contract record no.: X2020980007284

Denomination of invention: A student classroom monitoring system based on mobile phone image acquisition and its monitoring method

Granted publication date: 20180406

License type: Common License

Record date: 20201029

EE01 Entry into force of recordation of patent licensing contract
EC01 Cancellation of recordation of patent licensing contract

Assignee: Zhenjiang Kaituo Machinery Co., Ltd

Assignor: JIANGSU University OF SCIENCE AND TECHNOLOGY

Contract record no.: X2020980007284

Date of cancellation: 20201223

EC01 Cancellation of recordation of patent licensing contract