CN113967014B - Student behavior analysis device, system and method based on big data - Google Patents
Student behavior analysis device, system and method based on big data Download PDFInfo
- Publication number
- CN113967014B CN113967014B CN202111581016.2A CN202111581016A CN113967014B CN 113967014 B CN113967014 B CN 113967014B CN 202111581016 A CN202111581016 A CN 202111581016A CN 113967014 B CN113967014 B CN 113967014B
- Authority
- CN
- China
- Prior art keywords
- student
- behavior analysis
- student behavior
- abnormal
- detection device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1103—Detecting eye twinkling
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1116—Determining posture transitions
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1118—Determining activity level
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4806—Sleep evaluation
- A61B5/4809—Sleep detection, i.e. determining whether a subject is asleep or not
Abstract
The invention relates to a student behavior analysis device, a system and a method based on big data, which belong to the technical field of student behavior data analysis, and are characterized in that different progressive detection modes and detection result detection schemes are designed, the image periodic detection with the lowest cost is used as a trigger, the long-time running of video acquisition is avoided, and the detection modes are divided into three degrees of suspicious drowsy state, serious drowsy state and drowsy state in sequence, so that the student behavior analysis result has higher accuracy and better reliability. The method is characterized in that facial images are collected periodically, the cost is extremely low compared with that of video collection, the facial images are used as long-time starting device equipment, and subsequent progressive inspection and detection are triggered after abnormality is detected.
Description
Technical Field
The invention belongs to the technical field of student behavior data analysis, and particularly relates to a student behavior analysis device, a student behavior analysis system and a student behavior analysis method based on big data.
Background
The current student behavior analysis scheme is to detect different states of students in class, including whether the students are dozing and sleeping.
In the prior art, different states of students in class are detected more comprehensively, the mode of carrying out video detection on the students in the whole course of class is adopted violently, the cost problem of video detection equipment facilities is ignored completely, different detection modes and detection result detection schemes which are gradual are not designed, and the accuracy of student behavior analysis results is lower and the reliability is poorer.
Therefore, in the present stage, it is necessary to design a student behavior analysis device, system and method based on big data to solve the above problems.
Disclosure of Invention
The invention aims to provide a student behavior analysis device, a student behavior analysis system and a student behavior analysis method based on big data, which are used for solving the technical problems in the prior art, such as: in the prior art, different states of students in class are detected more comprehensively, the mode of carrying out video detection on the students in the whole course of class is adopted violently, the cost problem of video detection equipment facilities is ignored completely, different detection modes and detection result detection schemes which are gradual are not designed, and the accuracy of student behavior analysis results is lower and the reliability is poorer.
In order to achieve the purpose, the technical scheme of the invention is as follows:
a big-data-based student behavior analysis apparatus comprising:
the eyelid tension detection device is used for detecting whether the eyelid tension of the student is abnormal or not;
blink frequency detection means for detecting whether or not the blink frequency of the student is abnormal;
the nodding speed detection device is used for detecting whether the nodding speed of the student is abnormal or not;
wherein the eyelid tension detection device, the blink frequency detection device and the nodding speed detection device are in a closed state;
when the student behavior analysis device is started, the eyelid tension detection device is started;
if the eyelid tension detection device detects that the eyelid tension of the student is abnormal, the blinking frequency detection device is started, and the student behavior analysis device judges that the student behavior is in a suspected sleepy state;
if the blinking frequency detection device detects that the blinking frequency of the student is abnormal, the nodding speed detection device is started, and the student behavior analysis device judges that the student behavior is in a severe suspected sleepy state;
and if the nodding speed detection device detects that the nodding speed of the student is abnormal, the student behavior analysis device judges that the student behavior is in a doze state.
Further, in the eyelid flare degree detecting apparatus,
collecting facial images of students at regular intervals;
acquiring the eyelid tension of the student according to the facial image;
and matching and comparing the eyelid tension with a preset standard eyelid tension, if the eyelid tension is not matched with the preset standard eyelid tension, judging that the eyelid tension is abnormal at the moment, and if not, judging that the eyelid tension is normal.
Further, the fixed time period is an integral multiple of the eye opening and blinking periods of the students in normal states;
the eye opening and blinking periods are screened from the student's historical data.
Further, in the blink frequency detection apparatus,
collecting facial videos of students in a preset time period;
acquiring the blinking frequency of the student according to the face video;
and matching and comparing the blink frequency with a preset standard blink frequency, if the blink frequency is not matched with the preset standard blink frequency, judging that the blink frequency is abnormal at the moment, and if not, judging that the blink frequency is normal.
Further, in the nodding speed detecting device,
continuously collecting body contour videos of students;
acquiring the nodding speed of the student according to the body contour video;
and matching and comparing the nodding speed with a preset standard nodding speed, judging that the nodding speed is abnormal at the moment if the nodding speed is not matched with the preset standard nodding speed, and otherwise, judging that the nodding speed is normal.
Further, the student computer desk further comprises a gravity center deviation detection device for detecting whether the gravity center deviation of the upper body of the student is abnormal;
if the gravity center shift detection device detects that the gravity center shift of the upper body of the student is abnormal, the student behavior analysis device judges that the student behavior is in a sleeping state.
The student behavior analysis system based on the big data comprises the student behavior analysis device based on the big data and a cloud server, and the student behavior analysis device and the cloud server are in data interaction.
The student behavior analysis method based on the big data adopts the student behavior analysis device based on the big data to analyze the student behavior based on the big data.
A storage medium having stored thereon a computer program which, when executed, performs a big-data based student behavior analysis method as described above.
An electronic device comprises a processor and a memory, wherein the memory is used for storing executable commands of the processor, and the processor executes the executable commands to realize a big data-based student behavior analysis method.
Compared with the prior art, the invention has the beneficial effects that:
one of the beneficial effects of the scheme is that different progressive detection modes and detection result detection schemes are designed, the image periodic detection with the lowest cost is used as triggering, the long-time running of video acquisition is avoided, and the method is divided into three degrees of suspected drowsy state, severe suspected drowsy state and drowsy state in sequence, so that the student behavior analysis result is higher in accuracy and better in reliability. The method is characterized in that facial images are collected periodically, the cost is extremely low compared with that of video collection, the facial images are used as long-time starting device equipment, and subsequent progressive inspection and detection are triggered after abnormality is detected.
Drawings
Fig. 1 is a schematic view of a working principle process of a student behavior analysis device according to an embodiment of the present application.
Fig. 2 is a schematic view of a working principle process of the eyelid flare degree detection apparatus according to the embodiment of the present application.
Fig. 3 is a schematic process diagram of an operation principle of the blink frequency detection apparatus according to the embodiment of the application.
Fig. 4 is a schematic process diagram of the working principle of the nodding speed detection device according to the embodiment of the application.
Fig. 5 is an explanatory diagram of eyelid flare in the embodiment of the present application.
Fig. 6 is a schematic diagram illustrating the self-help body balance maintaining process according to the embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to fig. 1 to 6 of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the prior art, different states of students in class are detected more comprehensively, the mode of carrying out video detection on the students in the whole course of class is adopted violently, the cost problem of video detection equipment facilities is ignored completely, different detection modes and detection result detection schemes which are gradual are not designed, and the accuracy of student behavior analysis results is lower and the reliability is poorer.
As shown in fig. 1, a big data-based student behavior analysis apparatus is provided, including:
the eyelid openness detection device is used for detecting whether the eyelid openness of the student (the degree of opening and contraction of the eyelid is larger, namely, the larger the opening degree is, the smaller the eye opening is, the larger the contraction degree is, and the larger the eye opening is, as shown in fig. 5, the schematic diagram is only used as an explanatory explanation, does not limit the protection range of the scheme, and is not the only choice of the scheme) is abnormal;
blink frequency detection means for detecting whether or not the blink frequency of the student is abnormal;
the nodding speed detection device is used for detecting whether the nodding speed of the student is abnormal or not;
wherein the eyelid tension detection device, the blink frequency detection device and the nodding speed detection device are in a closed state;
when the student behavior analysis device is started, the eyelid tension detection device is started;
if the eyelid tension detection device detects that the eyelid tension of the student is abnormal, the blinking frequency detection device is started, and the student behavior analysis device judges that the student behavior is in a suspected sleepy state;
because the difference between the pupil size of a small number of students and the average pupil size is large, misjudgment of the doze state is possible by directly judging, and the doze suspicion is more reasonable to judge.
If the blinking frequency detection device detects that the blinking frequency of the student is abnormal, the nodding speed detection device is started, and the student behavior analysis device judges that the student behavior is in a severe suspected sleepy state;
since the students sometimes classify the blinking frequency of the students into a state matched with the drowsy state because the eyes of the students are not relaxed (for example, the students carelessly focus on the content on the blackboard), the students can judge that the drowsy state is misjudged directly, and the judgment that the serious drowsy is suspected is more reasonable.
And if the nodding speed detection device detects that the nodding speed of the student is abnormal, the student behavior analysis device judges that the student behavior is in a doze state.
When the student sleeps, the head of the student can be noded in a weightless mode, and the nodding speed is extremely special under the condition.
In the scheme, different progressive detection modes and detection result detection schemes are designed, the image periodic detection with the lowest cost is used as triggering, the long-time running of video acquisition is avoided, and the detection schemes are divided into the steps of suspected sleepy state, severe suspected sleepy state and sleepy state in sequence, so that the accuracy of student behavior analysis results is high, and the reliability is good.
Further, as shown in fig. 2, in the eyelid flare degree detecting apparatus,
collecting facial images of students at regular intervals;
acquiring the eyelid tension of the student according to the facial image;
and matching and comparing the eyelid tension with a preset standard eyelid tension, if the eyelid tension is not matched with the preset standard eyelid tension, judging that the eyelid tension is abnormal at the moment, and if not, judging that the eyelid tension is normal.
In the scheme, the face images are collected periodically, the cost is extremely low compared with that of video collection, the face images are used as long-time starting device equipment, and subsequent progressive inspection and detection are triggered after abnormality is detected.
Further, the fixed time period is an integral multiple of the eye opening and blinking periods of the students in normal states;
the eye opening and blinking periods are screened from the student's historical data.
Further, as shown in fig. 3, in the blink frequency detection apparatus,
collecting facial videos of students in a preset time period;
acquiring the blinking frequency of the student according to the face video;
and matching and comparing the blink frequency with a preset standard blink frequency, if the blink frequency is not matched with the preset standard blink frequency, judging that the blink frequency is abnormal at the moment, and if not, judging that the blink frequency is normal.
In the scheme, the face images are collected periodically, and the face video collection of students in the preset time period is triggered after the abnormality is detected, so that the cost is reduced, and meanwhile, the reliability of the detection result is further improved.
Further, as shown in fig. 4, in the nodding-speed detecting device,
continuously collecting body contour videos of students;
acquiring the nodding speed of the student according to the body contour video;
and matching and comparing the nodding speed with a preset standard nodding speed, judging that the nodding speed is abnormal at the moment if the nodding speed is not matched with the preset standard nodding speed, and otherwise, judging that the nodding speed is normal.
In the above scheme, the face video of the student is collected within the preset time period, and the body contour video of the student is triggered to be collected continuously after the abnormality is detected, so that the cost is reduced, and meanwhile, the reliability of the detection result is further improved.
Further, the student computer desk further comprises a gravity center deviation detection device for detecting whether the gravity center deviation of the upper body of the student is abnormal;
if the gravity center shift detection device detects that the gravity center shift of the upper body of the student is abnormal, the student behavior analysis device judges that the student behavior is in a sleeping state.
In the scheme, the gravity center deviation detection device is also designed to be started periodically, and the gravity center deviation condition of the upper half of the student is judged through image acquisition, identification and judgment, and whether the gravity center deviation is abnormal or not is judged according to the physical and mechanical balance of the upper half of the student (as shown in fig. 6, the schematic diagram is only used as an explanatory explanation and does not limit the protection range of the scheme, but is not the only choice of the scheme because the sitting posture of the student is self-acting to maintain the physical balance when the student is in a waking state, but the sitting posture of the student is supported by the outside of a seat or a desk to maintain the physical balance).
The student behavior analysis system based on the big data comprises the student behavior analysis device based on the big data and a cloud server, and the student behavior analysis device and the cloud server are in data interaction.
The student behavior analysis method based on the big data adopts the student behavior analysis device based on the big data to analyze the student behavior based on the big data.
A storage medium having stored thereon a computer program which, when executed, performs a big-data based student behavior analysis method as described above.
An electronic device comprises a processor and a memory, wherein the memory is used for storing executable commands of the processor, and the processor executes the executable commands to realize a big data-based student behavior analysis method.
The above are preferred embodiments of the present invention, and all changes made according to the technical scheme of the present invention that produce functional effects do not exceed the scope of the technical scheme of the present invention belong to the protection scope of the present invention.
Claims (4)
1. A student behavior analysis device based on big data, comprising:
the eyelid tension detection device is used for detecting whether the eyelid tension of the student is abnormal or not;
blink frequency detection means for detecting whether or not the blink frequency of the student is abnormal;
the nodding speed detection device is used for detecting whether the nodding speed of the student is abnormal or not;
wherein the eyelid tension detection device, the blink frequency detection device and the nodding speed detection device are in a closed state;
when the student behavior analysis device is started, the eyelid tension detection device is started;
if the eyelid tension detection device detects that the eyelid tension of the student is abnormal, the blinking frequency detection device is started, and the student behavior analysis device judges that the student behavior is in a suspected sleepy state;
if the blinking frequency detection device detects that the blinking frequency of the student is abnormal, the nodding speed detection device is started, and the student behavior analysis device judges that the student behavior is in a severe suspected sleepy state;
if the nodding speed detection device detects that the nodding speed of the student is abnormal, the student behavior analysis device judges that the student behavior is in a doze state;
in the device for detecting the degree of eyelid opening,
collecting facial images of students at regular intervals;
acquiring the eyelid tension of the student according to the facial image;
matching and comparing the eyelid tension with a preset standard eyelid tension, if the eyelid tension is not matched with the preset standard eyelid tension, judging that the eyelid tension is abnormal at the moment, and if not, judging that the eyelid tension is normal;
the fixed time period is integral multiple of the eye opening and blinking periods of the students in normal state;
the eye opening and blinking periods are obtained by screening historical data of students;
in the blink frequency detection apparatus, a frequency of blinking may be detected,
collecting facial videos of students in a preset time period;
acquiring the blinking frequency of the student according to the face video;
matching and comparing the blink frequency with a preset standard blink frequency, if the blink frequency is not matched with the preset standard blink frequency, judging that the blink frequency is abnormal at the moment, otherwise, judging that the blink frequency is normal
The student system comprises a student and a student;
if the gravity center deviation detection device detects that the gravity center deviation of the upper body of the student is abnormal, the student behavior analysis device judges that the student behavior is in a sleeping state;
the center of gravity shift detection means is also designed to be activated periodically.
2. The big-data-based student behavior analysis device according to claim 1, wherein in the nodding-speed detecting device,
continuously collecting body contour videos of students;
acquiring the nodding speed of the student according to the body contour video;
and matching and comparing the nodding speed with a preset standard nodding speed, judging that the nodding speed is abnormal at the moment if the nodding speed is not matched with the preset standard nodding speed, and otherwise, judging that the nodding speed is normal.
3. A student behavior analysis system based on big data, comprising the student behavior analysis device based on big data as claimed in claim 1 or 2, and further comprising a cloud server, wherein the student behavior analysis device performs data interaction with the cloud server.
4. A student behavior analysis method based on big data, characterized in that the student behavior analysis based on big data is performed by using the student behavior analysis device based on big data according to claim 1 or 2.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111581016.2A CN113967014B (en) | 2021-12-22 | 2021-12-22 | Student behavior analysis device, system and method based on big data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111581016.2A CN113967014B (en) | 2021-12-22 | 2021-12-22 | Student behavior analysis device, system and method based on big data |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113967014A CN113967014A (en) | 2022-01-25 |
CN113967014B true CN113967014B (en) | 2022-04-08 |
Family
ID=79590775
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111581016.2A Active CN113967014B (en) | 2021-12-22 | 2021-12-22 | Student behavior analysis device, system and method based on big data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113967014B (en) |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN100462047C (en) * | 2007-03-21 | 2009-02-18 | 汤一平 | Safe driving auxiliary device based on omnidirectional computer vision |
CN107468211A (en) * | 2010-01-18 | 2017-12-15 | 艾欧敏达有限公司 | For analyzing the method and system and assessment system of neurophysiological data |
KR101604232B1 (en) * | 2011-09-05 | 2016-03-17 | 토야마켄 | Dozing-off detection method and device |
CN103020594B (en) * | 2012-12-03 | 2016-01-20 | 清华大学苏州汽车研究院(吴江) | On-line study is utilized to eliminate the fatigue state detection method of driver individual difference |
US8930269B2 (en) * | 2012-12-17 | 2015-01-06 | State Farm Mutual Automobile Insurance Company | System and method to adjust insurance rate based on real-time data about potential vehicle operator impairment |
US8981942B2 (en) * | 2012-12-17 | 2015-03-17 | State Farm Mutual Automobile Insurance Company | System and method to monitor and reduce vehicle operator impairment |
CN103617416B (en) * | 2013-11-20 | 2017-07-04 | 京东方科技集团股份有限公司 | Human-body fatigue status identification means, method and intelligent display |
US20150196241A1 (en) * | 2014-01-14 | 2015-07-16 | Ziv Yekutieli | Startscreen Diagnostics |
CN105035025B (en) * | 2015-07-03 | 2018-04-13 | 郑州宇通客车股份有限公司 | A kind of driver identifies management method and system |
EP3141414B1 (en) * | 2015-09-08 | 2019-05-22 | Aptiv Technologies Limited | Accessory module for instrument cluster |
CN106228293A (en) * | 2016-07-18 | 2016-12-14 | 重庆中科云丛科技有限公司 | teaching evaluation method and system |
JP6998564B2 (en) * | 2017-02-08 | 2022-01-18 | パナソニックIpマネジメント株式会社 | Arousal level estimation device and arousal level estimation method |
CN110476194A (en) * | 2017-03-28 | 2019-11-19 | 国立大学法人九州工业大学 | Driver status detection device |
CN108670260A (en) * | 2018-03-09 | 2018-10-19 | 广东小天才科技有限公司 | A kind of human fatigue detection method and mobile terminal based on mobile terminal |
CN108710839A (en) * | 2018-05-08 | 2018-10-26 | 中山大学 | A kind of sentry's drowsiness intelligent monitor system based on deep learning computer vision |
CN109050246A (en) * | 2018-07-12 | 2018-12-21 | 武汉仁山智水科技服务有限公司 | A kind of method and apparatus of giving fatigue pre-warning |
CN209842834U (en) * | 2019-06-28 | 2019-12-24 | 成都航空职业技术学院 | Driving doze-proof device |
CN113297966A (en) * | 2021-05-25 | 2021-08-24 | 郑州铁路职业技术学院 | Night learning method based on multiple stimuli |
CN113792577A (en) * | 2021-07-29 | 2021-12-14 | 何泽仪 | Method and system for detecting attention state of students in online class and storage medium |
-
2021
- 2021-12-22 CN CN202111581016.2A patent/CN113967014B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN113967014A (en) | 2022-01-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20070173699A1 (en) | Method and system for user sensitive pacing during rapid serial visual presentation | |
WO2010032725A1 (en) | Drowsiness determining device and program | |
US9113837B2 (en) | Drowsiness detection method and associated device | |
WO2013035704A1 (en) | Dozing-off detection method and device | |
Vijayan et al. | Real time detection system of driver drowsiness based on representation learning using deep neural networks | |
CN102150189A (en) | Open-eye or closed-eye determination apparatus, degree of eye openness estimation apparatus and program | |
WO2007084584A2 (en) | System and method for prioritization of a image triage system based on rapid serial visual presentation | |
CN111616718B (en) | Method and system for detecting fatigue state of driver based on attitude characteristics | |
US20190059790A1 (en) | Blink detection apparatus | |
Nakamura et al. | Detection of driver's drowsy facial expression | |
Alioua et al. | Driver’s fatigue and drowsiness detection to reduce traffic accidents on road | |
CN113967014B (en) | Student behavior analysis device, system and method based on big data | |
Varghese et al. | An integrated framework for driver drowsiness detection and alcohol intoxication using machine learning | |
Pinto et al. | A deep learning approach to detect drowsy drivers in real time | |
KR20200013128A (en) | Algorithm for detecting engineer behavior and helping determinent for research direction through collecting and analyzing lab status data based on pupil recognition | |
Dari et al. | Unsupervised blink detection and driver drowsiness metrics on naturalistic driving data | |
Mašanović et al. | Driver monitoring using the in-vehicle camera | |
Niwa et al. | A wearable device for traffic safety-a study on estimating drowsiness with eyewear, JINS MEME | |
US20220370009A1 (en) | Stress estimation device, stress estimation method, and recording media | |
CN114399752A (en) | Eye movement multi-feature fusion fatigue detection system and method based on micro eye jump characteristics | |
Seifoory et al. | An accurate morphological drowsy detection | |
Ma et al. | Dynamic threshold distribution domain adaptation network: A cross-subject fatigue recognition method based on EEG signals | |
Khan et al. | Human Drowsiness Detection System | |
Fernando et al. | Unsupervised Blink Detection Using Eye Aspect Ratio Values | |
CN113469004A (en) | Artificial intelligence student sleepy state detection system in classroom |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |