CN109359606A - A kind of classroom real-time monitoring and assessment system and its working method, creation method - Google Patents
A kind of classroom real-time monitoring and assessment system and its working method, creation method Download PDFInfo
- Publication number
- CN109359606A CN109359606A CN201811242461.4A CN201811242461A CN109359606A CN 109359606 A CN109359606 A CN 109359606A CN 201811242461 A CN201811242461 A CN 201811242461A CN 109359606 A CN109359606 A CN 109359606A
- Authority
- CN
- China
- Prior art keywords
- classroom
- module
- real
- time monitoring
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 40
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000006399 behavior Effects 0.000 claims abstract description 45
- 230000015654 memory Effects 0.000 claims abstract description 24
- 238000010191 image analysis Methods 0.000 claims abstract description 22
- 206010000117 Abnormal behaviour Diseases 0.000 claims abstract description 17
- 238000010195 expression analysis Methods 0.000 claims abstract description 13
- 230000008859 change Effects 0.000 claims abstract description 4
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims abstract description 4
- 239000010410 layer Substances 0.000 claims description 49
- 230000014509 gene expression Effects 0.000 claims description 18
- 238000004458 analytical method Methods 0.000 claims description 17
- 230000008921 facial expression Effects 0.000 claims description 11
- 238000012549 training Methods 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 4
- 239000011229 interlayer Substances 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 3
- 230000003068 static effect Effects 0.000 claims description 3
- 206010057315 Daydreaming Diseases 0.000 abstract description 2
- 238000007619 statistical method Methods 0.000 abstract description 2
- 238000011156 evaluation Methods 0.000 description 7
- 238000013461 design Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 235000013399 edible fruits Nutrition 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011897 real-time detection Methods 0.000 description 1
- 238000004064 recycling Methods 0.000 description 1
- 230000007958 sleep Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Tourism & Hospitality (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Primary Health Care (AREA)
- Marketing (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Economics (AREA)
- Human Resources & Organizations (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The present invention provides a kind of classroom real-time monitoring and assessment system, including sequentially connected video acquisition module, data dispatch module, image analysis module, result statistical module；Data dispatch module includes first memory and a First Input First Output submodule；Image analysis module includes a behavior Expression analysis network model based on YOLO network, and behavior Expression analysis network model includes the network layer of several flowing water setting, two second memories and YOLO output layer to store each network layer output result；YOLO output layer is connect with afterbody network layer, result statistical module respectively, is transmitted to result statistical module will export result；As a result statistical module is for statistical analysis to abnormal behaviour therein.The present invention is capable of the performance of listening to the teacher of real-time display student, can help teacher at any time students ' the case where, in time remind listen to the teacher absent-minded student, change teaching method, adjustment teaching plan, improve the quality of teaching conscientiously.
Description
Technical field
The present invention relates to wisdom education fields, in particular to a kind of classroom real-time monitoring and assessment system and its work
Method, creation method.
Background technique
Classroom instruction is to carry out theoretical knowledge in personnel training to teach most basic, most important link, quality
Superiority and inferiority has direct influence to the quality of personnel training.Practice have shown that class efficacy monitoring and evaluation is for improving classroom religion
Quality, scientificity classroom instruction are learned, assisted teacher understands student and learns situation, update the content of courses, adjustment teaching plan, change
There is positive facilitation into teaching method.
In traditional teaching mode, common class efficacy evaluation is divided into field observation evaluation, evaluation is monitored in monitoring, video recording is commented
Valence, Scale assessment etc. are generally used for the evaluation to teacher；And the mode that teacher understands student then mainly passes through operation or survey
It tests, hysteresis quality is bigger.
Summary of the invention
It is an object of that present invention to provide a kind of classroom real-time detection and assessment systems, and be capable of real-time display student listens school timetable
It is existing, can help teacher at any time students ' the case where, remind the absent-minded student that listens to the teacher, change teaching method, adjustment teaching in time
Scheme is improved the quality of teaching conscientiously.
To reach above-mentioned purpose, the present invention proposes a kind of classroom real-time monitoring and assessment system, the classroom real-time monitoring
With assessment system be a FPGA system, including sequentially connected video acquisition module, data dispatch module, image analysis module,
As a result statistical module；
The video acquisition module to acquire the indoor video image of religion in real time, if the video image of acquisition is parsed into
Data dispatch module is successively sent to after dry frame；
The data dispatch module includes at least one first memory and a First Input First Output submodule, data dispatch
The picture frame received is sent to first memory by module, is sequentially entered image analysis module by First Input First Output and is carried out
Image analysis；
Described image analysis module includes a behavior Expression analysis network model based on YOLO network, behavior expression point
Analysis network model includes the network layer of several flowing water setting, two second storages to store each network layer output result
Device and the YOLO output layer to export analysis result；
Each network layer includes the convolutional layer and pond layer being correspondingly arranged, the output result friendship of convolutional layer and pond layer
For being written in two second memories, to realize ping-pong operation；
Starting switching between the behavior Expression analysis network model interlayer is determined by handshake, it may be assumed that by letter of shaking hands
Number starting convolutional layer and pond floor alternately read data from two second memories, be sent to next stage after being handled
Network layer；
The YOLO output layer is connect with afterbody network layer, result statistical module respectively, is passed will export result
Transport to result statistical module；
The result statistical module receives the analysis of image analysis module transmission as a result, uniting to abnormal behaviour therein
Meter analysis.
In further embodiment, the first memory is synchronous DRAM；
The second memory is static random access memory.
In further embodiment, the pond layer is maximum pond layer.
In further embodiment, an Image Adjusting mould is provided between the data dispatch module and image analysis module
Block is sent in two second memories after scaling and calls for network layer to receive the image of data dispatch module output.
In further embodiment, the behavior Expression analysis network model also has a weight setting module, to set
Set the convolution kernel weight of network layer.
Based on aforementioned classroom real-time monitoring and assessment system, the present invention further mentions a kind of classroom real-time monitoring and assessment system
Working method, the working method includes:
In real time acquisition classroom on student behavior and facial expression image, by importings classroom real-time monitoring and assessment system progress
Classroom performance analysis and statistics, classroom performance include abnormal behaviour and two kinds of normal behaviour, and
It is greater than a setting amount threshold in response to student's quantity of the abnormal behaviour of synchronization, gives a warning.
In further embodiment, the method also includes:
Classroom performance scoring is carried out to the students ' behavior expression in every frame image of acquisition, lower than the classroom table of setting score value
Now it is defined as abnormal behaviour.
In further embodiment, the method also includes:
Classroom process is divided into several time period tsi, count in all images acquired in each period
The scoring a of the classroom performance of students ' behavior expressioni, i={ 1,2 ..., n } calculates the teaching knot in this classroom according to following formula
Fruit overall score S:
Wherein, ωiIt is each period scoring weight occupied when calculating teaching result overall score,
In further embodiment, the method also includes:
The statistic analysis result of the result statistical module is sent to a given client end after classroom.
The present invention further mentions the creation method of a kind of classroom real-time monitoring and assessment system, the classroom real-time monitoring with comment
The creation method for estimating system includes:
S1: acquiring behavior and the facial expression image of student, is superimposed the Facial expression database of standard to create classroom student's row
For expression data library；
S2: carrying out depth network training to the data in the students ' behavior expression data library of classroom, is repeatedly recycled to obtain
Optimal network parameter；
S3: according to the network parameter obtained in step S2 to establish classroom real-time monitoring and assessment system.
The above technical solution of the present invention, compared with existing, significant beneficial effect is:
1) classroom students ' behavior and expression data library are established, provides foundation for class efficacy assessment.
2) study condition of real-time display classroom student, by capturing the facial expression and behavior of student, statistical
Student classroom performance is analysed, teacher is reminded when there is abnormal behaviour.
3) FPGA design of system and realization, the data of system acquisition protect student without uploading cloud to the maximum extent
With the privacy of teacher.
It should be appreciated that as long as aforementioned concepts and all combinations additionally conceived described in greater detail below are at this
It can be viewed as a part of the subject matter of the disclosure in the case that the design of sample is not conflicting.In addition, required guarantor
All combinations of the theme of shield are considered as a part of the subject matter of the disclosure.
Can be more fully appreciated from the following description in conjunction with attached drawing present invention teach that the foregoing and other aspects, reality
Apply example and feature.The features and/or benefits of other additional aspects such as illustrative embodiments of the invention will be below
Description in it is obvious, or learnt in practice by the specific embodiment instructed according to the present invention.
Detailed description of the invention
Attached drawing is not intended to drawn to scale.In the accompanying drawings, identical or nearly identical group each of is shown in each figure
It can be indicated by the same numeral at part.For clarity, in each figure, not each component part is labeled.
Now, example will be passed through and the embodiments of various aspects of the invention is described in reference to the drawings, in which:
Fig. 1 is the structural schematic diagram of classroom real-time monitoring and assessment system of the invention.
Fig. 2 is the schematic diagram of YOLOV3_tiny network structure of the invention.
Fig. 3 is the FPGA design of target detection network of the invention and the architecture diagram of realization.
Fig. 4 is the working method schematic diagram of classroom real-time monitoring and assessment system of the invention.
Fig. 5 is the creation method schematic diagram of classroom real-time monitoring and assessment system of the invention.
Specific embodiment
In order to better understand the technical content of the present invention, special to lift specific embodiment and institute's accompanying drawings is cooperated to be described as follows.
Various aspects with reference to the accompanying drawings to describe the present invention in the disclosure, shown in the drawings of the embodiment of many explanations.
Embodiment of the disclosure need not be defined on including all aspects of the invention.It should be appreciated that a variety of designs and reality presented hereinbefore
Those of apply example, and describe in more detail below design and embodiment can in many ways in any one come it is real
It applies, this is because conception and embodiment disclosed in this invention are not limited to any embodiment.In addition, disclosed by the invention one
A little aspects can be used alone, or otherwise any appropriately combined use with disclosed by the invention.
In conjunction with Fig. 1, the present invention proposes a kind of classroom real-time monitoring and assessment system, and the classroom real-time monitoring and assessment are
System is a FPGA system, including sequentially connected video acquisition module 10, data dispatch module 20, image analysis module 30, knot
Fruit statistical module 40 and one coordinates the processor module (not identifying in figure) that all modules operate normally.
The video image of acquisition is parsed by the video acquisition module 10 to acquire the indoor video image of religion in real time
Data dispatch module 20 is successively sent to after several frames.
In conjunction with Fig. 3, the data dispatch module 20 includes at least one first memory and a First Input First Output submodule
The picture frame received is sent to first memory by block, data dispatch module 20, sequentially enters figure by First Input First Output
As analysis module 30 carries out image analysis.Preferably, the first memory is synchronous DRAM.
Described image analysis module 30 includes a behavior Expression analysis network model based on YOLO network, behavior expression
Analysis network model includes the network layer of several flowing water setting, deposits to store two second of each network layer output result
Reservoir and the YOLO output layer to export analysis result.Preferably, the second memory is static random access memory
Device.
What YOLO network herein was selected is YOLOV3_tiny network, compares common V1 network, V2 network, V3 network
With fast response time, performance more preferably characteristic, it is suitble to analyze that this crowd density is higher, behavior expressive features value in classroom
More applications.
In conjunction with Fig. 2, each network layer includes the convolutional layer that is correspondingly arranged and pond layer, convolutional layer and pond layer it is defeated
Result is alternately written into two second memories out, to realize ping-pong operation.
In the present embodiment, the pond layer is maximum pond layer.
Starting switching between the behavior Expression analysis network model interlayer is determined by handshake, it may be assumed that by letter of shaking hands
Number starting convolutional layer and pond floor alternately read data from two second memories, be sent to next stage after being handled
Network layer.
The YOLO output layer is connect with afterbody network layer, result statistical module 40 respectively, will export result
It is transmitted to result statistical module 40.
The result statistical module 40 receive the analysis that image analysis module 30 is sent as a result, to abnormal behaviour therein into
Row statistical analysis.
In some instances, an Image Adjusting mould is provided between the data dispatch module 20 and image analysis module 30
Block is sent in two second memories to receive the image of the output of data dispatch module 20, after scaling and calls for network layer,
Data point reuse module is sent to image analysis module 30 after zooming in and out to the picture frame exported to data scheduler module 20, makes
Picture frame meets the reception standard of image analysis module 30.
For example, the pixel ratio of piece image frame is 1920*1080, being converted into pixel ratio after image adjustment module is handled is
The image of 288*288 enters the analysis that image analysis module 30 carries out concrete behavior expression.
In further embodiment, the behavior Expression analysis network model also has a weight setting module, to set
The convolution kernel weight of network layer is set, convolution kernel weight has no definite value, user is needed to set according to actual needs.
In conjunction with Fig. 4, be based on aforementioned classroom real-time monitoring and assessment system, the present invention further mention a kind of classroom real-time monitoring with
The working method of assessment system, the working method include:
In real time acquisition classroom on student behavior and facial expression image, by importings classroom real-time monitoring and assessment system progress
Classroom performance analysis and statistics, classroom performance includes abnormal behaviour and two kinds of normal behaviour, and in response to the different of synchronization
Student's quantity of Chang Hangwei is greater than a setting amount threshold, gives a warning.
It is corresponding, further include an alert module in classroom real-time monitoring and assessment system, reminds teacher to give a warning
The abnormal behaviour on classroom is paid attention in time.
Wherein, the criterion of abnormal behaviour can be set as follows:
Classroom performance scoring is carried out to the students ' behavior expression in every frame image of acquisition, lower than the classroom table of setting score value
Now it is defined as abnormal behaviour.
For example, the eye gaze teacher of its middle school student A, sitting posture correction, raising one's hand to answer a question, expression is happiness, respectively
One point of note, student A is scored at 4 points；The eye gaze teacher of student B, expression are happiness, each one point of note, but it is acted to lie prone
Desk detains one point, and the score of student B is then 1 point.If setting score value as 2 points, the behavior of student A is judged as normal row
For the behavior of student B is then judged as abnormal behaviour.
During a classroom, the attention for closing on student when classroom starts more is concentrated, and classroom middle section or
The attention of person back segment student can be laxed because of fatigue, and as a result statistical module 40 is in the teaching result for counting a classroom
Time factor can be taken into account when overall score, to obtain more objective and accurate judgement result.
Specifically, the method also includes:
Classroom process is divided into several time period tsi, count in all images acquired in each period
The scoring a of the classroom performance of students ' behavior expressioni, i={ 1,2 ..., n } calculates the teaching knot in this classroom according to following formula
Fruit overall score S:
Wherein, ωiIt is each period scoring weight occupied when calculating teaching result overall score,
The method also includes:
The statistic analysis result of the result statistical module 40 is sent to a given client end after classroom, such as
The mobile phone of corresponding teacher, the mobile phone of staff for being responsible for evaluation class efficacy etc..
In conjunction with Fig. 5, the present invention further mentions the creation method of a kind of classroom real-time monitoring and assessment system, and the classroom is real-time
The creation method of monitoring and evaluation system includes:
S1: acquiring behavior and the facial expression image of student, is superimposed the Facial expression database of standard to create classroom student's row
For expression data library.
Specifically, the method in creation classroom students ' behavior expression data library further include: marked to the image data of acquisition
Note, not only the region of label target face also needs to mark its behavior and expression.
S2: carrying out depth network training to the data in the students ' behavior expression data library of classroom, is repeatedly recycled to obtain
Optimal network parameter.For example, obtaining optimal network parameter by repeatedly recycling by BP algorithm training depth network.
S3: according to the network parameter obtained in step S2 to establish classroom real-time monitoring and assessment system, classroom is supervised in real time
Surveying with assessment system is a FPGA system, and the data of system acquisition protect student and teacher without uploading cloud to the maximum extent
Privacy.
The classroom behavior and expression data library is student's data by accumulation plus the image of acquisition, records student
It reads, record the note, pay attention to the class, raise one's hand and lies prone the behaviors such as desk and the expressions such as happiness, dislike, stupefied, surprised, angry, establish class
Hall students ' behavior expression data library, training network parameter.
The study condition of the real-time display classroom student, be by capture student facial expression and behavior,
Student classroom performance is statisticallyd analyze, and abnormal behaviour (phenomena such as mobile phone is played in such as large quantities of collective of students sleeps) is reminded.
All operations of the real time embedded system are locally completed by FPGA, without uploading cloud, without uploading cloud
The privacy of student and teacher are protected in end.The FPGA design of system is as shown in Figure 3.The statistics output result terminates in classroom
Result is sent on teacher's mobile phone afterwards.
Although the present invention has been disclosed as a preferred embodiment, however, it is not to limit the invention.Skill belonging to the present invention
Has usually intellectual in art field, without departing from the spirit and scope of the present invention, when can be used for a variety of modifications and variations.Cause
This, the scope of protection of the present invention is defined by those of the claims.
Claims (10)
1. a kind of classroom real-time monitoring and assessment system, which is characterized in that the classroom real-time monitoring is one with assessment system
FPGA system, including sequentially connected video acquisition module, data dispatch module, image analysis module, result statistical module；
The video image of acquisition is parsed into several frames to acquire the indoor video image of religion in real time by the video acquisition module
It is successively sent to data dispatch module afterwards；
The data dispatch module includes at least one first memory and a First Input First Output submodule, data dispatch module
The picture frame received is sent to first memory, image analysis module is sequentially entered by First Input First Output and carries out image
Analysis；
Described image analysis module includes a behavior Expression analysis network model based on YOLO network, behavior Expression analysis net
Network model include the network layer of several flowing water setting, two second memories to store each network layer output result,
And the YOLO output layer to export analysis result；
Each network layer includes the convolutional layer that is correspondingly arranged and pond layer, and the output result of convolutional layer and pond layer, which replaces, to be write
Enter in two second memories, to realize ping-pong operation；
Starting switching between the behavior Expression analysis network model interlayer is determined by handshake, it may be assumed that is opened by handshake
Dynamic convolutional layer and pond layer alternately reads data from two second memories, and next stage network is sent to after being handled
Layer；
The YOLO output layer is connect with afterbody network layer, result statistical module respectively, is transmitted to will export result
As a result statistical module；
The result statistical module receives the analysis that image analysis module is sent as a result, carrying out statistical to abnormal behaviour therein
Analysis.
2. classroom real-time monitoring according to claim 1 and assessment system, which is characterized in that the first memory is same
Walk dynamic RAM；
The second memory is static random access memory.
3. classroom real-time monitoring according to claim 1 and assessment system, which is characterized in that the pond layer is maximum pond
Change layer.
4. classroom real-time monitoring according to claim 1 and assessment system, which is characterized in that the data dispatch module with
It is provided with an image adjustment module between image analysis module, to receive the image of data dispatch module output, is sent out after scaling
It send into two second memories and is called for network layer.
5. classroom real-time monitoring according to claim 1 and assessment system, which is characterized in that the behavior Expression analysis net
Network model also has a weight setting module, the convolution kernel weight of network layer is arranged.
6. a kind of working method based on classroom real-time monitoring and assessment system described in any one of claim 1-5,
It is characterized in that, the working method includes:
In real time acquisition classroom on student behavior and facial expression image, by importings classroom real-time monitoring and assessment system progress classroom
Performance analysis and statistics, classroom performance include abnormal behaviour and two kinds of normal behaviour, and
It is greater than a setting amount threshold in response to student's quantity of the abnormal behaviour of synchronization, gives a warning.
7. classroom real-time monitoring according to claim 6 and appraisal procedure, which is characterized in that the method also includes:
Classroom performance scoring is carried out to the students ' behavior expression in every frame image of acquisition, the classroom lower than setting score value shows quilt
It is defined as abnormal behaviour.
8. classroom real-time monitoring according to claim 6 and appraisal procedure, which is characterized in that the method also includes:
Classroom process is divided into several time period tsi, count the student in all images acquired in each period
The scoring a of the classroom performance of behavior expressioni, i={ 1,2 ..., n }, the teaching result for calculating this classroom according to following formula is total
Score S:
Wherein, ωiIt is each period scoring weight occupied when calculating teaching result overall score,
9. classroom real-time monitoring according to claim 6 and appraisal procedure, which is characterized in that the method also includes:
The statistic analysis result of the result statistical module is sent to a given client end after classroom.
10. a kind of creation method of classroom real-time monitoring and assessment system, which is characterized in that the classroom real-time monitoring and assessment
The creation method of system includes:
S1: acquiring behavior and the facial expression image of student, is superimposed the Facial expression database of standard to create classroom students ' behavior table
Feelings database；
S2: carrying out depth network training to the data in the students ' behavior expression data library of classroom, is repeatedly recycled best to obtain
Network parameter；
S3: according to the network parameter obtained in step S2 to establish classroom real-time monitoring and assessment system.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811242461.4A CN109359606A (en) | 2018-10-24 | 2018-10-24 | A kind of classroom real-time monitoring and assessment system and its working method, creation method |
| PCT/CN2019/107886 WO2020082971A1 (en) | 2018-10-24 | 2019-09-25 | Real-time classroom monitoring and evaluation system and operation and creation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811242461.4A CN109359606A (en) | 2018-10-24 | 2018-10-24 | A kind of classroom real-time monitoring and assessment system and its working method, creation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109359606A true CN109359606A (en) | 2019-02-19 |
Family
ID=65346517
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811242461.4A Pending CN109359606A (en) | 2018-10-24 | 2018-10-24 | A kind of classroom real-time monitoring and assessment system and its working method, creation method |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109359606A (en) |
| WO (1) | WO2020082971A1 (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110334610A (en) * | 2019-06-14 | 2019-10-15 | 华中师范大学 | A kind of various dimensions classroom based on computer vision quantization system and method |
| CN110598632A (en) * | 2019-09-12 | 2019-12-20 | 深圳市商汤科技有限公司 | Target object monitoring method and device, electronic equipment and storage medium |
| WO2020082971A1 (en) * | 2018-10-24 | 2020-04-30 | 江苏君英天达人工智能研究院有限公司 | Real-time classroom monitoring and evaluation system and operation and creation method thereof |
| CN111291613A (en) * | 2019-12-30 | 2020-06-16 | 新大陆数字技术股份有限公司 | Classroom performance evaluation method and system |
| CN111428686A (en) * | 2020-04-14 | 2020-07-17 | 北京易华录信息技术股份有限公司 | Student interest preference evaluation method, device and system |
| CN111898492A (en) * | 2020-07-15 | 2020-11-06 | 西安石油大学 | Intelligent campus study room monitoring and management system |
| CN116051324A (en) * | 2022-12-31 | 2023-05-02 | 华中师范大学 | Student classroom participation state evaluation method and system based on gesture detection |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111538640B (en) * | 2020-06-09 | 2023-05-16 | 陈君宁 | Dynamic analysis data chain |
| CN111931598B (en) * | 2020-07-20 | 2024-05-17 | 武汉美和易思数字科技有限公司 | Intelligent real-time classroom analysis method and system based on face recognition |
| CN112116264A (en) * | 2020-09-24 | 2020-12-22 | 北京易华录信息技术股份有限公司 | Activity evaluation method and apparatus |
| CN113065441A (en) * | 2021-03-25 | 2021-07-02 | 开放智能机器（上海）有限公司 | Image processing system and method based on edge device |
| CN113743250B (en) * | 2021-08-16 | 2024-02-13 | 华中师范大学 | Construction method and system of classroom teaching behavior event description model |
| CN114677644B (en) * | 2022-03-31 | 2024-07-26 | 北京理工大学 | Classroom monitoring video-based student seating distribution identification method and system |
| CN114926758A (en) * | 2022-05-05 | 2022-08-19 | 北京中庆现代技术股份有限公司 | Method for analyzing classroom student participation |
| CN115130932B (en) * | 2022-08-31 | 2023-07-25 | 中国医学科学院阜外医院 | Classroom activity digital evaluation method |
| CN115810163B (en) * | 2022-11-17 | 2023-09-05 | 云启智慧科技有限公司 | Teaching evaluation method and system based on AI classroom behavior recognition |
| CN116611022B (en) * | 2023-04-21 | 2024-04-26 | 深圳乐行智慧产业有限公司 | Intelligent campus education big data fusion method and platform |
| CN117557428B (en) * | 2024-01-11 | 2024-05-07 | 深圳市华视圣电子科技有限公司 | Teaching assistance method and system based on AI vision |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180018525A1 (en) * | 2015-02-26 | 2018-01-18 | Carrier Corporation | System and method for auto-commissioning an intelligent video system with feedback |
| CN107895244A (en) * | 2017-12-26 | 2018-04-10 | 重庆大争科技有限公司 | Classroom teaching quality assessment method |
| CN108073888A (en) * | 2017-08-07 | 2018-05-25 | 中国科学院深圳先进技术研究院 | A kind of teaching auxiliary and the teaching auxiliary system using this method |
| CN108399376A (en) * | 2018-02-07 | 2018-08-14 | 华中师范大学 | Student classroom learning interest intelligent analysis method and system |
| CN108537117A (en) * | 2018-03-06 | 2018-09-14 | 哈尔滨思派科技有限公司 | A kind of occupant detection method and system based on deep learning |
| CN108596037A (en) * | 2018-03-27 | 2018-09-28 | 康体佳智能科技（深圳）有限公司 | Face identification system based on neural network and recognition methods |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9666088B2 (en) * | 2013-08-07 | 2017-05-30 | Xerox Corporation | Video-based teacher assistance |
| US9355306B2 (en) * | 2013-09-27 | 2016-05-31 | Konica Minolta Laboratory U.S.A., Inc. | Method and system for recognition of abnormal behavior |
| CN109359606A (en) * | 2018-10-24 | 2019-02-19 | 江苏君英天达人工智能研究院有限公司 | A kind of classroom real-time monitoring and assessment system and its working method, creation method |
-
2018
- 2018-10-24 CN CN201811242461.4A patent/CN109359606A/en active Pending
-
2019
- 2019-09-25 WO PCT/CN2019/107886 patent/WO2020082971A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180018525A1 (en) * | 2015-02-26 | 2018-01-18 | Carrier Corporation | System and method for auto-commissioning an intelligent video system with feedback |
| CN108073888A (en) * | 2017-08-07 | 2018-05-25 | 中国科学院深圳先进技术研究院 | A kind of teaching auxiliary and the teaching auxiliary system using this method |
| CN107895244A (en) * | 2017-12-26 | 2018-04-10 | 重庆大争科技有限公司 | Classroom teaching quality assessment method |
| CN108399376A (en) * | 2018-02-07 | 2018-08-14 | 华中师范大学 | Student classroom learning interest intelligent analysis method and system |
| CN108537117A (en) * | 2018-03-06 | 2018-09-14 | 哈尔滨思派科技有限公司 | A kind of occupant detection method and system based on deep learning |
| CN108596037A (en) * | 2018-03-27 | 2018-09-28 | 康体佳智能科技（深圳）有限公司 | Face identification system based on neural network and recognition methods |
Non-Patent Citations (1)
| Title |
|---|
| 刘冬寅: "教室监控视频中人员异常行为检测研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020082971A1 (en) * | 2018-10-24 | 2020-04-30 | 江苏君英天达人工智能研究院有限公司 | Real-time classroom monitoring and evaluation system and operation and creation method thereof |
| CN110334610A (en) * | 2019-06-14 | 2019-10-15 | 华中师范大学 | A kind of various dimensions classroom based on computer vision quantization system and method |
| CN110598632A (en) * | 2019-09-12 | 2019-12-20 | 深圳市商汤科技有限公司 | Target object monitoring method and device, electronic equipment and storage medium |
| CN110598632B (en) * | 2019-09-12 | 2022-09-09 | 深圳市商汤科技有限公司 | Target object monitoring method and device, electronic equipment and storage medium |
| CN111291613A (en) * | 2019-12-30 | 2020-06-16 | 新大陆数字技术股份有限公司 | Classroom performance evaluation method and system |
| CN111291613B (en) * | 2019-12-30 | 2024-04-23 | 新大陆数字技术股份有限公司 | Classroom performance evaluation method and system |
| CN111428686A (en) * | 2020-04-14 | 2020-07-17 | 北京易华录信息技术股份有限公司 | Student interest preference evaluation method, device and system |
| CN111898492A (en) * | 2020-07-15 | 2020-11-06 | 西安石油大学 | Intelligent campus study room monitoring and management system |
| CN116051324A (en) * | 2022-12-31 | 2023-05-02 | 华中师范大学 | Student classroom participation state evaluation method and system based on gesture detection |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020082971A1 (en) | 2020-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109359606A (en) | A kind of classroom real-time monitoring and assessment system and its working method, creation method | |
| CN110334610B (en) | Multi-dimensional classroom quantification system and method based on computer vision | |
| Bradley et al. | The effect of competition on the efficiency of secondary schools in England | |
| CN110837795A (en) | Teaching condition intelligent monitoring method, device and equipment based on classroom monitoring video | |
| WO2019028592A1 (en) | Teaching assistance method and teaching assistance system using said method | |
| CN108073888A (en) | A kind of teaching auxiliary and the teaching auxiliary system using this method | |
| CN110009210B (en) | Comprehensive assessment method for student class listening level based on attention degree and concentration degree | |
| CN108009754A (en) | Method of Teaching Quality Evaluation | |
| CN111814587B (en) | Human behavior detection method, teacher behavior detection method, and related systems and devices | |
| CN111312367A (en) | Campus personnel abnormal psychological prediction method based on self-adaptive cloud management platform | |
| CN108154304A (en) | There is the server of Teaching Quality Assessment | |
| CN111523445B (en) | Examination behavior detection method based on improved Openpost model and facial micro-expression | |
| CN108921748A (en) | Didactic code method and computer-readable medium based on big data analysis | |
| CN108764640A (en) | A kind of personalized dynamic teaching diagnosis and the system of improvement based on big data | |
| CN114677644A (en) | Student seating distribution identification method and system based on classroom monitoring video | |
| CN111666829A (en) | Multi-scene multi-subject identity behavior emotion recognition analysis method and intelligent supervision system | |
| CN104408781A (en) | Concentration attendance system | |
| CN116343311A (en) | Virtual person teaching auxiliary system based on facial expression recognition | |
| CN110348328A (en) | Appraisal procedure, device, storage medium and the electronic equipment of quality of instruction | |
| CN113469001A (en) | Student classroom behavior detection method based on deep learning | |
| CN115829234A (en) | Automatic supervision system based on classroom detection and working method thereof | |
| CN112070662B (en) | Evaluation method and device of face changing model, electronic equipment and storage medium | |
| CN114998440A (en) | Multi-mode-based evaluation method, device, medium and equipment | |
| Liu | The Detection of English Students’ Classroom Learning State in Higher Vocational Colleges Based on Improved SSD Algorithm | |
| CN211293955U (en) | Teenager eyesight guard system based on video deep learning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Gu Xiaodong Inventor after: Wang Shizhao Inventor before: Gu Xiaodong Inventor before: Wang Shizhao |
|
| CB03 | Change of inventor or designer information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190219 |
|
| RJ01 | Rejection of invention patent application after publication |