CN109461104A - Classroom monitoring method, device and electronic equipment - Google Patents
Classroom monitoring method, device and electronic equipment Download PDFInfo
- Publication number
- CN109461104A CN109461104A CN201811232978.5A CN201811232978A CN109461104A CN 109461104 A CN109461104 A CN 109461104A CN 201811232978 A CN201811232978 A CN 201811232978A CN 109461104 A CN109461104 A CN 109461104A
- Authority
- CN
- China
- Prior art keywords
- student
- classroom
- behavior
- type
- image information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Abstract
The present invention provides a kind of classroom monitoring method, device and electronic equipments, are related to the technical field of teaching management, wherein teaching indoor image information this method comprises: obtaining；Feature extraction is carried out to the image information, and is based on pre-stored feature database, determines the classroom acceptance level of student；Wherein, this feature library includes behavioural characteristic library and face characteristic library.Technical solution provided by the invention, the classroom mood for comparing student is analyzed by face characteristic, the classroom behavior for comparing student is analyzed by behavioural characteristic, to analyze in terms of mood and behavior two the classroom acceptance level of student, which will be imparted knowledge to students and be blended with Image Information Processing, improve conventional teaching environment unification, intelligence degree is low, information-based insufficient problem, and accurate teaching data can be obtained, be conducive to improve Classroom Teaching, it is convenient for later data statistics, and then meet the daily teaching and learning demand of people.
Description
Technical field
The present invention relates to teaching management technical fields, more particularly, to a kind of classroom monitoring method, device and electronic equipment.
Background technique
In recent years, China's Development of IT-based Education is rapid, and education sector is under the overall background of era change, also just towards complete
The direction that orientation is changed carries out.The study of student is imitated as the teaching of classroom and student and the important place of study in classroom
Fruit influence it is obvious, for low age bracket student especially poor to self-control, needed in learning process teacher play supervise and
The effect of Emotional support.
The teaching environment in traditional classroom, teacher need to confirm by query link, put question to interaction link, the small test wrapper in classroom
Section etc., after providing simple selection, student raises one's hand or oral answer, and which cannot obtain accurate statistical data, teacher
Student can only be judged to the acceptance level of knowledge according to general condition.
Therefore, the unification of conventional teaching environment, intelligence degree be low, information-based deficiency, it is difficult to obtain accurately teaching number
According to so that later data statistics can not be carried out, and then being unable to satisfy the daily teaching and learning demand of people.
Summary of the invention
In view of this, will impart knowledge to students and figure the purpose of the present invention is to provide classroom monitoring method, device and electronic equipment
As information processing blends, the problem of the unification of conventional teaching environment, low, the information-based deficiency of intelligence degree, and energy are improved
Accurate teaching data is enough obtained, is conducive to improve Classroom Teaching, is convenient for later data statistics, and then meet people
Daily teaching and learning demand.
In a first aspect, the embodiment of the invention provides a kind of classroom monitoring methods, comprising:
It obtains and teaches indoor image information；
Feature extraction is carried out to described image information, and is based on pre-stored feature database, determines that the classroom of student receives
Degree；
Wherein, the feature database includes behavioural characteristic library and face characteristic library.
With reference to first aspect, the embodiment of the invention provides the first possible embodiments of first aspect, wherein institute
It states and feature extraction is carried out to described image information, and be based on pre-stored feature database, determine the classroom acceptance level packet of student
It includes:
Feature extraction is carried out to described image information, obtains face characteristic and behavioural characteristic；
Based on the face characteristic and the face characteristic library, the type of emotion of student is determined；
Based on the behavioural characteristic and the behavioural characteristic library, the behavior type of the student is determined；
According to the type of emotion and the behavior type, determine that the classroom of the student receives degree.
With reference to first aspect, the embodiment of the invention provides second of possible embodiments of first aspect, wherein institute
It states and feature extraction is carried out to described image information, and be based on pre-stored feature database, determine the classroom acceptance level packet of student
It includes:
Described image information is pre-processed, face characteristic is extracted；
Based on the face characteristic and face characteristic library, the identity information and type of emotion of test object are determined；
When determining that the test object is student according to the identity information, behavior knowledge is carried out to described image information
Not, behavioural characteristic is extracted；
Based on the behavioural characteristic and behavioural characteristic library, the behavior type of the student is determined；
According to the type of emotion and the behavior type, the classroom acceptance level of the student is determined.
With reference to first aspect the first or second of possible embodiment, the embodiment of the invention provides first party
The third possible embodiment in face, wherein it is described according to the type of emotion and the behavior type, determine the student
Classroom acceptance level include:
According to the type of emotion and preset mood score value related information, the corresponding mood point of the type of emotion is determined
Value；
According to the behavior type and preset behavior score value related information, the corresponding behavior point of the behavior type is determined
Value；
According to the mood score value and mood rate of specific gravity and the behavior score value and behavior rate of specific gravity, the student is determined
Classroom receive degree.
With reference to first aspect the first or second of possible embodiment, the embodiment of the invention provides first party
The 4th kind of possible embodiment in face, wherein it is described to be based on the behavioural characteristic and behavioural characteristic library, determine the student's
After behavior type, further includes:
Judge whether the corresponding behavior of the behavior type of the student is hazardous act；
If it is, sending warning message to corresponding parent's terminal.
With reference to first aspect the first or second of possible embodiment, the embodiment of the invention provides first party
The 5th kind of possible embodiment in face, wherein it is described to be based on the behavioural characteristic and behavioural characteristic library, determine the student's
After behavior type, further includes:
Judge whether the corresponding behavior of the behavior type of the student is preset behavior；
If it is, saving current image information to corresponding growth archives.
With reference to first aspect, the embodiment of the invention provides the 6th kind of possible embodiments of first aspect, wherein also
Include:
The request of checking of parent's terminal transmission is received, it is described to check that request includes class's information；
Request is checked according to described, sends corresponding image information in real time to parent's terminal.
Second aspect, the embodiment of the present invention also provide a kind of classroom monitoring device, comprising:
Module is obtained, teaches indoor image information for obtaining；
Determining module for carrying out feature extraction to described image information, and is based on pre-stored feature database, determines and learn
Raw classroom acceptance level；
Wherein, the feature database includes behavioural characteristic library and face characteristic library.
The third aspect, the embodiment of the present invention also provide a kind of electronic equipment, including memory, processor, the memory
On be stored with the computer program that can be run on the processor, the processor is realized when executing the computer program
State method described in first aspect and its any possible embodiment.
Fourth aspect, the embodiment of the present invention also provide a kind of meter of non-volatile program code that can be performed with processor
Calculation machine readable medium, said program code make the processor execute the first aspect and its any possible embodiment
The method.
The embodiment of the present invention bring it is following the utility model has the advantages that
In embodiments of the present invention, which includes: and obtains to teach indoor image information；Described image is believed
Breath carries out feature extraction, and is based on pre-stored feature database, determines the classroom acceptance level of student；Wherein, this feature library is wrapped
Include behavioural characteristic library and face characteristic library.Technical solution provided by the invention, by face characteristic to the classroom feelings for comparing student
Thread is analyzed, and is analyzed by behavioural characteristic the classroom behavior for comparing student, thus in terms of mood and behavior two
The classroom acceptance level of student is analyzed, which will be imparted knowledge to students and be blended with Image Information Processing, and conventional teaching is improved
Environment unification, low, the information-based deficiency of intelligence degree problem, and accurate teaching data can be obtained, be conducive to improve
Classroom Teaching is convenient for later data statistics, and then meets the daily teaching and learning demand of people.
Other features and advantages of the present invention will illustrate in the following description, also, partly become from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention are in specification, claims
And specifically noted structure is achieved and obtained in attached drawing.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate
Appended attached drawing, is described in detail below.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art be briefly described, it should be apparent that, it is described below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, is also possible to obtain other drawings based on these drawings.
Fig. 1 is a kind of flow diagram of classroom monitoring method provided in an embodiment of the present invention；
Fig. 2 is the flow diagram of another classroom monitoring method provided in an embodiment of the present invention；
Fig. 3 is a kind of flow diagram of classroom monitoring device provided in an embodiment of the present invention；
Fig. 4 is the flow diagram of electronic equipment provided in an embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with attached drawing to the present invention
Technical solution be clearly and completely described, it is clear that described embodiments are some of the embodiments of the present invention, rather than
Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Under every other embodiment obtained, shall fall within the protection scope of the present invention.
Conventional teaching environment unification at present, intelligence degree be low, information-based deficiency, it is difficult to obtain accurately teaching number
According to so that later data statistics can not be carried out, and then being unable to satisfy the daily teaching and learning demand of people.
Based on the above issues, a kind of classroom monitoring method, device and electronic equipment provided in an embodiment of the present invention, Ke Yitong
It crosses face Characteristic Contrast to analyze the classroom mood of student, the classroom behavior for comparing student is divided by behavioural characteristic
Analysis, to analyze in terms of mood and behavior two the classroom acceptance level of student, which will impart knowledge to students to be believed with image
Breath processing blends, and improves the problem of the unification of conventional teaching environment, low, the information-based deficiency of intelligence degree, and can obtain
Accurate teaching data is obtained, is conducive to improve Classroom Teaching, is convenient for later data statistics, and then meet the day of people
Often teaching and learning demand.
For convenient for understanding the present embodiment, first to a kind of classroom monitoring method disclosed in the embodiment of the present invention into
Row is discussed in detail.This method can be, but not limited to be applied to Cloud Server, and rely on related hardware or software realization, main to use
It is applied in teaching.
Embodiment one:
Fig. 1 shows a kind of flow diagram of classroom monitoring method provided in an embodiment of the present invention.As shown in Figure 1, should
Classroom monitoring method includes:
Step S101 is obtained and is taught indoor image information.
Wherein, which can be obtained by being mounted on the indoor camera of religion.Camera can be respectively set to be multiple
In the different positions in classroom, therefore its coverage can cover each corner in entire classroom, so as to in classroom
Student shoot and monitor.
Specifically, it as the camera can be taken the photograph once at interval of certain time such as 1 second beats, can also be shot by camera
Classroom video obtain, such as from the video of classroom automatically intercept obtain image.
Step S102 carries out feature extraction to above-mentioned image information, and is based on pre-stored feature database, determines student's
Classroom acceptance level.
Wherein, this feature library includes behavioural characteristic library and face characteristic library.Behavior feature database and face characteristic library are bases
It is obtained in a large amount of facial image sample gathered in advance and behavior image pattern for training sample set.In face characteristic library
The face sample characteristics for marking have in advance are stored with, are stored with what label in advance had in behavioural characteristic library
Behavior sample feature.
In a possible embodiment, above-mentioned steps S102 includes:
(a1) feature extraction is carried out to above-mentioned image information, obtains face characteristic and behavioural characteristic.
(a2) it is based on the face characteristic and face characteristic library, determines the type of emotion of student.
(a3) it is based on behavior feature and behavioural characteristic library, determines the behavior type of student.
(a4) according to the type of emotion and behavior type, determine that the classroom of student receives degree.
Specifically, image information to above-mentioned comprising face information carries out feature extraction, obtain student face characteristic and
Behavioural characteristic compares the face characteristic and the face sample characteristics in face characteristic library, to obtain matched face sample
Eigen simultaneously determines corresponding type of emotion, and behavioural characteristic and the behavior sample feature in behavioural characteristic library are compared, with
It obtains matched behavior sample feature and determines corresponding behavior type.Determine student's according to the type of emotion and behavior type
Classroom acceptance level.
In a possible embodiment, type of emotion it is such as glad, it is sad, low, angry, feel uncertain；Its middle school student's is dynamic
Make type, such as sits up straight, turns one's head, bows, eats or get something to drink, play thing, is lying or leaning, whispering to each other, lean on chin, desk of lying prone, dance, walking
Road, running, raises one's hand, fall etc..
In a possible embodiment, it can determine whether to attend class the stage in classroom by the shooting time of image.Class
Hall student classroom attend class the mood showed in the stage can characterize classroom student to the absorbed degree of course and/or
Favorable rating attends class the behavior act showed in the stage in classroom according to classroom student, characterizes classroom student to course
It is absorbed in degree.
Classroom acceptance level can be, but not limited to be indicated with basic, normal, high different brackets, or can use fraction representation.?
In possible embodiment, if it is determined that the type of emotion of student is happiness, and type of action is to sit up straight, it is determined that the classroom of student connects
It is height by degree；If it is determined that the type of emotion of student be it is low, type of action be turn one's head, it is determined that the classroom of student receives journey
Degree is low.
Technical solution provided by the invention analyzes the classroom mood for comparing student by face characteristic, passes through row
It is characterized and the classroom behavior for comparing student is analyzed, thus to the classroom acceptance level of student in terms of mood and behavior two
It is analyzed, which will be imparted knowledge to students and be blended with Image Information Processing, and the unification of conventional teaching environment, intelligence degree are improved
The problem of low, information-based deficiency, and accurate teaching data can be obtained, be conducive to improve Classroom Teaching, be convenient for
Later data statistics, and then meet the daily teaching and learning demand of people.
In other possible embodiment, above-mentioned steps S102 includes:
(b1) above-mentioned image information is pre-processed, extracts face characteristic.
Cloud Server, by detecting human face region, tracks face after receiving the image information that camera is sent in real time
Feature changes over time.When the image for capturing a frame and meeting certain standard (such as positive face in the deviation range for meeting configuration)
When, image is pre-processed.
Wherein in order to improve signal-to-noise ratio, above-mentioned pretreatment includes that the image removed or reduced in image information is obscured, moved
Fuzzy and geometric distortion improves clarity etc..
It specifically, include various distance proportions and angle value from the face characteristic extracted in information in image, between two
Distance, the angle value etc. that combination between distance, two cheeks between distance, eyes size and each characteristic point is formed.
(b2) based on above-mentioned face characteristic and face characteristic library, the identity information and type of emotion of test object are determined.
Wherein test object is that can be the student to attend class in the classroom positioned at indoor people is taught, be also possible to other religions
Worker person.The identity information can be non-student, or be student and its student identification.
The student to attend class in the classroom registers by related software in advance, so that Cloud Server obtains
Corresponding student identification is marked to the corresponding face sample characteristics of each student, and by the face sample characteristics.
Specifically, the face sample characteristics for marking have in advance are stored in face characteristic library.It can be by face
Feature marks the face sample characteristics having to compare in advance with face characteristic library, so that it is determined that go out and the people
The student identification of face characteristic matching, and then it is set to exact student, the identification to test object is realized by this way, is obtained
To the identity information of the test object.
In a possible embodiment, face characteristic can be carried out with the face sample characteristics having are marked in advance
Comparison, so that it is determined that going out the corresponding type of emotion of the face characteristic, the type of emotion is associated with corresponding student identification.
In addition type of emotion also can use under type such as and determine: by the image information of continuous acquisition, determine to inspection
The variation of subjects face feature is surveyed, and then analyzes the type of emotion for driving and generating.
(b3) when determining that test object is student according to above-mentioned identity information, behavior knowledge is carried out to above-mentioned image information
Not, behavioural characteristic is extracted.
(b4) based on above-mentioned behavioural characteristic and behavioural characteristic library, the behavior type of student is determined.
Behavioural characteristic and the behavior sample feature in behavioural characteristic library are compared, it is special to obtain matched behavior sample
Levy and determine corresponding behavior type, behavior type is associated with corresponding student identification.
(b5) according to above-mentioned type of emotion and above-mentioned behavior type, the classroom acceptance level of student is determined.
Each student onto classroom can be accurately positioned based on above-mentioned identification, known by Emotion identification and mood
Not, the classroom acceptance level of each student on each classroom is determined.
In a possible embodiment, above-mentioned steps (b5) include:
(c1) according to above-mentioned type of emotion and preset mood score value related information, the corresponding mood of the type of emotion is determined
Score value.
Specifically, the corresponding mood score value of each type of emotion is preset, such as glad corresponding mood score value is 90 points,
Corresponding mood score value of feeling uncertain is 50 points.
(c2) according to above-mentioned behavior type and preset behavior score value related information, the corresponding behavior of behavior type is determined
Score value.
Specifically, the corresponding mood score value of each behavior type is preset, such as sitting up straight corresponding behavior score value is 90 points,
Corresponding action values of eating or get something to drink are 50 points.
(c3) according to mood score value and mood rate of specific gravity and behavior score value and behavior rate of specific gravity, determine that the classroom of student connects
Receipts degree.
Wherein, mood rate of specific gravity and behavior rate of specific gravity are preset, and respectively less than 1, and mood rate of specific gravity is such as arranged and is
0.6, behavior rate of specific gravity is 0.4.
In a possible embodiment, above-mentioned classroom receives the specific fraction representation of degree, and classroom receives degree=mood
Score value × mood rate of specific gravity+behavior score value × behavior rate of specific gravity.
Fig. 2 shows the flow diagrams of another classroom monitoring method provided in an embodiment of the present invention.As shown in Fig. 2,
The classroom monitoring method includes:
Step S201 is obtained and is taught indoor image information.
Wherein, the image information that camera is sent is received, includes face information in the image information.
Step S202 pre-processes the image information, carries out Face datection.
Step S203, extract face characteristic, be based on face characteristic and face characteristic library, determine face characteristic whether with face
Face sample characteristics matching in feature database.
Specifically, the student to attend class in the classroom is required to register, and preserves the student's in Cloud Server
Face sample characteristics.It determines that the object to be detected is non-student if mismatching, determines the object to be detected if matching
For student.
If it does, then executing step S204；Process terminates if mismatching.
Step S204 determines the identity information of test object.
Specifically, when which is student, which includes student identification.Face characteristic and face is special
The face sample characteristics marked in advance in sign library are compared, so that it is determined that going out with the face characteristic matching
Raw mark, and then it is set to exact student, if in face characteristic library not including the face sample to match with the face characteristic
Eigen, then process terminates, or can also prompt the test object is non-student.
Step S205 carries out behavioural analysis to above-mentioned image information, extracts behavioural characteristic.
Step S206 is based on behavior feature and behavioural characteristic library, determines the behavior type of test object.
Step S207 judges whether the corresponding behavior of the behavior type of the test object is hazardous act.
In a possible embodiment, hazardous act includes the behaviors such as falling down, jumping, and can specifically be carried out by related personnel
It preassigns.If the corresponding behavior of the behavior type of the test object is hazardous act, S208 is thened follow the steps；If detection
The corresponding behavior of the behavior type of object is not hazardous act, thens follow the steps S209.
Step S208 sends warning message to the corresponding parent's terminal of above-mentioned identity information.
Step S209 judges whether the corresponding behavior of the behavior type of the test object is preset behavior.
In a possible embodiment, preset behavior includes the behaviors such as raise one's hand, dance, and can specifically be carried out by related personnel
It preassigns.If the corresponding behavior of the behavior type of the test object is preset behavior, S210 is thened follow the steps；If detection
The corresponding behavior of the behavior type of object is not preset behavior, then process terminates.
Step S210 saves current image information to the corresponding growth archives of identity information.
It should be noted that the sequencing between above-mentioned steps S207 and step S208 is unlimited.
In a possible embodiment, which includes student identification, and parent's terminal can check at any time this at long span
Case, the above method further include: receive the transmission of parent's terminal checks request, this checks that request includes student identification；It is looked into according to this
It sees request, sends corresponding growth archives in real time to parent's terminal.
For the situation for checking parents of student at any time in classroom, performance of the student on classroom is understood, in addition
Embodiment in, each classroom is corresponding with preset class's information.The above method further include: receive looking into for parent's terminal transmission
See request, this checks that request includes class's information；Request is checked according to this, sends corresponding image information in real time to parent's end
End.By the means, parent can recognize the situation of attending class of corresponding student in classroom by image information.
In conclusion embodiment provided by the invention has the advantages that
It by acquisition image information and is analyzed and processed, realizes the fusion of information technology and teaching.
It is analyzed by classroom mood of the face recognition technology to student, real-time judge student receives journey to knowledge
Degree supervises to the deficiency in teacher's teaching, improves teacher's Classroom Teaching.
Any class efficacy of academics and students can be allowed student to be ready to interact, be happy to by the effective Real-time Feedback of system
Interaction is enjoyed in interaction.
Video monitoring crawl student is cooperated to teach indoor segment, hazard recognition behavior alarms to parent end.Parent
Specific account can be logged in, checks that attending class for child learns situation at any time, while protecting child safety, more storable preciousness
Video clip finds deficiency and advantage of the child in growth in time.
Technical solution provided by the invention analyzes the classroom mood for comparing student by face characteristic, passes through row
It is characterized and the classroom behavior for comparing student is analyzed, thus to the classroom acceptance level of student in terms of mood and behavior two
It is analyzed, which will be imparted knowledge to students and be blended with Image Information Processing, and the unification of conventional teaching environment, intelligence degree are improved
The problem of low, information-based deficiency, and accurate teaching data can be obtained, be conducive to improve Classroom Teaching, be convenient for
Later data statistics, and then meet the daily teaching and learning demand of people.
Embodiment two:
Based on the classroom monitoring method in embodiment one, the embodiment of the invention provides a kind of classroom monitoring device, referring to
Fig. 3, the device include:
Module 11 is obtained, teaches indoor image information for obtaining；
Determining module 12 for carrying out feature extraction to above-mentioned image information, and is based on pre-stored feature database, determines
The classroom acceptance level of student；
Wherein, this feature library includes behavioural characteristic library and face characteristic library.
Further, above-mentioned determining module 12 is also used to:
Above-mentioned image information is pre-processed, face characteristic is extracted；
Based on face characteristic and face characteristic library, the identity information and type of emotion of test object are determined；
When determining that the test object is student according to the identity information, Activity recognition is carried out to the image information, is mentioned
Take behavioural characteristic；
Based on above-mentioned behavioural characteristic and behavioural characteristic library, the behavior type of student is determined；
According to above-mentioned type of emotion and the behavior type, the classroom acceptance level of student is determined.
Technical solution provided by the invention analyzes the classroom mood for comparing student by face characteristic, passes through row
It is characterized and the classroom behavior for comparing student is analyzed, thus to the classroom acceptance level of student in terms of mood and behavior two
It is analyzed, which will be imparted knowledge to students and be blended with Image Information Processing, and the unification of conventional teaching environment, intelligence degree are improved
The problem of low, information-based deficiency, and accurate teaching data can be obtained, be conducive to improve Classroom Teaching, be convenient for
Later data statistics, and then meet the daily teaching and learning demand of people.
Embodiment three:
Referring to fig. 4, the embodiment of the present invention also provides a kind of electronic equipment 100, comprising: processor 40, memory 41, bus
42 and communication interface 43, the processor 40, communication interface 43 and memory 41 are connected by bus 42；Processor 40 is for holding
The executable module stored in line storage 41, such as computer program.
Wherein, memory 41 may include high-speed random access memory (RAM, Random Access Memory),
It may further include nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.By at least
One communication interface 43 (can be wired or wireless) realizes the communication between the system network element and at least one other network element
Connection, can be used internet, wide area network, local network, Metropolitan Area Network (MAN) etc..
Bus 42 can be isa bus, pci bus or eisa bus etc..The bus can be divided into address bus, data
Bus, control bus etc..Only to be indicated with a four-headed arrow convenient for indicating, in Fig. 4, it is not intended that an only bus or
A type of bus.
Wherein, memory 41 is for storing program, and the processor 40 executes the journey after receiving and executing instruction
Sequence, method performed by the device that the stream process that aforementioned any embodiment of the embodiment of the present invention discloses defines can be applied to handle
In device 40, or realized by processor 40.
Processor 40 may be a kind of IC chip, the processing capacity with signal.During realization, above-mentioned side
Each step of method can be completed by the integrated logic circuit of the hardware in processor 40 or the instruction of software form.Above-mentioned
Processor 40 can be general processor, including central processing unit (Central Processing Unit, abbreviation CPU), network
Processor (Network Processor, abbreviation NP) etc.；It can also be digital signal processor (Digital Signal
Processing, abbreviation DSP), specific integrated circuit (Application Specific Integrated Circuit, referred to as
ASIC), ready-made programmable gate array (Field-Programmable Gate Array, abbreviation FPGA) or other are programmable
Logical device, discrete gate or transistor logic, discrete hardware components.It may be implemented or execute in the embodiment of the present invention
Disclosed each method, step and logic diagram.General processor can be microprocessor or the processor is also possible to appoint
What conventional processor etc..The step of method in conjunction with disclosed in the embodiment of the present invention, can be embodied directly in hardware decoding processing
Device executes completion, or in decoding processor hardware and software module combination execute completion.Software module can be located at
Machine memory, flash memory, read-only memory, programmable read only memory or electrically erasable programmable memory, register etc. are originally
In the storage medium of field maturation.The storage medium is located at memory 41, and processor 40 reads the information in memory 41, in conjunction with
Its hardware completes the step of above method.
Classroom monitoring device and electronic equipment provided in an embodiment of the present invention, with classroom monitoring side provided by the above embodiment
Method technical characteristic having the same reaches identical technical effect so also can solve identical technical problem.
The computer program product of classroom monitoring method is carried out provided by the embodiment of the present invention, including stores processor
The computer readable storage medium of executable non-volatile program code, the instruction that said program code includes can be used for executing
Previous methods method as described in the examples, specific implementation can be found in embodiment of the method, and details are not described herein.
It is apparent to those skilled in the art that for convenience and simplicity of description, the device of foregoing description
And the specific work process of electronic equipment, it can refer to corresponding processes in the foregoing method embodiment, details are not described herein.
The flow chart and block diagram in the drawings show multiple embodiment method and computer program products according to the present invention
Architecture, function and operation in the cards.In this regard, each box in flowchart or block diagram can represent one
A part of module, section or code, a part of the module, section or code include it is one or more for realizing
The executable instruction of defined logic function.It should also be noted that in some implementations as replacements, function marked in the box
It can also can occur in a different order than that indicated in the drawings.For example, two continuous boxes can actually be substantially parallel
Ground executes, they can also be executed in the opposite order sometimes, and this depends on the function involved.It is also noted that block diagram
And/or the combination of each box in flow chart and the box in block diagram and or flow chart, it can the function as defined in executing
Can or the dedicated hardware based system of behavior realize, or can come using a combination of dedicated hardware and computer instructions real
It is existing.
In addition, term " first ", " second ", " third " are used for description purposes only, it is not understood to indicate or imply phase
To importance.Unless specifically stated otherwise, the opposite step of the component and step that otherwise illustrate in these embodiments, digital table
It is not limit the scope of the invention up to formula and numerical value
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it
Its mode is realized.The apparatus embodiments described above are merely exemplary, for example, the division of the unit, only
A kind of logical function partition, there may be another division manner in actual implementation, in another example, multiple units or components can combine
Or it is desirably integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed phase
Coupling, direct-coupling or communication connection between mutually can be through some communication interfaces, the INDIRECT COUPLING of device or unit or
Communication connection can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in the executable non-volatile computer-readable storage medium of a processor.Based on this understanding, of the invention
Technical solution substantially the part of the part that contributes to existing technology or the technical solution can be with software in other words
The form of product embodies, which is stored in a storage medium, including some instructions use so that
One computer equipment (can be personal computer, server or the network equipment etc.) executes each embodiment institute of the present invention
State all or part of the steps of method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-
Only Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can be with
Store the medium of program code.
Finally, it should be noted that embodiment described above, only a specific embodiment of the invention, to illustrate the present invention
Technical solution, rather than its limitations, scope of protection of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, those skilled in the art should understand that: anyone skilled in the art
In the technical scope disclosed by the present invention, it can still modify to technical solution documented by previous embodiment or can be light
It is readily conceivable that variation or equivalent replacement of some of the technical features；And these modifications, variation or replacement, do not make
The essence of corresponding technical solution is detached from the spirit and scope of technical solution of the embodiment of the present invention, should all cover in protection of the invention
Within the scope of.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. a kind of classroom monitoring method characterized by comprising
It obtains and teaches indoor image information；
Feature extraction is carried out to described image information, and is based on pre-stored feature database, determines the classroom acceptance level of student；
Wherein, the feature database includes behavioural characteristic library and face characteristic library.
2. the method according to claim 1, wherein described carry out feature extraction, and base to described image information
In pre-stored feature database, determine that the classroom acceptance level of student includes:
Feature extraction is carried out to described image information, obtains face characteristic and behavioural characteristic；
Based on the face characteristic and the face characteristic library, the type of emotion of student is determined；
Based on the behavioural characteristic and the behavioural characteristic library, the behavior type of the student is determined；
According to the type of emotion and the behavior type, determine that the classroom of the student receives degree.
3. the method according to claim 1, wherein described carry out feature extraction, and base to described image information
In pre-stored feature database, determine that the classroom acceptance level of student includes:
Described image information is pre-processed, face characteristic is extracted；
Based on the face characteristic and face characteristic library, the identity information and type of emotion of test object are determined；
When determining that the test object is student according to the identity information, Activity recognition is carried out to described image information, is mentioned
Take behavioural characteristic；
Based on the behavioural characteristic and behavioural characteristic library, the behavior type of the student is determined；
According to the type of emotion and the behavior type, the classroom acceptance level of the student is determined.
4. according to the method in claim 2 or 3, which is characterized in that described according to the type of emotion and the behavior class
Type determines that the classroom acceptance level of the student includes:
According to the type of emotion and preset mood score value related information, the corresponding mood score value of the type of emotion is determined；
According to the behavior type and preset behavior score value related information, the corresponding behavior score value of the behavior type is determined；
According to the mood score value and mood rate of specific gravity and the behavior score value and behavior rate of specific gravity, the class of the student is determined
Hall receives degree.
5. according to the method in claim 2 or 3, which is characterized in that it is described to be based on the behavioural characteristic and behavioural characteristic library,
After the behavior type for determining the student, further includes:
Judge whether the corresponding behavior of the behavior type of the student is hazardous act；
If it is, sending warning message to corresponding parent's terminal.
6. according to the method in claim 2 or 3, which is characterized in that it is described to be based on the behavioural characteristic and behavioural characteristic library,
After the behavior type for determining the student, further includes:
Judge whether the corresponding behavior of the behavior type of the student is preset behavior；
If it is, saving current image information to corresponding growth archives.
7. the method according to claim 1, wherein further include:
The request of checking of parent's terminal transmission is received, it is described to check that request includes class's information；
Request is checked according to described, sends corresponding image information in real time to parent's terminal.
8. a kind of classroom monitoring device characterized by comprising
Module is obtained, teaches indoor image information for obtaining；
Determining module for carrying out feature extraction to described image information, and is based on pre-stored feature database, determines student's
Classroom acceptance level；
Wherein, the feature database includes behavioural characteristic library and face characteristic library.
9. a kind of electronic equipment, including memory, processor, be stored on the memory to run on the processor
Computer program, which is characterized in that the processor realizes that the claims 1 to 7 are any when executing the computer program
Method described in.
10. a kind of computer-readable medium for the non-volatile program code that can be performed with processor, which is characterized in that described
Program code makes the processor execute the described in any item methods of claim 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811232978.5A CN109461104A (en) | 2018-10-22 | 2018-10-22 | Classroom monitoring method, device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811232978.5A CN109461104A (en) | 2018-10-22 | 2018-10-22 | Classroom monitoring method, device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109461104A true CN109461104A (en) | 2019-03-12 |
Family
ID=65608107
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811232978.5A Pending CN109461104A (en) | 2018-10-22 | 2018-10-22 | Classroom monitoring method, device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109461104A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110647842A (en) * | 2019-09-20 | 2020-01-03 | 重庆大学 | Double-camera classroom inspection method and system |
| CN110729049A (en) * | 2019-11-01 | 2020-01-24 | 广州云蝶科技有限公司 | Mental health early warning method |
| CN110853428A (en) * | 2019-12-04 | 2020-02-28 | 广州云蝶科技有限公司 | Recording and broadcasting control method and system based on Internet of things |
| CN111339809A (en) * | 2018-12-20 | 2020-06-26 | 深圳市鸿合创新信息技术有限责任公司 | Classroom behavior analysis method and device and electronic equipment |
| CN111666829A (en) * | 2020-05-18 | 2020-09-15 | 首都经济贸易大学 | Multi-scene multi-subject identity behavior emotion recognition analysis method and intelligent supervision system |
| CN111882305A (en) * | 2020-05-09 | 2020-11-03 | 北京文香信息技术有限公司 | Behavior analysis device and behavior monitoring analysis system |
| CN112580910A (en) * | 2019-09-29 | 2021-03-30 | 鸿富锦精密电子(天津)有限公司 | Teaching questionnaire analysis method, electronic device and storage medium |
| CN112597813A (en) * | 2020-12-03 | 2021-04-02 | 宁波大学科学技术学院 | Teaching evaluation method and device and computer readable storage medium |
| CN113160003A (en) * | 2020-01-07 | 2021-07-23 | 钟苑菁 | Paired learning system |
| CN117095464A (en) * | 2023-09-12 | 2023-11-21 | 广州乐庚信息科技有限公司 | Student classroom learning habit analysis method and system based on image recognition |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105390038A (en) * | 2015-12-18 | 2016-03-09 | 广东公信智能会议股份有限公司 | Classroom multifunctional timely feedback system |
| CN106713857A (en) * | 2016-12-15 | 2017-05-24 | 重庆凯泽科技股份有限公司 | Campus security system and method based on intelligent videos |
| CN107292271A (en) * | 2017-06-23 | 2017-10-24 | 北京易真学思教育科技有限公司 | Learning-memory behavior method, device and electronic equipment |
| CN107844762A (en) * | 2017-10-25 | 2018-03-27 | 大连三增上学教育科技有限公司 | Information processing method and system |
| CN107958433A (en) * | 2017-12-11 | 2018-04-24 | 吉林大学 | A kind of online education man-machine interaction method and system based on artificial intelligence |
-
2018
- 2018-10-22 CN CN201811232978.5A patent/CN109461104A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105390038A (en) * | 2015-12-18 | 2016-03-09 | 广东公信智能会议股份有限公司 | Classroom multifunctional timely feedback system |
| CN106713857A (en) * | 2016-12-15 | 2017-05-24 | 重庆凯泽科技股份有限公司 | Campus security system and method based on intelligent videos |
| CN107292271A (en) * | 2017-06-23 | 2017-10-24 | 北京易真学思教育科技有限公司 | Learning-memory behavior method, device and electronic equipment |
| CN107844762A (en) * | 2017-10-25 | 2018-03-27 | 大连三增上学教育科技有限公司 | Information processing method and system |
| CN107958433A (en) * | 2017-12-11 | 2018-04-24 | 吉林大学 | A kind of online education man-machine interaction method and system based on artificial intelligence |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111339809A (en) * | 2018-12-20 | 2020-06-26 | 深圳市鸿合创新信息技术有限责任公司 | Classroom behavior analysis method and device and electronic equipment |
| CN110647842A (en) * | 2019-09-20 | 2020-01-03 | 重庆大学 | Double-camera classroom inspection method and system |
| CN110647842B (en) * | 2019-09-20 | 2022-02-15 | 重庆大学 | Double-camera classroom inspection method and system |
| CN112580910A (en) * | 2019-09-29 | 2021-03-30 | 鸿富锦精密电子(天津)有限公司 | Teaching questionnaire analysis method, electronic device and storage medium |
| CN110729049A (en) * | 2019-11-01 | 2020-01-24 | 广州云蝶科技有限公司 | Mental health early warning method |
| CN110729049B (en) * | 2019-11-01 | 2023-09-22 | 广州云蝶科技有限公司 | Psychological health early warning method |
| CN110853428A (en) * | 2019-12-04 | 2020-02-28 | 广州云蝶科技有限公司 | Recording and broadcasting control method and system based on Internet of things |
| CN113160003A (en) * | 2020-01-07 | 2021-07-23 | 钟苑菁 | Paired learning system |
| CN111882305A (en) * | 2020-05-09 | 2020-11-03 | 北京文香信息技术有限公司 | Behavior analysis device and behavior monitoring analysis system |
| CN111666829A (en) * | 2020-05-18 | 2020-09-15 | 首都经济贸易大学 | Multi-scene multi-subject identity behavior emotion recognition analysis method and intelligent supervision system |
| CN112597813A (en) * | 2020-12-03 | 2021-04-02 | 宁波大学科学技术学院 | Teaching evaluation method and device and computer readable storage medium |
| CN117095464A (en) * | 2023-09-12 | 2023-11-21 | 广州乐庚信息科技有限公司 | Student classroom learning habit analysis method and system based on image recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109461104A (en) | Classroom monitoring method, device and electronic equipment | |
| CN107292271B (en) | Learning monitoring method and device and electronic equipment | |
| CN107742107B (en) | Facial image classification method, device and server | |
| CN111507283B (en) | Student behavior identification method and system based on classroom scene | |
| CN109740446A (en) | Classroom students ' behavior analysis method and device | |
| WO2021077382A1 (en) | Method and apparatus for determining learning state, and intelligent robot | |
| CN105405150B (en) | Anomaly detection method and device based on fusion feature | |
| CN107103330A (en) | A kind of LED status recognition methods and device | |
| CN110536724A (en) | The piece number detection system of recreation substitutionary coinage | |
| CN110718067A (en) | Violation behavior warning method and related device | |
| CN112613780B (en) | Method and device for generating learning report, electronic equipment and storage medium | |
| CN108345865A (en) | A kind of monitoring method, device and the user terminal of involved party's abnormal behaviour | |
| CN111814587A (en) | Human behavior detection method, teacher behavior detection method, and related system and device | |
| CN110517558B (en) | Piano playing fingering judging method and system, storage medium and terminal | |
| CN112948636B (en) | Regional education cloud resource sharing system and method | |
| CN109522775A (en) | Face character detection method, device and electronic equipment | |
| CN109670517A (en) | Object detection method, device, electronic equipment and target detection model | |
| CN110287856A (en) | A kind of security personnel's behavior analysis system, method and device | |
| CN110213668A (en) | Generation method, device, electronic equipment and the storage medium of video title | |
| CN110334620A (en) | Appraisal procedure, device, storage medium and the electronic equipment of quality of instruction | |
| CN117218703A (en) | Intelligent learning emotion analysis method and system | |
| TWI776429B (en) | Action recognition method and device, computer readable storage medium | |
| CN115223029A (en) | Intelligent monitoring system based on intelligent breeding support robot | |
| US20170109583A1 (en) | Evaluation of models generated from objects in video | |
| CN112634100A (en) | Behavior analysis education system based on big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190312 |