CN109583352A - Classroom teacher's behaviors acquisition methods, device and medium based on video analysis - Google Patents
Classroom teacher's behaviors acquisition methods, device and medium based on video analysis Download PDFInfo
- Publication number
- CN109583352A CN109583352A CN201811400381.7A CN201811400381A CN109583352A CN 109583352 A CN109583352 A CN 109583352A CN 201811400381 A CN201811400381 A CN 201811400381A CN 109583352 A CN109583352 A CN 109583352A
- Authority
- CN
- China
- Prior art keywords
- teacher
- behaviors
- image
- classroom
- target area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000006399 behavior Effects 0.000 title claims abstract description 67
- 238000004458 analytical method Methods 0.000 title claims abstract description 48
- 238000000034 method Methods 0.000 title claims abstract description 34
- 241001633942 Dais Species 0.000 claims abstract description 27
- 238000000605 extraction Methods 0.000 claims abstract description 19
- 238000001514 detection method Methods 0.000 claims abstract description 18
- 239000000284 extract Substances 0.000 claims abstract description 11
- 230000015654 memory Effects 0.000 claims description 19
- 230000003542 behavioural effect Effects 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 9
- 230000000873 masking effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000007619 statistical method Methods 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 229910052799 carbon Inorganic materials 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 210000003733 optic disk Anatomy 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
Abstract
The present invention discloses a kind of classroom teacher's behaviors acquisition methods, device and medium based on video analysis, is related to intelligent tutoring technical field, comprising: extracts the frame image in video flowing, area-of-interest is further extracted from image；Teacher's target detection is carried out to the image after region of interesting extraction, obtains teacher target area；Teacher's behaviors state is determined according to the present position of teacher target area central point；It returns to step to count the teacher's behaviors in time in classroom；The present invention is on the basis of the recording and broadcasting system of classroom, intellectual analysis function is added to teacher's video of attending class, it can detect the behavioural information that teacher attends class, analyze walking about for teacher give lessons, stand give lessons, the behavior states such as lower dais is given lessons and upper dais is given lessons, and these statistics are analyzed, the feature that teacher attends class is excavated, so that teacher be allowed to have objective autognosis to the situation of attending class of oneself, is improved the quality of teaching.
Description
Technical field
The present invention relates to intelligent tutoring technical field more particularly to a kind of classroom teacher's behaviors acquisitions based on video analysis
Method, apparatus and medium.
Background technique
Education recorded broadcast and VOD system are slowly popularized in campus at present, reduce the imbalance of education in urban and rural areas level
Property.But these recorded broadcast videos are only available to user and watch, and do not carry out intellectual analysis to video, information utilization is not
Height has lost the available resources of a part.Therefore intellectual analysis is carried out to the classroom video after recorded broadcast, is that following development becomes
Gesture, and implement an important link of Intelligent campus.
Instruction analysis is there are many content is analyzed, and wherein classroom teacher behavioural analysis is in a key of classroom instruction analysis
Hold.By that teacher can be allowed to carry out autognosis to the teaching behavior of itself to classroom teacher progress behavioural analysis and statistics, and
The teaching behavior consciousness for strengthening teacher, effectively improves the behavior of teacher's teaching.Traditional instruction analysis method is to pass through viewing
Video carries out manual analysis, and this method is cumbersome and time consuming, while also with subjective uncertainty, therefore in nowadays intelligence
Intelligent campus, wisdom education background under be gradually eliminated instead the analysis method of computer automation, wherein
Video analysis is a kind of most wide method of applicability.
Summary of the invention
The present invention provides a kind of classroom teacher's behaviors acquisition methods based on video analysis, dress aiming at the problem that background technique
It sets and medium automatically analyzes the behavior state information that teacher attends class, allow teacher to certainly by analyzing the video of attending class of teacher
The teaching behavior of body carries out autognosis so as to improve quality of instruction.
To achieve the goals above, the present invention proposes a kind of classroom teacher's behaviors acquisition methods based on video analysis, packet
Include following steps:
A frame image in S10, extraction video flowing, further extracts area-of-interest from image；
S20, teacher's target detection is carried out to the image after region of interesting extraction, obtains teacher target area；
S30, teacher's behaviors state is determined according to the present position of teacher target area central point；
S40, S10 is returned to step to count the teacher's behaviors in time in classroom.
Preferably, the frame image in extraction video flowing described in step S10, further extracts region of interest from image
Domain specifically includes:
S101, it extracts the frame image in video flowing and carries out mask processing；
S102, area-of-interest is further extracted from mask treated image.
Preferably, before step S10, further includes:
Area-of-interest and shielding area in S00, setting video, and set the image mask of shielding area.
Preferably, the area-of-interest, specifically: the dais regional scope in image.
Preferably, teacher's target detection is carried out to the image after region of interesting extraction described in step S20, obtains teacher
Target area, specifically:
S201, current frame image and previous frame image are subjected to inter-frame difference processing, obtain current frame difference image；
The outer profile of S202, the current frame difference image of detection, obtain teacher target area.
Preferably, the outer profile of frame difference image is detected described in step S202, i.e. acquisition teacher target area, specifically:
The outer profile of S2021, the current frame difference image of detection；
S2022, by the outer profile of current frame difference image with frame difference image before outer profile carry out size compared with, choose it
In largest contours；
S2023, using largest contours as teacher target area.
Preferably, teacher's behaviors state is determined according to the present position of teacher target area central point described in step S30,
Include:
S301, judge whether teacher target area central point is in interest range, if so, teacher is in dais region
It is interior, otherwise outside the region of dais.
Preferably, teacher's behaviors state is determined according to the present position of teacher target area central point described in step S30,
Include:
S302, obtain current frame image teacher target area central point and previous frame image teacher target area central point it
Between distance；
S303, judge whether distance is less than given threshold, if so, teacher is in state of giving lessons of standing, otherwise at teacher
In the state of giving lessons of walking about.
The present invention also proposes a kind of classroom teacher's behaviors acquisition device based on video analysis, comprising:
Processor；
Memory is coupled to the processor and is stored with instruction, and the instruction is executing reality by the processor
Now the step of classroom teacher's behaviors acquisition methods based on video analysis.
The present invention also proposes that a kind of computer-readable storage medium, the computer-readable storage medium are stored with base
In the application program of the classroom teacher's behaviors acquisition methods of video analysis, the application program is realized as mentioned based on video point
The step of classroom teacher's behaviors acquisition methods of analysis.
The present invention proposes a kind of classroom teacher's behaviors acquisition methods, device and medium based on video analysis, records in classroom
On the basis of broadcasting system, intellectual analysis function is added to teacher's video of attending class, can detect the behavioural information that teacher attends class, point
Be precipitated walking about for teacher give lessons, stand give lessons, the behavior states such as lower dais is given lessons and upper dais is given lessons, and to these statistics
Analysis, excavates the feature that teacher attends class, so that teacher be allowed to have objective autognosis to the situation of attending class of oneself, improves teaching
Quality.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
The structure shown according to these attached drawings obtains other attached drawings.
Fig. 1 is the classroom teacher's behaviors acquisition methods flow chart based on video analysis in first preferred embodiment of the invention；
Fig. 2 is the classroom teacher's behaviors acquisition methods flow chart based on video analysis in second preferred embodiment of the invention；
Fig. 3 is the classroom teacher's behaviors acquisition methods flow chart based on video analysis in third preferred embodiment of the invention；
Fig. 4 is teacher's behaviors state categories schematic diagram in third preferred embodiment of the invention；
Fig. 5 is the classroom teacher's behaviors acquisition device structural representation based on video analysis in four preferred embodiment of the invention
Figure；
Fig. 6 is computer-readable storage medium structural schematic diagram in four preferred embodiment of the invention；
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiment is only a part of the embodiments of the present invention, instead of all the embodiments.Base
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts it is all its
His embodiment, shall fall within the protection scope of the present invention.
It is to be appreciated that if relating to directionality instruction (such as up, down, left, right, before and after ...) in the embodiment of the present invention,
Then directionality instruction be only used for explain under a certain particular pose (as shown in the picture) between each component relative positional relationship,
Motion conditions etc., if the particular pose changes, directionality instruction is also correspondingly changed correspondingly.
In addition, being somebody's turn to do " first ", " second " etc. if relating to the description of " first ", " second " etc. in the embodiment of the present invention
Description be used for description purposes only, be not understood to indicate or imply its relative importance or implicitly indicate indicated skill
The quantity of art feature." first " is defined as a result, the feature of " second " can explicitly or implicitly include at least one spy
Sign.It in addition, the technical solution between each embodiment can be combined with each other, but must be with those of ordinary skill in the art's energy
It is enough realize based on, will be understood that the knot of this technical solution when conflicting or cannot achieve when occurs in the combination of technical solution
Conjunction is not present, also not the present invention claims protection scope within.
The present invention proposes a kind of classroom teacher's behaviors acquisition methods based on video analysis；
In first preferred embodiment of the invention, as shown in Figure 1, including the following steps:
Dais range area-of-interest R in S00, setting videopAnd shielding area, and the image for setting shielding area is covered
Code Ms；
In the embodiment of the present invention, area-of-interest RpNeed accurately to be set as the dais region that teacher attends class in video, and
Shielding area can be with more than one, for masking some noise regions interfered；
A frame image in S10, extraction video flowing, the area-of-interest of dais range is further extracted from image, is obtained
To image；Specifically:
S101, the frame image I in video flowing and the image mask M according to setting are extractedsMask processing is carried out, is schemed
As IM；
In the embodiment of the present invention, the formula of mask processing is carried out to I are as follows:
Wherein, IM(x, y) indicates image IMThe pixel value of each pixel, I (x, y) indicate the pixel value of image I pixel；
(x, y) indicates pixel position；
S102, from mask treated image IMIn further extract area-of-interest, obtain image IR；
In the embodiment of the present invention, the formula of interested image-region is extracted are as follows:
Wherein, IR(x, y) indicates image IRThe pixel value of each pixel；
S20, to the image I after region of interesting extractionRTeacher's target detection is carried out, teacher target area R is obtainedo；
S30, teacher's behaviors state is determined according to the present position of teacher target area central point；
S40, S10 is returned to step to count the teacher's behaviors in time in classroom.
In second preferred embodiment of the invention, further limited on the basis of first preferred embodiment, as shown in Fig. 2,
Include the following steps:
Dais range area-of-interest R in S00, setting videopAnd shielding area, and the image for setting shielding area is covered
Code Ms；
In the embodiment of the present invention, area-of-interest RpNeed accurately to be set as the dais region that teacher attends class in video, and
Shielding area can be with more than one, for masking some noise regions interfered；
A frame image in S10, extraction video flowing, the area-of-interest of dais range is further extracted from image, is obtained
To image；Specifically:
S101, the frame image I in video flowing and the image mask M according to setting are extractedsMask processing is carried out, is schemed
As IM；
In the embodiment of the present invention, the formula of mask processing is carried out to I are as follows:
Wherein, IM(x, y) indicates image IMThe pixel value of each pixel, I (x, y) indicate the pixel value of image I pixel；
(x, y) indicates pixel position；
S102, from mask treated image IMIn further extract area-of-interest, obtain image IR；
In the embodiment of the present invention, the formula of interested image-region is extracted are as follows:
Wherein, IR(x, y) indicates image IRThe pixel value of each pixel；
S20, to the image I after region of interesting extractionRTeacher's target detection is carried out, teacher target area R is obtainedo, specifically
Include:
S201, by current frame image IRWith previous frame image IRPInter-frame difference processing is carried out, current frame difference image I is obtainedd；
In the embodiment of the present invention, the inter-frame difference formula of use are as follows:
Wherein, thr indicates differential threshold, the susceptibility for control algolithm；
S202, the current frame difference image I of detectiondOuter profile, obtain teacher target area；
It is specific as follows in a kind of preferred embodiment of the present invention:
S2021, the current frame difference image I of detectiondOuter profile；
S2022, by the outer profile of current frame difference image with frame difference image before outer profile carry out size compared with, choose it
In largest contours；
In the embodiment of the present invention, due to the iteration continuous processing of sampled frame images each for video flowing, obtain a series of more
The outer profile of a frame difference image obtains wherein largest contours c by being compared to each othermax, the region where the profile is teacher's mesh
Mark region Ro；
S2023, using largest contours as teacher target area；
In the embodiment of the present invention, by I after acquisition profileRPReplace with IR, i.e. IRP=IR；
S30, teacher's behaviors state is determined according to the present position of teacher target area central point；
S40, S10 is returned to step to count the teacher's behaviors in time in classroom.
In third preferred embodiment of the invention, further limited on the basis of the second preferred embodiment, as shown in figure 3,
Include the following steps:
Dais range area-of-interest R in S00, setting videopAnd shielding area, and the image for setting shielding area is covered
Code Ms；
In the embodiment of the present invention, area-of-interest RpNeed accurately to be set as the dais region that teacher attends class in video, and
Shielding area can be with more than one, for masking some noise regions interfered；
A frame image in S10, extraction video flowing, the area-of-interest of dais range is further extracted from image, is obtained
To image；Specifically:
S101, the frame image I in video flowing and the image mask M according to setting are extractedsMask processing is carried out, is schemed
As IM；
In the embodiment of the present invention, the formula of mask processing is carried out to I are as follows:
Wherein, IM(x, y) indicates image IMThe pixel value of each pixel, I (x, y) indicate the pixel value of image I pixel；
(x, y) indicates pixel position；
S102, from mask treated image IMIn further extract area-of-interest, obtain image IR；
In the embodiment of the present invention, the formula of interested image-region is extracted are as follows:
Wherein, IR(x, y) indicates image IRThe pixel value of each pixel；
S20, to the image I after region of interesting extractionRTeacher's target detection is carried out, teacher target area R is obtainedo, specifically
Include:
S201, by current frame image IRWith previous frame image IRPInter-frame difference processing is carried out, current frame difference image I is obtainedd；
In the embodiment of the present invention, when original state, image does not do difference processing, after the second frame image, the interframe of use
Difference formula are as follows:
Wherein, thr indicates differential threshold, the susceptibility for control algolithm；
S202, the current frame difference image I of detectiondOuter profile, obtain teacher target area；
It is specific as follows in a kind of preferred embodiment of the present invention:
S2021, the current frame difference image I of detectiondOuter profile；
S2022, by the outer profile of current frame difference image with frame difference image before outer profile carry out size compared with, choose it
In largest contours；
In the embodiment of the present invention, due to the iteration continuous processing of sampled frame images each for video flowing, obtain a series of more
The outer profile of a frame difference image obtains wherein largest contours c by being compared to each othermax, the region where the profile is teacher's mesh
Mark region Ro；
S2023, using largest contours as teacher target area；
In the embodiment of the present invention, by I after acquisition profileRPReplace with IR, i.e. IRP=IR；
S30, teacher's behaviors state is determined according to the present position of teacher target area central point；
In the embodiment of the present invention, to teacher target area RoIt is analyzed, obtains the current behavior state of teacher, such as Fig. 4
It is shown, four kinds of behavior states of teacher include: teacher walk about give lessons, stand give lessons, lower dais is given lessons and upper dais is given lessons；Specifically
Step includes:
S301, judge teacher target area RoCentral point Pc(xc,yc) whether it is in interest range RpIt is interior, if so, teacher
In the region of dais, otherwise outside the region of dais；
S302, current frame image teacher target area central point P is obtainedc(xc,yc) and previous frame image teacher target area
Central point Pp(xp,yp) the distance between D；
S303, judge whether distance D is less than given threshold dth, give lessons state if so, teacher is in stand, otherwise teacher
In the state of giving lessons of walking about.
In the embodiment of the present invention, after the completion of judgement, and by PpIt is replaced by Pc, i.e. Pp=Pc；
S40, S10 is returned to step to count the teacher's behaviors in time in classroom；
In the embodiment of the present invention, record teacher walk about give lessons, stand give lessons, the behavior that lower dais is given lessons and upper dais is given lessons
State, for statistical analysis, and excavate the feature that teacher attends class, then repeatedly step S10.
According to above-mentioned steps, the present invention can in real time be analyzed the video of attending class of teacher, and obtain walking about for teacher
Give lessons, stand give lessons, the behavior states such as lower dais is given lessons and upper dais is given lessons, and it is for statistical analysis to these states, excavate
The feature that teacher attends class out allows teacher objectively can carry out autognosis to the situation of attending class of oneself, to improve teaching matter
Amount.
The present invention also proposes a kind of classroom teacher's behaviors acquisition device based on video analysis；
In four preferred embodiment of the invention, as shown in Figure 5, comprising:
Processor；
Memory is coupled to the processor and is stored with instruction, and the instruction is executing reality by the processor
Now the step of classroom teacher's behaviors acquisition methods based on video analysis, such as:
A frame image in S10, extraction video flowing, further extracts area-of-interest from image；
S20, teacher's target detection is carried out to the image after region of interesting extraction, obtains teacher target area；
S30, teacher's behaviors state is determined according to the present position of teacher target area central point；
S40, S10 is returned to step to count the teacher's behaviors in time in classroom.
In the embodiment of the present invention, specific implementation detail has hereinbefore been illustrated, is no longer repeated herein；
In the embodiment of the present invention, the classroom teacher's behaviors acquisition device internal processor based on video analysis can
To be made of integrated circuit, such as can be made of the integrated circuit of single package, be also possible to by multiple identical functions or
The integrated circuit of different function encapsulation is formed, including one or more central processing unit (Central Processing
Unit, CPU), the combination etc. of microprocessor, digital processing chip, graphics processor and various control chips.Processor is using respectively
Kind interface and connection take all parts, by running or executing the program being stored in memory or unit, and tune
The various functions and processing number obtained with the data being stored in memory, the classroom teacher's behaviors with execution based on video analysis
According to；
Memory is mounted on the classroom teacher's behaviors based on video analysis and obtains for storing program code and various data
In device, and the access realized high speed in the process of running, be automatically completed program or data.The memory includes read-only deposits
Reservoir (Read-Only Memory, ROM), may be programmed read-only deposit at random access memory (Random Access Memory, RAM)
Reservoir (Programmable Read-Only Memory, PROM), Erasable Programmable Read Only Memory EPROM (Erasable
Programmable Read-Only Memory, EPROM), disposable programmable read-only memory (One-time
Programmable Read-Only Memory, OTPROM), electronics erasing type can make carbon copies read-only memory
(Electrically-Erasable Programmable Read-Only Memory, EEPROM), CD-ROM (Compact
Disc Read-Only Memory, CD-ROM) or other disc memories, magnetic disk storage, magnetic tape storage or can
For carrying or any other computer-readable medium of storing data.
The present invention also proposes a kind of computer-readable storage medium；
In fifth preferred embodiment of the invention, as shown in fig. 6, the computer-readable storage medium is stored with based on view
The application program of the classroom teacher's behaviors acquisition methods of frequency analysis, the application program are realized as mentioned based on video analysis
The step of classroom teacher's behaviors acquisition methods, such as:
A frame image in S10, extraction video flowing, further extracts area-of-interest from image；
S20, teacher's target detection is carried out to the image after region of interesting extraction, obtains teacher target area；
S30, teacher's behaviors state is determined according to the present position of teacher target area central point；
S40, S10 is returned to step to count the teacher's behaviors in time in classroom.
In the embodiment of the present invention, specific implementation detail has hereinbefore been illustrated, is no longer repeated herein；
In the description of embodiments of the present invention, it should be noted that in flow chart or described otherwise above herein
Any process or method description be construed as, indicate to include one or more for realizing specific logical function or mistake
Module, segment or the part of the code of the executable instruction of the step of journey, and the range packet of the preferred embodiment of the present invention
Include other realization, wherein sequence shown or discussed can not be pressed, including according to related function by it is basic simultaneously
Mode or in the opposite order, Lai Zhihang function, this should be managed by the embodiment of the present invention person of ordinary skill in the field
Solution.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processing module or other can be from instruction
Execute system, device or equipment instruction fetch and the system that executes instruction) use, or combine these instruction execution systems, device or
Equipment and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, store, communicating, propagating
Or transfer program uses for instruction execution system, device or equipment or in conjunction with these instruction execution systems, device or equipment
Device.The more specific example (non-exhaustive list) of computer-readable medium include the following: there are one or more wirings
Electrical connection section (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium because can then be edited for example by carrying out optical scanner to paper or other media, interpret or when necessary with
Other suitable methods are handled electronically to obtain described program, are then stored in computer storage.
The above description is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all at this
Under the inventive concept of invention, using equivalent structure transformation made by description of the invention and accompanying drawing content, or directly/use indirectly
It is included in other related technical areas in scope of patent protection of the invention.
Claims (10)
1. a kind of classroom teacher's behaviors acquisition methods based on video analysis, which comprises the steps of:
A frame image in S10, extraction video flowing, further extracts area-of-interest from image；
S20, teacher's target detection is carried out to the image after region of interesting extraction, obtains teacher target area；
S30, teacher's behaviors state is determined according to the present position of teacher target area central point；
S40, S10 is returned to step to count the teacher's behaviors in time in classroom.
2. the classroom teacher's behaviors acquisition methods according to claim 1 based on video analysis, which is characterized in that step
A frame image in extraction video flowing described in S10, area-of-interest is further extracted from image, is specifically included:
S101, it extracts the frame image in video flowing and carries out mask processing；
S102, area-of-interest is further extracted from mask treated image.
3. the classroom teacher's behaviors acquisition methods according to claim 2 based on video analysis, which is characterized in that step
Before S10, further includes:
Area-of-interest and shielding area in S00, setting video, and set the image mask of shielding area.
4. the classroom teacher's behaviors acquisition methods according to claim 1 based on video analysis, which is characterized in that described
Area-of-interest, specifically: the dais regional scope in image.
5. the classroom teacher's behaviors acquisition methods according to claim 1 based on video analysis, which is characterized in that step
Teacher's target detection is carried out to the image after region of interesting extraction described in S20, obtains teacher target area, specifically:
S201, current frame image and previous frame image are subjected to inter-frame difference processing, obtain current frame difference image；
The outer profile of S202, the current frame difference image of detection, obtain teacher target area.
6. the classroom teacher's behaviors acquisition methods according to claim 5 based on video analysis, which is characterized in that step
The outer profile of frame difference image, i.e. acquisition teacher target area are detected described in S202, specifically:
The outer profile of S2021, the current frame difference image of detection；
S2022, by the outer profile of current frame difference image with frame difference image before outer profile carry out size compared with, choose it is therein
Largest contours；
S2023, using largest contours as teacher target area.
7. the classroom teacher's behaviors acquisition methods according to claim 1 based on video analysis, which is characterized in that step
Teacher's behaviors state is determined according to the present position of teacher target area central point described in S30, comprising:
S301, judge whether teacher target area central point is in interest range, if so, teacher is in the region of dais,
Otherwise outside the region of dais.
8. the classroom teacher's behaviors acquisition methods according to claim 1 based on video analysis, which is characterized in that step
Teacher's behaviors state is determined according to the present position of teacher target area central point described in S30, comprising:
S302, it obtains between current frame image teacher target area central point and previous frame image teacher target area central point
Distance；
S303, judge whether distance is less than given threshold, if so, teacher is in state of giving lessons of standing, otherwise teacher is in away
Dynamic state of giving lessons.
9. a kind of classroom teacher's behaviors acquisition device based on video analysis characterized by comprising
Processor；
Memory is coupled to the processor and is stored with instruction, and the instruction is executing the power of realization by the processor
Benefit require any one of 1 to 8 described in classroom teacher's behaviors acquisition methods based on video analysis the step of.
10. a kind of computer-readable storage medium, which is characterized in that the computer-readable storage medium, which is stored with, to be based on
The application program of the classroom teacher's behaviors acquisition methods of video analysis, the application program are realized as any in claim 1 to 8
The step of classroom teacher's behaviors acquisition methods based on video analysis described in item.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811400381.7A CN109583352A (en) | 2018-11-22 | 2018-11-22 | Classroom teacher's behaviors acquisition methods, device and medium based on video analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811400381.7A CN109583352A (en) | 2018-11-22 | 2018-11-22 | Classroom teacher's behaviors acquisition methods, device and medium based on video analysis |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109583352A true CN109583352A (en) | 2019-04-05 |
Family
ID=65923501
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811400381.7A Pending CN109583352A (en) | 2018-11-22 | 2018-11-22 | Classroom teacher's behaviors acquisition methods, device and medium based on video analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109583352A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110232346A (en) * | 2019-06-06 | 2019-09-13 | 南京睦泽信息科技有限公司 | A kind of video intelligent analysis system based on deep learning |
| CN111144255A (en) * | 2019-12-18 | 2020-05-12 | 华中科技大学鄂州工业技术研究院 | Method and device for analyzing non-language behaviors of teacher |
| CN111814587A (en) * | 2020-06-18 | 2020-10-23 | 浙江大华技术股份有限公司 | Human behavior detection method, teacher behavior detection method, and related system and device |
| CN111985269A (en) * | 2019-05-21 | 2020-11-24 | 顺丰科技有限公司 | Detection model construction method, detection device, server and medium |
| CN113141464A (en) * | 2021-04-20 | 2021-07-20 | 北京安博盛赢教育科技有限责任公司 | Camera control method, device, medium and electronic equipment |
| CN114650454A (en) * | 2022-04-02 | 2022-06-21 | 北京中庆现代技术股份有限公司 | Motion detection method, device, equipment and medium applied to classroom recording and broadcasting |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101699469A (en) * | 2009-11-09 | 2010-04-28 | 南京邮电大学 | Method for automatically identifying action of writing on blackboard of teacher in class video recording |
| CN107909598A (en) * | 2017-10-28 | 2018-04-13 | 天津大学 | A kind of moving object detection and tracking method based on interprocess communication |
-
2018
- 2018-11-22 CN CN201811400381.7A patent/CN109583352A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101699469A (en) * | 2009-11-09 | 2010-04-28 | 南京邮电大学 | Method for automatically identifying action of writing on blackboard of teacher in class video recording |
| CN107909598A (en) * | 2017-10-28 | 2018-04-13 | 天津大学 | A kind of moving object detection and tracking method based on interprocess communication |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111985269A (en) * | 2019-05-21 | 2020-11-24 | 顺丰科技有限公司 | Detection model construction method, detection device, server and medium |
| CN110232346A (en) * | 2019-06-06 | 2019-09-13 | 南京睦泽信息科技有限公司 | A kind of video intelligent analysis system based on deep learning |
| CN111144255A (en) * | 2019-12-18 | 2020-05-12 | 华中科技大学鄂州工业技术研究院 | Method and device for analyzing non-language behaviors of teacher |
| CN111144255B (en) * | 2019-12-18 | 2024-04-19 | 华中科技大学鄂州工业技术研究院 | Analysis method and device for non-language behaviors of teacher |
| CN111814587A (en) * | 2020-06-18 | 2020-10-23 | 浙江大华技术股份有限公司 | Human behavior detection method, teacher behavior detection method, and related system and device |
| CN113141464A (en) * | 2021-04-20 | 2021-07-20 | 北京安博盛赢教育科技有限责任公司 | Camera control method, device, medium and electronic equipment |
| CN114650454A (en) * | 2022-04-02 | 2022-06-21 | 北京中庆现代技术股份有限公司 | Motion detection method, device, equipment and medium applied to classroom recording and broadcasting |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109583352A (en) | Classroom teacher's behaviors acquisition methods, device and medium based on video analysis | |
| CN112163634B (en) | Sample screening method and device for instance segmentation model, computer equipment and medium | |
| Zhou et al. | Salient region detection via integrating diffusion-based compactness and local contrast | |
| US20230410560A1 (en) | Method and apparatus for constructing three-dimensional data set of pedestrian re-identification based on neural radiation field | |
| US20030002715A1 (en) | Visual language classification system | |
| CN107358157A (en) | A kind of human face in-vivo detection method, device and electronic equipment | |
| Niu et al. | Tactic analysis based on real-world ball trajectory in soccer video | |
| CN110532833A (en) | A kind of video analysis method and device | |
| Cioppa et al. | Scaling up SoccerNet with multi-view spatial localization and re-identification | |
| CN111241872B (en) | Video image shielding method and device | |
| CN110324679A (en) | A kind of video data handling procedure and device | |
| CN113160231A (en) | Sample generation method, sample generation device and electronic equipment | |
| CN110198482A (en) | A kind of video emphasis bridge section mask method, terminal and storage medium | |
| Li et al. | Improved-storygan for sequential images visualization | |
| CN113361643A (en) | Deep learning-based universal mark identification method, system, equipment and storage medium | |
| CN114064974A (en) | Information processing method, information processing apparatus, electronic device, storage medium, and program product | |
| CN106327531A (en) | Panorama video identification method and device, and video playing method and device | |
| CN108921070A (en) | Image processing method, model training method and corresponding intrument | |
| CN105844204A (en) | Method and device for recognizing behavior of human body | |
| CN110248235A (en) | Software teaching method, apparatus, terminal device and medium | |
| Jacob et al. | A non-intrusive approach for 2d platform game design analysis based on provenance data extracted from game streaming | |
| CN110404258A (en) | A kind of information-pushing method and device | |
| CN113472834A (en) | Object pushing method and device | |
| CN106060388A (en) | Full-automatic micro-course recording control method and system | |
| CN115905862A (en) | Missing data processing method and system based on generation countermeasure network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zhao Dingjin Inventor after: Zhu Zhenghui Inventor after: Zhang Changhua Inventor before: Zhao Dingjin Inventor before: Zhu Zhenghui Inventor before: Zhang Changhua Inventor before: Ming De |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190405 |