CN114554144B - Network live video stream hardware system and method based on embedded type - Google Patents
Network live video stream hardware system and method based on embedded type Download PDFInfo
- Publication number
- CN114554144B CN114554144B CN202210052261.2A CN202210052261A CN114554144B CN 114554144 B CN114554144 B CN 114554144B CN 202210052261 A CN202210052261 A CN 202210052261A CN 114554144 B CN114554144 B CN 114554144B
- Authority
- CN
- China
- Prior art keywords
- module
- acquisition unit
- teacher
- acquisition
- analysis module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 15
- 238000004458 analytical method Methods 0.000 claims abstract description 33
- 238000007405 data analysis Methods 0.000 claims abstract description 19
- 230000006399 behavior Effects 0.000 claims description 42
- 230000009471 action Effects 0.000 claims description 20
- 230000033764 rhythmic process Effects 0.000 claims description 10
- 230000008447 perception Effects 0.000 claims description 6
- 210000003128 head Anatomy 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000019771 cognition Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000000638 solvent extraction Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000002747 voluntary effect Effects 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
- H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses an embedded network live video stream hardware system and method, comprising a video acquisition end, a data analysis module and an adjustment module, wherein the video acquisition end is used for acquiring multiparty video data through a network camera, the data analysis module is used for further analyzing according to the acquired video data, the adjustment module is used for adjusting equipment according to an analysis result, the data analysis module comprises a teacher behavior analysis module and a student behavior analysis module, the teacher behavior analysis module is used for analyzing behavior characteristics of a teacher who is teaching, the student behavior analysis module is used for analyzing behavior characteristics of a student who is teaching, the teacher behavior analysis module comprises a touch sensing sub-module, and the student behavior analysis module comprises a gazing sensing sub-module and a time recording sub-module.
Description
Technical Field
The invention relates to the technical field of network live broadcasting, in particular to an embedded network live broadcasting video stream based hardware system and method.
Background
The high-straightening public lesson playing method includes various lessons playing on a live broadcast platform, classroom recorded lessons playing, classroom live lessons playing and the like; for the live platform teaching, a teacher does not need to enter a classroom, and can give lessons only by using equipment with audio and video input, and the disadvantage is that blackboard writing is required to be externally connected with a handwriting board, and the classroom atmosphere is insufficient; for classroom recorded broadcast teaching, video of a teacher in a classroom is recorded and clipped and then uploaded, students can watch online at any time, and the disadvantage is that the teaching content needs to be uploaded again after being updated; for classroom live lectures, teachers give lessons in the classroom, and network cameras live broadcast and push to a server in real time, students can give lessons on the lessons by accessing the server, and the disadvantage is that the teacher is difficult to interact with students for the current equipment technology.
Through investigation, more people tend to live lectures in classrooms, because the mode can more comprehensively simulate the mode of online lectures, teachers can conduct blackboard writing on a blackboard, students can feel stronger, but the current mode of live lectures in classrooms is limited by equipment defects, and the problems that the teachers cannot interact with students in real time, the video angle is single and is not immersed enough, the requirement on the load capacity of a server is high and the like exist, meanwhile, the lesson rhythm of the teachers cannot be gradually advanced according to the performance of the students, the teachers cannot well grasp the lesson condition of the students, the teaching quality is low, and live broadcasting pictures cannot be cut and switched in real time are very necessary.
Disclosure of Invention
The invention aims to provide an embedded network live video streaming-based hardware system and method for solving the problems in the background technology.
In order to solve the technical problems, the invention provides the following technical scheme: the system comprises a video acquisition end, a data analysis module and an adjusting module, wherein the video acquisition end is electrically connected with the data analysis module, the data analysis module is electrically connected with the adjusting module, the video acquisition end is used for acquiring multiparty video data through a network camera, the data analysis module is used for further analyzing according to the acquired video data, the adjusting module is used for adjusting equipment according to analysis results, the data analysis module comprises a teacher behavior analysis module and a student behavior analysis module, the teacher behavior analysis module is electrically connected with the student behavior analysis module, the teacher behavior analysis module is used for analyzing behavior characteristics of a teacher who is teaching, the student behavior analysis module is used for analyzing behavior characteristics of a student who is teaching, the teacher behavior analysis module comprises a touch sensing submodule and a time recording submodule, the touch sensing submodule is used for sensing whether a student book on a screen or not, the gaze sensing submodule is used for judging whether the student looks on the screen or not and judging the student behavior according to time recording time duration recording submodule is used for recording the student behavior on the student screen.
According to the technical scheme, the video acquisition end comprises a first acquisition unit, a second acquisition unit and a third acquisition unit, wherein the first acquisition unit is used for acquiring an integral video in a teaching room, the second acquisition unit is used for acquiring blackboard writing and a projection curtain, the third acquisition unit is used for acquiring a limb action video of a teacher, and the first acquisition unit, the second acquisition unit and the third acquisition unit are electrically connected.
According to the technical scheme, the adjusting module comprises a logic judging module, an acquisition switching module and a display module, wherein the logic judging module is electrically connected with the acquisition switching module, the acquisition switching module is electrically connected with the display module, the logic judging module is used for providing logic judging signals, the acquisition switching module is used for switching the acquisition unit, and the display module is used for displaying a lesson picture and providing feedback for teachers.
According to the technical scheme, the embedded network live video stream based hardware system and method comprise the following steps:
Step S1: the first acquisition unit is arranged behind the classroom, can perform wide-angle acquisition in the classroom, acquire a large-scale classroom teaching situation, improve the cognition of students to the classroom environment, and is beneficial to placing the students in the classroom, and the students can take lessons on a network more participatively;
Step S2: the second acquisition unit is arranged above the platform and is used for carrying out high-precision acquisition on the blackboard and the projection curtain, ppt content on the blackboard and the projection curtain contain teaching knowledge points, a fixed camera with higher definition is required to be used, diffuse reflection gain of the projection curtain is considered to be different from that of the blackboard, automatic adjustment is required according to different objects, and acquisition quality is ensured;
Step S3: the collection unit III is arranged in the center of a classroom, collects the behaviors of a teaching teacher in real time, has an automatic focus tracking function, has teaching significance in the expression, action and volume change of the teacher during teaching activities, can promote the teaching rhythm, improves the teaching quality, captures and collects the expression actions of the teacher, and improves the teaching enthusiasm and the interestingness of students;
Step S4: the gazing perception module is connected with a camera of the student equipment, screen display content is dynamically adjusted according to the gazing position of the student, and when in live broadcasting teaching, the display content at the student end can be adjusted in real time according to the class situation of the classroom, so that the class experience of the student is improved;
Step S5: the acquisition switching module controls the preferential display of the video acquisition end through control signals, ensures the quality of network teaching, ensures that the video content acquired by different acquisition units is different, and in order to ensure that the teaching content is rich and the angle is multiple, the acquisition switching module intelligently switches the acquisition units, and when the current acquisition unit acquires, the rest acquisition units enter a dormant state, so that the resource waste is reduced, the teaching content is more rich, and the interest of students and the teaching experience are improved.
According to the above technical solution, the step S3 further includes the following steps:
Step S31: the touch sensing sub-module is arranged in the blackboard and the projection curtain, and sends out a control signal when a teacher performs blackboard writing or PPT explanation, and when the teacher performs blackboard writing or PPT explanation, the touch sensing sub-module is triggered to work, and sends out the control signal to the switching module, so that the blackboard and the projection curtain picture acquired by the acquisition unit II are arranged in the maximum occupation ratio area, and the teaching efficiency is improved;
Step S32: the logic judging module analyzes the actions of the students in real time, and judges the display time according to the behaviors of the students when the maximum occupation ratio area is the blackboard and the PPT picture acquired by the acquisition unit II; when a teacher performs blackboard writing, the maximum duty ratio area of the current display picture is the blackboard and projection curtain picture acquired by the acquisition unit II, at the moment, the student has a low-head recording action, the watching sensing submodule has a short signal interruption, when the time T of the student watching the display screen again is lower than a preset value, the layout of the display area is locked until the time T of the student watching the display screen is higher than the preset value, and the layout of the contact display area is locked.
According to the above technical solution, the step S4 further includes the following steps:
Step S41: when students conduct online class, eyes need to watch the display screen of the equipment, the watch perception submodule judges whether the students are in a watch state through the camera of the equipment, and as the online live public class is voluntary class, the students watch the screen to be regarded as a listening and speaking state;
step S42: after the lesson is started, dividing the display screen into blocks according to the proportions of 80%, 15% and 5%, and displaying different contents at the same time; corresponding pictures are required to be displayed at different schedules in a class, a display screen area is divided into three parts with different proportions, the acquired picture with the highest priority is arranged at the largest part, the acquired picture with the highest priority with the remaining sub-priority is arranged at the remaining part of the display area with low resolution, and the class experience of students is improved;
Step S43: the distribution condition of the pictures acquired by each current acquisition unit is sent to the teacher end in real time for the teacher to refer to; in the network teaching process, a teacher and students are difficult to communicate, teaching quality is low, the teacher can be referred to through statistics of distribution conditions of collected pictures in a display area, the teaching rhythm is convenient to adjust, and the teaching quality is improved.
According to the above technical solution, the step S43 further includes the following steps:
step S431: t i is the residence time of the acquisition unit i in the maximum ratio display area;
step S432: calculating a distribution index H i of the part according to the display residence time of the pictures acquired by each acquisition unit and the layout proportion of the display screen;
Step S433: the distribution index is fed back to the teacher end in real time, and the teacher adjusts the teaching rhythm by taking the distribution index as a reference. The distribution index of each part can reflect the teaching progress of students, the learning level of different students is different, the learning progress is also different, the teaching feedback can be given to teachers through calculating the distribution index, and the teaching rhythm can be adjusted in time.
According to the above technical solution, in step S432, the calculation formula of the distribution index H i of each portion is:
The distribution index of each part is determined by the area proportion on the display screen and the residence time of the acquisition units in the display screen in a partitioning way, the sum of the display time of the three acquisition units in the most preferable display area of the display screen is a set period, and the product of the proportion of the single acquisition unit and the proportion of the most preferable display area reflects the distribution condition.
According to the above technical solution, the step S5 further includes the following steps:
step S51: the fixation sensing module sends an electric signal to the time recording module when sensing fixation of the student, starts timing, and starts timing again after receiving a sensing signal next time when the student has low head and causes signal interruption, wherein the recorded time is T;
Step S52: when the T is subjected to frequent zero clearing action, locking the layout of the display picture; the frequent zero clearing action of T shows that the low head raising frequency of students in the period is higher, and the possibility of taking notes is higher, so that the display layout is required to be locked;
step S53: when the value of T is larger than the set threshold value, the layout of the display picture is unlocked, and normal switching is started; after the value of T is larger than the set threshold, the student looks at the screen for a long time at the moment, and does not need locking operation, and normal picture switching can be carried out.
According to the technical scheme, the first acquisition unit, the second acquisition unit and the third acquisition unit of the video acquisition end work independently at the same time, so that stable picture switching is ensured, and the teaching efficiency of students is improved.
Compared with the prior art, the invention has the following beneficial effects: in the present invention, the number of the components,
(1) By arranging a plurality of video acquisition ends, different contents in the classroom are acquired, the real experience of the live broadcasting classroom is restored, and the immersion feeling of students is deep;
(2) Through the data analysis module, the behavior characteristics of teachers and students are analyzed, and a basis is provided for display switching logic;
(3) Through being provided with display module, divide into the triplex with the display screen to according to every student's study progress accuracy regulation, it is more intelligent to learn lessons, and efficiency is higher.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
FIG. 1 is a schematic diagram of the system module composition of the present invention;
fig. 2 is a schematic diagram of a display screen distribution.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1-2, the present invention provides the following technical solutions: the system comprises a video acquisition end, a data analysis module and an adjusting module, wherein the video acquisition end is electrically connected with the data analysis module, the data analysis module is electrically connected with the adjusting module, the video acquisition end is used for acquiring multiparty video data through a network camera, the data analysis module is used for further analyzing according to the acquired video data, the adjusting module is used for adjusting equipment according to analysis results, the data analysis module comprises a teacher behavior analysis module and a student behavior analysis module, the teacher behavior analysis module is electrically connected with the student behavior analysis module, the teacher behavior analysis module is used for analyzing behavior characteristics of a teacher who is teaching, the student behavior analysis module is used for analyzing behavior characteristics of classmates in the course, the teacher behavior analysis module comprises a touch sensing submodule, the student behavior analysis module comprises a gazing sensing submodule and a time recording submodule, the touch sensing submodule is used for sensing whether a blackboard writing behavior appears, the sensing submodule is used for judging whether the student gazes a screen or not, the gazing time is judged, and the student behavior is used for recording the student gazing duration.
The video acquisition end comprises an acquisition unit I, an acquisition unit II and an acquisition unit III, wherein the acquisition unit I is used for acquiring an integral video in a classroom, the acquisition unit II is used for acquiring blackboard writing and a projection curtain, the acquisition unit III is used for acquiring a limb action video of a teacher, and the acquisition unit I, the acquisition unit II and the acquisition unit III are electrically connected.
The adjusting module comprises a logic judging module, an acquisition switching module and a display module, wherein the logic judging module is electrically connected with the acquisition switching module, the acquisition switching module is electrically connected with the display module, the logic judging module is used for providing logic judging signals, the acquisition switching module is used for switching the acquisition unit, and the display module is used for displaying a picture on lessons and providing feedback for teachers.
An embedded network live video stream based hardware system and method comprises the following steps:
Step S1: the first acquisition unit is arranged behind the classroom, can perform wide-angle acquisition in the classroom, acquire a large-scale classroom teaching situation, improve the cognition of students to the classroom environment, and is beneficial to placing the students in the classroom, and the students can take lessons on a network more participatively;
Step S2: the second acquisition unit is arranged above the platform and is used for carrying out high-precision acquisition on the blackboard and the projection curtain, ppt content on the blackboard and the projection curtain contain teaching knowledge points, a fixed camera with higher definition is required to be used, diffuse reflection gain of the projection curtain is considered to be different from that of the blackboard, automatic adjustment is required according to different objects, and acquisition quality is ensured;
Step S3: the collection unit III is arranged in the center of a classroom, collects the behaviors of a teaching teacher in real time, has an automatic focus tracking function, has teaching significance in the expression, action and volume change of the teacher during teaching activities, can promote the teaching rhythm, improves the teaching quality, captures and collects the expression actions of the teacher, and improves the teaching enthusiasm and the interestingness of students;
Step S4: the gazing perception module is connected with a camera of the student equipment, screen display content is dynamically adjusted according to the gazing position of the student, and when in live broadcasting teaching, the display content at the student end can be adjusted in real time according to the class situation of the classroom, so that the class experience of the student is improved;
Step S5: the acquisition switching module controls the preferential display of the video acquisition end through control signals, ensures the quality of network teaching, ensures that the video content acquired by different acquisition units is different, and in order to ensure that the teaching content is rich and the angle is multiple, the acquisition switching module intelligently switches the acquisition units, and when the current acquisition unit acquires, the rest acquisition units enter a dormant state, so that the resource waste is reduced, the teaching content is more rich, and the interest of students and the teaching experience are improved.
Step S3 further comprises the steps of:
Step S31: the touch sensing sub-module is arranged in the blackboard and the projection curtain, and sends out a control signal when a teacher performs blackboard writing or PPT explanation, and when the teacher performs blackboard writing or PPT explanation, the touch sensing sub-module is triggered to work, and sends out the control signal to the switching module, so that the blackboard and the projection curtain picture acquired by the acquisition unit II are arranged in the maximum occupation ratio area, and the teaching efficiency is improved;
Step S32: the logic judging module analyzes the actions of the students in real time, and judges the display time according to the behaviors of the students when the maximum occupation ratio area is the blackboard and the PPT picture acquired by the acquisition unit II; when a teacher performs blackboard writing, the maximum duty ratio area of the current display picture is the blackboard and projection curtain picture acquired by the acquisition unit II, at the moment, the student has a low-head recording action, the watching sensing submodule has a short signal interruption, when the time T of the student watching the display screen again is lower than a preset value, the layout of the display area is locked until the time T of the student watching the display screen is higher than the preset value, and the layout of the contact display area is locked.
Step S4 further comprises the steps of:
Step S41: when students conduct online class, eyes need to watch the display screen of the equipment, the watch perception submodule judges whether the students are in a watch state through the camera of the equipment, and as the online live public class is voluntary class, the students watch the screen to be regarded as a listening and speaking state;
step S42: after the lesson is started, dividing the display screen into blocks according to the proportions of 80%, 15% and 5%, and displaying different contents at the same time; corresponding pictures are required to be displayed at different schedules in a class, a display screen area is divided into three parts with different proportions, the acquired picture with the highest priority is arranged at the largest part, the acquired picture with the highest priority with the remaining sub-priority is arranged at the remaining part of the display area with low resolution, and the class experience of students is improved;
Step S43: the distribution condition of the pictures acquired by each current acquisition unit is sent to the teacher end in real time for the teacher to refer to; in the network teaching process, a teacher and students are difficult to communicate, teaching quality is low, the teacher can be referred to through statistics of distribution conditions of collected pictures in a display area, the teaching rhythm is convenient to adjust, and the teaching quality is improved.
Step S43 further comprises the steps of:
step S431: t i is the residence time of the acquisition unit i in the maximum ratio display area;
step S432: calculating a distribution index H i of the part according to the display residence time of the pictures acquired by each acquisition unit and the layout proportion of the display screen;
Step S433: the distribution index is fed back to the teacher end in real time, and the teacher adjusts the teaching rhythm by taking the distribution index as a reference. The distribution index of each part can reflect the teaching progress of students, the learning level of different students is different, the learning progress is also different, the teaching feedback can be given to teachers through calculating the distribution index, and the teaching rhythm can be adjusted in time.
In step S432, the calculation formula of the distribution index H i of each portion is:
The distribution index of each part is determined by the area proportion on the display screen and the residence time of the acquisition units in the display screen in a partitioning way, the sum of the display time of the three acquisition units in the most preferable display area of the display screen is a set period, and the product of the proportion of the single acquisition unit and the proportion of the most preferable display area reflects the distribution condition.
Step S5 further comprises the steps of:
step S51: the fixation sensing module sends an electric signal to the time recording module when sensing fixation of the student, starts timing, and starts timing again after receiving a sensing signal next time when the student has low head and causes signal interruption, wherein the recorded time is T;
Step S52: when the T is subjected to frequent zero clearing action, locking the layout of the display picture; the frequent zero clearing action of T shows that the low head raising frequency of students in the period is higher, and the possibility of taking notes is higher, so that the display layout is required to be locked;
step S53: when the value of T is larger than the set threshold value, the layout of the display picture is unlocked, and normal switching is started; after the value of T is larger than the set threshold, the student looks at the screen for a long time at the moment, and does not need locking operation, and normal picture switching can be carried out.
The first acquisition unit, the second acquisition unit and the third acquisition unit of the video acquisition end work independently at the same time, so that stable picture switching is ensured, and the teaching efficiency of students is improved.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Finally, it should be noted that: the foregoing description is only a preferred embodiment of the present invention, and the present invention is not limited thereto, but it is to be understood that modifications and equivalents of some of the technical features described in the foregoing embodiments may be made by those skilled in the art, although the present invention has been described in detail with reference to the foregoing embodiments. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (3)
1. The utility model provides a network live video stream hardware system based on it is embedded, includes video acquisition end, data analysis module, adjustment module, its characterized in that: the video acquisition end is electrically connected with the data analysis module, the data analysis module is electrically connected with the adjustment module, the video acquisition end is used for acquiring multiparty video data through a network camera, the data analysis module is used for further analyzing according to the acquired video data, the adjustment module is used for adjusting equipment according to analysis results, the data analysis module comprises a teacher behavior analysis module and a student behavior analysis module, the teacher behavior analysis module is electrically connected with the student behavior analysis module, the teacher behavior analysis module is used for analyzing behavior characteristics of a teacher who is teaching, the student behavior analysis module is used for analyzing behavior characteristics of a student who is on lessons, the teacher behavior analysis module comprises a touch sensing submodule, the student behavior analysis module comprises a gazing sensing submodule and a time recording submodule, the touch sensing submodule is used for sensing whether a teacher has blackboard writing behaviors or not, the gazing sensing submodule is used for judging whether the student gazes at a screen or not and judging the student behavior according to gazing time, and the time recording submodule is used for recording concentration duration;
The video acquisition end comprises an acquisition unit I, an acquisition unit II and an acquisition unit III, wherein the acquisition unit I is used for acquiring an integral video in a teaching room, the acquisition unit II is used for acquiring blackboard writing and a projection curtain, the acquisition unit III is used for acquiring a limb action video of a teacher, and the acquisition unit I, the acquisition unit II and the acquisition unit III are electrically connected;
The operation method of the embedded network live video stream hardware-based system comprises the following steps:
Step S1: the first acquisition unit is arranged behind the classroom and can acquire the classroom at a wide angle;
Step S2: the second acquisition unit is arranged above the platform and is used for carrying out high-precision acquisition on the blackboard and the projection curtain;
Step S3: the collecting unit III is arranged in the center of a classroom, collects the behaviors of a teaching teacher in real time and has an automatic focus tracking function;
Step S4: the gazing perception module is connected with a camera of student equipment and dynamically adjusts screen display content according to the gazing position of the student;
Step S5: the acquisition switching module controls the priority display of the video acquisition end through the control signal, so that the quality of the network teaching is ensured;
The step S3 further includes the steps of:
Step S31: the touch sensing sub-module is arranged in the blackboard and the projection curtain, and sends out a control signal when a teacher carries out blackboard writing or PPT explanation;
step S32: the logic judging module analyzes the actions of the students in real time, and judges the display time according to the behaviors of the students when the maximum occupation ratio area is the blackboard and the PPT picture acquired by the acquisition unit II;
The step S4 further includes the steps of:
Step S41: when students conduct online class, eyes need to watch the display screen of the equipment, and the watch perception submodule judges whether the students are in a watch state or not through the camera of the equipment;
step S42: after the lesson is started, dividing the display screen into blocks according to the proportions of 80%, 15% and 5%, and displaying different contents at the same time;
step S43: the distribution condition of the pictures acquired by each current acquisition unit is sent to the teacher end in real time for the teacher to refer to;
the step S43 further includes the steps of:
step S431: for acquisition unit/> Dwell time in the maximum ratio display area;
Step S432: calculating a distribution index according to the display residence time of the pictures acquired by each acquisition unit and the layout proportion of the display screen ；
Step S433: the distribution index is fed back to the teacher end in real time, and the teacher adjusts the teaching rhythm by taking the distribution index as a reference;
in the step S432, the distribution index of each part The calculation formula of (2) is as follows:
；
The distribution index of each part, the area proportion on the display screen and the residence time of the acquisition units in the display screen are determined, the sum of the display time of the three acquisition units in the most preferable display area of the display screen is a set period, and the product of the proportion of the single acquisition unit and the proportion of the most preferable display area reflects the distribution condition;
the step S5 further includes the steps of:
Step S51: the fixation sensing module sends an electric signal to the time recording module when sensing fixation of the student, starts timing after receiving a sensing signal next time when the student has low head and causes signal interruption, and records the time as follows ；
Step S52: when (when)When the frequent zero clearing action occurs, locking the layout of the display picture;
Step S53: when (when) When the value of (2) is larger than the set threshold value, the layout of the display screen is unlocked, and normal switching is started.
2. The embedded network live video streaming hardware-based system of claim 1, wherein: the adjusting module comprises a logic judging module, an acquisition switching module and a display module, wherein the logic judging module is electrically connected with the acquisition switching module, the acquisition switching module is electrically connected with the display module, the logic judging module is used for providing logic judging signals, the acquisition switching module is used for switching the acquisition unit, and the display module is used for displaying a lesson picture and providing feedback for teachers.
3. An embedded network live video streaming based hardware system according to claim 2, wherein: the first acquisition unit, the second acquisition unit and the third acquisition unit of the video acquisition end work independently at the same time, so that stable picture switching is ensured, and the teaching efficiency of students is improved.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210052261.2A CN114554144B (en) | 2022-01-18 | 2022-01-18 | Network live video stream hardware system and method based on embedded type |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210052261.2A CN114554144B (en) | 2022-01-18 | 2022-01-18 | Network live video stream hardware system and method based on embedded type |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114554144A CN114554144A (en) | 2022-05-27 |
| CN114554144B true CN114554144B (en) | 2024-04-26 |
Family
ID=81671189
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210052261.2A Active CN114554144B (en) | 2022-01-18 | 2022-01-18 | Network live video stream hardware system and method based on embedded type |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114554144B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115985150A (en) * | 2022-11-14 | 2023-04-18 | 李红英 | Interactive processing system based on big data |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107705639A (en) * | 2017-11-03 | 2018-02-16 | 合肥亚慕信息科技有限公司 | A kind of Online class caught based on face recognition puts question to answer system |
| WO2019095446A1 (en) * | 2017-11-17 | 2019-05-23 | 深圳市鹰硕音频科技有限公司 | Following teaching system having speech evaluation function |
| WO2019095447A1 (en) * | 2017-11-17 | 2019-05-23 | 深圳市鹰硕技术有限公司 | Guided teaching method having remote assessment function |
| CN111027865A (en) * | 2019-12-12 | 2020-04-17 | 山东大学 | Classroom teaching analysis and quality assessment system and method based on intelligent behavior and expression recognition |
| CN111182250A (en) * | 2019-11-29 | 2020-05-19 | 安徽文香信息技术有限公司 | Audio and video teaching recording and playing system and control method thereof |
| CN111709358A (en) * | 2020-06-14 | 2020-09-25 | 东南大学 | Teacher-student behavior analysis system based on classroom video |
| CN112419809A (en) * | 2020-11-09 | 2021-02-26 | 江苏创设未来教育发展有限公司 | Intelligent teaching monitoring system based on cloud data online education |
| CN113936512A (en) * | 2021-12-17 | 2022-01-14 | 正方软件股份有限公司 | Remote teaching method and system for colleges and universities |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112562433B (en) * | 2020-12-30 | 2021-09-07 | 华中师范大学 | Working method of 5G strong interaction remote delivery teaching system based on holographic terminal |
-
2022
- 2022-01-18 CN CN202210052261.2A patent/CN114554144B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107705639A (en) * | 2017-11-03 | 2018-02-16 | 合肥亚慕信息科技有限公司 | A kind of Online class caught based on face recognition puts question to answer system |
| WO2019095446A1 (en) * | 2017-11-17 | 2019-05-23 | 深圳市鹰硕音频科技有限公司 | Following teaching system having speech evaluation function |
| WO2019095447A1 (en) * | 2017-11-17 | 2019-05-23 | 深圳市鹰硕技术有限公司 | Guided teaching method having remote assessment function |
| CN111182250A (en) * | 2019-11-29 | 2020-05-19 | 安徽文香信息技术有限公司 | Audio and video teaching recording and playing system and control method thereof |
| CN111027865A (en) * | 2019-12-12 | 2020-04-17 | 山东大学 | Classroom teaching analysis and quality assessment system and method based on intelligent behavior and expression recognition |
| CN111709358A (en) * | 2020-06-14 | 2020-09-25 | 东南大学 | Teacher-student behavior analysis system based on classroom video |
| CN112419809A (en) * | 2020-11-09 | 2021-02-26 | 江苏创设未来教育发展有限公司 | Intelligent teaching monitoring system based on cloud data online education |
| CN113936512A (en) * | 2021-12-17 | 2022-01-14 | 正方软件股份有限公司 | Remote teaching method and system for colleges and universities |
Non-Patent Citations (3)
| Title |
|---|
| 基于大数据的高校教学质量评价系统设计研究;唐秀忠;兰晓俐;陈洪磊;;开封文化艺术职业学院学报;20200220(02);全文 * |
| 基于情境学习理论的网络学习环境设计;仇云龙;邱正国;张卫;;软件导刊(教育技术);20120523(05);全文 * |
| 智慧教室环境下的数学课堂教学行为研究;刘喆;苏新冰;杜炫杰;;数学教育学报;20200815(04);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114554144A (en) | 2022-05-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109243226B (en) | Multi-screen interactive teaching system and method | |
| CN112765419B (en) | Interactive live broadcast classroom system | |
| CN111610862A (en) | Online teaching mode switching method based on eye movement signal | |
| CN111369408A (en) | Hospital home intern teaching management system and method | |
| CN114554144B (en) | Network live video stream hardware system and method based on embedded type | |
| CN112131483A (en) | Personalized course content recommendation method for online vocational education | |
| Li et al. | Design of mobile learning resources based on new blended learning: a case study of superstar learning app | |
| CN112862267B (en) | Intelligent teaching platform and interactive system thereof | |
| CN109886255A (en) | A kind of intelligent interaction tutoring system with facial emotions identification function | |
| CN111681142A (en) | Method, system, equipment and storage medium based on education video virtual teaching | |
| CN117057669A (en) | Teaching quality assessment method, device and system | |
| CN114936952A (en) | Digital education internet learning system | |
| CN209993139U (en) | Multifunctional equipment for teaching management | |
| Cameron et al. | ICT literacy and the second digital divide: Understanding students’ experiences with technology | |
| Trang | Sustainability of E-learning in Vietnam: The case study of FPT University | |
| CN112289102A (en) | Efficient network teaching method | |
| CN112270264A (en) | Multi-party interactive teaching system | |
| CN112183364A (en) | Personalized virtual teacher behavior generation method and system | |
| CN115412679B (en) | Interactive teaching quality assessment system with direct recording and broadcasting function and method thereof | |
| CN118378959B (en) | Comprehensive teaching quality assessment system based on Internet of things | |
| CN113965793B (en) | Intelligent recording layout switching method and device | |
| Duraisamy et al. | Smaller class room engagement using appropriate seating arrangements | |
| CN219270405U (en) | Intelligent platform | |
| Smerdon et al. | Teachers’ tools | |
| CN115762264A (en) | Teaching interaction method, system, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |