CN114422820A - Education interactive live broadcast system and live broadcast method - Google Patents
Education interactive live broadcast system and live broadcast method Download PDFInfo
- Publication number
- CN114422820A CN114422820A CN202210091914.8A CN202210091914A CN114422820A CN 114422820 A CN114422820 A CN 114422820A CN 202210091914 A CN202210091914 A CN 202210091914A CN 114422820 A CN114422820 A CN 114422820A
- Authority
- CN
- China
- Prior art keywords
- module
- teacher
- student
- live broadcast
- students
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 66
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000012544 monitoring process Methods 0.000 claims abstract description 64
- 230000009471 action Effects 0.000 claims abstract description 25
- 230000008921 facial expression Effects 0.000 claims abstract description 11
- 238000001514 detection method Methods 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 21
- 238000012795 verification Methods 0.000 claims description 15
- 238000005516 engineering process Methods 0.000 claims description 14
- 230000006698 induction Effects 0.000 claims description 13
- 230000002159 abnormal effect Effects 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 9
- 238000012552 review Methods 0.000 claims description 9
- 238000004458 analytical method Methods 0.000 claims description 7
- 230000008451 emotion Effects 0.000 claims description 7
- 238000004364 calculation method Methods 0.000 claims description 5
- 230000011664 signaling Effects 0.000 claims description 4
- 230000006870 function Effects 0.000 claims description 3
- 238000007726 management method Methods 0.000 claims description 3
- 230000006399 behavior Effects 0.000 claims description 2
- 230000008909 emotion recognition Effects 0.000 claims description 2
- 238000000605 extraction Methods 0.000 claims description 2
- 230000001815 facial effect Effects 0.000 claims description 2
- 238000010191 image analysis Methods 0.000 claims description 2
- 230000010365 information processing Effects 0.000 claims description 2
- 210000000697 sensory organ Anatomy 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 5
- 238000001914 filtration Methods 0.000 abstract description 2
- 238000011161 development Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000012550 audit Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/254—Management at additional data server, e.g. shopping server, rights management server
- H04N21/2541—Rights Management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25875—Management of end-user data involving end-user authentication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Educational Administration (AREA)
- Social Psychology (AREA)
- Tourism & Hospitality (AREA)
- Computer Security & Cryptography (AREA)
- Strategic Management (AREA)
- Educational Technology (AREA)
- Computer Graphics (AREA)
- Primary Health Care (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Economics (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention relates to the technical field of online teaching, and discloses an education interactive live broadcast system which comprises a user side module, an interactive disputing module and a video sharing module, wherein the user side module comprises a teacher user side, a remote monitoring module and a student user side, and the teacher user side internally comprises a teaching data module and a teacher sharing module. The interactive live broadcasting system and the live broadcasting method for education enable teachers to give lessons online through the remote monitoring module, the students' facial expressions in a classroom are collected by the remote monitoring module for listening to lessons on the student user sides, the body actions and the judgment are carried out, the states of the students in the classroom are timely fed back to the teachers giving lessons, the live-action feeling of the states of the students listening to lessons is simulated, the supervision effect of the teachers during remote teaching is improved, the teaching quality is guaranteed, the interactive disputing module is arranged, questions asked and uploaded by the student user sides are collected in a unified mode, auditing and filtering are carried out, and repeated uploading of the same problems is avoided.
Description
Technical Field
The invention relates to the technical field of online teaching, in particular to an education interactive live broadcast system and a live broadcast method.
Background
Distance education is an education form which adopts various media ways to carry out system teaching and communication connection, and is education for delivering courses to one or more students outside a campus. Modern distance education refers to education in which courses are delivered through audio, video (live or video), and computer technology, both real-time and non-real-time. Modern distance education is a new education mode generated along with the development of modern information technology. The development of computer technology, multimedia technology and communication technology, especially the rapid development of internet (internet), makes the means of distance education have a qualitative leap, becoming distance education under the high and new technical conditions. Modern remote education is mainly based on modern remote education means, is compatible with traditional teaching forms such as professor, letter and self-study, and the education mode of multiple media optimal combination, but the student can't ask questions in the live broadcast process of most education live broadcast systems at present, can only simply receive the live broadcast content of teacher, and live broadcast middle school student is poor with teacher's interactivity, and the teacher is owing to be absorbed in giving lessons in live broadcast process, does not have the impression of real scene to the state that the student listened to the class, and the supervision effect is poor.
Disclosure of Invention
Technical problem to be solved
The invention provides an educational interactive live broadcast system and a live broadcast method, which solve the problems in the background technology.
(II) technical scheme
The invention provides the following technical scheme: an education interactive live broadcast system comprises a user side module, an interactive disputing module and a video sharing module, wherein the user side module comprises a teacher user side, a remote monitoring module and a student user side, and the video sharing module internally comprises an information collecting and processing module, an information examination module, an information backup and terminal module; the teacher passes through the teacher user gives student's lecture course, the teacher user passes through the course that remote monitoring module taught the teacher transmits extremely the student user, the student is in the in-process of listening to the class and passes through interactive disputing of doubt module and teacher carry out interdynamic, the student passes through video recording sharing module carries out the playback to the course.
Preferably, the interactive questioning solving module internally comprises a question induction module and a question and answer database; the questions uploaded by the student user side questions are collected, audited and filtered in a unified mode through the question induction module, the questions uploaded by the questions are stored in the question and answer database, and the teacher answers the questions in sequence according to the number of the questions corresponding to the questions and stores the content of the answers in the question and answer database.
Preferably, the teacher user side comprises a teaching data module and a teacher sharing module, and the teacher user side and the student user side comprise user verification modules; the teaching data module is used for calling the lesson information, and the teacher sharing module is used for enabling teachers to share data and exchange experiences; the teacher passes through the inside user authentication module of teacher's user end and verifies and get into education interactive live broadcast system, and the student passes through the inside user authentication module of student's user end and verifies and get into education interactive live broadcast system.
Preferably, the remote monitoring module comprises a teaching remote monitoring module and a lecture listening remote monitoring module; when on-line teaching is carried out through the teaching remote monitoring module, the facial expressions and the body actions of students in a classroom are collected by the teaching remote monitoring module arranged at the student user side, collected data are distinguished, and classroom student state distinguishing results are fed back to a teaching teacher in real time.
Preferably, the lecture-attending remote monitoring module comprises a face recognition detection module, a limb action detection module and a voice recognition detection module; the facial recognition detection module is used for collecting facial expressions of students, the limb action detection module is used for collecting limb actions of the students, and the voice recognition detection module is used for collecting voices of the students; and the lecture-attending remote monitoring module analyzes the collected facial expressions, limb actions and voices of the students by adopting an AI algorithm.
Preferably, the user authentication module is used for authenticating login requests of the teacher end and the student end, and the authentication mode of the user authentication module is seal identification or authentication code identification.
Preferably, the server of the teacher user side is based on a cloud server system; the student user side includes: the live broadcast review module separates the functions of transcoding and recording real-time audio and video of the online classroom module, the transcoding and recording are carried out by the recording server, and the recorded video and voice are stored in the file system; the teacher issues real-time audio and video streams of the course and forwards the real-time audio and video streams to the recording server; after receiving the audio and video stream, the recording server records the video and the voice through a program; the recording server sends the recorded file to the file system for storage, and students select a proper audio and video stream format according to requirements to pull the audio and video stream file from the file system to review the live broadcast content.
Preferably, the lecture-attending remote monitoring module analyzes the collected monitoring image, limb movement and voice by adopting an AI algorithm;
the lecture listening remote monitoring module utilizes an AI technology, a face recognition technology, a computer information processing technology and an intelligent image analysis technology, recognizes faces through three steps of face detection, feature extraction and classification recognition, recognizes and analyzes face orientation, five sense organs and emotion, behaviors and non-learning objects of students, monitors classroom concentration degree and mastery degree of each knowledge point of each student and the whole class students in real time, and generates reports based on combination of multi-dimensional emotion recognition, concentration analysis and intelligent teaching monitoring analysis and feeds back to teachers.
Preferably, the interactive disambiguation module further includes: the signaling server and the media server are connected through the teacher user side and the signaling server to apply for joining the room, if the room is not created, the room is created first and then the room is joined, and if the room exists, the room is directly joined; the method comprises the steps that a student user side and a media server are connected, after peer-to-peer connection is successfully established, the student user side sends real-time audio and video streams to a room, and if other students exist in the room, the room receives the real-time audio and video streams of the other students; receiving a real-time media stream of a student when the student joins the room; when a student leaves the room, the room stops receiving the audio and video stream of the student leaving the room, and the connection between the student user end of the student leaving the room and the media server is disconnected;
the question induction module comprises: the system comprises an SFU framework and an MCU framework, wherein when the number of students is small, the uplink and downlink bandwidth consumption of the user side module is small, and the SFU framework is used; when the amount of the students is large, the students are converted into an MCU framework, and the uplink and downlink bandwidths are guaranteed to support huge flow consumption.
An educational interactive live broadcasting system and a live broadcasting method comprise the following operation steps:
s1, a teacher enters an education interactive live broadcast system through the verification of a user verification module in a teacher user side, then lesson information is called through a lesson giving data module, shared data and experience can be exchanged among teachers through a teacher sharing module, then, a teacher live broadcasts teaching video to an education system in real time through a lesson giving remote monitoring module in a remote monitoring module, the teaching video is output to student user sides, and the teacher user side is in signal connection with the student user sides through the education interactive live broadcast system;
s2, the students enter the education interactive live broadcast system through the verification of the user verification module in the student user side, then the students watch the live broadcast teaching of the teacher by using the lesson listening remote monitoring module in the remote monitoring module, and in the process of the live broadcast teaching, the face recognition detection module, the limb action detection module and the voice recognition detection module in the lesson listening remote monitoring module analyze the collected monitoring images, limb actions and voices by using an AI algorithm;
s3, when the remote monitoring module for attending lessons detects an abnormal signal, the abnormal signal is transmitted to the education interactive live broadcast system, and video and audio information related to the abnormal process is stored in a memory card for follow-up background management personnel to review and manually analyze; when the education interactive live broadcast system receives the abnormal signal, reminding information is respectively sent to the student user sides, the teacher user side and the student user sides, so that the teacher can control classroom order and remind students of studying attentively;
s4, in the live broadcast teaching process, after a student generates a problem, the student can enter a problem induction module in the interactive question solving module to input the problem, then the problem induction module carries out abundance value analysis, and by analogy, the number of questions asked for the selected problem is counted, and then the questions are sorted according to the number of the questions asked; the principle of the abundance value calculation is that corresponding pictures and text descriptions in the problems are obtained aiming at the uploaded problems which are considered to be the same problem; marking the number of pictures in the problem as A, and marking the text size of the text description as B; obtaining an abundance value D of the problem by using a formula C (A multiplied by a1+ B multiplied by B2), wherein a1 and B2 are both proportionality coefficients, and selecting the problem with the largest abundance value as a selected problem;
and S5, transmitting the corresponding questions to a teacher end according to the sequence of the selected questions, and after the teacher end receives the selected questions, the teacher answers the selected questions in sequence.
S6, in the process of live broadcast teaching of the education interactive live broadcast system, the video sharing module synchronously works, the teaching content of a teacher enters the information collecting and processing module through sound, image and character acquisition and carries out data processing, then the information examination module is used for examining the input information data, error information is modified, the information backup and terminal module carries out backup on the edited information after completion, the backup process is automatically divided into three modes of student, teacher and public, and the follow-up mode is used for the students to watch and study for many times.
(III) advantageous effects
The invention has the following beneficial effects:
1. according to the education interactive live broadcast system and the live broadcast method, when a teacher gives lessons on line through the remote monitoring module, the student face expressions, the body actions and the judgment of the students in the class are collected by the teaching remote monitoring module arranged at the student user side, so that the states of the students in the class are fed back to the teaching teacher in time, the live-action feeling of the states of the students in the class is simulated, the supervision effect of the teacher in the remote teaching process is improved, and the teaching quality is guaranteed.
2. This interactive live broadcast system of education and live broadcast method through setting up interactive questioning module, unify the problem of collecting, examining and verifying the filtration with student's user side questioning upload, avoids the repeated upload of same problem, improves the efficiency of answering, promotes interactive effect, and the teacher answers according to the number of questioning of corresponding problem in proper order, is favorable to understanding student's knowledge and masters the condition, and then corresponds adjustment teaching content, improves the quality of teaching.
Drawings
FIG. 1 is a schematic structural view of the present invention;
FIG. 2 is a schematic structural diagram of a teacher's client end according to the present invention;
FIG. 3 is a schematic structural diagram of a remote monitoring module according to the present invention;
fig. 4 is a schematic structural diagram of the remote monitoring module for attending class according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, an educational interactive live broadcasting system includes a client module, an interactive disputing module, and a video sharing module, where the client module includes a teacher client, a remote monitoring module, and a student client, the teacher client includes a teaching data module, the teacher sharing module, and both the teacher client and the student client include a user verification module. The teacher passes through the teacher user gives student's lecture course, the teacher user passes through the course that remote monitoring module taught the teacher transmits extremely the student user, the student is in the in-process of listening to the class and passes through interactive disputing of doubt module and teacher carry out interdynamic, the student passes through video recording sharing module carries out the playback to the course.
Referring to fig. 1 and 2, a server of a teacher user side is based on a cloud server system, a user authentication module is used for authenticating login requests of the teacher user side and a student user side, the authentication mode of the user authentication module is seal identification or authentication code identification, a subsequent teacher accesses an education interactive live broadcast system through authentication of the user authentication module in the teacher user side, a student accesses the education interactive live broadcast system through authentication of the user authentication module in the student user side, and both parties access the system through authentication to ensure data security in the system.
Please refer to fig. 1, fig. 3 and fig. 4, the remote monitoring module comprises a teaching remote monitoring module and a listening remote monitoring module, the listening remote monitoring module comprises a face recognition detection module, a limb action detection module and a voice recognition detection module, the listening remote monitoring module adopts an AI algorithm to analyze the collected monitoring image, limb action and voice, when on-line teaching is performed through the remote monitoring module, the student user terminal is set to collect the facial expressions of students in the classroom, limb action and discrimination, thereby timely feeding the student status back to the teaching teacher, so as to simulate the live-action feeling of the student listening status, improve the supervision effect of the teacher during remote teaching, and ensure the teaching quality.
The student user side includes: the live broadcast review module separates the functions of transcoding and recording real-time audio and video of the online classroom module, the transcoding and recording are carried out by the recording server, and the recorded video and voice are stored in the file system; the teacher issues real-time audio and video streams of the course and forwards the real-time audio and video streams to the recording server; after receiving the audio and video stream, the recording server records the video and the voice through a program; the recording server sends the recorded file to the file system for storage, and students select a proper audio and video stream format according to requirements to pull the audio and video stream file from the file system to review the live broadcast content.
Referring to fig. 1, the video sharing module includes an information collecting and processing module, an information examining module, an information backup and terminal module, and the video sharing module records the live broadcast in real time and forms a backup file, which can be subsequently queried by students and teachers in real time.
Please refer to fig. 1, the interactive question solving module includes a question summarizing module and a question and answer database inside, and collects, audits and filters the questions uploaded by the student user side questions uniformly, thereby avoiding repeated uploading of the same question, improving the question solving efficiency, improving the interactive effect, and the teacher solves the questions in sequence according to the number of questions asked by the corresponding question, facilitating understanding of the knowledge mastering conditions of the students, correspondingly adjusting the teaching content, and improving the teaching quality.
The question induction module comprises: the system comprises an SFU framework and an MCU framework, when the number of students is small, the consumption of uplink and downlink bandwidths of the client module is small, and the resources of a cloud server can be saved by using the SFU framework; when the amount of the students is large, the students are converted into an MCU framework, and the uplink and downlink bandwidths are guaranteed to support huge flow consumption.
An educational interactive live broadcasting system and a live broadcasting method comprise the following operation steps:
s1, a teacher enters an education interactive live broadcast system through the verification of a user verification module in a teacher user side, then lesson information is called through a lesson giving data module, shared data and experience can be exchanged among teachers through a teacher sharing module, then, a teacher live broadcasts teaching video to an education system in real time through a lesson giving remote monitoring module in a remote monitoring module, the teaching video is output to student user sides, and the teacher user side is in signal connection with the student user sides through the education interactive live broadcast system;
s2, the students enter the education interactive live broadcast system through the verification of the user verification module in the student user side, then the students watch the live broadcast teaching of the teacher by using the lesson listening remote monitoring module in the remote monitoring module, and in the process of the live broadcast teaching, the face recognition detection module, the limb action detection module and the voice recognition detection module in the lesson listening remote monitoring module analyze the collected monitoring images, limb actions and voices by using an AI algorithm;
s3, when the remote monitoring module for attending lessons detects an abnormal signal, the abnormal signal is transmitted to the education interactive live broadcast system, and video and audio information related to the abnormal process is stored in a memory card for follow-up background management personnel to review and manually analyze; when the education interactive live broadcast system receives the abnormal signal, reminding information is respectively sent to the student user sides, the teacher user side and the student user sides, so that the teacher can control classroom order and remind students of studying attentively;
s4, in the live broadcast teaching process, after a student generates a problem, the student can enter a problem induction module in the interactive question solving module to input the problem, then the problem induction module carries out abundance value analysis, and by analogy, the number of questions asked for the selected problem is counted, and then the questions are sorted according to the number of the questions asked; the principle of the abundance value calculation is that corresponding pictures and text descriptions in the problems are obtained aiming at the uploaded problems which are considered to be the same problem; marking the number of pictures in the problem as A, and marking the text size of the text description as B; obtaining an abundance value D of the problem by using a formula C (A multiplied by a1+ B multiplied by B2), wherein a1 and B2 are both proportionality coefficients, and selecting the problem with the largest abundance value as a selected problem;
and S5, transmitting the corresponding questions to a teacher end according to the sequence of the selected questions, and after the teacher end receives the selected questions, the teacher answers the selected questions in sequence.
S6, in the process of live broadcast teaching of the education interactive live broadcast system, the video sharing module synchronously works, the teaching content of a teacher enters the information collecting and processing module through sound, image and character acquisition and carries out data processing, then the information examination module is used for examining the input information data, error information is modified, the information backup and terminal module carries out backup on the edited information after completion, the backup process is automatically divided into three modes of student, teacher and public, and the follow-up mode is used for the students to watch and study for many times.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
The method comprises the steps of recognizing the class state of a student based on a deep learning mode through facial expressions, extracting features of the student according to the facial expressions, analyzing the features through a calculation mode of evaluation indexes, judging the emotion of the student, enabling a teacher to adjust courses in time, calculating the accuracy of each emotion in the emotion judgment process, averaging to obtain the accuracy, and enabling a class-listening remote monitoring module to analyze the multidimensional emotion and the special attention of the student more accurately through obtaining the accuracy.
Wherein, the calculation mode of the evaluation index is as follows:
WA represents the weighting accuracy; UA denotes unweighted accuracy; n represents the number of emotion categories; TPiThe number of samples of the ith type with correct prediction is shown; FN (FN)iThe number of samples of the ith class indicating a prediction error.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (10)
1. An education interactive live broadcast system comprises a user side module, an interactive disputing module and a video sharing module, wherein the user side module comprises a teacher user side, a remote monitoring module and a student user side, and the video sharing module internally comprises an information collecting and processing module, an information examination module, an information backup and terminal module; the teacher passes through the teacher user gives student's lecture course, the teacher user passes through the course that remote monitoring module taught the teacher transmits extremely the student user, the student is in the in-process of listening to the class and passes through interactive disputing of doubt module and teacher carry out interdynamic, the student passes through video recording sharing module carries out the playback to the course.
2. An educational interactive live broadcast system according to claim 1, wherein: the interactive questioning solving module comprises a question induction module and a question and answer database; the questions uploaded by the student user side questions are collected, audited and filtered in a unified mode through the question induction module, the questions uploaded by the questions are stored in the question and answer database, and the teacher answers the questions in sequence according to the number of the questions corresponding to the questions and stores the content of the answers in the question and answer database.
3. An educational interactive live broadcast system according to claim 1, wherein: the teacher user side and the student user sides respectively comprise user verification modules; the teaching data module is used for calling the lesson information, and the teacher sharing module is used for enabling teachers to share data and exchange experiences; the teacher passes through the inside user authentication module of teacher's user end and verifies and get into education interactive live broadcast system, and the student passes through the inside user authentication module of student's user end and verifies and get into education interactive live broadcast system.
4. An educational interactive live broadcast system according to claim 1, wherein: the remote monitoring module comprises a teaching remote monitoring module and a lecture listening remote monitoring module; when on-line teaching is carried out through the teaching remote monitoring module, the facial expressions and the body actions of students in a classroom are collected by the teaching remote monitoring module arranged at the student user side, collected data are distinguished, and classroom student state distinguishing results are fed back to a teaching teacher in real time.
5. An educational interactive live broadcast system according to claim 4, wherein: the interior of the lecture-attending remote monitoring module comprises a face recognition detection module, a limb action detection module and a voice recognition detection module; the facial recognition detection module is used for collecting facial expressions of students, the limb action detection module is used for collecting limb actions of the students, and the voice recognition detection module is used for collecting voices of the students; and the lecture-attending remote monitoring module analyzes the collected facial expressions, limb actions and voices of the students by adopting an AI algorithm.
6. An educational interactive live broadcast system according to claim 3, wherein: the user authentication module is used for authenticating login requests of a teacher user side and a student user side, and the authentication mode of the user authentication module is seal identification or authentication code identification.
7. An educational interactive live broadcast system according to claim 1, wherein: the server of the teacher user side is based on a cloud server system;
the student user side includes: the live broadcast review module separates the functions of transcoding and recording real-time audio and video of the online classroom module, the transcoding and recording are carried out by the recording server, and the recorded video and voice are stored in the file system; the teacher issues real-time audio and video streams of the course and forwards the real-time audio and video streams to the recording server; after receiving the audio and video stream, the recording server records the video and the voice through a program; the recording server sends the recorded file to the file system for storage, and students select a proper audio and video stream format according to requirements to pull the audio and video stream file from the file system to review the live broadcast content.
8. An educational interactive live broadcast system according to claim 4, wherein: the lecture-attending remote monitoring module analyzes the collected monitoring image, limb action and voice by adopting an AI algorithm;
the lecture listening remote monitoring module utilizes an AI technology, a face recognition technology, a computer information processing technology and an intelligent image analysis technology, recognizes faces through three steps of face detection, feature extraction and classification recognition, recognizes and analyzes face orientation, five sense organs and emotion, behaviors and non-learning objects of students, monitors classroom concentration degree and mastery degree of each knowledge point of each student and the whole class students in real time, and generates reports based on combination of multi-dimensional emotion recognition, concentration analysis and intelligent teaching monitoring analysis and feeds back to teachers.
9. The educational interactive live broadcasting system of claim 2, wherein the interactive question-solving module further comprises: the signaling server and the media server are connected through the teacher user side and the signaling server to apply for joining the room, if the room is not created, the room is created first and then the room is joined, and if the room exists, the room is directly joined; the method comprises the steps that a student user side and a media server are connected, after peer-to-peer connection is successfully established, the student user side sends real-time audio and video streams to a room, and if other students exist in the room, the room receives the real-time audio and video streams of the other students; receiving a real-time media stream of a student when the student joins the room; when a student leaves the room, the room stops receiving the audio and video stream of the student leaving the room, and the connection between the student user end of the student leaving the room and the media server is disconnected;
the question induction module comprises: the system comprises an SFU framework and an MCU framework, wherein when the number of students is small, the uplink and downlink bandwidth consumption of the user side module is small, and the SFU framework is used; when the amount of the students is large, the students are converted into an MCU framework, and the uplink and downlink bandwidths are guaranteed to support huge flow consumption.
10. An educational interactive live broadcasting method, comprising the educational interactive live broadcasting system according to any one of claims 1 to 8, wherein the live broadcasting method comprises the following steps:
s1, a teacher enters an education interactive live broadcast system through the verification of a user verification module in a teacher user side, then lesson information is called through a lesson giving data module, shared data and experience can be exchanged among teachers through a teacher sharing module, then, a teacher live broadcasts teaching video to an education system in real time through a lesson giving remote monitoring module in a remote monitoring module, the teaching video is output to student user sides, and the teacher user side is in signal connection with the student user sides through the education interactive live broadcast system;
s2, the students enter the education interactive live broadcast system through the verification of the user verification module in the student user side, then the students watch the live broadcast teaching of the teacher by using the lesson listening remote monitoring module in the remote monitoring module, and in the process of the live broadcast teaching, the face recognition detection module, the limb action detection module and the voice recognition detection module in the lesson listening remote monitoring module analyze the collected monitoring images, limb actions and voices by using an AI algorithm;
s3, when the remote monitoring module for attending lessons detects an abnormal signal, the abnormal signal is transmitted to the education interactive live broadcast system, and video and audio information related to the abnormal process is stored in a memory card for follow-up background management personnel to review and manually analyze; when the education interactive live broadcast system receives the abnormal signal, reminding information is respectively sent to the student user sides, the teacher user side and the student user sides, so that the teacher can control classroom order and remind students of studying attentively;
s4, in the live broadcast teaching process, after a student generates a problem, the student can enter a problem induction module in the interactive question solving module to input the problem, then the problem induction module carries out abundance value analysis, and by analogy, the number of questions asked for the selected problem is counted, and then the questions are sorted according to the number of the questions asked; the principle of the abundance value calculation is that corresponding pictures and text descriptions in the problems are obtained aiming at the uploaded problems which are considered to be the same problem; marking the number of pictures in the problem as A, and marking the text size of the text description as B; obtaining an abundance value D of the problem by using a formula C (A multiplied by a1+ B multiplied by B2), wherein a1 and B2 are both proportionality coefficients, and selecting the problem with the largest abundance value as a selected problem;
and S5, transmitting the corresponding questions to a teacher end according to the sequence of the selected questions, and after the teacher end receives the selected questions, the teacher answers the selected questions in sequence.
S6, in the process of live broadcast teaching of the education interactive live broadcast system, the video sharing module synchronously works, the teaching content of a teacher enters the information collecting and processing module through sound, image and character acquisition and carries out data processing, then the information examination module is used for examining the input information data, error information is modified, the information backup and terminal module carries out backup on the edited information after completion, the backup process is automatically divided into three modes of student, teacher and public, and the follow-up mode is used for the students to watch and study for many times.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210091914.8A CN114422820A (en) | 2022-01-26 | 2022-01-26 | Education interactive live broadcast system and live broadcast method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210091914.8A CN114422820A (en) | 2022-01-26 | 2022-01-26 | Education interactive live broadcast system and live broadcast method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114422820A true CN114422820A (en) | 2022-04-29 |
Family
ID=81278277
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210091914.8A Withdrawn CN114422820A (en) | 2022-01-26 | 2022-01-26 | Education interactive live broadcast system and live broadcast method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114422820A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114743274A (en) * | 2022-06-09 | 2022-07-12 | 深圳市纬亚森科技有限公司 | Multimedia remote teaching management system and method based on Internet of things |
| CN115065839A (en) * | 2022-07-27 | 2022-09-16 | 术康美国有限公司 | Live broadcast system assisting remote home rehabilitation |
| CN115985150A (en) * | 2022-11-14 | 2023-04-18 | 李红英 | Interactive processing system based on big data |
| CN116800919A (en) * | 2023-06-21 | 2023-09-22 | 深圳市翰视科技有限公司 | Intelligent touch screen interaction teaching equipment |
| CN117314700A (en) * | 2023-11-27 | 2023-12-29 | 朗朗教育科技股份有限公司 | Dual-teacher teaching management method and system for preschool education |
| CN117615182A (en) * | 2024-01-23 | 2024-02-27 | 江苏欧帝电子科技有限公司 | Live broadcast and interaction dynamic switching method, system and terminal based on number of participants |
-
2022
- 2022-01-26 CN CN202210091914.8A patent/CN114422820A/en not_active Withdrawn
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114743274A (en) * | 2022-06-09 | 2022-07-12 | 深圳市纬亚森科技有限公司 | Multimedia remote teaching management system and method based on Internet of things |
| CN114743274B (en) * | 2022-06-09 | 2022-09-09 | 深圳市纬亚森科技有限公司 | Multimedia remote teaching management system and method based on Internet of things |
| CN115065839A (en) * | 2022-07-27 | 2022-09-16 | 术康美国有限公司 | Live broadcast system assisting remote home rehabilitation |
| CN115985150A (en) * | 2022-11-14 | 2023-04-18 | 李红英 | Interactive processing system based on big data |
| CN116800919A (en) * | 2023-06-21 | 2023-09-22 | 深圳市翰视科技有限公司 | Intelligent touch screen interaction teaching equipment |
| CN117314700A (en) * | 2023-11-27 | 2023-12-29 | 朗朗教育科技股份有限公司 | Dual-teacher teaching management method and system for preschool education |
| CN117615182A (en) * | 2024-01-23 | 2024-02-27 | 江苏欧帝电子科技有限公司 | Live broadcast and interaction dynamic switching method, system and terminal based on number of participants |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114422820A (en) | Education interactive live broadcast system and live broadcast method | |
| US11151892B2 (en) | Internet teaching platform-based following teaching system | |
| CN111949822B (en) | Intelligent education video service system based on cloud computing and mobile terminal and operation method thereof | |
| CN110991381B (en) | Real-time classroom student status analysis and indication reminding system and method based on behavior and voice intelligent recognition | |
| WO2018072390A1 (en) | Classroom teaching recording and requesting method and system | |
| CN109872587A (en) | The processing system of multidimensional teaching data | |
| CN115170369B (en) | Live course online watching intelligent management system based on mobile internet | |
| CN109727167B (en) | Teaching auxiliary system | |
| CN109817040A (en) | A kind of processing system for teaching data | |
| CN107958351A (en) | Teaching quality assessment cloud service platform | |
| CN113781853B (en) | Teacher-student remote interactive education platform based on terminal | |
| CN104299178A (en) | Facial-recognition-based network teaching method and system | |
| CN109685692A (en) | A kind of noninductive acquisition and analysis system of various dimensions student learning behavior | |
| CN110930781B (en) | Recording and broadcasting system | |
| CN109359613A (en) | A kind of teaching process analysis method based on artificial intelligence | |
| CN107316511B (en) | Interactive video system based on web browser | |
| CN107393362A (en) | A kind of computer application teaching and training system | |
| CN114115392A (en) | Intelligent classroom control system and method based on 5G cloud edge combination | |
| CN108766075A (en) | A kind of individualized education analysis system and method based on video analysis | |
| CN115878766A (en) | Teacher experience type intelligent question bank based on AI technology and use method thereof | |
| CN111028583A (en) | Remote network teaching system and method | |
| CN109656944A (en) | A kind of online education consulting system recognizing calculating and big data analysis | |
| CN109686154A (en) | A kind of ideology and politics tutoring system based on Cloud Server | |
| CN115278272B (en) | Education practice online guidance system and method | |
| CN112116841A (en) | Personalized remote education system and method based on deep learning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20220429 |