CN112242074A - Interactive classroom audio and video switching system and switching strategy based on teacher and student behaviors - Google Patents
Interactive classroom audio and video switching system and switching strategy based on teacher and student behaviors Download PDFInfo
- Publication number
- CN112242074A CN112242074A CN201910641354.7A CN201910641354A CN112242074A CN 112242074 A CN112242074 A CN 112242074A CN 201910641354 A CN201910641354 A CN 201910641354A CN 112242074 A CN112242074 A CN 112242074A
- Authority
- CN
- China
- Prior art keywords
- lecture
- listening
- tscloud
- video
- platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Electrically Operated Instructional Devices (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to an interactive classroom audio and video switching system and a switching strategy based on teacher and student behaviors, wherein the system comprises a TSCloud platform, a multipoint interactive platform, a recording and broadcasting server, a video terminal and an electronic cloud mirror; the electronic cloud mirror is in communication connection with the recording and broadcasting server and is used for collecting video signals of the classroom end, identifying behaviors of the classroom end according to the video signals to form behavior signals and transmitting the video signals and the behavior signals to the recording and broadcasting server; the TSCloud platform executes a corresponding picture switching strategy according to the behavior signals; the TSCLOUD platform is in communication connection with the multipoint interactive platform, and the multipoint interactive platform executes the picture playing of the video terminal according to the command of the picture switching strategy of the TSCLOUD platform.
Description
Technical Field
The invention relates to the technical field of internet remote teaching, in particular to an interactive classroom audio and video switching system and switching strategy based on teacher and student behaviors.
Background
At present, the remote interactive classroom in the market adopts a fixed picture display strategy. The main defects of a lecture hall and a listening classroom which always see all classroom-side pictures including the lecture hall and receive all classroom-side sounds include the following:
a. classroom order cannot be maintained and controlled: under the condition that the sound of all classes is in an open state and is not effectively controlled, the class order cannot be effectively kept, and once a certain classroom end has noisy sound, even echo may occur, the class listening effect of the whole class is influenced.
b. Students cannot concentrate on: the students in the class-listening classroom can always see each other and receive sound, when the teacher in the main classroom gives lessons, the students may be curious or the students cannot concentrate on the attention and listen to the class seriously for other reasons, and the attention of the students may be at the other classroom ends.
c. Unable accurate teaching: in a traditional teaching process classroom, the expression and the behavior of students can be observed to judge the understanding condition of the students on a certain knowledge point. The prior scheme is not sufficient for a multi-picture teacher to master the classroom condition of remote students, particularly the receiving degree of knowledge points, due to the factors of lens debugging, display screen setting and the like.
Disclosure of Invention
The invention aims to provide an interactive classroom audio and video switching system and a switching strategy based on teacher and student behaviors, and aims to solve the problems that classroom order cannot be guaranteed, student attention cannot be concentrated and the like in the traditional remote teaching.
In order to achieve the purpose, the technical scheme of the invention is as follows:
an interactive classroom audio and video switching system based on teacher and student behaviors comprises a TSCloud platform, a multi-point interactive platform, a recording and broadcasting server, a video terminal and an electronic cloud mirror; the electronic cloud mirror is in communication connection with the recording and broadcasting server and is used for collecting video signals of the classroom end, identifying behaviors of the classroom end according to the video signals to form behavior signals and transmitting the video signals and the behavior signals to the recording and broadcasting server; the TSCLOUD platform is used for executing a corresponding picture switching strategy according to the behavior signals; the TSCLOUD platform is in communication connection with the multipoint interactive platform, and the multipoint interactive platform executes the picture playing of the video terminal according to the command of the picture switching strategy of the TSCLOUD platform.
Further, the TSCloud platform comprises a TSCloud server, a message middleware, a device middleware and an MCU middleware; the device middleware is used for monitoring the behavior signal of the recording and broadcasting server and transmitting the behavior signal to the message middleware in real time; the message middleware is used for receiving information of the equipment middleware and the MCU middleware and transmitting the information to the TSCloud server through a routing mode, and the TSCloud server obtains a picture switching strategy after operation processing and transmits the picture switching strategy to the multipoint interaction platform through the MCU middleware.
Further, the message middleware comprises an authentication service module, a message service module, a routing service module and a storage service module; the message service module provides support of a communication service foundation and a database, and is used for receiving and forwarding messages and packaging the messages by adopting a socket packet; the authentication service module provides authentication of the PUB to the SUB; the routing service module performs routing determination on message transmission; the storage service module is used for storing authentication data, configuration information and equipment relation data.
Further, the device middleware comprises a management and control scheduling service module and a device driving module; the equipment driving module receives the behavior signal of the recording and broadcasting server and reports the behavior signal to the management and control scheduling service module; the management and control scheduling service module is used for performing instruction analysis, parameter packaging, driving scheduling, state storage and reporting on the behavior signals.
An interactive classroom audio and video switching strategy based on teacher and student behaviors comprises a main speaking end, a local lecture listening end and a far-end lecture listening end, and comprises the following switching steps:
when the student attends a class normally, the main lecture end displays all student pictures of the lecture end in a split screen mode, and the lecture end displays teacher pictures of the main lecture end;
when the far-end lecture-listening end is called, the single-screen or split-screen display of the calling lecture-listening end displays the called lecture-listening end, the called lecture-listening end displays the calling lecture-listening end and other called lecture-listening ends, and the other lecture-listening ends display the calling lecture-listening end and all called lecture-listening ends;
when students speak at the local lecture listening end, the main lecture listening end displays all lecture listening ends in a split screen mode, and the lecture listening end displays the local main lecture students in a single screen mode;
when students speak at the local lecture listening end and the remote lecture listening end, the main lecture listening end is viewed by the calling lecture listening end in a split screen mode, the called lecture listening end displays the main lecture listening end and other called lecture listening ends, and the other lecture listening ends display the main lecture listening end and all called lecture listening ends.
The interactive classroom audio and video switching system and the switching strategy based on the teacher and student behaviors have the following advantages:
1. the automatic or manual switching mode can be selected according to the supporting degree of the equipment;
2. the system realizes equipment removal, and a user does not need to learn the operation steps of specific equipment, so that the learning cost is reduced;
3. the automatic switching strategy of the TSCloud platform does not need human intervention, and is easy to use in a normalized mode under the condition of keeping the traditional teaching mode.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention, and are best understood by reference to the accompanying drawings in which:
fig. 1 is a schematic block diagram of an audio/video switching system for a classroom based on teacher-student interaction according to an embodiment of the present invention.
Detailed Description
The technical solution of the present invention is further described in detail with reference to the accompanying drawings and examples.
Referring to fig. 1, an interactive classroom audio and video switching system based on teacher and student behaviors comprises a TSCloud platform, a multipoint interactive platform, a recording and broadcasting server, a video terminal and an electronic cloud mirror;
the electronic cloud mirror is in communication connection with the recording and broadcasting server, and is used for collecting video signals of a classroom end, identifying behaviors of the classroom end according to the video signals to form behavior signals, and transmitting the video signals and the behavior signals to the recording and broadcasting server; the TSCloud platform is in communication connection with the TSCloud platform and the video terminal respectively, the video terminal is in communication connection with the multipoint interaction platform through an H323 or SIP protocol, the video recording and broadcasting server switches video signals according to the behavior signals and transmits the switched video signals to the multipoint interaction platform through the video terminal, the video recording and broadcasting server transmits the behavior signals to the TSCloud platform, and the TSCloud platform calculates and processes the behavior signals to obtain a corresponding picture switching strategy; the TSCLOUD platform is in communication connection with the multipoint interactive platform, and the multipoint interactive platform executes the picture playing of the video terminal according to the command of the picture switching strategy of the TSCLOUD platform.
In one embodiment, the TSCloud platform comprises a TSCloud server, message middleware, equipment middleware and MCU middleware; the message service module provides support for a communication service foundation and a database, is used for receiving and forwarding messages, packages the messages by adopting a socket packet, and simultaneously supports message return in a Websocket mode and message forwarding in a TCP (transmission control protocol) and RMI (remote management interface) mode; the authentication service module provides authentication of the PUB to the SUB; the routing service module performs routing determination on message transmission and simultaneously supports two modes of message routing and message broadcasting; the storage service module is used for storing authentication data, configuration information and equipment relation data.
The device middleware comprises a management and control scheduling service module and a device driving module; the equipment driving module receives the behavior signal of the recording and broadcasting server and reports the behavior signal to the management and control scheduling service module; the management and control scheduling service module is used for performing instruction analysis, parameter packaging, driving scheduling, state storage and reporting on the behavior signals.
The device middleware is used for monitoring the behavior signal of the recording and broadcasting server and transmitting the behavior signal to the message middleware in real time; the message middleware is used for receiving information of the equipment middleware and the MCU middleware, transmitting the information to the TSCloud server through a routing mode, and obtaining a picture switching strategy after the TSCloud server is operated and transmitted to the multipoint interactive platform through the MCU middleware.
In this embodiment, the TSCloud platform is provided with a TSCloud server, a message middleware, an equipment middleware and an MCU middleware in a public network, the equipment middleware, the MCU middleware and the message middleware transmit real-time data through a socket, the equipment middleware communicates with the recording and broadcasting server and the video terminal through various communication protocols, and the MCU middleware communicates with the MCU controller through a communication protocol. The device middleware and the MCU middleware are arranged in each local area network, socket real-time data transmission is realized with the message middleware of the public network, the device middleware is communicated with the recorded broadcast server and the video terminal through various communication protocols, and the MCU middleware is communicated with the MCU controller through the communication protocols.
An interactive classroom audio and video switching strategy based on teacher and student behaviors comprises a main speaking end, a local lecture listening end and a far-end lecture listening end, and the specific switching method comprises the following steps:
when the student attends a class normally, the main lecture end displays all student pictures of the lecture end in a split screen mode, and the lecture end displays teacher pictures of the main lecture end;
when the far-end lecture-listening end is called, the single-screen or split-screen display of the calling lecture-listening end displays the called lecture-listening end, the called lecture-listening end displays the calling lecture-listening end and other called lecture-listening ends, and the other lecture-listening ends display the calling lecture-listening end and all called lecture-listening ends;
when students speak at the local lecture listening end, the main lecture listening end displays all lecture listening ends in a split screen mode, and the lecture listening end displays the local main lecture students in a single screen mode;
when students speak at the local lecture listening end and the remote lecture listening end, the main lecture listening end is viewed by the calling lecture listening end in a split screen mode, the called lecture listening end displays the main lecture listening end and other called lecture listening ends, and the other lecture listening ends display the main lecture listening end and all called lecture listening ends.
When one far-end lecture listening end is called for and speaks, the calling listening end displays the called lecture listening end on a single screen, the called lecture listening end displays a calling lecture listening end picture, and the other lecture listening ends display a calling lecture listening end picture and a called lecture listening end picture; when two far-end lecture-listening ends are called for and speak, the main lecture-listening end is viewed by the called lecture-listening end in a split screen mode, the called lecture-listening end displays pictures of the main lecture-listening end and other called lecture-listening ends, the other lecture-listening ends display pictures of the main lecture-listening end and all called lecture-listening ends, and the display pictures of the main lecture-listening end and the lecture-listening ends are switched by logical analogy.
In the whole interactive classroom audio and video switching process, the audio frequency of the main speaking end is opened in the whole process, the fact that the teachers' voice of the main speaking end is received in the whole process of the listening end is guaranteed, and the voice in the corresponding teaching rooms of the listening end can be automatically opened when the main speaking end is switched to the pictures of the listening end.
According to the interactive classroom audio and video switching system based on teacher and student behaviors, an electronic cloud mirror transmits collected classroom-end video signals to video terminals, the video terminals transmit the video signals to a multipoint interaction unit through an H323 or SIP protocol, a teacher performs roll calling operation on a certain listening end through a TSCloud platform, a TSCloud server receives the roll called listening end and then executes a corresponding picture switching strategy, an instruction is transmitted to an MCU middleware through a message middleware, the MCU middleware controls the multipoint interaction platform to open roll called classroom sounds and switch pictures received by each video terminal according to the received instruction, and the video terminals output the received pictures to display equipment.
The above-mentioned embodiments, objects, technical solutions and advantages of the present invention are further described in detail, it should be understood that the above-mentioned embodiments are only specific embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (5)
1. The utility model provides an interactive classroom audio frequency and video switched systems based on teachers and students' action which characterized in that: the system comprises a TSCloud platform, a multi-point interaction platform, a recording and broadcasting server, a video terminal and an electronic cloud mirror;
the electronic cloud mirror is in communication connection with the recording and broadcasting server and is used for collecting video signals of the classroom end, identifying behaviors of the classroom end according to the video signals to form behavior signals and transmitting the video signals and the behavior signals to the recording and broadcasting server;
the TSCLOUD server is in communication connection with the TSCLOUD platform and the video terminal respectively, the video terminal is in communication connection with the multipoint interaction platform through a protocol, the TSCLOUD server switches video signals according to behavior signals and transmits the switched video signals to the multipoint interaction platform through the video terminal, the TSCLOUD server transmits the behavior signals to the TSCLOUD platform, and the TSCLOUD platform obtains a corresponding picture switching strategy according to the operation processing of the behavior signals;
the TSCloud platform is in communication connection with the multipoint interaction platform, and the multipoint interaction platform switches playing pictures of the video terminal according to the command of the picture switching strategy.
2. The interactive classroom audio-video switching system based on teacher and student behaviors as claimed in claim 1, wherein: the TSCloud platform comprises a TSCloud server, a message middleware, a device middleware and an MCU middleware;
the device middleware is used for monitoring the behavior signal of the recording and broadcasting server and transmitting the behavior signal to the message middleware in real time;
the message middleware is used for receiving information of the equipment middleware and the MCU middleware and transmitting the information to the TSCloud server through a routing mode, and the TSCloud server obtains a picture switching strategy after operation processing and transmits the picture switching strategy to the multipoint interaction platform through the MCU middleware.
3. The interactive classroom audio-video switching system based on teacher and student behaviors as claimed in claim 1, wherein: the message middleware comprises an authentication service module, a message service module, a routing service module and a storage service module;
the message service module provides support of a communication service foundation and a database, and is used for receiving and forwarding messages and packaging the messages by adopting a socket packet;
the authentication service module provides authentication of the PUB to the SUB;
the routing service module performs routing determination on message transmission;
the storage service module is used for storing authentication data, configuration information and equipment relation data.
4. The interactive classroom audio-video switching system based on teacher and student behaviors as claimed in claim 1, wherein: the device middleware comprises a management and control scheduling service module and a device driving module;
the equipment driving module receives the behavior signal of the recording and broadcasting server and reports the behavior signal to the management and control scheduling service module;
the management and control scheduling service module is used for performing instruction analysis, parameter packaging, driving scheduling, state storage and reporting on the behavior signals.
5. The utility model provides an interactive classroom audio frequency and video switches strategy based on teacher's student's action, includes that main speaking end, local end and the far-end of listening to class, when normally going to class, main speaking end divides the screen display to show all end student's pictures of listening to class, and the end of listening to class shows main speaking end mr's picture, when TSCLOUD platform received the action signal, makes corresponding video switch strategy, its characterized in that:
when the far-end lecture-listening end is called, the single-screen or split-screen display of the calling lecture-listening end displays the called lecture-listening end, the called lecture-listening end displays the calling lecture-listening end and other called lecture-listening ends, and the other lecture-listening ends display the calling lecture-listening end and all called lecture-listening ends;
when students speak at the local lecture listening end, the main lecture listening end displays all lecture listening ends in a split screen mode, and the lecture listening end displays the local main lecture students in a single screen mode;
when students speak at the local lecture listening end and the remote lecture listening end, the main lecture listening end is viewed by the calling lecture listening end in a split screen mode, the called lecture listening end displays the main lecture listening end and other called lecture listening ends, and the other lecture listening ends display the main lecture listening end and all called lecture listening ends.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910641354.7A CN112242074A (en) | 2019-07-16 | 2019-07-16 | Interactive classroom audio and video switching system and switching strategy based on teacher and student behaviors |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910641354.7A CN112242074A (en) | 2019-07-16 | 2019-07-16 | Interactive classroom audio and video switching system and switching strategy based on teacher and student behaviors |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112242074A true CN112242074A (en) | 2021-01-19 |
Family
ID=74167125
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910641354.7A Pending CN112242074A (en) | 2019-07-16 | 2019-07-16 | Interactive classroom audio and video switching system and switching strategy based on teacher and student behaviors |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112242074A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113986443A (en) * | 2021-11-10 | 2022-01-28 | 四川天辰智联科技有限公司 | Interactive recording and broadcasting method, equipment and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201315632Y (en) * | 2008-11-14 | 2009-09-23 | 天津市联大通讯发展有限公司 | Automatic tracking and shooting controlling device |
| CN103531049A (en) * | 2013-11-05 | 2014-01-22 | 熊才平 | Remote synchronous interactive network teaching platform |
| CN106384546A (en) * | 2016-09-07 | 2017-02-08 | 江苏三步网络科技有限公司 | Remote interactive teaching automatic voicing method based on students' behaviors |
| CN107731032A (en) * | 2017-09-08 | 2018-02-23 | 蒋翔东 | A kind of audio-video switching method, device and remote multi-point interactive education system |
| CN209002068U (en) * | 2018-11-07 | 2019-06-18 | 杭州晨安科技股份有限公司 | Intelligent cloud mirror video camera |
-
2019
- 2019-07-16 CN CN201910641354.7A patent/CN112242074A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201315632Y (en) * | 2008-11-14 | 2009-09-23 | 天津市联大通讯发展有限公司 | Automatic tracking and shooting controlling device |
| CN103531049A (en) * | 2013-11-05 | 2014-01-22 | 熊才平 | Remote synchronous interactive network teaching platform |
| CN106384546A (en) * | 2016-09-07 | 2017-02-08 | 江苏三步网络科技有限公司 | Remote interactive teaching automatic voicing method based on students' behaviors |
| CN107731032A (en) * | 2017-09-08 | 2018-02-23 | 蒋翔东 | A kind of audio-video switching method, device and remote multi-point interactive education system |
| CN209002068U (en) * | 2018-11-07 | 2019-06-18 | 杭州晨安科技股份有限公司 | Intelligent cloud mirror video camera |
Non-Patent Citations (1)
| Title |
|---|
| 湛江频道: "《三步科技教育信息化TS Cloud平台开放性独树一帜》", 《搜狐网》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113986443A (en) * | 2021-11-10 | 2022-01-28 | 四川天辰智联科技有限公司 | Interactive recording and broadcasting method, equipment and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108831218A (en) | Teleeducation system based on virtual reality | |
| WO2019096126A1 (en) | Smart classroom teaching system employing internet of things | |
| CN203455963U (en) | Remote interactive simulation teaching system | |
| CN104735416A (en) | Tracking camera, record information acquisition processing live broadcast network teaching system | |
| CN106023689A (en) | Teaching management system | |
| CN110349456A (en) | Intelligence control system, remote control terminal and the classroom terminal of interaction classroom | |
| CN207115790U (en) | A kind of English-Assisted Instruction system | |
| CN105374234A (en) | Internet-of-things teaching integrated machine | |
| CN106454200A (en) | Video interaction method and video interaction system based on scene switching | |
| CN113112881A (en) | Remote experiment question answering system based on WebRTC | |
| CN205983949U (en) | Teaching management system | |
| CN110570701A (en) | two-way voice interactive teaching system and method for synchronous video | |
| CN112242074A (en) | Interactive classroom audio and video switching system and switching strategy based on teacher and student behaviors | |
| CN109191967A (en) | A kind of multimedia education system | |
| CN108462847A (en) | A kind of interactive recording and broadcasting system of teaching | |
| CN210466804U (en) | Remote interactive education system | |
| CN205486925U (en) | Information -based video teaching system | |
| CN102568263A (en) | Remote multimedia interactive teaching system based on SIP signaling | |
| CN204650604U (en) | A kind of interactive recording and broadcasting system based on cloud education services platform | |
| CN103531049A (en) | Remote synchronous interactive network teaching platform | |
| CN115565412A (en) | Live-broadcast teaching system and method for online and offline fusion training of enterprise | |
| CN111028580A (en) | Class-class teaching method based on video conference system | |
| CN110933510B (en) | Information interaction method in control system | |
| CN205211202U (en) | Thing networking teaching all -in -one | |
| CN212847226U (en) | Immersive scene practical training system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210119 |