WO2015024301A1

WO2015024301A1 - Method and system for implementing online synchronous class

Info

Publication number: WO2015024301A1
Application number: PCT/CN2013/086815
Authority: WO
Inventors: 胡加明
Original assignee: 苏州阔地网络科技有限公司
Priority date: 2013-08-14
Filing date: 2013-11-11
Publication date: 2015-02-26
Also published as: CN103413472B; CN103413472A

Abstract

A method and system for implementing an online synchronous class. The method comprises the following steps: a positioned video camera of a main classroom monitoring motion of a teacher and students in the main classroom, and sending motion information of the teacher and the students to a tracking host of the main classroom; the tracking host of the main classroom sending a control instruction to a tracking video camera of the main classroom and a teaching client of the main classroom; after receiving the control instruction, the teaching client of the main classroom determining, according to a current teaching mode, a target video that needs to be output, and sending an image processing instruction to an image stitcher of the main classroom; the image stitcher of the main classroom forming a combined video according to tracking video information acquired from the tracking video camera of the main classroom and the image processing instruction received from the teaching client of the main classroom, and pushing the combined video to the teaching client of the main classroom; and the teaching client of the main classroom sending currently output audio and video information to a teaching client of a secondary classroom through a streaming media server.

Description

Method and system for implementing network synchronous classroom

The invention belongs to the field of network communication, and in particular relates to a method and system for implementing a network synchronous classroom. Background technique

With the popularization of the Internet, distance learning has become a common teaching method in today's developed information. However, at present, the functions of the online teaching classroom are relatively simple. Although remote transmission can be realized, the online interaction of teaching is poor, and the teaching quality cannot be effectively improved. Summary of the invention

The invention provides a network synchronization classroom implementation method and system to solve the above problems.

The invention provides a network synchronization classroom implementation method. The above method comprises the following steps: The positioning camera of the main classroom monitors the movement of the teacher and the student in the main classroom, and sends the movement information of the teacher and the student to the tracking host of the main classroom; the tracking host of the main classroom sends a control instruction to the main classroom. Tracking the camera and the teaching client of the main classroom; after receiving the control instruction, the teaching client of the main classroom determines the target video to be output according to the current teaching mode, and sends an image processing instruction to the image splicer of the main classroom; The image splicer forms a combined video push to the teaching client of the main classroom according to the tracking video information obtained from the tracking camera of the main classroom and the image processing instruction received from the teaching client of the main classroom; the teaching client of the main classroom passes the streaming media The server sends the currently output audio and video information to the teaching client of the secondary classroom.

The invention also provides a network synchronization classroom implementation system, which comprises a main classroom system, a secondary classroom system and a streaming media server. The main classroom system includes a positioning camera, a tracking host, a tracking camera, a teaching client, and an image splicer. The secondary classroom system includes a teaching client. The tracking host of the main classroom is respectively connected with the positioning camera, the tracking camera and the teaching client. The image splicer is respectively connected with the teaching client and the tracking camera, and the teaching client of the main classroom is connected to the teaching client of the auxiliary classroom through the streaming media server. The positioning camera of the main classroom is used to monitor the movement of teachers and students in the main classroom, and send the sports information of the teachers and students to the tracking host of the main classroom. The main classroom tracking host is used to send control commands to the tracking camera of the main classroom and the teaching client of the main classroom. After receiving the control instruction, the teaching client of the main classroom is configured to determine the target video to be output according to the current teaching mode, and send an image processing instruction to the image splicer of the main classroom. The image splicer of the main classroom is used to form a combined video push to the teaching client of the main classroom based on the tracking video information obtained from the tracking camera of the main classroom and the image processing instructions received from the teaching client of the main classroom. The teaching client of the main classroom is configured to send the currently output audio and video information to the teaching client of the auxiliary classroom through the streaming server. Compared with the prior art, the network synchronization classroom implementation method and system provided by the present invention realizes network classroom synchronization through the assistance communication of the main classroom and the auxiliary classroom. In addition, the automation and intelligence of the network synchronization classroom is improved, thereby improving the teaching quality of teachers and improving the classroom experience of students. DRAWINGS

The drawings are intended to provide a further understanding of the present invention, and are intended to be a part of the present invention, and the description of the present invention is not intended to limit the invention. In the drawing:

1 is a schematic diagram of a network synchronization classroom implementation method according to a preferred embodiment of the present invention; and FIG. 2 is a schematic diagram of a network synchronization classroom implementation system according to a preferred embodiment of the present invention. detailed description

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

FIG. 1 is a schematic diagram of a method for implementing a network synchronization classroom according to a preferred embodiment of the present invention. As shown in FIG. 1, the network synchronization classroom implementation method provided by the preferred embodiment of the present invention includes steps 101-105.

In step 101, the positioning camera of the main classroom monitors the movement of the teacher and the student in the main classroom, and transmits the movement information of the teacher and the student to the tracking host of the main classroom. Here, the positioning camera of the main classroom includes a teacher positioning camera and a student positioning camera. The teacher positioning camera in the main classroom monitors the teacher's book in the main classroom or the teacher moves the teacher's dynamic image information to the teacher tracking host during the lecture; the student positioning camera in the main classroom monitors the student standing in the main classroom. Or when sitting down, send the student dynamic image information to the student tracking host at this time; in addition, the teacher tracking host and the student tracking host can be merged into one tracking host.

In step 102, the tracking host of the main classroom sends a control command to the tracking camera of the main classroom and the teaching client of the main classroom. Here, the tracking camera of the main classroom includes a teacher tracking camera and a student tracking camera. The main classroom tracking host sends control commands to the teacher tracking camera of the main classroom, the student tracking camera, and the teaching client of the main classroom based on the teacher dynamic image information obtained from the teacher positioning camera and the student dynamic image information acquired from the student positioning camera. The control command carries the motion direction information, the motion amplitude information, and the signal source information. In this way, after the teacher tracking camera or the student tracking camera of the main classroom receives the control command sent by the tracking host, the teacher or student's motion can be tracked accordingly.

In step 103, after receiving the control instruction, the teaching client of the main classroom determines the target video to be output according to the current teaching mode, and sends an image processing instruction to the image splicer of the main classroom. Specifically, after receiving the control instruction, the teaching client of the main classroom determines which video is output as the target view according to the current actual teaching mode. Frequency, and send image processing instructions to the image splicer of the main classroom. The image processing instruction includes carrying the target video output information. Here, the types of teaching modes include a normal teaching mode, a voice resource mode, a silent resource mode, and an interactive discussion mode. However, the present invention is not limited thereto. Wherein, in the normal teaching mode, the target video to be output is mainly the video signal of the teacher tracking camera of the main classroom, the student tracking camera or the student tracking camera of the auxiliary classroom; in the audio resource mode, the target video to be output is The VGA (Video Graphics Array) signal is mainly used in the teaching client of the main classroom; in the silent resource mode, the target video to be output is mainly the VGA signal of the teaching client of the main classroom; in the interactive discussion mode, the target video to be output is required. The main classroom student tracking camera or secondary classroom student tracking camera video signal.

In step 104, the image splicer of the main classroom forms a combined video push to the main classroom according to the tracking video information acquired from the tracking camera of the main classroom and the image processing instruction received from the teaching client of the main classroom. Teaching client. Here, the image splicer of the main classroom forms a combined video in the corresponding teaching mode according to the image processing instruction and the tracking video information of the teacher tracking camera or the student tracking camera, and pushes the determined combined video to the teaching client of the main classroom. In this case, the image splicer will splicing a composite picture of the main and the two assistants to the teaching client of the main classroom according to different teaching modes.

In step 105, the teaching client of the main classroom sends the currently output audio and video information to the teaching client of the auxiliary classroom through the streaming server. Here, the teaching client of the main classroom sends the currently output audio and video information to the teaching client of the auxiliary classroom through the streaming server, thus realizing the synchronization of information between the main classroom and the auxiliary classroom.

In this embodiment, the teaching client of the main classroom sets the type of the teaching mode, the teaching duration corresponding to each teaching mode, the warning time, and the switching sequence, and the teaching client of the main classroom corresponds to the corresponding teaching duration. The mode provides switching control.

Specifically, after the teaching client of the main classroom completes the types of teaching modes, the teaching duration corresponding to each teaching mode, the warning time, and the switching sequence, the timing trigger function is activated, and when the timing time is reached, the teaching mode corresponding to the first order is opened. And sending, by the streaming media server, a startup notification message to the teaching client of the auxiliary classroom, wherein the startup notification message carries the teaching client teaching mode information of the main classroom and the sound control strategy information of the auxiliary classroom corresponding to the mode. Moreover, when the teaching client of the main classroom judges that the teaching duration of the corresponding teaching mode reaches the warning time, the teaching client of the main classroom displays the prompt information. The prompt information includes the remaining teaching duration of the corresponding teaching mode and whether the teacher is willing to extend the teaching duration.

In addition, in this embodiment, different teaching modes correspond to different sound control strategies, and when the teaching client of the main classroom switches between different teaching modes, the sound control of the main classroom is adjusted according to the corresponding sound control strategy, and the auxiliary classroom is notified at the same time. Teaching client. The notification message carries the following information: the teaching mode information after the switching, and the voice control policy information of the auxiliary classroom corresponding to the switched teaching mode. The teaching client of the auxiliary classroom completes the teaching mode according to the notification message Switching and sound control strategy adjustments.

In this embodiment, in the normal teaching mode, the sound control strategy is: In the main classroom, the teaching client of the main classroom calls the microphone sound collection module to collect the microphone sound, and the microphone audio signal is connected to the teaching client of the main classroom. The input port of the terminal, in the auxiliary classroom, the teaching client of the auxiliary classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client of the auxiliary classroom. In the audio resource mode, the sound control strategy is: In the main classroom, the teaching client of the main classroom calls the sound card sound collection module, the microphone sound collection module, and the input signal of the teaching client sound card of the main classroom and the input signal of the microphone. The mixing is performed, and the mixed audio signal is used as an input signal of the sound card input port. In the auxiliary classroom, the teaching client of the auxiliary classroom calls the microphone mute module to perform mute processing. At this time, the students in the auxiliary classroom cannot speak. In the silent resource mode, the sound control strategy is: In the main classroom, the teaching client of the main classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client, in the auxiliary classroom, The teaching client of the classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client. In the interactive discussion mode, the sound control strategy is: In the main classroom, the teaching client of the main classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client, in the auxiliary classroom, The teaching client of the classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client.

Here, if the setting of the teaching client of the teacher in the main classroom is as shown in Table 1, the implementation process of the network synchronization classroom provided by the embodiment is described in detail below according to Table 1.

Table 1

Specifically, the teacher can set the teaching mode, teaching duration, warning time, and switching order through the teaching setting interface of the teaching client of the main classroom. The teaching client obtains the comprehensive information as shown in Table 1 according to the teacher's settings. In addition, the teacher selects the time (for example, 10 minutes), and the teaching client starts the timing trigger function. When the time arrives, the teaching client opens the teaching mode corresponding to the first order (as shown in Table 1 is the normal teaching mode). ). At this point, the teacher officially started class. At the same time, the teaching client of the main classroom sends a startup notification message to the teaching client of the auxiliary classroom through the streaming media server, wherein the startup notification message carries the normal teaching mode information (ie, the teaching mode information of the teaching client of the current main classroom) and the mode. The corresponding sound control strategy information of the secondary classroom. After receiving the start notification message, the teaching client of the auxiliary classroom sets the current mode to the normal teaching mode, and determines that the current sound control strategy is: the teaching client of the auxiliary classroom The microphone sound collection module is called to collect the microphone sound, and the microphone audio signal is input to the input port of the teaching client of the auxiliary classroom. In this way, the secondary classroom can interact with the main classroom.

Specifically, in the normal teaching mode, if the teacher board moves or moves during the lecture, the teacher tracking camera of the main classroom tracks the movement of the teacher, and the teaching client of the main classroom sends an image processing instruction to the image splicer, the image splicer According to the image obtained from the teacher tracking camera in the main classroom, a composite picture based on the output of the teacher tracking camera is spliced and pushed to the teaching client of the main classroom. The teaching client of the main classroom delivers the current audio and video information to the teaching client of the secondary classroom through the streaming server. If the students in the main classroom stand up, the student positioning camera in the main classroom sends the student dynamic image information to the tracking host of the main classroom. The tracking host of the main classroom sends control commands to the student tracking camera and the teaching client according to the received information. The teaching client of the main classroom determines that the target video to be output is based on the information of the student tracking camera, and sends image processing instructions to the image splicer of the main classroom. At this time, the student tracking camera of the main classroom performs close-up tracking of the students. After receiving the image processing instruction, the image splicer of the main classroom splicing out a composite picture mainly based on the output of the student tracking camera, and pushing it to the teaching client of the main classroom. . The teaching client of the main classroom delivers the current audio and video information to the teaching client of the secondary classroom through the streaming media server. If the student speaking in the main classroom sits down, the student positioning camera of the main classroom sends the student dynamic image information to the tracking host of the main classroom, the tracking host analyzes the above information, and sends a control instruction to the student tracking camera and the teaching client of the main classroom. Then, the student tracking camera of the main classroom cancels the close-up tracking of the speaking students. At the same time, after the teaching client of the main classroom receives the control instruction, it recognizes that there is no student speaking at this time, and then determines that the signal of the teacher tracking camera is the main output (if the teacher The board book or walks during the lecture, and sends image processing instructions to the image splicer. After receiving the image processing instruction, the image splicer of the main classroom splices the composite picture based on the output of the teacher tracking camera and pushes it to the teaching client of the main classroom. The teaching client of the main classroom delivers the current audio and video information to the teaching client of the secondary classroom through the streaming server. In addition, in this mode, the students in the auxiliary classroom can also speak. At this time, the teaching client of the auxiliary classroom collects the audio and video data of the auxiliary classroom, and sends it to the teaching client of the main classroom through the streaming server. The manner in which the auxiliary classroom obtains the audio and video data of the speech of the auxiliary classroom student is the same as that of the main classroom, and therefore will not be described here.

In addition, when the teaching client of the main classroom is in the normal teaching mode, the teaching time reaches the warning time (for example, when the teaching duration shown in Table 1 reaches 18 minutes), the teaching client of the main classroom displays the prompt information, prompting the teacher to the remaining teaching of the normal teaching mode. Duration (for example, 2 minutes remaining) and prompts the teacher if they are willing to extend the length of the normal teaching mode. If the teacher chooses to extend the teaching duration of the normal teaching mode, the teaching client of the main classroom sets the extension time according to the teacher's selection, and at the same time resets the timing of the teaching duration corresponding to each teaching mode in the entire course.

After the teaching time of the normal teaching mode reaches the set time (as shown in Table 1 for 20 minutes) or the extended teaching time is also reached (for example, if the extension time is 5 minutes, it reaches 25 minutes), the teaching client of the main classroom Switching the teaching mode to the voice resource state, and sending a notification message to the teaching client of the secondary classroom through the streaming server. among them, The notification message carries the sound resource mode information and the sound control policy information of the auxiliary classroom corresponding to the voice resource mode. After receiving the notification message, the teaching client of the auxiliary classroom switches the current mode to the voice resource mode, and adjusts the voice control strategy to: the teaching client of the auxiliary classroom invokes the microphone mute module to perform mute processing, and at this time, the student in the auxiliary classroom cannot Speak.

In the audio resource mode, the teaching client of the main classroom calls the audio resource to play according to the address stored by the voice resource. Among them, audio resources include MP4, audio and electronic courseware. In the main classroom, the voice control strategy is: the teaching client of the main classroom calls the sound card sound collection module, the microphone sound collection module, and mixes the sound output signal of the teaching client of the main classroom and the input signal of the microphone, after mixing The audio signal acts as an input signal to the sound card input port. In this mode, the teaching client of the main classroom determines the VGA signal as the primary output signal and sends the image processing instructions to the image splicer of the main classroom. The image splicer of the main classroom spliced the combined video and pushed it to the teaching client of the main classroom. The teaching client of the main classroom sends the current audio and video information to the teaching client of the auxiliary classroom through the streaming server.

In addition, when the teaching duration of the audio resource mode reaches the warning time (as shown in Table 1 when the teaching duration reaches 8 minutes), the teaching client of the main classroom displays the prompt information. Here, the display and operation of the prompt information are as described in the normal teaching mode, and thus will not be described herein.

After the teaching time of the audio resource mode reaches the set time (10 minutes as shown in Table 1) or the extended teaching time is also reached (for example, if the extension time is 5 minutes, it reaches 15 minutes), the teaching client of the main classroom Switch the teaching mode to silent resource mode. At the same time, the teaching client of the main classroom sends a notification message to the teaching client of the secondary classroom. The notification message carries information of the silent resource mode and the sound control policy information of the secondary classroom corresponding to the silent resource mode. After receiving the notification message, the teaching client of the auxiliary classroom switches the current mode to the silent resource mode, and adjusts the sound control strategy to: the teaching client of the auxiliary classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the teaching client. The input port of the end.

In the silent resource mode, the teaching client of the main classroom calls the silent resource to play according to the address stored by the silent resource. In the main classroom, the voice control strategy is: The teaching client of the main classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client. In this mode, the teaching client of the main classroom determines to use the VGA signal as the main output signal and sends image processing instructions to the image splicer of the main classroom. The image splicer of the main classroom splicing out the combined video and pushing it to the teaching client of the main classroom. The teaching client of the main classroom sends the current audio and video information to the teaching client of the auxiliary classroom through the streaming media server.

In addition, when the teaching duration of the silent resource mode reaches the warning time (as shown in Table 1 when the teaching duration reaches 8 minutes), the teaching client of the main classroom displays the prompt information. Here, the display and operation of the prompt information are as described in the normal teaching mode, and thus will not be described herein.

After the teaching time of the silent resource mode reaches the set time (10 minutes as shown in Table 1) or the extended teaching time is also reached (for example, if the extension time is 5 minutes, it reaches 15 minutes), the teaching client of the main classroom Cut the teaching mode Switch to interactive discussion mode. At the same time, the teaching client of the main classroom sends a notification message to the teaching client of the secondary classroom. The notification message carries the information of the interactive discussion mode and the voice control strategy information of the secondary classroom corresponding to the interactive discussion mode. After receiving the notification message, the teaching client of the auxiliary classroom switches the current mode to the interactive discussion mode, and adjusts the sound control strategy to: The teaching client of the auxiliary classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the teaching client. The input port of the end.

In the interactive discussion mode, the teaching client of the main classroom determines that the target video to be output is mainly based on the student tracking camera of the main classroom, and sends image processing instructions to the image splicer of the main classroom. The image splicer stitches out the composite image based on the output of the student tracking camera from the image captured by the student tracking camera in the main classroom, and pushes it to the teaching client of the main classroom. The teaching client of the main classroom delivers the current audio and video information to the teaching client of the secondary classroom through the streaming server.

In addition, when the teaching duration of the interactive discussion mode reaches the warning time (as shown in Table 1 when the teaching duration reaches 5 minutes), the teaching client of the main classroom displays the prompt information. Here, the display and operation of the prompt information are as described in the normal teaching mode, and thus will not be described herein. It should be noted that after the teaching time of the interactive discussion mode reaches the set time (as shown in Table 1 for 5 minutes) or the extended teaching time is also reached (for example, if the extension time is 5 minutes, it reaches 10 minutes), the whole teaching The course ends.

2 is a schematic diagram of a network synchronization classroom implementation system provided in accordance with a preferred embodiment of the present invention. As shown in FIG. 2, the network synchronization classroom implementation system provided by the preferred embodiment of the present invention includes a main classroom system 10, a secondary classroom system 12, and a streaming media server 11. The main classroom system 10 includes positioning cameras 100, 101, tracking host 102, tracking cameras 103, 104, teaching client 105, and image splicer 106. The secondary classroom system 12 includes a teaching client 125. The tracking host 102 of the main classroom is respectively connected to the positioning cameras 100, 101, the tracking cameras 103, 104 and the teaching client 105. The image splicer 106 is connected to the teaching client 105 and the tracking cameras 103, 104 respectively, and the teaching client 105 of the main classroom passes. The streaming server 11 is connected to the teaching client 125 of the secondary classroom.

In this embodiment, the positioning cameras 100, 101 of the main classroom are used to monitor the movements of the teachers and students in the main classroom, and send the sports information of the teachers and students to the tracking host 102 of the main classroom. The tracking host 102 of the main classroom is configured to send control commands to the tracking cameras 103, 104 of the main classroom and the teaching client 105 of the main classroom. After receiving the control instruction, the teaching client 105 of the main classroom is configured to determine the target video that needs to be output according to the current teaching mode, and send an image processing instruction to the image splicer 106 of the main classroom. The image splicer 106 of the main classroom is used to form a combined video push to the teaching client of the main classroom based on the tracking video information acquired from the tracking cameras 103, 104 of the main classroom and the image processing instructions received from the teaching client 105 of the main classroom. 105. The teaching client 105 of the main classroom is configured to send the currently output audio and video information to the teaching client 125 of the secondary classroom through the streaming server 11. Among them, the teaching mode of the main classroom 105 sets the type of teaching mode, the teaching duration corresponding to each teaching mode, the warning time and the switching sequence, the main classroom The teaching client 105 is configured to provide switching control according to the corresponding teaching duration for the corresponding teaching mode.

In the present embodiment, the secondary classroom system 12 further includes a student positioning camera 121, a student tracking host 122, a student tracking camera 124, and an image splicer 126. The student tracking host 122 connects the student positioning camera 121, the student tracking camera 124, and the teaching client 125, and the image splicer 126 connects the teaching client 125 and the student tracking camera 124. The specific operation process of the system is the same as that described above, and therefore will not be further described herein.

In summary, the method and system for implementing a network synchronization classroom according to a preferred embodiment of the present invention implements network classroom synchronization through assistance communication between the primary classroom and the secondary classroom. In addition, through the teaching client of the main classroom to set the type of teaching mode, the teaching duration corresponding to each teaching mode, the warning time and the switching sequence, the teaching client of the main classroom provides switching control according to the corresponding teaching duration for the corresponding teaching mode. . In this way, the automation and intelligence of the network synchronization classroom is improved, thereby improving the teaching quality of the teacher and improving the classroom experience of the student.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

WO 2015/024301 ^ ^ _^ PCT/CN2013/086815

1. A method for implementing network synchronized classrooms, which is characterized by including the following steps:

The positioning camera in the main classroom monitors the movements of teachers and students in the main classroom, and sends the movement information of teachers and students to the tracking host in the main classroom;

The tracking host in the main classroom sends control instructions to the tracking camera in the main classroom and the teaching client in the main classroom; after receiving the control instructions, the teaching client in the main classroom determines the target that needs to be output according to the current teaching mode. video, and send image processing instructions to the image splicer in the main classroom;

The image splicer of the main classroom forms a combined video and pushes it to the teaching client of the main classroom based on the tracking video information obtained from the tracking camera of the main classroom and the image processing instructions received from the teaching client of the main classroom;

The teaching client of the main classroom sends the currently output audio and video information to the teaching client of the auxiliary classroom through the streaming media server.

2. The method according to claim 1, characterized in that, the type of teaching mode, the teaching duration corresponding to each teaching mode, the warning time and the switching sequence are set through the teaching client of the main classroom. The teaching client provides switching control for the corresponding teaching mode according to the corresponding teaching time.

3. The method according to claim 2, characterized in that, after the teaching client of the main classroom completes the teaching mode type, the teaching duration corresponding to each teaching mode, the warning time and the switching sequence, it starts the timing trigger function, and the timing time reaches When Below is the sound control strategy information for the corresponding auxiliary classroom;

When the teaching client of the main classroom determines that the teaching time of the corresponding teaching mode reaches the warning time, the teaching client of the main classroom displays prompt information.

4. The method according to claim 2, characterized in that different teaching modes are correspondingly set with different sound control strategies, and when the teaching client of the main classroom switches between different teaching modes, the main classroom is adjusted according to the corresponding sound control strategies. The sound control of the classroom also notifies the teaching client of the auxiliary classroom, where the notification message carries the following information: the switching teaching mode information, the sound control strategy information of the auxiliary classroom corresponding to the switched teaching mode;

The teaching client of the auxiliary classroom completes teaching mode switching and sound control strategy adjustment according to the notification message.

5. The method according to claim 2, characterized in that the types of teaching modes include normal teaching mode, audio resource mode, silent resource mode and interactive discussion mode.

6. The method according to claim 5, characterized in that, in the normal teaching mode, the sound control strategy is: in the main classroom, the teaching client of the main classroom calls the microphone sound collection module to collect the microphone sound, and the microphone The audio signal is connected to the input port of the teaching client of the main classroom. In the auxiliary classroom, the teaching client of the auxiliary classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client of the auxiliary classroom; In the sound resource mode, the sound control strategy is: In the main classroom, the teaching client of the main classroom calls the sound card sound collection module and the microphone sound collection module, and outputs the sound card output signal and the microphone input signal of the teaching client of the main classroom Mix, and use the mixed audio signal as the input signal of the sound card input port. In the auxiliary classroom, the teaching client of the auxiliary classroom calls the microphone mute module to perform mute processing. At this time, students in the auxiliary classroom cannot speak;

In the silent resource mode, the sound control strategy is: In the main classroom, the teaching client of the main classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client. In the auxiliary classroom, the auxiliary classroom The teaching client in the classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client;

In the interactive discussion mode, the sound control strategy is: In the main classroom, the teaching client of the main classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client. In the auxiliary classroom, the auxiliary classroom The teaching client in the classroom calls the microphone sound collection module to collect the microphone sound, and the audio signal of the microphone is connected to the input port of the teaching client.

7. The method according to claim 1, wherein the positioning cameras in the main classroom include a teacher positioning camera and a student positioning camera, and the tracking cameras in the main classroom include a teacher tracking camera and a student tracking camera.

8. The method according to claim 1, wherein the control instruction carries movement direction information, movement amplitude information and signal source information; and the image processing instruction carries target video output information.

9 types of network synchronized classroom implementation systems are characterized by including a main classroom system, an auxiliary classroom system and a streaming media server. The main classroom system includes a positioning camera, a tracking host, a tracking camera, a teaching client and an image splicer. The auxiliary classroom system includes a teaching client. The tracking host of the main classroom is connected to the positioning camera, the tracking camera and the teaching client respectively. The image splicer is connected to the teaching client and the tracking camera respectively. The main classroom The teaching client of the classroom connects to the teaching client of the auxiliary classroom through the streaming media server,

The positioning camera in the main classroom is used to monitor the movements of teachers and students in the main classroom, and send the movement information of teachers and students to the tracking host in the main classroom.

The tracking host of the main classroom is used to send control instructions to the tracking camera of the main classroom and the teaching client of the main classroom. After receiving the control instructions, the teaching client of the main classroom is used to determine the needs according to the current teaching mode. output the target video and send image processing instructions to the image splicer in the main classroom,

The image splicer of the main classroom is used to form a combined video and push it to the teaching client of the main classroom based on the tracking video information obtained from the tracking camera of the main classroom and the image processing instructions received from the teaching client of the main classroom. The terminal, the teaching client of the main classroom, is used to send the currently output audio and video information to the teaching client of the auxiliary classroom through the streaming media server. 10. The system according to claim 9, characterized in that the auxiliary classroom system also includes a student positioning camera, a student tracking host, a student tracking camera and an image splicer, and the student tracking host is connected to the student positioning camera respectively. , the student tracking camera and the teaching client, and the image splicer connects the teaching client and the student tracking camera.