CN115767238A

CN115767238A - System and method for remote teaching classroom

Info

Publication number: CN115767238A
Application number: CN202211405575.2A
Authority: CN
Inventors: 赵飞; 赵兴国
Original assignee: Shanghai Sailian Information Technology Co ltd
Current assignee: Shanghai Sailian Information Technology Co ltd
Priority date: 2022-11-10
Filing date: 2022-11-10
Publication date: 2023-03-07

Abstract

The invention provides a system and a method for remote teaching classroom, wherein the system comprises a teacher end, a student end and a server connecting the teacher end and the student end. The teacher end includes POE touch control large-screen all-in-one and POE peripheral hardware including the POE port. POE touch-control large-size screen all-in-one passes through the POE port and connects POE peripheral hardware, supplies power and data transmission to it to the installation is used for remote teaching's application, controls POE peripheral hardware and realizes remote teaching's function. The POE peripheral device comprises a POE camera and a POE audio device and can be used for shooting, inputting audio and video and/or tracking a target. The student end receives and plays the audio and video data packet from the teacher end, records student audio and video, and transmits the audio and video data packet of the student end to the teacher end through the server. And the server transmits the audio and video data packets of the teacher end and the student end to each other. The remote teaching classroom system and the method effectively realize the effects of easy deployment, flexible configuration and low cost of the remote teaching classroom.

Description

System and method for remote teaching classroom

Technical Field

The invention relates to the field of remote teaching classes, in particular to a system and a method for a remote teaching class.

Background

With the change of social large environment caused by factors such as epidemic situation, the remote teaching classroom based on the internet is gradually and widely applied to teaching scenes. In the traditional mode, when only a blackboard or a whiteboard exists in a classroom, external devices such as a camera, a microphone, a sound box and the like need to be erected for remote teaching. If a teacher needs to display the courseware PPT or interact with students in a classroom, a host computer or a hardware terminal special for remote teaching interaction, a large display screen, a projector, a curtain and the like need to be erected. The devices not only need higher purchase cost, but also need independent electric lines for power supply, and data transmission between the devices also needs some data transmission lines, such as VGA data connection lines or HDMI data connection lines and the like needed by connecting a remote teaching interactive special hardware terminal with a large display screen. However, in many waiting classrooms, the number and positions of the electrical sockets are fixed, and the number of the ports of each device is fixed, some expansion plug rows or port expansion docks may need to be purchased during configuration and deployment, and the purchase cost is continuously increased. During wiring, potential safety hazards such as overload current, line short circuit and fire need to be considered due to the fact that various lines are too many, and when safety inspection and supervision are conducted by a safety production supervision authority, classrooms may be stopped and safety rectification and improvement are conducted due to the fact that the lines are deployed and other safety problems. When safety rectification is carried out, the number of lines and the number of devices can be limited, and finally, remote teaching cannot be carried out or the remote teaching presentation effect is poor. Moreover, when the complex wiring mode is used for replacing or increasing equipment, the problem of potential safety hazard needs to be considered, and the circuit planning needs to be carried out again, so that the redeployment is complicated and troublesome, and the configuration is not flexible. In addition, in a traditional mode, when a general touch large-screen all-in-one machine is used in a classroom and a remote teaching is carried out, the touch large-screen all-in-one machine needs to be connected with various external devices, such as a camera, a microphone, an extended screen, a sound box and the like, the external devices need to be connected with a data transmission line and a power line, and the multiple lines also cause difficulty in wiring deployment in the classroom, inflexible configuration and potential safety hazards such as overcurrent, line short circuit and fire. Sometimes, because the number of ports of an existing touch-control large-screen all-in-one machine in a classroom is not enough to meet the number of lines of external equipment, some needed external equipment cannot be used, and therefore remote teaching cannot be implemented or the remote teaching presentation effect is poor. If the docking station is additionally arranged at the port of the touch large-screen all-in-one machine in a classroom, the problems of increased cost, inflexible configuration and the like can be caused.

Therefore, the conventional remote teaching classroom equipment and method in the prior art cannot effectively solve the problems of complex remote teaching classroom deployment, inflexible configuration and high cost.

Disclosure of Invention

In order to solve the problems in the prior art, the invention provides a remote teaching classroom system and a remote teaching classroom method, which effectively achieve the effects of easy deployment, flexible configuration and low cost of a remote teaching classroom.

In a first aspect, the present invention provides a remote teaching classroom system, which is characterized in that the system includes a teacher end, a student end, and a server connecting the teacher end and the student end:

the teacher end includes POE touch-control large-screen all-in-one and POE peripheral hardware, wherein

The POE touch large-screen all-in-one machine comprises a POE port, is used for teaching and/or conference multimedia use and receiving audio and video data packets from the student end, and supplies power and transmits data to a POE peripheral device connected with the POE port through the POE port;

the POE peripheral device comprises a POE camera and a POE audio device;

the POE camera is used for being connected to the POE touch large-screen integrated machine through the POE port, shooting, inputting videos and/or tracking targets; and

the POE audio device is used for connecting to the POE touch large-screen all-in-one machine through the POE port and inputting audio;

an application program for remote teaching is installed in the POE touch large-screen all-in-one machine, and controls the POE camera and the POE audio device to realize the function of remote teaching;

the student end is used for receiving and playing the audio and video data packet from the teacher end, recording the audio and video of students and transmitting the audio and video data packet of the student end to the teacher end through the server;

the server is connected to the teacher end and the student end and used for transmitting the audio and video data packets of the teacher end and the student end to each other.

In a second aspect, the present invention further provides a remote teaching classroom system, which is characterized in that the system includes a teacher end, a student end, and a server connecting the teacher end and the student end:

the teacher end includes touch-control large-screen all-in-one, POE switch and POE peripheral hardware, wherein

The touch large-screen all-in-one machine is used for teaching and/or conference multimedia and receiving audio and video data packets from the student end;

the POE switch comprises a POE port and is used for being connected to the touch large-screen all-in-one machine and carrying out power supply and data transmission on a POE peripheral device connected with the POE port through the POE port;

the POE peripheral device comprises a POE camera and a POE audio device;

the POE camera is used for being connected to the touch large-screen all-in-one machine through the POE port, and shooting, inputting videos and/or tracking targets; and

the POE audio device is used for being connected to the touch large-screen all-in-one machine through the POE port and inputting audio;

an application program for remote teaching is installed in the touch large-screen all-in-one machine and controls the POE camera and the POE audio device to realize the function of remote teaching;

the server is connected to the teacher end and the student end and used for mutually transmitting the audio and video data packets of the teacher end and the student end.

In a third aspect, the invention further provides a remote teaching classroom method for a remote teaching classroom system, which is characterized in that the remote teaching classroom system comprises a teacher end, a student end and a server connecting the teacher end and the student end, the teacher end comprises a POE touch screen all-in-one machine comprising a POE port and a POE peripheral device, the POE peripheral device comprises a POE camera and a POE audio device,

wherein the method comprises:

the POE touch large-screen all-in-one machine is used for teaching and/or meeting and receiving audio and video data packets from the student end, and the POE peripheral device connected with the POE port is powered and data transmission is carried out through the POE port;

connecting the POE camera to the POE touch large-screen integrated machine through the POE port, and shooting, inputting a video and/or tracking a target; and

connecting the POE audio device to the POE touch screen integrated machine through the POE port, and inputting audio;

installing an application program for remote teaching in the POE touch large-screen all-in-one machine to control the POE camera and the POE audio device to realize the function of remote teaching;

receiving and playing audio and video data packets from the teacher end through the student end, recording the audio and video of students, and transmitting the audio and video data packets of the student end to the teacher end through the server;

The system and the method for remote teaching classroom provided by the invention comprise the following steps:

when only a blackboard or a whiteboard is arranged in a classroom and the budget is limited, a user only needs to purchase a POE touch screen all-in-one machine, a POE camera and a POE audio device (such as a POE microphone), the remote teaching classroom can be deployed, and the purchase cost is reduced. When the POE touch screen integrated machine is deployed, the POE touch screen integrated machine is directly connected with the POE camera and the POE audio device through the POE port, and an application program which is used for a remote teaching classroom and can control the POE camera and the POE audio device is installed, so that the deployment is completed. The whole deployment process is efficient and quick, and labor cost, classroom construction cost and other material cost are reduced. Because POE touch-control large-size screen all-in-one can directly carry out power supply and data transmission to POE camera and POE audio frequency device through the POE port of taking oneself, so reduced a large amount of circuits (for example charging wire, the data line of each equipment). Because the circuit is simple, also need not to purchase row of inserting, docking station etc. again, when reducing purchasing cost, more need not to consume time and energy and think planning problems such as wiring. And because the invention only needs to install an application program to realize the audio-video interaction between the remote teaching classroom and the student end, the cost expenditure of purchasing a remote teaching hardware control terminal in the prior art is reduced. The effects of easy deployment, flexible configuration and low cost of the remote teaching classroom are effectively realized.

When a general touch large-screen all-in-one machine is arranged in a classroom, a user only needs to install an application program which is used for a remote teaching classroom and can control a POE camera and a POE audio device on the touch large-screen all-in-one machine and purchase a POE switch, the POE camera and the POE audio device (such as a POE microphone), and then the remote teaching classroom can be deployed. When the deployment, POE switch is connected to touch-control large-screen all-in-one, and POE camera and POE audio device are connected respectively to the POE switch, have just accomplished whole deployment. The remote teaching system has the advantages that a remote teaching hardware terminal, various external power supplies, external data lines, a power strip, a docking station and the like are not required to be purchased, purchasing cost expenditure is reduced, deployment is efficient and rapid, and wiring and other problems are not required to be considered. The effects of easy deployment, flexible configuration and low cost in the remote teaching classroom are effectively realized.

When a user wants to increase, reduce or replace the configuration according to the requirement, the problems of re-arrangement of wiring and routing and the like do not need to spend time and energy, the external equipment is plugged and pulled instantly, namely, the configuration is increased and then replaced, and the configuration is flexible.

In conclusion, the remote teaching classroom system and the remote teaching classroom method effectively achieve the effects of easy deployment, flexible configuration and low cost of the remote teaching classroom.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required to be used in the embodiments or the prior art description will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings may be obtained according to these drawings without inventive labor.

FIG. 1 is a schematic diagram of a remote teaching classroom system 100 provided by an embodiment of the present invention;

FIG. 2 is a schematic diagram of a teacher end 110 according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of another teacher end 110 provided by an embodiment of the invention;

fig. 4 is a schematic view of a video of a recorded on-site picture of a teacher lecture captured by the POE camera 113 according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a teacher portrait video output by post-matting processing according to an embodiment of the present invention;

fig. 6 is a schematic view of a screen content video of the recording POE touch large-screen all-in-one machine 111 and/or touch large-screen all-in-one machine 117 provided by the embodiment of the present invention;

fig. 7 is a schematic diagram of a teacher end 110 total video frame after a synthesis process of a screen content video and a teacher portrait video according to an embodiment of the present invention;

fig. 8 is a schematic diagram of the student terminal 130 playing the audio/video images from the teacher terminal 110 according to the embodiment of the present invention;

FIG. 9 is a diagram illustrating the content of a screen blocked when a teacher gives a lecture according to an embodiment of the present invention;

FIG. 10 is a schematic view of another recorded screen content video provided by an embodiment of the present invention;

FIG. 11 is a schematic diagram of a teacher portrait video output by another post-matting process provided by an embodiment of the invention;

FIG. 12 is a schematic diagram of white regions in a screen content video provided by an embodiment of the invention;

fig. 13 is a schematic diagram of a teacher end 110 total video frame after a teacher portrait video and another screen content video are combined according to an embodiment of the present invention;

fig. 14 is a schematic diagram of another student terminal 130 playing an audio-video picture from the teacher terminal 110 according to an embodiment of the present invention;

fig. 15 is a schematic diagram of time stamping and time correspondence synchronization of audio and video provided by an embodiment of the present invention.

Detailed Description

The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.

Summary of The Invention

As described above, the present invention provides a remote teaching classroom system and method, which can effectively solve the problems of complex deployment, inflexible configuration, and high cost of a remote teaching classroom, and make the remote teaching classroom easy to deploy, flexible to configure, and low in cost.

Exemplary System

The embodiment of the invention provides a remote teaching classroom system.

The system composition and the connection mode provided by the embodiment are provided.

Fig. 1 is a schematic diagram of a remote teaching classroom system 100 according to an embodiment of the present invention.

As shown in fig. 1, the system provided in this embodiment includes: a teacher end 110, a student end 130, and a server 120 connecting the teacher end 110 and the student end 130.

The usage and connection relationship among the teacher end 110, the student end 130 and the server 120 are as follows:

(1) The purpose of the server 120 is: the server 120 is connected to the teacher end and the student end, and is configured to transmit the audio and video data packets of the teacher end 110 and the student end 130 to each other.

(2) Use of the student end 130: the student terminal 130 is configured to receive and play the audio and video data packet from the teacher terminal 110, record audio and video of a student, and transmit the audio and video data packet of the student terminal 130 to the teacher terminal 110 through the server 120.

(3) The purpose of the teacher terminal 110 is: the teacher end 110 is configured to record, process and output audio and video data packets of the teacher end 110, transmit the audio and video data packets of the teacher end 110 to the student end 130 through the server 120, and receive and play the audio and video data packets from the student end 130.

For example, teacher a is a math teacher hiring outside a school, but for some reasons, can only remotely attend class B students at school. Teacher a turns on the teacher's end 110 device in its own work room and connects to the server 120 through the network. The class B students turn on the student side 130 devices (e.g., display, speakers, cameras, etc.) within the class, also connected to the server 120 over the network. After the class starts, the teacher end 110 device records the audio and video content of the teacher a, performs real-time audio and video processing, synthesizes the final audio and video data packet of the teacher a, and sends the audio and video data packet to the server 120 in real time, and the server 120 forwards the audio and video data packet of the teacher a to the student end 130 device in class B for real-time playing, so that students in class B can remotely watch and learn the teaching content of the teacher a. Meanwhile, the student end 130 device in class B synchronously records the audio and video (such as the real-time dynamic audio and video content of students asking questions, interacting with teachers, and the like) of the students in class B, and sends the audio and video content to the server 120 in real time, and the server 120 forwards the audio and video data packets to the teacher end 110 device of the teacher a after receiving the audio and video data packets of the students in class B. The teacher A can play the live audio and video of the class B students by using the mobile phone or the expansion screen and the audio box, and can solve and explain the knowledge points according to the interactive contents of the students displayed in the played audio and video so as to complete remote teaching.

The present embodiment is not limited to other connection manners of the teacher end 110, the student end 130, and the server 120 connecting the teacher end 110 and the student end 130 in the system provided by the present embodiment. For example, only the student terminal 130 is connected to the server 120 through the network, and the teacher terminal 110 may be directly physically connected to the server 120 to directly perform transmission of audio and video data packets of the teacher terminal 110, and the like.

The mode of receiving and playing the audio and video data packets of the teacher end 110 by the student end 130, the mode of recording the audio and video of the student by the student end 130, and the mode of transmitting the audio and video data packets of the student to the server 120 by the student end 130 are not limited. For example, 25 students in a class receive and play the audios and videos of the teacher end 110 through the display screen and the sound box in one classroom simultaneously, record the audios and videos of the 25 students through the camera and the microphone array of the camera, and directly transmit the audios and videos to the server 120 in real time. For another example, a student uses a mobile phone to play the audio and video of the teacher end 110, and directly records the audio and video through a camera and a microphone of the mobile phone, and directly transmits the audio and video to the server 120 in real time.

And (ii) the software and hardware configuration of the teacher end 110 and its uses and advantages.

The software and hardware configuration of the teacher end 110 is divided into a hardware configuration and a software configuration. The hardware configuration comprises POE equipment and/or POE port-free equipment, and the software configuration comprises an application program for remote teaching.

1. Teacher end 110 hardware configuration: POE equipment and/or equipment without POE ports.

Fig. 2 is a schematic diagram of a teacher terminal 110 according to an embodiment of the present invention.

Fig. 3 is a schematic diagram of another teacher terminal 110 according to an embodiment of the present invention.

(1) The composition of the POE device in the teacher end 110, and the adoption of the POE device by the teacher end 110 for hardware configuration have the advantages of easy deployment, flexible configuration and low cost in the remote teaching classroom.

As shown in fig. 2, the teacher end 110 includes a POE touch screen all-in-one machine 111 and a POE peripheral device; the POE touch screen all-in-one machine 111 comprises a POE port, and is used for teaching and/or conference multimedia use and receiving audio and video data packets from the student end 130, and the POE peripheral device connected with the POE port is powered and data transmission is carried out through the POE port; the POE peripheral device comprises a POE camera 113 and a POE audio device 112; the POE camera 113 is configured to be connected to the POE touch screen all-in-one machine 111 through the POE port, and perform shooting, video input, and/or target tracking; the POE audio device 112 is configured to connect to the POE touch-control large-screen all-in-one machine 111 through the POE port, and input audio; install the application that is used for the remote teaching in the big screen all-in-one of POE touch-control, its control POE camera with the function that POE audio frequency device realized the remote teaching.

As shown in fig. 3, the teacher end 110 includes a touch-control large-screen all-in-one machine 117, a POE switch 116, and a POE peripheral device; the touch control large-screen all-in-one machine 117 is used for teaching and/or conference multimedia use and receiving audio and video data packets from the student terminal 130; the POE switch 116 includes a POE port, is used for connecting to the touch-control large-screen all-in-one machine 117, and performs power supply and data transmission on a POE peripheral device connected to the POE port through the POE port; the POE peripheral device comprises a POE camera 113 and a POE audio device 112; the POE camera 113 is configured to be connected to the touch-control large-screen all-in-one machine 117 through the POE port, and perform shooting, video input, and/or target tracking; the POE audio device 112 is configured to connect to the touch-control large-screen all-in-one machine 117 through the POE port, and input audio; an application program for remote teaching is installed in the touch large-screen all-in-one machine and controls the POE camera and the POE audio device to achieve the function of remote teaching.

The POE is an abbreviation of Power Over Ethernet, and refers to a technology that, without any change to an existing Ethernet cat.5 wiring infrastructure, can provide dc Power for some IP-based terminals (such as an IP telephone, a wireless local area network access point AP, a network camera, and the like) while transmitting data signals. Thus, POE is also referred to as local area network based power system or active ethernet, sometimes also referred to simply as power over ethernet. Power over ethernet, also known as POE power, is a technology that can transmit power and data to devices over twisted pair wires in an ethernet network. The advantage of the ethernet power supply technology is that small network devices such as IP phones, WLAN access points, and network cameras can directly obtain power from ethernet lines (idle 2 pairs of 4 twisted pairs for transmission), and no power line needs to be laid separately, so as to simplify system wiring and reduce the construction cost of network infrastructure.

A local area network refers to a computer communication network formed by connecting devices (e.g., computers, printers, application software, databases, routers, switches, etc.) within a local geographic area (typically within several kilometers). The local area network can implement file management, printer sharing, scanner functionality, internal communication, and application software sharing.

The Ethernet belongs to one of local area networks. The Ethernet has the main advantages of good compatibility, wide technical support, easy connection with the Internet, low cost, high communication speed and great sustainable development potential.

In this embodiment, the POE touch screen all-in-one machine 111, the POE camera 113, the POE audio device 112, and the POE switch 116 are POE devices powered by ethernet.

In this embodiment, the POE device is used as a hardware configuration support of the teacher end 110, which has the following advantages:

(1) the deployment is easy.

Specifically, in an embodiment, the POE touch screen all-in-one machine 111 only needs to use a network cable through the POE port, so as to connect the POE camera 113, and directly supply power and transmit data to the POE camera 113 through the network cable. In another embodiment, the touch-control large-screen all-in-one machine 117 can be connected to the POE switch 116 through only one network cable through its network port, the POE switch 116 can be connected to the POE audio device 112 through only one network cable through the POE port, and the POE audio device 112 is directly powered and data transmitted through the network cable. In the conventional technology, a camera or an audio device needs an external power supply and can usually use a USB interface to realize power supply and data transmission, but due to the limited length of a USB cable, the position of each device needs to be studied in many aspects when the device is deployed in a field, for example, the camera may need to be installed right opposite to a teacher and has a distance of 3-5 meters from the teacher to completely shoot the course of the teacher lecture and the large screen content displayed. When the host has too many external devices and the USB cable is not long enough, the problem of difficult wiring is faced. If the peripheral devices are connected with the POE touch screen all-in-one machine 111 in a wireless mode such as bluetooth or wifi, the peripheral devices need to be additionally powered by batteries or power supplies, the batteries need to be charged or replaced frequently, and potential safety hazards may be caused by limited sockets or connection of wiring boards. Therefore, the conventional power supply method for the peripheral device has various defects and cannot meet the requirement of flexible deployment.

In this embodiment, because each device can be connected together to complete power supply and data transmission only through a network cable, and because the characteristics of the network cable can be customized according to the user's needs, thereby enabling the user to place each device in a customized manner according to the needs of the user when the user is deployed in a field. For example, POE camera 113 can place the top of the face-to-face wall of POE touch-control large-screen all-in-one 111 in the classroom, then insert a long net twine of walking along the wall from the POE port of POE touch-control large-screen all-in-one 111, alright connect POE camera 113 to supply power and data transmission to it. The whole deployment process is convenient and quick, and a plurality of problems in the conventional technology are practically solved.

(2) The configuration is flexible.

Specifically, in an embodiment, when a user needs to increase, decrease or replace the configuration, the user only needs to pull the network cable from the device to be changed and change the network cable into another device to be plugged, i.e., the network cable is increased or decreased, i.e., the network cable is replaced, so that the reconfiguration can be completed. The problems of re-arrangement of wiring and routing and the like are not needed to be solved by spending time and energy, and the configuration is flexible.

For example, when a user wants to upgrade a POE camera a that only has fixed shooting to a POE camera B that has a function of tracking a portrait, only the network cable inserted into the POE port of the original POE camera a needs to be pulled out and reinserted into the POE camera B, so that the configured upgrade can be completed.

(3) The cost is low.

In the implementation, when the user purchases, deploys, manages and maintains the remote teaching classroom, the overall cost can be controlled to be relatively low.

Specifically, in an embodiment, when there has been touch-control large-screen all-in-one in the user classroom, use general net gape through a net twine alright connect POE switch 116, so the user need not to purchase teleeducation hardware terminal and relevant equipment again, only need install one on touch-control large-screen all-in-one and be used for the teleeducation classroom and can control the application of POE camera and POE audio device, purchase POE switch 116 again, POE camera 113, POE audio device 112 (for example POE microphone) and net twine, just can carry out the deployment in teleeducation classroom. When the deployment is performed, the touch-control large-screen integrated machine 117 is connected with the POE switch 116 through one network cable, and the POE switch 116 is respectively connected with the POE camera 113 and the POE audio device 112 through the network cables, so that the whole deployment is completed. The user does not need to replace the existing touch large-screen integrated machine, purchase a remote teaching hardware terminal and related equipment thereof, purchase various external power supplies, external data lines, plug rows, docking stations and the like, and purchase cost is greatly reduced. When reducing purchasing cost expenditure, it is high-efficient swift to deploy, need not to consider the wiring scheduling problem, further reduces cost of labor and later maintenance cost. And because POE switch 116, POE camera 113 and POE audio device 112 all relate to ethernet correlation technique, the compatibility is strong, and equipment is convenient for maintain or the maintenance, can not be replaced by other similar products of function in longer time, has reduced the purchase cost that the user constantly updated to equipment.

Specifically, in another embodiment, when the user site does not have any device such as a touch screen, only the POE touch screen all-in-one machine 111, the POE camera 113, the POE audio device 112, and the network cable need to be purchased, and then the remote teaching classroom deployment can be performed. When the deployment is performed, the POE touch screen all-in-one machine 111 is directly connected with the POE camera 113 and the POE audio device 112 through the own POE port by using a network cable, and then an application program which is used for the remote teaching classroom and can control the POE camera and the POE audio device is installed, so that the deployment is completed. The whole deployment process is efficient and quick, and the labor cost, the site construction cost and other material costs are reduced. Because POE touch-control large-size screen all-in-one 111 can directly supply power and data transmission to POE camera and POE audio frequency device through the POE port of taking oneself, so reduced a large amount of circuits (for example charging wire, the data line of each equipment). Because the circuit is simple, also need not to purchase row of inserting, docking station etc. again, when reducing purchasing cost, more need not to consume time and energy and think planning problems such as wiring. And because the invention only needs to install an application program to realize the audio-video interaction between the remote teaching classroom and the student end, the cost expenditure of purchasing a remote teaching hardware control terminal in the prior art is reduced. The effects of easy deployment, flexible configuration and low cost of the remote teaching classroom are effectively realized. In the subsequent use process, because the Ethernet has high communication rate, easy connection with the Internet and good compatibility, the transmitted audio and video pictures are continuous without blockage. In the subsequent maintenance process, because the POE equipment belongs to the Ethernet power supply equipment, the POE equipment has the advantages of good compatibility, wide technical support and the like, can not be replaced by other products with similar functions in a longer time, is convenient for a user to manage and maintain for a long time, and simultaneously reduces the purchase cost of the user for continuously updating and updating the equipment.

In summary, the teacher end 110 of the system of this embodiment performs hardware configuration by using POE devices, which has the advantages of easy deployment in a remote teaching classroom, flexible configuration, and low cost.

(2) And the teacher end 110 is specifically connected with the POE device and/or the device without the POE port.

The POE equipment comprises equipment with a built-in POE power supply module and/or equipment with a built-in POE power receiving module. The device with the built-in POE power supply module and/or the device with the built-in POE powered module are/is provided with POE ports, and the POE ports and the device with the built-in POE powered module are connected with each other through a network cable (for example, a twisted pair) through the POE ports. The equipment with the built-in POE powered module does not need to be connected with other charging power supplies. The equipment with the built-in POE power supply module can directly supply power and transmit data to the equipment with the built-in POE power receiving module connected through the network cable.

Specifically, in this embodiment, POE touch-control large-screen all-in-one 111 just belongs to the equipment of built-in POE power module, has the POE port on the POE power module, POE touch-control large-screen all-in-one 111 supplies power and data transmission through the POE port to the POE peripheral device who is connected with this POE port.

Specifically, in this embodiment, POE peripheral hardware just belongs to the equipment that built-in POE received the electric module, for example, POE camera 113 and POE audio device 112 shown in fig. 2, POE received the electric module has all been built-in, it is very convenient when wiring, need not external power supply, need not the forceful electric power construction, only need a net twine (for example, the paired line), alright be connected with built-in POE power module equipment (for example, the big screen all-in-one of POE touch-control 111 that fig. 2 shows, the POE switch 116 shown in fig. 3), directly obtain electric power from built-in POE power module equipment, and carry out data transmission with built-in POE power module equipment.

For example, as shown in fig. 2, when the teacher C uses the teacher end 110, the POE touch screen all-in-one machine 111 is only plugged into a power line in a classroom, and then the POE camera 113 and the POE audio device 112 are connected by using a twisted pair through the POE port. After connection, the teacher a opens the POE touch screen all-in-one machine 111, the POE camera 113 and the POE audio device 112 respectively. At this time, the POE touch screen all-in-one machine 111 directly performs power supply and data transmission on the POE camera 113 and the POE audio device 112 through the twisted pair into which the POE port is inserted. The teacher C does not need to additionally configure power lines for the POE cameras 113 and the POE audio devices 112 to supply power.

In addition, the POE port of the POE touch screen all-in-one machine 111 of the teacher end 110 can automatically adjust and match MDI and MDI-X ports according to the type of network cables inserted into the port.

Where network wires may be used to communicate information within the network. The commonly used network wires are mainly twisted pairs. Twisted pair is a data transmission line composed of many pairs of wires, and its feature is low price, so it is widely used.

In this embodiment, the used network cable is a twisted pair, so that the purchase cost of the user is reduced, and meanwhile, the automatic adjustment and combination are performed according to the twisted pair and the POE port, so that the user can deploy the equipment more conveniently and quickly.

The twisted pair is generally composed of 8 wires, and is divided into a straight-line twisted pair and a cross-line twisted pair according to different wire orders at two ends. The POE port types of POE devices vary according to manufacturers and/or product designs. POE port types are mainly classified into two types: MDI ports and MDI-X ports. The connection between the MDI port and the MDI-X port requires the use of a straight type of twisted pair, while the connection between the same type of port requires the use of a cross type of twisted pair. In order to facilitate the POE devices designed by different manufacturers and/or different products to be connected together more conveniently and quickly, the POE port of the POE device in this embodiment may automatically adjust and match the MDI port and the MDI-X port according to the type of the cable inserted into the port.

For example, the network cable purchased by the teacher D is a cross-line twisted pair, the POE port type of the purchased POE audio device 112 is an MDI port, and the POE port type of the purchased POE camera 113 is an MDI-X port. When the teacher D connects the POE audio device 112 and the POE port a of the POE touch-screen all-in-one machine 111 together using the cross-line twisted pair, the POE port a of the POE touch-screen all-in-one machine 111 is automatically adjusted to become the MDI port type. When the teacher D connects the POE camera 113 and the POE port B of the POE touch screen all-in-one machine 111 together using the cross-line twisted pair, the POE port B of the POE touch screen all-in-one machine 111 is automatically adjusted to become the MDI-X port type.

For another example, the network cable purchased by the teacher E is a direct-connection twisted pair, the POE port type of the purchased POE audio device 112 is an MDI port, and the POE port type of the purchased POE camera 113 is an MDI-X port. When the teacher E connects the POE audio device 112 and the POE port C of the POE touch-screen all-in-one machine 111 together using the twisted pair of the direct-wired type, the POE port C of the POE touch-screen all-in-one machine 111 is automatically adjusted to become the MDI-X port type. When the teacher E uses the twisted pair of the direct connection type to connect the POE camera 113 and the POE port D of the POE touch screen all-in-one machine 111 together, the POE port D of the POE touch screen all-in-one machine 111 is automatically adjusted to become the MDI port type.

When a user needs to use a device without a POE port, (for example, an expansion screen, a sound box, or the like), the device without the POE port is connected to the POE touch-control large-screen all-in-one device 111 and/or the touch-control large-screen all-in-one device 117 using a data line and/or a network cable, so as to transmit data. If the equipment without the POE port needs electricity, a battery or a power line can be used for supplying power.

Other connection modes of the hardware configuration in the teacher end 110 are not limited herein. For example, the devices may be connected using data lines to transmit data, etc.

(3) Specific use of POE devices and/or POE port-less devices in the teacher end 110.

The hardware of the teacher end 110 includes POE devices and/or POE-port-less devices. The functional uses and advantages may vary from manufacturer to manufacturer and/or product design to product design.

In one embodiment, the POE touch-control large-screen all-in-one machine 111 is used for teaching and/or conference multimedia use and receiving audio and video data packets from a student end, and performs power supply and data transmission on a POE peripheral device connected with a POE port through the POE port; the POE peripheral device comprises a POE camera and a POE audio device; the POE camera is used for being connected to the POE touch large-screen all-in-one machine through the POE port, shooting, inputting videos and/or tracking targets, shooting a teacher teaching site picture video, and transmitting the teacher teaching site picture video to the POE touch large-screen all-in-one machine through the POE port; the POE audio device is used for being connected to the POE touch screen all-in-one machine through the POE port, inputting audio, inputting teaching site audio of a teacher, and transmitting the teaching site audio of the teacher to the POE touch screen all-in-one machine 111 through the POE port; install the application that is used for remote teaching in the big screen all-in-one of POE touch-control, its function that control POE camera and POE audio device realized remote teaching. The POE touch large-screen all-in-one machine 111 and/or the touch large-screen all-in-one machine 117 at the teacher end further comprises a non-POE port, and the non-POE port is used for connecting a peripheral device without the POE port; the peripheral device without the POE port comprises an expansion screen and/or a sound box; the extension screen and/or the sound box and the built-in sound box and/or the touch large screen of the POE touch large-screen all-in-one machine 111 are used for playing student audio and video data packets received by the POE touch large-screen all-in-one machine 111.

Specifically, as shown in fig. 2, in a remote teaching classroom, a teacher stands before the POE touch screen all-in-one machine 111 to give a lecture, and materials related to the course (for example, course materials such as courseware, pictures, audio, and video) are played on the touch screen of the POE touch screen all-in-one machine 111. The related audio can be played by using a built-in sound box 1111 of the POE touch large-screen all-in-one machine 111, and can also be played by using a non-POE port of the POE touch large-screen all-in-one machine 111 to connect with a peripheral sound box 115. The non-POE port of the POE touch large-screen all-in-one machine 111 can also be connected with external devices such as the expansion screen 114, the expansion screen 114 and/or the sound box 115 and the built-in sound box 1111 of the POE touch large-screen all-in-one machine 111 and/or the touch large-screen can be used for playing audio and video data packets of the students received by the POE touch large-screen all-in-one machine 111, so that a teacher can directly view the audios and videos of the students and course interaction is carried out. POE audio device 112 (for example, POE microphone) is connected to the POE port of POE touch-control large-screen all-in-one 111, when providing power to POE audio device 112, POE audio device 112 is with the audio input of the on-the-spot lecture of teacher in POE touch-control large-screen all-in-one 111, forms audio data. POE camera 113 is still connected to POE touch-control large-screen all-in-one 111's POE port, when carrying out the power supply to POE camera 113, POE camera 113 forms video data in the POE touch-control large-screen all-in-one 111 with the video picture input of the on-the-spot lecture of teacher. Install the application that is used for long-range teaching on POE touch-control large-screen all-in-one 111, it can control POE camera 113 and POE audio device 112 to can control POE touch-control large-screen all-in-one 111 and record the screen, clear screen audio and video data on the touch-control large-screen when exporting the teacher and lecturing. The application program for remote teaching synthesizes all audio and video data to form an audio and video data packet at the final 110 of the teacher end, and the audio and video data packet is sent to the server 120 through the network and finally forwarded to the student end 130 by the server 120 for playing.

In another embodiment, as shown in fig. 3, when the teacher has the touch-screen all-in-one machine 117, the POE switch 116 with the POE port is used to connect to the touch-screen all-in-one machine 117, and the POE peripheral device connected to the POE port is powered and data transmitted through the POE port.

Specifically, a network cable is used to connect the non-POE port of the touch-control large-screen all-in-one machine 117 with the non-POE port of the POE switch 116. Then, a network cable is used to connect the POE port of the POE switch 116 to the POE port of the POE audio device 112. In addition, a network cable is used to connect the POE port of the POE switch 116 with the POE port of the POE camera 113. POE switch 116 directly supplies power and carry out data transmission to POE audio device 112 and POE camera 113 through the net twine to transmit audio data and video data that POE audio device 112 and POE camera 113 transmitted to touch-control big screen all-in-one machine 117 through the net twine. The touch large-screen all-in-one machine 117 is provided with an application program for remote teaching, can control the POE camera 113 and the POE audio device 112, can control the touch large-screen all-in-one machine 117 to record a screen, and outputs clear screen audio and video data on a touch large screen during teacher lecture. The application program for remote teaching synthesizes all audio and video data to form an audio and video data packet at the final 110 of the teacher end, and the audio and video data packet is sent to the server 120 through the network and finally forwarded to the student end 130 by the server 120 for playing.

In addition, POE touch-control large-screen all-in-one 111 and/or POE switch 116 have intelligent power supply, power-off protection function. The method comprises the steps of intelligently supplying power to a POE peripheral device connected with a POE port, and automatically identifying the POE peripheral device to supply power; when the POE port is connected with the peripheral device without the POE port, the power supply is automatically cut off; when the POE port is connected with the POE peripheral device and the power requirement of the POE peripheral device exceeds the rated output power of the POE port, the power supply is automatically cut off.

The other functions and purposes of the hardware configuration of the teacher end 110 are not limited herein. For example, the POE camera has a portrait tracking function, and the camera performs tracking shooting following the portrait of the teacher, and the like.

2. Teacher end 110 software configuration: application program for distance teaching.

The POE touch large-screen all-in-one machine 111 and/or the touch large-screen all-in-one machine 117 are provided with application programs for remote teaching, and the application programs and the submodules thereof comprise:

(1) And controlling the POE camera 113 and the POE audio device 112 to realize the function of remote teaching.

Specifically, after the application program for remote teaching is opened, whether power is supplied to the POE camera 113 and/or the POE audio device 112 can be set, whether data transmission can be performed by the POE camera 113 and/or the POE audio device 112 can be set, and the data storage position of data transmission and the like are set.

For example, after the POE touch large-screen all-in-one machine 111 is connected with the POE camera 113, an application program for remote teaching is opened, and the video data storage path of the POE camera 113 is selected to be under the D: \ YCJX \ video directory. After the recording of the POE camera 113 is completed, opening the POE touch screen all-in-one 111 folder D \ YCJX \ video, and finding the recorded original video material.

(2) And carrying out timestamp marking on the teacher teaching site audio and the teacher teaching site picture video transmitted to the POE touch large-screen all-in-one machine 111 and/or the touch large-screen all-in-one machine 117 in real time.

Specifically, in order to synthesize an audio/video data packet which can be finally provided for students to clearly view images of teachers and contents of courseware images of the teachers in the same screen and synchronously play sound at the same time in a later stage, time stamping needs to be performed on audio data and/or video data in real time. The application program for remote teaching time stamps audio data transmitted by the POE audio device 112 to the POE touch-screen all-in-one 111 and/or the touch-screen all-in-one 117. The application program for remote teaching transmits the POE camera 113 to the POE touch large-screen all-in-one machine 111 and/or the video data on the touch large-screen all-in-one machine 117 for timestamp marking. Subsequently, the application program for distance teaching may compare, synchronize, and process the audio data and/or the video data with the time stamp according to the time stamp.

For example, as shown in fig. 15, audio data are marked with time stamps T1, T2, T3, T4, T5, T6 \8230, video data recorded at the same time are also marked with time stamps T1, T2, T3, T4, T5, T6 \8230, and \8230, when audio/video synthesis is performed, the audio data T1 is synchronized with the video data T1, the audio data T2 is synchronized with the video data T2, the audio data T3 is synchronized with the video data T3, the audio data T4 is synchronized with the video data T4, the audio data T5 is synchronized with the video data T5, the audio data T6 is synchronized with the video data T6 \8230, and finally the synchronized audio data and the video data are synthesized together to output an audio/video data packet.

(3) And performing audio and video recording and real-time timestamp marking on the screen content of the POE touch large-screen all-in-one machine 111 and/or the touch large-screen all-in-one machine 117, and recording screen content audio and screen content video (as shown in fig. 6).

Specifically, the application program for remote teaching is used for directly carrying out audio and video recording and real-time timestamp marking on the screen content of the POE touch large-screen all-in-one machine 111 and/or the touch large-screen all-in-one machine 117, and recording screen content audio and screen content video (as shown in fig. 6), so that the problems that when the screen content of the POE touch large-screen all-in-one machine and/or the touch large-screen all-in-one machine 117 is directly recorded by using a camera from a distance, the screen content recorded by the camera has shadows, light reflection, shielding, unclear and the like due to shielding of on-site light, people and objects and the like can be solved, and finally, the picture presented by the multimedia content of the teacher lecture is clearer; meanwhile, when noise exists on site, only the sound inside the POE touch large-screen all-in-one machine 111 and/or the touch large-screen all-in-one machine 117 is recorded, so that the audio presented by the multimedia content of the teacher lecture can be clearer. And the application program for remote teaching carries out real-time timestamp marking on the recorded screen content audio and the screen content video, and is favorable for synchronous synthesis of later audio and video processing.

For example, when screen content audio is recorded, an application program for remote teaching synchronously marks the screen content audio with timestamps T1, T2, T3, T4, T5 \8230;, audio data recorded and transmitted by the POE audio device 112 to the POE touch screen all-in-one machine 111 at the same time is also marked with timestamps T1, T2, T3, T4, T5 \8230;. When the total audio data are synthesized, the timestamps are compared, the POE audio device 112 audio frequency T1 corresponding to the screen content audio frequency T1 is synchronized, the POE audio device 112 audio frequency T2 corresponding to the screen content audio frequency T2 is synchronized, the POE audio device 112 audio frequency T3 corresponding to the screen content audio frequency T3 is synchronized, the POE audio device 112 audio frequency T4 corresponding to the screen content audio frequency T4 is synchronized, the POE audio device 112 audio frequency T5 corresponding to the screen content audio frequency T5 is synchronized \8230, 8230, the screen content audio frequency and the POE audio device 112 audio frequency which are synchronously completed are synthesized together, and audio and video data packets are output.

(4) Processing and compositing the video, comprising: (1) a module for matting the teacher portrait in the teacher lecture scene picture video, processing and outputting the teacher portrait video; (2) and a module for superposing and synthesizing the teacher portrait video at the corresponding position in the screen content video according to the time stamp, the screen position of the POE touch large-screen all-in-one machine 111 and/or the touch large-screen all-in-one machine 117 in the teacher lecture site picture video and the position of the teacher portrait, simultaneously intercepting the teacher portrait video picture beyond the screen range, and finally synthesizing and outputting the teacher-side total video combining the screen content video and the teacher portrait video.

Specifically, in one embodiment, in order to synthesize and output a video frame that is clear and contains a teacher portrait and a teacher teaching multimedia screen content, the video is processed and synthesized, and the method specifically includes the following steps:

(1) the internal submodule of the application program for remote teaching carries out image matting processing on the teacher portrait in the recorded teacher lecture site picture video (shown in fig. 4) shot by the POE camera 113, synchronously marks a timestamp marked on the teacher lecture site picture video, and simultaneously marks a corresponding relation between the screen position of the POE touch large-screen all-in-one machine 111 and/or the touch large-screen all-in-one machine 117 and the teacher portrait position in the teacher lecture site picture video, and processes and outputs the teacher portrait video (shown in fig. 5) after the timestamp and the position relation mark are completed.

(2) The internal submodule of the application for distance learning time-synchronizes the teacher portrait video (as shown in fig. 5) and the recorded time-stamped screen content video (as shown in fig. 6) according to the stamped time-stamps (e.g., time-stamps T1, T2, T3, T4, T5 \8230;). After the time synchronization corresponds, the teacher portrait video is superimposed and synthesized at the corresponding position in the screen content video according to the corresponding relationship between the marked screen position and the teacher portrait position, and the teacher portrait video picture exceeding the screen range is captured at the same time, so as to finally synthesize a teacher end 110 total video picture (shown in fig. 7) in which the output screen content video and the teacher portrait video are combined.

After the total video frames of the teacher end 110 are transmitted to the student end 130 through the server 120, the display effect is as shown in fig. 8.

The processing of the video is not limited to multiple passes. For example, the teacher portrait is subjected to beautifying processing, new background addition, transparency, portrait changing, cartoon image splicing and the like.

(5) Processing and synthesizing the video, further comprising: (1) a module for matting the teacher portrait in the teacher lecture scene picture video, processing and outputting the teacher portrait video; (2) and the module is used for scaling the teacher portrait video in an equal proportion according to the timestamp and the size and the position of the blank area of the screen content video picture, superposing and synthesizing the teacher portrait video at the blank area of the screen content video picture, and finally synthesizing and outputting a teacher-side total video formed by combining the screen content video and the teacher portrait video.

Specifically, in another embodiment, as shown in fig. 9, when a teacher blocks a screen during a lecture, in order to synthesize and output a video frame that is clear and contains a portrait of the teacher and a multimedia screen content of the lecture of the teacher, processing and synthesizing a video includes the following specific steps:

(1) the internal sub-module of the application program for distance teaching performs matting processing on the teacher portrait in the teacher teaching site picture video (shown in fig. 9) recorded by the POE camera 113, synchronously marks a time stamp marked by the teacher teaching site picture video on the teacher portrait video, and processes and outputs the teacher portrait video (shown in fig. 11).

(2) The internal submodule of the application for distance learning time-synchronizes the teacher portrait video (as shown in fig. 11) and the recorded time-stamped screen content video (as shown in fig. 10) according to the stamped time-stamps (e.g., time-stamps T1, T2, T3, T4, T5 \8230;). After time synchronization is performed, a blank area in the screen content video is detected (as shown in fig. 12), appropriate scaling-down (or partial clipping) is performed on the teacher portrait video according to the size and the position of the blank area, the teacher portrait is superimposed and combined at the blank area of the screen content video, and finally, a teacher end 110 total video frame (as shown in fig. 13) in which the screen content video and the teacher portrait video are combined is synthesized and output.

After the total video frames of the teacher end 110 are transmitted to the student end 130 through the server 120, the display effect is as shown in fig. 14.

Above-mentioned a processing of inside submodule piece for remote teaching's application for the teacher is more true, the screen content of show is more clear comprehensive, teacher portrait ratio, the position can be adjusted, can not shelter from the course content on the screen, make the student can see complete course content, and can also strengthen the picture sense in remote teaching classroom, the interactivity between reinforcing student and the teacher, make the student can further deepen the understanding to the course content according to the suggestion such as mr's expression, action.

The processing of the video is not limited to a plurality of times. For example, the teacher portrait is subjected to beautifying processing, new background addition, transparency, portrait changing, cartoon image splicing and the like. For example, when the teaching object of the teacher is a pupil, the portrait of the teacher and the cartoon image such as a jingle cat can be subjected to two-dimensional synthesis to show the image of the cartoon teacher.

(6) Processing and synthesizing the audio, comprising: (1) a module for performing noise reduction processing on the teacher lecture site audio; (2) and a module for performing audio synthesis on the audio of the teacher lecture site and the screen content audio after the noise reduction according to the timestamp, and finally synthesizing and outputting the total audio of the teacher end 110.

(1) Specifically, because the live audio frequency of teacher's lecture of recording probably has the noise, for example wind sound outside the window, the air conditioner sound in the classroom etc. for the audio frequency effect that the messenger transmitted student end broadcast is more clear, the inside submodule piece that is used for the application of remote teaching carries out noise reduction processing and timestamp synchronization mark to the audio data of recording through POE audio frequency device 112, the live audio frequency of teacher's lecture of the mark timestamp of output relative clear noiseless.

For example, the teacher H may enter live noise audio data using an application for distance teaching before class and set noise reduction parameters. When lecturing, the application program for remote teaching can be according to the noise data and the parameter that this teacher H set up to the audio data that record through POE audio device 112 carry out noise reduction, when noise reduction, synchronous to the audio frequency of making an uproar mark correspondence before not making an uproar time stamp, the teacher H lecture live audio frequency of the mark time stamp of output relatively clear noiseless.

(2) Specifically, the application program for remote teaching adjusts the volume of the relatively clear and noiseless teacher lecture live audio subjected to noise reduction processing, and synchronizes the time stamp with the recorded screen content audio. After time synchronization, the audio tracks of the two are synthesized into the same audio track, and the total audio of the teacher end 110 is synthesized and output.

After the total audio of the teacher end 110 is transmitted to the student end 130 through the server 120, the audio is relatively clear and noiseless.

The audio is not limited to being processed multiple times. For example, the adjustment processing is performed on the pitch, loudness, and the like of the audio.

(7) And the audio/video processing module is configured to process the teacher end 110 total video and/or the teacher end 110 total audio according to the timestamp, output the teacher end 110 audio/video data packet, and transmit the audio/video data packet to the server 120.

Specifically, as shown in fig. 15, an application program for remote teaching synchronizes total videos of teacher end 110 and/or timestamps T1, T2, T3, T4, T5, and T6 \8230oftotal audio marks of teacher end 110, performs time comparison, synchronizes total videos T1 of teacher end 110 with total audio T1 of teacher end 110, synchronizes total videos T2 of teacher end 110 with total audio T2 of teacher end 110, synchronizes total videos T3 of teacher end 110 with total audio T3 of teacher end 110, synchronizes total videos T4 of teacher end 110 with total audio T4 of teacher end 110, synchronizes total videos T5 of teacher end 110 with total audio T5 of teacher end 110, synchronizes total videos T6 of teacher end 110 with total audio T6 of teacher end 110, and finally synthesizes total videos of teacher end 110 and total videos of teacher end 8230together and outputs a total audio and video data package of teacher end 110.

The application for distance teaching sends the general teacher's 110 audio-video data packets to the server 120. After receiving the audio/video data packet of the teacher terminal 110, the server 120 forwards the audio/video data packet to the student terminal 130 for playing, so as to give lessons in the teacher remote teaching class.

The manner of synthesizing and/or transmitting the audio of the instructor end 110 and/or the video of the instructor end 110 is not limited herein. For example, the teacher end 110 may process the audio, may perform filter processing on the video, and so on when synthesizing the total audio/video data packet. For another example, the audio/video data packet of the teacher end 110 may be directly transmitted to the server 120 through the data line.

Exemplary method

Correspondingly, the embodiment of the invention also provides a remote teaching classroom method for the remote teaching classroom system. Remote teaching classroom system includes teacher's end 110, student's end 130 and connects teacher's end 110 with student's end 130's server 120, teacher's end 110 includes POE touch-control large screen all-in-one 111 and POE peripheral hardware that include the POE port, POE peripheral hardware includes POE camera 113 and POE audio device 112, wherein the embodiment method includes:

the POE touch-control large-screen all-in-one machine 111 is used for teaching and/or meeting and receiving audio and video data packets from the student end 130, and the POE peripheral device connected with the POE port is powered and data transmission is carried out through the POE port;

connecting the POE camera 113 to the POE touch screen all-in-one machine 111 through the POE port, and shooting, inputting a video and/or tracking a target;

connecting the POE audio device 112 to the POE touch screen all-in-one machine 111 through the POE port, and inputting audio;

installing an application program for remote teaching in the POE touch large-screen all-in-one machine 111 to control the POE camera 113 and the POE audio device 112 to implement a remote teaching function;

receiving and playing audio and video data packets from the teacher end 110 through the student end 130, recording the audio and video of students, and transmitting the audio and video data packets of the student end 130 to the teacher end 110 through the server 120;

the server 120 is connected to the teacher end 110 and the student end 130, and is configured to transmit audio and video data packets of the teacher end 110 and the student end 130 to each other.

The POE audio device 112 of the teacher end 110 is used to input audio on the site of the teacher lecture, and the audio on the site of the teacher lecture is transmitted to the POE touch screen all-in-one machine 111 through the POE port.

Use teacher's 110 POE camera 113 shoots the video of the on-the-spot picture of teacher's lecture, and passes through the POE port will the video transmission of the on-the-spot picture of teacher's lecture arrives in the POE touch-control large-screen all-in-one 111.

Use teacher's end 110 install in the POE touch-control large-screen all-in-one 111 remote teaching application is to transmitting in the POE touch-control large-screen all-in-one 111 the teacher lecture live audio with the teacher lecture live picture video carries out the timestamp mark in real time.

And the remote teaching application program installed in the POE touch large-screen all-in-one machine 111 of the teacher terminal 110 is used for recording the screen content of the POE touch large-screen all-in-one machine 111 in audio and video and carrying out timestamp marking in real time, and recording the screen content audio and the screen content video.

The remote teaching application program installed in the POE touch screen all-in-one machine 111 of the teacher end 110 is used for processing and synthesizing the video, and the method comprises the following steps:

performing image matting processing on the teacher portrait in the teacher lecture site picture video, and processing and outputting a teacher portrait video;

according to the timestamp and the screen position of the POE touch large-screen all-in-one machine and the position of the teacher portrait in the teacher teaching field picture video, superposing and synthesizing the teacher portrait video to the corresponding position in the screen content video, simultaneously intercepting the teacher portrait video picture beyond the screen range, and finally synthesizing and outputting the teacher end 110 total video combining the screen content video and the teacher portrait video.

The remote teaching application program installed in the POE touch screen all-in-one machine 111 of the teacher end is used for processing and synthesizing the video, and the method further comprises the following steps:

keying images of the teachers in the lecture scene picture video, and processing and outputting a teacher image video;

and scaling the teacher portrait video in an equal proportion according to the timestamp and the size and the position of the blank area of the screen content video picture, superposing and synthesizing the teacher portrait video at the blank area of the screen content video picture, and finally synthesizing and outputting the teacher end 110 total video combined by the screen content video and the teacher portrait video.

The remote teaching application program installed in the POE touch large-screen all-in-one machine 111 of the teacher terminal 110 is used for processing and synthesizing the audio, and the method comprises the following steps of:

carrying out noise reduction processing on the audio of the teacher teaching site;

and performing audio synthesis on the audio of the teacher lecture site and the screen content audio after the noise reduction according to the timestamp, and finally synthesizing and outputting the total audio of the teacher end 110.

And processing the total video of the teacher end 110 and/or the total audio of the teacher end 110 by using the remote teaching application installed in the POE touch large-screen all-in-one machine 111 of the teacher end 110 according to the timestamp, outputting the audio and video data packet of the teacher end 110, and transmitting the audio and video data packet to the server 120.

While the spirit and principles of the invention have been described with reference to several particular embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, nor is the division of aspects, which is for convenience only as the features in such aspects may not be combined to benefit. The invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

It should be noted that although the operations of the system and method of the present invention are described in the embodiments and figures in a particular order, this does not require or imply that the operations must be performed in this particular order or that all of the illustrated operations must be performed to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.

Furthermore, although several devices, units, or modules of the system of the distance teaching classroom have been mentioned in the detailed description above, such partitioning is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the modules described above may be embodied in one module according to embodiments of the invention. Conversely, the features and functions of one module described above may be further divided into embodiments by a plurality of modules.

The present invention provides:

1. the remote teaching classroom system is characterized in that the system comprises a teacher end, a student end and a server connected with the teacher end and the student end:

the teacher end comprises a POE touch control large-screen all-in-one machine and a POE peripheral device, wherein

The POE touch large-screen all-in-one machine comprises a POE port, is used for teaching and/or meeting multimedia, receiving audio and video data packets from the student end, and supplying power and transmitting data to a POE peripheral device connected with the POE port through the POE port;

the POE peripheral device comprises a POE camera and a POE audio device;

the POE camera is used for being connected to the POE touch large-screen all-in-one machine through the POE port, and shooting, inputting videos and/or tracking targets; and

2. The system according to claim 1, wherein the POE touch screen all-in-one machine at the teacher end further comprises a non-POE port, and the non-POE port is used for connecting a peripheral device without a POE port;

the peripheral device without the POE port comprises an expansion screen and/or a sound box;

the extension screen and/or the sound box and/or the touch large screen built-in POE touch large screen all-in-one machine are/is used for playing the student audio and video data packets received by the POE touch large screen all-in-one machine.

3. The system of item 1, characterized in that, the teacher end POE audio device still is used for inputing the on-the-spot audio frequency of teacher's lecture, and passes through the POE port will the on-the-spot audio frequency transmission of teacher's lecture arrives in the POE touch-control large-screen all-in-one machine.

4. The system of item 1, characterized in that, the teacher end the POE camera still is used for shooting the on-the-spot picture video of teacher's lecture, and passes through the POE port will the on-the-spot picture video transmission of teacher's lecture arrives in the POE touch-control large-screen all-in-one machine.

5. The system according to item 3 or 4, characterized in that, the teacher end the remote teaching application installed in the POE touch-control large-screen all-in-one machine is also used for timestamp marking in real time the audio of the teacher's lecture site and the video of the teacher's lecture site picture transmitted to the POE touch-control large-screen all-in-one machine.

6. The system of claim 5, wherein the teacher end installs in the POE touch-control large-screen all-in-one machine the remote teaching application program is further configured to record audio and video and timestamp the screen content of the POE touch-control large-screen all-in-one machine in real time, and record screen content audio and screen content video.

7. The system of claim 6, wherein the teacher end installs in the POE touch-control large-screen all-in-one remote teaching application program is further configured to process and synthesize the video, and comprises:

a module for matting the teacher portrait in the teacher lecture scene picture video, processing and outputting the teacher portrait video;

and the module is used for superposing and synthesizing the teacher portrait video to the corresponding position in the screen content video according to the time stamp and the screen position of the POE touch large-screen all-in-one machine in the teacher lecture site picture video and the position of the teacher portrait, simultaneously intercepting the teacher portrait video picture beyond the screen range, and finally synthesizing and outputting the teacher end total video combined by the screen content video and the teacher portrait video.

8. The system of claim 6, wherein the teacher end installs in the POE touch-control large-screen all-in-one remote teaching application program is further configured to process and synthesize the video, and further comprises:

a module for matting the teacher portrait in the teacher lecture scene picture video and processing and outputting the teacher portrait video;

and the module is used for scaling the teacher portrait video in an equal proportion according to the timestamp and the size and the position of the screen content video picture blank area, superposing and synthesizing the teacher portrait video at the screen content video picture blank area, and finally synthesizing and outputting the teacher end total video combined by the screen content video and the teacher portrait video.

9. The system of claim 6, wherein the teacher end installs in the POE touch-control large-screen all-in-one remote teaching application program is further configured to process and synthesize the audio, and comprises:

a module for performing noise reduction processing on the teacher lecture site audio;

and the module is used for carrying out audio synthesis on the audio of the teacher lecture site after the noise reduction and the screen content audio according to the timestamp, and finally synthesizing and outputting the total audio of a teacher end.

10. The system according to item 7, 8 or 9, wherein the teacher end is configured to install the remote teaching application in the POE touch-control large-screen all-in-one machine, and further configured to process the teacher end total video and/or the teacher end total audio according to the timestamp, output the teacher end audio/video data packet, and transmit the teacher end audio/video data packet to the server.

11. The system of item 1, characterized in that, teacher's end POE touch control large screen all-in-one POE port can be according to the net twine type of inserting the port, automatic adjustment matches MDI and MDI-X port.

12. The system according to item 2, wherein the POE touch screen all-in-one machine intelligently supplies power to the POE peripheral device connected to the POE port, and automatically identifies the POE peripheral device for supplying power;

when the POE port is connected with the peripheral device without the POE port, the power supply is automatically cut off;

and when the POE port is connected with the POE peripheral device and the power requirement of the POE peripheral device exceeds the rated output power of the POE port, automatically disconnecting power supply.

13. The remote teaching classroom system is characterized in that the system comprises a teacher end, a student end and a server connected with the teacher end and the student end:

teacher end includes touch-control large-screen all-in-one, POE switch and POE peripheral hardware, wherein

The touch control large-screen all-in-one machine is used for teaching and/or conference multimedia and receiving audio and video data packets from the student end;

the POE peripheral device comprises a POE camera and a POE audio device;

the POE camera is connected to the touch large-screen all-in-one machine through the POE port and used for shooting, inputting videos and/or tracking targets; and

an application program for remote teaching is installed in the touch large-screen all-in-one machine, and the touch large-screen all-in-one machine controls the POE camera and the POE audio device to achieve the function of remote teaching;

14. The system of item 13, characterized in that, teacher's end POE audio frequency device still is used for inputing teacher's on-the-spot audio frequency of lecturing, and passes through the POE port will teacher's on-the-spot audio frequency of lecturing transmits in the big screen all-in-one of touch-control.

15. The system of item 13, characterized in that, the teacher end the POE camera still is used for shooting the video of the on-the-spot picture of teacher's lecture, and will through the POE port the video transmission of the on-the-spot picture of teacher's lecture is to in the touch-control large-screen all-in-one machine.

16. The system according to claim 14 or 15, wherein the remote teaching application installed in the touch-control large-screen all-in-one machine at the teacher end is further configured to perform timestamp marking on the teacher lecture site audio and the teacher lecture site picture video transmitted to the touch-control large-screen all-in-one machine in real time.

17. The system of claim 16, wherein the remote teaching application installed in the touch-control large-screen all-in-one machine at the teacher end is further configured to record audio and video of the screen content of the touch-control large-screen all-in-one machine, perform timestamp marking in real time, and record the audio and video of the screen content.

18. The system of claim 17, wherein the remote teaching application installed in the touch-sensitive large-screen all-in-one machine at the teacher end is further configured to process and synthesize the video, and comprises:

and the module is used for superposing and synthesizing the teacher portrait video to the corresponding position in the screen content video according to the timestamp, the screen position of the touch large-screen all-in-one machine in the teacher lecture site picture video and the position of the teacher portrait, intercepting the teacher portrait video picture beyond the screen range, and finally synthesizing and outputting the teacher end total video combining the screen content video and the teacher portrait video.

19. The system of claim 17, wherein the remote teaching application installed in the touch-sensitive large-screen all-in-one machine at the teacher end is further configured to process and synthesize the video, and further comprising:

20. The system of claim 17, wherein the remote teaching application installed in the touch-sensitive large-screen all-in-one machine at the teacher end is further configured to process and synthesize the audio, and comprises:

the module is used for carrying out noise reduction processing on the audio of the teacher teaching site;

and the module is used for carrying out audio synthesis on the audio of the teacher lecture site after noise reduction and the screen content audio according to the timestamp, and finally synthesizing and outputting the total audio of a teacher end.

21. The system according to claim 18, 19 or 20, wherein the remote teaching application installed in the touch-sensitive large-screen all-in-one machine at the teacher end is further configured to process the teacher end total video and/or the teacher end total audio according to the timestamp, output the teacher end audio-video data packet, and transmit the teacher end audio-video data packet to the server.

22. A remote teaching classroom method for a remote teaching classroom system is characterized in that the remote teaching classroom system comprises a teacher end, a student end and a server connecting the teacher end and the student end, the teacher end comprises a POE touch screen all-in-one machine comprising a POE port and a POE peripheral device, the POE peripheral device comprises a POE camera and a POE audio device,

wherein the method comprises:

23. The method of claim 22, further comprising inputting a teacher lecture live audio using the POE audio device of the teacher end, and transmitting the teacher lecture live audio to the POE touch-screen all-in-one machine through the POE port.

24. The method of claim 22, further comprising capturing a video of a teacher lecture scene picture by using the POE camera of the teacher end, and transmitting the video of the teacher lecture scene picture to the POE touch screen all-in-one machine through the POE port.

25. The method of claim 23 or 24, further comprising timestamp marking the teacher lecture live audio and the teacher lecture live picture video transmitted to the POE touch large-screen all-in-one machine in real time using the remote teaching application installed in the POE touch large-screen all-in-one machine at the teacher end.

26. The method according to item 25, further comprising the step of using the remote teaching application installed in the POE touch large-screen all-in-one machine at the teacher end to record audio and video of the screen content of the POE touch large-screen all-in-one machine and perform timestamp marking in real time, so as to record the audio and video of the screen content.

27. The method of claim 26, further comprising processing and compositing the video using the remote teaching application installed in the POE touch large screen all-in-one machine at the teacher end, comprising the steps of:

according to the timestamp and the screen position of the POE touch large-screen all-in-one machine and the position of the teacher portrait in the teacher teaching site picture video, superposing and synthesizing the teacher portrait video to the corresponding position in the screen content video, simultaneously intercepting the teacher portrait video picture beyond the screen range, and finally synthesizing and outputting a teacher end total video combining the screen content video and the teacher portrait video.

28. The method of claim 26, further comprising processing and synthesizing the video using the remote teaching application installed in the POE touch-screen all-in-one machine at the teacher end, further comprising the steps of:

and according to the time stamp and the size and the position of the blank area of the screen content video picture, carrying out equal-scale scaling on the teacher portrait video, superposing and synthesizing the teacher portrait video at the blank area of the screen content video picture, and finally synthesizing and outputting the teacher end total video combined by the screen content video and the teacher portrait video.

29. The method of claim 26, further comprising processing and synthesizing the audio using the remote tutoring application installed in the POE touch-screen all-in-one machine at the teacher end, comprising the steps of:

and performing audio synthesis on the audio of the teacher lecture site after the noise reduction and the screen content audio according to the timestamp, and finally synthesizing and outputting a teacher end total audio.

30. The method according to claim 27, 28 or 29, further comprising processing the teacher side total video and/or the teacher side total audio by using the remote teaching application installed in the POE touch large-screen all-in-one machine of the teacher side according to the timestamp, outputting the teacher side audio/video data packet, and transmitting the teacher side audio/video data packet to the server.

Claims

the POE peripheral device comprises a POE camera and a POE audio device;

2. The system of claim 1, wherein the POE touch screen all-in-one machine at the teacher end further comprises a non-POE port, which is used for connecting a peripheral device without the POE port;

3. The system of claim 1, wherein the remote teaching application installed in the POE touch-screen all-in-one machine at the teacher end is further configured to timestamp in real time a teacher lecture live audio and a teacher lecture live picture video transmitted to the POE touch-screen all-in-one machine.

4. The system according to claim 3, wherein the remote teaching application installed in the POE touch-control large-screen all-in-one machine at the teacher end is further configured to record audio and video of the screen content of the POE touch-control large-screen all-in-one machine and perform timestamp marking in real time to record the screen content audio and the screen content video.

5. The system of claim 4, wherein the remote teaching application installed in the POE touch-control large-screen all-in-one machine at the teacher end is further configured to process and synthesize the video, and the processing and synthesizing comprises:

and the module is used for superposing and synthesizing the teacher portrait video at the corresponding position in the screen content video according to the timestamp and the position of the POE touch screen integrated machine and the teacher portrait in the teacher lecture site picture video, intercepting the teacher portrait video picture exceeding the screen range, and finally synthesizing and outputting the screen content video and the teacher end total video combined by the teacher portrait video.

6. The system of claim 4, wherein the remote teaching application installed in the POE touch-control large-screen all-in-one machine at the teacher end is further configured to process and synthesize the video, and further comprising:

and the module is used for scaling the teacher portrait video in an equal proportion according to the timestamp and the size and the position of the blank area of the screen content video picture, superposing and synthesizing the teacher portrait video at the blank area of the screen content video picture, and finally synthesizing and outputting a teacher-side total video formed by combining the screen content video and the teacher portrait video.

7. The system of claim 4, wherein the remote teaching application installed in the POE touch-control large-screen all-in-one machine at the teacher end is further configured to process and synthesize the audio, and the remote teaching application comprises:

8. The system according to claim 5, 6 or 7, wherein the remote teaching application installed in the POE touch-control large-screen all-in-one machine at the teacher end is further configured to process the teacher-end total video and/or the teacher-end total audio according to the timestamp, output the teacher-end audio-video data packet, and transmit the teacher-end audio-video data packet to the server.

9. A distance teaching classroom system, said system comprising a teacher end, a student end, and a server connecting said teacher end and said student end:

the POE peripheral device comprises a POE camera and a POE audio device;

10. A remote teaching classroom method for a remote teaching classroom system is characterized in that the remote teaching classroom system comprises a teacher end, a student end and a server connecting the teacher end and the student end, the teacher end comprises a POE touch screen all-in-one machine comprising a POE port and a POE peripheral device, the POE peripheral device comprises a POE camera and a POE audio device,

wherein the method comprises:

connecting the POE camera to the POE touch large-screen all-in-one machine through the POE port, and carrying out shooting, video inputting and/or target tracking; and