WO2023016425A1

WO2023016425A1 - Multi-screen interaction system and multi-screen interaction device

Info

Publication number: WO2023016425A1
Application number: PCT/CN2022/110991
Authority: WO
Inventors: 甘恒
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2021-08-12
Filing date: 2022-08-09
Publication date: 2023-02-16
Also published as: CN115914729A; CN115914729B

Abstract

Provided in the embodiments of the present application are a multi-screen interaction system and a multi-screen interaction device. A first display device and a plurality of second display devices of the multi-screen interaction system are all connected to the multi-screen interaction device, a central control device is connected to the multi-screen interaction device, and the first display device, the second display devices and the central control device are all connected to a switch; the multi-screen interaction device receives a first display signal of a first target device according to a first control signal that is sent by the central control device, and sends the first display signal to a second target device; and the switch sends, to the second target device, a second control signal that is sent by the central control device, and the second target device displays the first display signal according to the second control signal, wherein the first target device is the first display device and the second target device is the second display device, or the first target device is the second display device and the second target device is the first display device. By means of the multi-screen interaction system, the technical problem of it not being possible to take both the number of serial port cables of an intelligent teaching system in a classroom and the effective transmission of a display signal into consideration can be solved.

Description

Multi-screen interactive system and multi-screen interactive equipment

This application claims the priority of the Chinese patent application with the application number 202110926403.9 and the title of the invention "multi-screen interactive system and multi-screen interactive equipment" submitted to the China Patent Office on August 12, 2021. The entire content of this application is incorporated by reference in this application.

technical field

An embodiment of the present application relates to the technical field of intelligent teaching, in particular to a multi-screen interactive system and a multi-screen interactive device.

Background technique

With the development of intelligent technology, various intelligent devices are widely used in various scenes of daily life. For example, in the teaching scene, various smart devices are installed in the teaching classroom to assist the teacher in teaching, and all kinds of smart devices work together to form an intelligent teaching system. For example, a display device for the teacher is installed on the blackboard side of the classroom (note display device for the teacher), multiple display devices for students (denoted as group display device) are installed on the side of the student seat, and a central control device is installed on the side of the podium to control the teacher's display device and the group display device. There is a video matrix device to transmit display signals between the teacher display device and the group display device. At this time, you can connect the central control device with the teacher’s display device and the group display device through a serial port cable, and connect the video matrix device with the teacher’s display device and the group display device through a multimedia transmission line, so that the display signals of the teacher’s display device and the group display device can be transmitted. Control and transmission, but need to use more serial cables, which increases the complexity of equipment wiring in the classroom. In order to reduce the complexity of wiring, the switch installed in the classroom can also be used to connect the central control device, the teacher's display device and the group display device through the network, so as to control and transmit the display signals of the teacher's display device and the group display device, and There is no need to install a video matrix device, but it relies heavily on the network. When the network is unstable, it will affect the transmission of display signals, and it is prone to interruptions and freezes.

To sum up, how to reduce the number of serial cables of the intelligent teaching system in the classroom and ensure the effective transmission of display signals has become a technical problem that needs to be solved urgently.

Contents of the invention

An embodiment of the present application provides a multi-screen interactive system and multi-screen interactive equipment to solve the technical problem in the related art that the number of serial cables and the effective transmission of display signals of the intelligent teaching system in the classroom cannot be taken into account at the same time.

In the first aspect, an embodiment of the present application provides a multi-screen interactive system, including: a first display device, a plurality of second display devices, a multi-screen interactive device, a central control device and a switch, the first display device and A plurality of the second display devices establish a multimedia connection with the multi-screen interactive device, the central control device establishes a serial port connection with the multi-screen interactive device, the first display device, the plurality of second display devices Both the device and the central control device establish a network connection with the switch;

The central control device generates a first control signal and a second control signal according to the user's first control instruction, and sends the first control signal to the multi-screen interactive device, and sends the second control signal to the said switch;

The multi-screen interactive device receives the current first display signal of the first target device according to the first control signal, and sends the first display signal to a second target device, and the first target device is the first target device When a display device, the second target device is the second display device, and when the first target device is the second display device, the second target device is the first display device;

the switch sends the second control signal to the second target device;

The second target device displays the first display signal according to the second control signal.

In the second aspect, an embodiment of the present application also provides a multi-screen interactive device, the multi-screen interactive device is provided with multiple multimedia interfaces and serial interfaces,

The multiple multimedia interfaces are respectively used to establish multimedia connections with the first display device and multiple second display devices, the serial interface is used to establish serial port connections with the central control device, the first display device, the central control device The control device and the multiple second display devices all establish a network connection with the switch;

The multi-screen interactive device receives a first control signal sent by the central control device through the serial interface, and the first control signal is generated by the central control device according to a user's first control instruction;

The multi-screen interactive device receives the current first display signal of the first target device through the first multimedia interface connected to the first target device according to the first control signal, and transmits the first display signal Send to the second target device through the second multimedia interface connected to the second target device, when the first target device is the first display device, the second target device is the second display device device, when the first target device is the second display device, the second target device is the first display device, and the second target device controls the The first display signal is displayed, and the second control signal is generated by the central control device according to the first control instruction and sent to the switch.

In one embodiment of the present application, the first display device and multiple second display devices in the multi-screen interactive system establish multimedia connections with the multi-screen interactive device, the central control device establishes a serial port connection with the multi-screen interactive device, and the first display device , Multiple second display devices and central control devices establish network connections with the switch, the central control device sends the first control signal to the multi-screen interactive device according to the user's first control command, and sends the second control signal to the switch, and the switch Send the second control signal to the second target device, the multi-screen interactive device receives the first display signal of the first target device according to the first control signal and sends it to the second target device, and the second target device displays the first display signal according to the second control signal A signal is displayed. Through the above-mentioned multi-screen interactive system, it can solve the technical problem that the number of serial cables and the effective transmission of display signals of the intelligent teaching system in the classroom cannot be taken into account at the same time. Using switches and network connections, centralized control by central control equipment can avoid using too many serial interface cables, reduce system wiring complexity, and facilitate unified control. The display signal is transmitted through the multimedia connection instead of using the network to transmit the display signal, which can avoid the phenomenon of display signal interruption and freeze when the network is unstable, and the first display device and the second display device do not need to carry out the first display signal. Encoding and decoding do not need to use the computing resources of the first display device and the second display device, which reduces the performance requirements of the first display device and the second display device, and can also realize the transmission of high-definition display signals, for example, realize 4K/60Hz display signal transmission.

Description of drawings

Fig. 1 is a schematic structural diagram of an intelligent teaching system provided by an embodiment of the present application;

Fig. 2 is a schematic structural diagram of another intelligent teaching system provided by an embodiment of the present application;

FIG. 3 is a schematic structural diagram of a multi-screen interactive system provided by an embodiment of the present application;

FIG. 4 is a schematic structural diagram of another multi-screen interactive system provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a multi-screen interactive device provided by an embodiment of the present application;

Fig. 6 is a schematic diagram of internal signal transmission of a multi-screen interactive device provided by an embodiment of the present application.

Detailed ways

The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are used to explain the present application rather than limit the present application. In addition, it should be noted that, for the convenience of description, only some structures related to the present application are shown in the drawings but not all structures.

Fig. 1 is a schematic structural diagram of an intelligent teaching system provided by an embodiment of the present application. Referring to Figure 1, the intelligent teaching system includes: teacher display devices, multiple group display devices (in Figure 1, four group display devices are taken as an example), lecture table display devices and video matrix devices, and the lecture table display devices are integrated with central control devices , wherein the teacher display device is for the teacher to operate, the group display device is for the student to operate, and the desk display device is set on the desk for the teacher to use. The teacher display device, group display device and desk display device are all connected to the video matrix device through the High Definition Multimedia Interface (HDMI), and the video matrix device, teacher display device and group display device are connected to the video matrix device through the RS-232 standard interface. The desk display device is connected, and the teacher's display device is connected to the teacher's display device through a Universal Serial Bus (USB). In the above-mentioned intelligent teaching system, the central control device can send control signals to the video matrix device, teacher display device and group display device through the RS-232 standard interface according to the teacher's instructions, and the video matrix device can receive the teacher's display device through HDMI according to the control signal display signal, and send the aforementioned display signal to at least one sub-display device for display through HDMI, or, the video matrix device receives the display signal of at least one sub-display device through HDMI according to the control signal and sends the display signal to The teacher's display device performs display, and the teacher's display device and the group display device receive and display the display signal sent by the video matrix device through HDMI according to the control signal. The lectern display device can also display the display signal of the teacher's display device sent by the video matrix device according to the settings of the central control device, and when the teacher touches the lectern display device, the lectern display device can also control the touch screen through USB. The signal is sent to the teacher's display device in response. The intelligent teaching system shown in Figure 1 requires more cables with RS-232 standard interfaces, which increases the complexity of wiring in the classroom. Moreover, when the group display device displays the display signal of the teacher's display device, it cannot communicate with the teacher through the group display device. The display signal of the teacher's display device is reverse-touched, or when the teacher's display device displays the display signal of the group's display device, the display signal of the group's display device cannot be reverse-touched through the teacher's display device. At the same time, when the RS- 232 standard interface cable loose, HDMI cable loose, video matrix device hardware failures, etc., the video matrix device will not be able to transmit display signals normally.

Fig. 2 is a schematic structural diagram of another intelligent teaching system provided by an embodiment of the present application. Referring to Figure 2, the intelligent teaching system includes: teacher display devices, multiple group display devices (in Figure 2, four group display devices are taken as an example), lecture table display devices and switches, and central control devices are integrated in the lecture table display devices. Among them, the teacher's display device is for teachers to operate, the group display device is for students to operate, the desk display device is set on the desk for teachers to use, the teacher's display device and the group display device are connected to the switch through a network cable, the desk display device and the teacher's display The devices are connected via HDMI and USB. In the above-mentioned intelligent teaching system, both the teacher's display device and the group's display device can transmit display signals to each other through the switch for display, and the display signals need to be encoded and decoded during transmission. The teacher's display device can also send a display signal to the lecture table display device through HDMI to enable the lecture table display device to display, and when the teacher touches the lecture table display device, the lecture table display device can also send the touch signal through USB to the teacher display device to respond. The intelligent teaching system shown in Figure 2 does not need many RS-232 standard interface cables, and the wiring is relatively simple. However, when the network is unstable, the stability of the teacher's display device and the group's display device are also easily affected, and it is easy to appear Display interruptions, freezes, etc., and both the teacher's display device and the group display device transmit display signals through the network, and the display signal needs to be encoded and decoded, which will occupy the computing power of the teacher's display device and the group display device. The performance of equipment and student display devices has certain requirements, and when the teacher's display device and student display device do not have the ability to codec, it will not be able to be applied in the intelligent teaching system, and when using the network to transmit display signals, it does not support the transmission of 4K/ 60Hz display signal.

It should be noted that the PCHDMI shown in Figures 1 and 2 can be understood as being connected to the computer module in the teacher's display device to transmit display signals generated by the computer module.

Based on the above content, an embodiment of the present application provides a multi-screen interactive system. The multi-screen interactive system can be used as an intelligent teaching system in classroom teaching scenarios, and can also be applied in other scenarios, such as meeting scenarios. The multi-screen interactive system can reduce the complexity of wiring, and can support HDMI transmission and network transmission, which has higher reliability. It can also be applied to multi-screen interactive systems for devices that cannot codec, increasing The practicability of the multi-screen interactive system is improved.

FIG. 3 is a schematic structural diagram of a multi-screen interactive system provided by an embodiment of the present application. Referring to Fig. 3, the multi-screen interactive system includes: a first display device 10, a plurality of second display devices 20, a multi-screen interactive device 30, a central control device 40 and a switch 50, the first display device 10 and a plurality of second display devices The devices 20 all establish a multimedia connection with the multi-screen interactive device 30, the central control device 40 establishes a serial port connection with the multi-screen interactive device 30, and the first display device 10, multiple second display devices and the central control device 40 all establish a network with the switch 50 connect.

The central control device 40 generates a first control signal and a second control signal according to the user's first control instruction, and sends the first control signal to the multi-screen interactive device 30 , and sends the second control signal to the switch 50 .

The multi-screen interactive device 30 receives the current first display signal of the first target device according to the first control signal, and sends the first display signal to the second target device. When the first target device is the first display device 10, the second target device When the device is the second display device 20 and the first target device is the second display device 20 , the second target device is the first display device 10 .

The switch 50 sends the second control signal to the second target device.

Exemplarily, the first display device 10 and the second display device 20 are display devices with built-in computer modules (ie, PC modules), and the operating system installed in the computer modules can make the first display device 10 and the second display device 20 have data analysis and processing capabilities. In one embodiment, both the first display device 10 and the second display device 20 can install an application program, the application program can be an application program that comes with the computer module, or an application program downloaded from a server or a third-party device. The type of program is currently not limited. In one embodiment, the display screens in the first display device 10 and the second display device 20 can be touch screens, and the touch screens can be one or more of infrared touch screens, capacitive touch screens, and electromagnetic touch screens. The control of the first display device 10 and the second display device 20 is realized by means of a touch screen. In addition, the first display device 10 and the second display device 20 can also be connected with external devices such as a mouse and a keyboard, and the user can control the first display device 10 and the second display device 20 through the external devices such as a mouse and a keyboard. The screen sizes of the first display device 10 and the second display device 20 may be the same or different, which is not currently limited. In one embodiment, the first display device 10 and the second display device 20 can be used by different users. For example, in a classroom teaching scene, the first display device 10 can be used as a teacher's display device and installed on the side of the blackboard for teachers to use. The second display device 20 can be used as a group display device, installed on the student side for students to use, and one second display device 20 can be used by one or more students.

The multi-screen interactive device 30 is a device for scheduling display signals (such as receiving and sending display signals) and processing (such as encoding and decoding display signals). The multi-screen interactive device 30 can be composed of a video matrix unit, a computing control unit and two It is composed of auxiliary circuits, among which, the computing control unit is mainly used for processing the display signal received by the video matrix unit, and controlling the reception and transmission of the display signal by the video matrix unit. The video matrix unit is used for receiving display signals and sending display signals according to the control of the computing control unit.

The central control device 40 has data analysis and processing functions, and can centrally control the first display device 10, the second display device 20 and the multi-screen interactive device 30. At this time, the user does not need to control each device separately, and the central control device 40 sets There is a display screen, and a human-computer interaction interface can be displayed on the display screen, so that the user can control through the human-computer interaction interface.

The switch 50 is a network device used for forwarding electrical (optical) signals, which can receive network signals and forward them.

In one embodiment, the multi-screen interactive device 30 is provided with a plurality of multimedia interfaces, and establishes a multimedia connection with the first display device 10 and the second display device 20 through the multimedia interface. The multimedia interface and the multimedia connection are respectively used to transmit multimedia signals interfaces and connections. Multimedia signals generally include signals in multiple media forms such as text, sound, and images. In one embodiment, the multimedia signals are display signals of a display device. It can be understood that the first display device 10 and the second display device 20 also have multimedia interfaces. , at this time, the multimedia interface between the multi-screen interactive device 30 and the display device can be connected through a multimedia transmission line. In one embodiment, there are two multimedia connections between the multi-screen interactive device 30 and each display device, that is, two multimedia transmission lines are used. At this time, each multimedia connection can transmit one display signal in one direction, for example, multiple There are two multimedia connections between the screen interactive device 30 and the first display device 10, one multimedia connection is used to send the display signal of the first display device 10 to the multi-screen interactive device 30, and one multimedia connection is used to send the multi-screen interactive device 30 from The display signals received by other display devices are sent to the first display device 10 . It can be understood that there are two multimedia connections between the multi-screen interactive device and each second display device. It should be noted that four second display devices 20 are taken as an example in FIG. 3 for description. In practical applications, the number of second display devices 20 can be set according to actual needs. Similarly, one first display device 10 is used in FIG. 3 This is described as an example. In practical applications, the number of first display devices 10 may also be set according to actual needs. In one embodiment, the multimedia connection is a high-definition multimedia interface connection, and each high-definition multimedia interface connection is used for unidirectional transmission of one display signal. At this time, the multi-screen interactive device includes multiple HDMI interfaces, and each HDMI interface can establish an HDMI connection (that is, a multimedia connection) with other devices, and each HDMI connection can transmit and display one display signal in one direction.

In one embodiment, the multi-screen interactive device 30 further includes at least one serial interface. Optionally, the serial interface may be an RS-232 standard interface or other serial interfaces. Exemplarily, the multi-screen interactive device 30 establishes a serial port connection with the central control device 40 through a serial interface. It can be understood that the central control device 40 is also provided with a serial interface, and the serial interface between the two devices can Connect the serial cable to realize the serial port connection between the two devices. In one embodiment, the central control device 40 can send a control signal to the multi-screen interactive device through a serial port connection, so that the multi-screen interactive device operates according to the control signal.

Exemplarily, the central control device 40, the first display device 10 and the second display device 20 can also establish a network connection, and the central control device 40 can send a control signal to the first display device 10 and the second display device 20 through the network to The first display device 10 and the second display device 20 are controlled. In one embodiment, the central control device 40, the first display device 10, and the second display device 20 are connected to the switch 50 through a network cable, so that the central control device 40, the first display device 10, and the second display device can be realized through the switch 50. 20 network transfers between. Optionally, when establishing a network connection, it is mainly connected to the computer modules of the first display device 10 and the second display device 20 . It should be noted that in practical applications, wireless network transmission may also be used among the central control device 40 , the first display device 10 and the second display device 20 .

Exemplarily, during the operation of the multi-screen interactive system, the user can control it through the central control device 40. In one embodiment, the user can instruct the second display device 20 to display the current display of the first display device 10 through the central control device 40. The screen may also instruct the first display device 10 to display the current display screen of the second display device 20 . At this time, the user issues a corresponding first control instruction on the human-computer interaction interface of the central control device, wherein the manner for the user to issue the first control instruction is currently not limited. Exemplarily, the first control instruction is used to instruct to send the display signal of the first target device to the second target device for display, wherein the display signal of the first target device is denoted as the first display signal, and the first display signal is the second display signal. A display signal of the current display screen of the target device. Exemplarily, when the first target device is the first display device 10 , the second target device is the second display device 20 . In one embodiment, it is described by taking all the second display devices as the second target devices as an example, that is, the first display signal of the first display device 10 needs to be displayed on all the second display devices 20, at this time, it is considered that the The first display signal is broadcast to each second display device 20 . Understandably, at least one second display device may also be selected as the second target device. Exemplarily, when the first target device is the second display device 20 , the second target device is the first display device 10 . In one embodiment, the description is made by taking a second display device 20 as the first target device as an example, that is, the first display signal of a second display device 20 is displayed on the first display device 10, at this time, it is considered that the second display device 20 A display signal is projected to the first display device 10 for display. It can be understood that multiple second display devices 20 can also be selected as the first target device, or other second display devices 20 and the first display device 10 can be selected as the second target device together with the first display device 10 except for sending the first display signal.

Exemplarily, after receiving the first control instruction, the central control device 40 specifies the first target device and the second target device, and generates the first control signal and the second control signal. Wherein, the central control device 40 sends the first control signal to the multi-screen interactive device 30 through the serial port connection, and the first control signal is used to instruct the multi-screen interactive device 30 to receive the first display signal of the first target device and send it to the second target device . After receiving the first control signal, the multi-screen interactive device 30 specifies the multimedia interface connected to the first target device and used to receive the signal according to the first control signal, which is currently recorded as the first multimedia interface, and through the first multimedia The body interface receives the first display signal, and, according to the first control signal, is clearly connected to the second target device and is used to send a multimedia interface, which is currently recorded as the second multimedia interface, and sends the first display signal to the second multimedia interface through the second multimedia interface. The second target device sends a first display signal. In one embodiment, the computing control unit of the multi-screen interactive device 30 receives the first control signal, and then the computing control unit instructs the video matrix unit to work according to the first control signal.

Exemplarily, the central control device 40 sends the second control signal to the switch 50 through the network connection, and the switch 50 sends the second control signal to the second target device through the network connection, and the second control signal is used to indicate that the second target The device displays a first display signal. Exemplarily, after receiving the second control signal, the switch 50 specifies a network cable connected to the second target device, and sends the second control signal to the second target device through the network cable. The second target device determines to display the first display signal currently received through the multimedia connection according to the second control signal.

In one embodiment, the second target device displaying the first display signal according to the second control signal includes: the second target device switches the currently used internal channel to an external channel according to the second control signal; The channel acquires the first display signal and displays the first display signal.

Optionally, before the second target device responds to the second control signal, it displays the display signal generated by its own computer module, and the display signal is transmitted in the internal channel of the second target device, that is, after the computer module generates the display signal, it is transmitted through the internal channel to display on the display. At this point, the display channel of the second target device is considered to be an internal channel. When the second target device responds to the second control signal, it switches the internal channel to the external channel according to the second control signal, so as to obtain the first display signal in the external channel for display. Wherein, the external channel is a channel for receiving a display signal generated by an external signal source, and the first display signal sent by the multi-screen interactive device 30 is transmitted in the external channel of the second target device. At this time, it is considered that the display channel currently used by the second target device is an external channel.

Optionally, the first control signal and the second control signal may also be integrated into the same control signal. In this case, the central control device 40 only needs to generate one control signal and send it to the multi-screen interactive device 30 and the switch 50 respectively.

Optionally, for the first target device, when displaying the first display signal generated by itself, it can continuously send the first display signal to the multi-screen interactive device 30, or, the central control device 40 also generates the first display signal according to the first control instruction. The eleventh control signal is sent to the switch 50 through the network connection, and the switch 50 sends it to the first target device, and then the first target device sends its own first display signal to the multi-screen interactive device 30 according to the eleventh control signal .

As mentioned above, in the multi-screen interactive system, the first display device and multiple second display devices establish multimedia connections with the multi-screen interactive device, and the central control device establishes a serial connection with the multi-screen interactive device. The first display device, multiple second display devices Both the device and the central control device establish a network connection with the switch, and the central control device sends the first control signal to the multi-screen interactive device according to the user's first control command, sends the second control signal to the switch, and the switch sends the second control signal To the second target device, the multi-screen interactive device receives the first display signal of the first target device according to the first control signal and sends it to the second target device, and the second target device displays the first display signal according to the second control signal. Through the above-mentioned multi-screen interactive system, it can solve the technical problem that the number of serial cables and the effective transmission of display signals of the intelligent teaching system in the classroom cannot be taken into account at the same time. Using the way of switch and network connection, centralized control by the central control equipment can avoid using too many serial cables, but use network connection, which reduces the complexity of system wiring and facilitates unified control. The display signal is transmitted through the multimedia connection instead of using the network to transmit the display signal, which can avoid the phenomenon of display signal interruption and freeze when the network is unstable, and the first display device and the second display device do not need to carry out the first display signal. Encoding and decoding do not need to use the computing resources of the first display device and the second display device, which reduces the performance requirements of the first display device and the second display device, and can also realize the transmission of high-definition display signals, for example, time 4K/60Hz display signal transmission.

In one embodiment of the present application, referring to FIG. 3 , after the second target device displays the first display signal according to the second control signal, it further includes: when the multi-screen interactive device 30 determines that the multimedia connection is abnormal, generate the first abnormal signal and send to the central control device 40; the central control device 40 generates a third control signal and a fourth control signal according to the first abnormal signal, and sends the third control signal and the fourth control signal to the switch 50; the switch 50 sends the third control signal to the first target device, and send the fourth control signal to the second target device; the first target device encodes the first display signal into a first network signal according to the third control signal, and sends it to the switch; the switch 50 converts the first The network signal is sent to the second target device; the second target device decodes the received first network signal according to the fourth control signal to obtain a first display signal, and displays the first display signal.

Exemplarily, when the multimedia is connected, the multimedia transmission line may fail to transmit the display signal due to failure, or the multi-screen interactive device is abnormal and cannot transmit the display signal. At this time, the central control device can also control the display signal of each display device by Multimedia transmission is changed to network transmission to ensure the normal transmission of display signals.

In one embodiment, the multi-screen interactive device 30 determines whether the multimedia connection is abnormal. Optionally, the multi-screen interactive device 30 can check whether the first display signal is received and whether the first display signal is sent to the second target device normally. To determine whether the connection between the multimedia connection line and the multimedia interface is loose, whether the multimedia connection line is abnormal (such as interrupted), etc. When the multi-screen interactive device 30 determines that the multimedia connection is abnormal, it generates an abnormal signal indicating the abnormality. In one embodiment, the currently generated abnormal signal is recorded as the first abnormal signal, and then the multi-screen interactive device 30 records the first abnormal The signal is sent to the central control device 40 through the serial port connection. Exemplarily, the computing control unit of the multi-screen interactive device 30 detects each multimedia interface of the video matrix unit and the connected multimedia transmission line to determine whether the multimedia connection is abnormal, and when abnormal, generates a first abnormal signal and sends it to the Control device 40.

After receiving the first abnormal signal, the central control device 40 changes the current multimedia transmission to network transmission, and generates a third control signal and a fourth control signal. Wherein, the third control signal is used to instruct the first target device to transmit the first display signal to the second target device through the network, and the fourth control signal is used to instruct the second target device to receive the first display signal through the network. It can be understood that The control device may determine the first target device and the second target device according to the first control instruction, and generate a third control signal and a fourth control signal according to the first abnormal signal. Optionally, when the central control device 40 generates the third control signal and the fourth control signal, it may also load settings related to network transmission, such as setting transmission speed, encoding and decoding rules, and the like. Optionally, after receiving the first abnormal signal, the central control device 40 may pop up an abnormal prompt on the human body interaction interface, and display whether to switch to network transmission in the abnormal prompt. If the user determines to switch to network transmission according to the abnormality prompt, the central control device 40 generates a third control signal and a fourth control signal.

Afterwards, the central control device 40 sends the third control signal and the fourth control signal to the switch through the network. After the switch receives the third control signal, it specifies the network cable connected to the first target device, and sends the third control signal to the first target device through the network cable. Similarly, after the switch receives the fourth control signal, it specifies the connection with the first target device. A network cable connecting the two target devices, and the fourth control signal is sent to the second target device through the network cable. It can be understood that the third control signal and the fourth control signal may also be integrated into one signal.

After receiving the third control signal, the first target device no longer sends the first target signal through the multimedia connection, but uses the network to send the first target signal. At this time, the computer module of the first target device encodes the first display signal to form a video stream suitable for network transmission. In one embodiment, the currently generated video stream is recorded as the first network signal. After that, the first target device The first network signal is sent to the switch through the network connection. Optionally, the first network signal also includes the address of the second target device, so that after the switch 50 receives the first network signal, the first network signal is sent to the switch through the address of the second target device. The network signal is sent to the second target device.

After receiving the fourth control signal, the second target device determines to use the network to receive the first display signal. If before receiving the fourth control signal, the second target device has currently received the first display signal through a multimedia connection, that is, the second target device displays the first display signal according to the second control signal, then the fourth control signal is received. After receiving the signal, the second target device changes the multimedia connection to a network connection according to the fourth control signal, and uses the network to receive the first network signal, and then decodes the first network signal to obtain the first display signal, and displays the first Show signal. If the second target device does not currently receive the first display signal, but displays the display signal generated by itself, it receives the first network signal through a network connection directly according to the fourth control signal, and decodes the first network signal to A first display signal is obtained, and then the first display signal is displayed.

In one embodiment, the second target device has received the first display signal through a multimedia connection as an example. At this time, the second target device decodes the received first network signal according to the fourth control signal to obtain the first display signal. A display signal, and displaying the first display signal includes: the second target device switches the currently used external channel to an internal channel according to the fourth control signal; the second target device decodes the first network signal according to the fourth control signal The first display signal is obtained; the second target device obtains the first display signal through an internal channel, and displays the first display signal.

Exemplarily, before the second target device receives the fourth control signal, the display channel is an external channel, but due to an abnormal multimedia connection, the second target device cannot normally display the second display signal. Therefore, after receiving the fourth control signal, the second target device switches the external channel to the internal channel according to the fourth control signal, that is, switches the current display channel to the internal channel, and then acquires the display signal in the internal channel for display. Exemplarily, after the second target device receives the fourth control signal, it also obtains the first network signal transmitted by the interactive machine 50 through the network according to the fourth control signal, and then, the second target device decodes the first network signal to obtain The first display signal, in one embodiment, the first network is decoded by the built-in computer module of the second target device. At this time, the first display signal can be regarded as the display signal obtained inside the second target device, that is, through The application program obtains the first display signal instead of directly obtaining the display signal from an external data source, and then, the second target device transmits the first display signal through an internal channel to display the first display signal.

Optionally, the user may also determine whether the first display signal is normally transmitted according to the display situation of the second target device, and when it is determined that the first display signal is not normally transmitted, in the human-computer interaction interface of the central control device 40 An abnormal instruction is issued, and the embodiment of the issuing manner of the abnormal instruction is not limited, and then, the central control device 40 generates a third control signal and a fourth control signal according to the abnormal instruction. Optionally, when the multimedia connection is normal, the user can also send a control instruction from multimedia transmission to network transmission to the central control device 40 according to actual needs, and then the central control device 40 generates the third control signal and the second control signal according to the control instruction. Four control signals.

Optionally, when the central control device 40 is also abnormal, the user can directly issue a control command through the first target device, so that the first target device encodes its own first display signal into a first network signal and sends it to the second network signal through the switch. Two target devices are displayed.

The multi-screen interactive system shown above can transmit display signals through network connection when the multimedia connection is abnormal, that is, multiplex network connection to transmit control signals and display signals, which enriches the functionality of network connection. Moreover, the multi-screen interactive system supports two working modes of multimedia transmission and network transmission, and can be switched at any time according to actual needs, ensuring the normal transmission of display signals, and making the multi-screen interactive system have the advantages of multimedia transmission and network transmission, avoiding the The lack of single transmission makes multi-screen interactive devices more reliable. At the same time, when the display signal is transmitted through the network connection, even if all the multimedia interfaces of the current multi-screen interactive device have been connected to the first display device and the second display device, a new first display device can also be added to the multi-screen interactive system and/or the second display device, and the new first display device and/or the second display device can transmit display signals through a network connection, which reduces the limit on the number of the first display device and the second display device, and improves the Cost-effective multi-screen interactive system.

In an embodiment of the present application, referring to FIG. 3 , the multi-screen interactive device 30 establishes a network connection with the switch 50 . After the second target device displays the first display signal according to the second control signal, it further includes: when the multi-screen interactive device 30 determines that the multimedia connection is abnormal, generates a second abnormal signal and sends it to the central control device 40; The second abnormal signal generates the fifth control signal and the sixth control signal, and sends the fifth control signal to the multi-screen interactive device 30, and sends the sixth control signal to the switch 50; the multi-screen interactive device 30 sends the fifth control signal to the fifth control signal. A display signal is encoded as a second network signal, and the second network signal is sent to the switch 50; the switch 50 sends the sixth control signal to the second target device; the switch 50 sends the second network signal to the second target device; The second target device decodes the received second network signal according to the sixth control signal to obtain the first display signal, and displays the first display signal.

Exemplarily, when the multi-screen interactive device 30 determines that the multimedia connection is abnormal, it generates the second abnormal signal and sends it to the central control device 40. When the multi-screen interactive device 30 determines that the multimedia connection is abnormal, it generates the first abnormal signal and sends it to the central control device The implementation of the process of 40 is the same, and will not be repeated here. The meaning of the second abnormal signal is the same as that of the first abnormal signal. Optionally, the current exception refers to the abnormality of the multimedia connection between the multi-screen interactive device 30 and the second target device.

Exemplarily, when the first target device does not have the ability to encode and decode the first display signal (for example, the first target device does not have an application program with a codec function installed or the first target device cannot use a network connection), multi-screen display can be used. The interactive device 30 encodes the first display signal.

After receiving the second abnormal signal, the central control device 40 changes the current multimedia transmission to network transmission, and generates a fifth control signal and a sixth control signal. Wherein, the fifth control signal is used to instruct the multi-screen interactive device 30 to transmit the first display signal through the network, and the meaning of the sixth control signal is the same as that of the fourth control signal, which will not be repeated here. Wherein, the manner of generating the fifth control signal and the sixth control signal by the central control device 40 is the same as that of generating the third control signal and the fourth control signal, which will not be repeated here. The fifth control signal and the sixth control signal can be integrated into one control signal.

Afterwards, the central control device 40 sends the fifth control signal to the multi-screen interactive device 30 through the serial port connection. The multi-screen interactive device 30 determines to encode the received first display signal according to the fifth control signal, and transmits the received first display signal to the second target device through network transmission, and no longer transmits the first display signal through multimedia transmission. In one embodiment, the signal currently encoded by the multi-screen interactive device 30 is recorded as the second network signal. Optionally, the connection between the video matrix module of the multi-screen interactive device 30 and the calculation control unit includes a connection for transmitting the first display signal, and each display signal input to the multi-screen interactive device can be sent to the calculation control unit through a connection . Exemplarily, after receiving the fifth control signal sent by the central control device 40, the calculation control unit sends a control signal to the video matrix unit, so that the video matrix unit sends the first display signal to the calculation control unit according to the control signal, Afterwards, the computing control unit encodes the first display signal to obtain a second network signal, and transmits it to the switch through the network connection.

Afterwards, after receiving the sixth control signal, the switch 50 determines the network cable connected to the second target device, and sends the sixth control signal to the second target device through the network cable. And, the switch 50 sends the second network signal to the second target device.

The second target device receives the sixth control signal, decodes the second network signal according to the sixth control signal to obtain the first display signal, and displays the first display signal. The process of decoding a network signal to obtain the first display signal and displaying the first display signal is implemented in the same way, and will not be repeated here. In one embodiment, the second target device decodes the received second network signal according to the sixth control signal to obtain the first display signal, and displaying the first display signal includes: the second target device converts the currently used The external channel is switched to the internal channel; the second target device decodes the second network signal to obtain the first display signal according to the sixth control signal; the second target device obtains the first display signal through the internal channel and displays the first display signal .

Optionally, the user may also determine whether the first display signal is normally transmitted according to the display situation of the second target device, and when it is determined that the first display signal is not normally transmitted, in the human-computer interaction interface of the central control device 40 An abnormal command is sent out, and the embodiment of the sending method of the abnormal command is not limited. Afterwards, the central control device generates a fifth control signal and a sixth control signal according to the abnormal command. Optionally, when the multimedia connection is normal, the user can also send an instruction to the central control device 40 to switch from multimedia transmission to network transmission according to actual needs, and then the central control device 40 generates the fifth control signal and the sixth control signal according to the instruction. Signal. Optionally, when the central control device 40 generates the fifth control signal, it may also add the device to which the encoded display signal belongs to the fifth control signal, that is, it is currently not limited to only the first display signal of the first target device. For encoding, the multi-screen interactive device 30 can also receive and encode display signals of other devices according to the fifth control signal. After the network transmission is adopted, the user may also switch the network transmission back to the multimedia transmission through the central control device 40 .

Optionally, when the second target device does not have the ability to encode and decode the first display signal (for example, the second target device does not have an application program with a codec function installed), the multi-screen interactive device 30 can be used to decode the first display signal . At this time, the central control device 40 generates a twelfth control signal and a thirteenth control signal according to the second abnormal signal, the twelfth control signal is used to instruct the first target device to encode the first display signal, and the thirteenth control signal It is used to instruct the multi-screen interactive device to decode the first display signal and send it to the second target device. Optionally, the current abnormality mainly refers to an abnormal connection between the first target device and the multi-screen interactive device 30 . In one embodiment, the central control device 40 sends the twelfth control signal to the switch 50 , and sends the thirteenth control signal to the multi-screen interactive device 30 . The switch sends the twelfth control signal to the first target device. The first target device encodes the first display signal according to the twelfth control signal, and records the currently encoded signal as the third network signal. After that, the first target device sends the third network signal to the switch 50, and the switch 50 50 sends the third network signal to the multi-screen interactive device 30 . Afterwards, the multi-screen interactive device 30 decodes the third network signal according to the thirteenth control signal to obtain the first display signal, and sends the first display signal to the second target device through a multimedia connection.

The multi-screen interactive system shown above can encode the first display signal of the first target device through the multi-screen interactive device when the multimedia connection is abnormal and the first target device does not have the coding capability, and then use the network connection The transmission of display signals not only enriches the functionality of network connection, but also enables the multi-screen interactive system to support two working modes of multimedia transmission and network transmission. Normal transmission makes multi-screen interactive devices more reliable. At the same time, it can also make the multi-screen interactive system support devices that cannot perform codec.

In an embodiment of the present application, FIG. 4 is a schematic structural diagram of another multi-screen interactive system provided in an embodiment of the present application. Referring to FIG. 4 , on the basis of the multi-screen interactive system shown in FIG. 3 , it also includes: a third display device 60 , the third display device 60 establishes a multimedia connection with the multi-screen interactive device 30 , establishes a connection with the central control device 40 , A network connection is established with the switch 50 .

The central control device 40 generates a seventh control signal and an eighth control signal according to the user's second control instruction, and sends the seventh control signal to the multi-screen interactive device 30 , and sends the eighth control signal to the third display device 60 .

The multi-screen interactive device 30 sends the first display signal to the third display device 60 according to the seventh control signal.

The third display device 60 displays the first display signal according to the eighth control signal.

Exemplarily, the third display device 60 is a display device with a built-in computer module, and the third display device 60 can have data analysis and processing capabilities through the operating system installed in the computer module. In one embodiment, the third display device 60 can install an application program. The application program can be an application program that comes with the computer module, or an application program downloaded from a server or a third-party device. The type of the application program is not currently limited. In one embodiment, the display screen in the third display device 60 is a touch screen, and the touch screen can be one or more of an infrared touch screen, a capacitive touch screen, and an electromagnetic touch screen, and the user can touch the display screen to realize Control of the third display device 60 . In addition, the third display device 60 can also be connected with external devices such as a mouse and a keyboard, and the user can control the third display device 60 through the external devices such as a mouse and a keyboard. In one embodiment, the third display device 60 is installed at a different location from the first display device 10 and the second display device 20 . For example, in a classroom teaching scene, the first display device 10 is installed on the blackboard side for teachers to use, the second display device 20 can be used as a group display device, installed on the student side for students to use, and the third display device 60 is installed on the desk side for students to use. Teachers use.

In one embodiment, a multimedia connection is established between the third display device 60 and the multi-screen interactive device 30, that is, the multimedia interface of the multi-screen interactive device 30 is connected to the corresponding multimedia interface of the third display device 60, optionally, through a multimedia transmission line. Connection of two interfaces. Optionally, there is only one multimedia connection between the multi-screen interactive device 30 and the third display device 60, through which the display signal received by the multi-screen interactive device 30 can be sent to the third display device 60 for display. In practical applications, another multimedia connection can be established between the multi-screen interactive device 30 and the third display device 60 in combination with actual needs, through which the display signal of the third display device 60 can be sent to the multi-screen interactive device 30, In order to make the multi-screen interactive device 30 send the display signal to other devices for display. The third display device 60 is also connected to the central control device 40 . In one embodiment, the central control device 40 and the third display device 60 are integrated into one physical device. At this time, the connection between the central control device 40 and the third display device 60 belongs to the internal connection of the physical device, and the central control device 40 and the third display device 60 may share a display screen and a network interface. In one embodiment, the central control device 40 and the third display device 60 are not integrated into one physical device. At this time, the central control device 40 and the third display device 60 can be connected through a serial port connection, or both can be connected to a switch through a network cable 50 to establish a network connection. The third display device 60 also establishes a network connection with the switch 50, so as to realize network transmission with other devices through the switch.

In an embodiment, the user can view the first display signal currently transmitted by the first target device through the third display device 60 . In one embodiment, the user can instruct the multi-screen interactive device 30 to send the first display signal to the third display device 60 for display through the central control device 40 . At this time, the user issues a second control instruction on the human-computer interaction interface of the central control device 40 for instructing the third display device 60 to display the first display signal, and the method for the user to issue the second control instruction is not currently limited. Exemplarily, after receiving the second control instruction, the central control device 40 generates the seventh control signal and the eighth control signal. Wherein, the central control device 40 sends the seventh control signal to the multi-screen interactive device 30 through the serial port connection, and the seventh control signal is used to instruct the multi-screen interactive device 30 to send the first display signal to the third display device 60 . After receiving the seventh control signal, the multi-screen interactive device 30 specifies the multimedia interface connected to the third display device 60 according to the seventh control signal, and sends the first display signal through the multimedia interface. In one embodiment, the calculation control unit of the multi-screen interactive device 30 receives the seventh control signal, and then the calculation control unit instructs the video matrix unit to work according to the seventh control signal.

Exemplarily, when the central control device 40 and the third display device 60 are integrated in the same physical device, the eighth control signal can be directly sent to the third display device 60 through an internal connection, so as to instruct the third display device to display the first display signal . When the central control device 40 and the third display device 60 are not integrated in the same physical device, the eighth control signal may be sent to the third display device 60 through a serial port connection or a network connection. Exemplarily, when the third display device 60 displays the first display signal, it includes: the third display device 60 switches the currently used internal channel to an external channel according to the eighth control signal; the third display device 60 acquires the first display signal and display the first display signal. This process is implemented in the same manner as the process of displaying the first display signal by the second target device, and details are not repeated here.

It should be noted that the current description will be made by taking the multi-screen interactive device 30 receiving the first display signal as an example. In practical applications, the multi-screen interactive device 30 can also receive other display signals. For example, when the multi-screen interactive system 30 also includes a recording and broadcasting device, the display signal of the recording and broadcasting screen during the recording process of the recording and broadcasting device can be sent to the multi-screen interactive device 30 After that, the central control device 40 can instruct the multi-screen interactive device 30 to send the display signal of the recording device to the third display device 60 for display according to the user's control instruction. This process is the same as instructing the multi-screen interactive device 30 to send the first display signal The implementation of sending to the third display device for display is the same, and details are not described here.

It can be understood that when the multimedia connection is abnormal, the central control device 40 can also instruct the first target device to encode the first display signal to obtain the first network signal and send it to the switch 50, and then the switch 50 sends the first network signal to the second The third display device 60, the third display device 60 decodes the first network signal to obtain a first display signal and displays it. It can be understood that this process is similar to the implementation of the process in which the central control device 40 instructs the first target device to send the first display signal to the second display device for display through a network connection, and details are not repeated here.

In the multi-screen interactive system shown above, when the first display signal is displayed through the third display device, the user can watch the first display signal through the third display device. Especially in the classroom teaching scene, when the third display device is installed on the side of the desk, the teacher uses the third display device on the side of the desk to watch the first display signal, without turning around to watch the first display signal on the first display device on the blackboard side.

In an embodiment of the present application, referring to FIG. 4 , the multi-screen interactive system further includes a recording and broadcasting device 70 . The recording and broadcasting device 70 establishes a multimedia connection with the multi-screen interactive device 30 and establishes a network connection with the switch 50 .

The central control device 40 generates a ninth control signal and a tenth control signal according to the third control instruction of the user, and sends the ninth control signal to the multi-screen interactive device 30 , and sends the tenth control signal to the switch 50 .

The multi-screen interactive device 30 sends the first display signal to the recording and broadcasting device 70 according to the ninth control signal.

The switch 50 sends the tenth control signal to the recording device 70 .

The recording and broadcasting device 70 records the first display signal according to the tenth control signal.

Exemplarily, the recording and broadcasting device 70 can immediately record the display signal it receives, that is, record the display signal. Optionally, the recording and broadcasting device 70 can publish the recorded display signal to the network, and can also save it as a recording and broadcasting file for subsequent use and viewing. The user can set various parameters required in the recording and broadcasting process through the recording and broadcasting device 70 , for example, setting a recorded display signal. In the multi-screen interactive system, a multimedia connection is established between the recording and broadcasting device 70 and the multi-screen interactive device 30, that is, the multimedia interface of the multi-screen interactive device is connected with the corresponding multimedia interface of the recording and broadcasting device 70. Optionally, two The device's multimedia connections. Optionally, there are two multimedia connections between the multi-screen interactive device 30 and the recording and broadcasting device 70 , and one multimedia connection is used to send the display signal received by the multi-screen interactive device 30 to the recording and broadcasting device 70 . Another multimedia connection is used to send the display signal of the recorded picture generated by the recording and broadcasting device 70 to the multi-screen interactive device 30 during the recording process. The recording and broadcasting device 70 also establishes a network connection with the switch 50 through a network cable, so as to realize network transmission with other devices through the switch 50 .

In one embodiment, when recording the first display signal, the user can instruct the multi-screen interactive device 30 to send the first display signal to the recording and broadcasting device 70 through the central control device 40 for recording. At this time, the user issues a third control instruction for instructing the recording and broadcasting device 70 to record in the human-computer interaction interface of the central control device 40, and the way for the user to issue the third control instruction is not currently limited. Exemplarily, after receiving the third control instruction, the central control device 40 generates the ninth control signal and the tenth control signal. It can be understood that the ninth control signal and the tenth control signal can also be integrated into the same control signal. Wherein, the central control device 40 sends the ninth control signal to the multi-screen interactive device 30 through the serial port connection, and the ninth control signal is used to instruct the multi-screen interactive device 30 to send the first display signal to the recording and broadcasting device 70 . After receiving the ninth control signal, the multi-screen interactive device 30 specifies the multimedia interface connected to the recording and broadcasting device 70 according to the ninth control signal, and sends the first display signal through the multimedia interface. In one embodiment, the computing control unit of the multi-screen interactive device 30 receives the ninth control signal, and then the computing control unit instructs the video matrix unit to work according to the ninth control signal.

Exemplarily, the central control device 40 sends the tenth control signal to the switch 50 through a network connection, and the switch 50 determines the network cable connected to the recording and broadcasting device 70 according to the tenth control signal, and sends the tenth control signal through the network cable To recording and broadcasting equipment 70. Afterwards, the recording and broadcasting device 70 determines to receive the first display signal according to the tenth control signal, and records the first display signal. The current first display signal can be regarded as a live display signal.

It should be noted that the current description will be made by taking the multi-screen interactive device 30 receiving the first display signal as an example. In practical applications, the multi-screen interactive device 30 can also receive other display signals, and at this time, the recording and broadcasting device 70 can also record other display signals. Optionally, in addition to the central control device 40, the user can also directly issue a control instruction instructing the recording device to record and broadcast in the recording device 70 and the first target device.

It can be understood that when the multimedia connection is abnormal, the central control device 40 can also instruct the first target device to send the first network signal obtained by encoding the first display signal to the switch 50, and then the switch 50 sends the first network signal to the recorder. The broadcasting device 70, and the recording and broadcasting device 70 decodes the first network signal to obtain the first display signal and records it.

Optionally, the recording and broadcasting device 70 can also record and collect video signals and/or sound data, etc., in addition to the received display signal. For example, the recording and broadcasting device is connected to at least one camera, and the recording and broadcasting device receives the video collected by at least one camera. signal and record at least one video signal.

Exemplarily, the recording and broadcasting device 70 is provided with a display screen, and the display screen can display the currently recorded display screen, so that the user can watch the currently recorded content. In one embodiment, the recording and broadcasting device 70 records the first display signal as an example for description. At this time, when the recording and broadcasting device 70 records the first display signal, the recording picture obtained during the current recording process (which may be the recording screen of the recording and broadcasting device) The display screen (or the display screen recorded by the recording and broadcasting host) corresponding to the display signal is sent to the multi-screen interactive device 30, and the multi-screen interactive device 30 forwards it to other display devices for display. In one embodiment, after the recording and broadcasting device 70 records the first display signal according to the tenth control signal, it further includes: the recording and broadcasting device 70 sends the second display signal generated during the recording to the multi-screen interactive device 30, and the second display signal The display signal is the recording screen of the recording device 70; the multi-screen interactive device 30 sends the second display signal to the third display device for display.

The display signal obtained during recording by the recording and broadcasting device 70 is recorded as the second display signal. Exemplarily, the recording and broadcasting device 70 sends the second display signal to the multi-screen interactive device 30 . Optionally, the recording and broadcasting device 70 may be instructed to send the second display signal to the multi-screen interactive device through the tenth control signal. Or, the user directly sends a control instruction in the recording and broadcasting device 70 so that the recording and broadcasting device 70 sends the second display signal to the multi-screen interactive device, or the user sends a control instruction in the central control device 40, and the central control device 40 generates The corresponding control signal is sent to the recording and broadcasting device 70 through the switch 50, so that the recording and broadcasting device 70 sends the second display signal to the multi-screen interactive device 30 according to the control signal.

In one embodiment, the third display device 60 displays the second display signal as an example for description. After receiving the second display signal, the multi-screen interactive device 30 sends the second display signal to the third display device for display. At this time, the third display device does not display the first display signal, but displays the second display signal. The multi-screen interactive device 30 may also continue to send the first display signal to the second target device for display. Optionally, the central control device 40 may add corresponding content of sending the second display signal to the third display device 60 in the ninth control signal, so that the multi-screen interactive device sends the second display signal to the third display device 60 according to the ninth control signal. A third display device. Or, the central control device 40 independently generates a control signal that sends the second display signal to the third display device 70, and sends it to the multi-screen interactive device 30 through a serial port connection, or, the recording and broadcasting device 70 generates a second display signal separately. The signal is sent to the control signal of the third display device 60 and sent to the multi-screen interactive device 30 through the network connection. In one embodiment, the calculation control unit of the multi-screen interactive device 30 receives the corresponding control signal, and then the calculation control unit instructs the video matrix unit to send the second display signal to the third display device according to the control signal. It can be understood that, in practical applications, the multi-screen interactive device 30 may also send the second display signal to other display devices for display, which is not currently limited.

Optionally, when the multimedia connection is abnormal, the central control device 40 can also instruct the recording and broadcasting device to encode the second display signal to obtain a network signal, which is currently recorded as the third network signal, and then the third network signal is sent to the switch 50 , the switch 50 sends the third network signal to the third display device 70, and the third display device 70 decodes the third network signal to obtain a second display signal and displays it. Optionally, when the recording and broadcasting device 70 does not have the encoding capability, and the multimedia connection between the multi-screen interactive device and the third display device is abnormal, the recording and broadcasting device 70 can continue to send the second display signal to the multi-screen interactive device 30, by The multi-screen interactive device 30 encodes the second display signal according to the corresponding control signal (which can be generated by the central control device or the recording and broadcasting device) to obtain a network signal, which is currently recorded as the fourth network signal, and then sends the fourth network signal to The switch 50, after that, the switch 50 sends the fourth network signal to the third display device 60, and the third display device 60 decodes the fourth network signal to obtain a second display signal and displays it.

The multi-screen interactive system shown above can record the first display signal, and can send the second display signal during the recording process to other display devices for display through the multi-screen interactive device. When the multimedia connection is abnormal, it is also possible to record the first display signal through the network connection, and make other display devices display the second display signal of the recording process. When the recording and broadcasting device does not have the encoding capability, the second display signal of the recording and broadcasting device can also be encoded through the multi-screen interactive device, so that other display devices can display the second display signal of the recording process.

In an embodiment of the present application, referring to FIG. 4 , the multi-screen interactive system further includes an external signal source device 80 , and the external signal source device 80 establishes a multimedia connection with the multi-screen interactive device 30 .

The external signal source device 80 sends its own third display signal to the multi-screen interactive device 30 .

The multi-screen interactive device 30 sends the third display signal to the first display device 10 for display.

Exemplarily, the external signal source device 80 can be connected to or removed from the multi-screen interactive system according to actual conditions, and the external signal source device 80 can serve as a signal source to provide display signals. The external signal source device 80 may be a notebook computer or the like.

In one embodiment, the display signal provided by the external signal source device 80 is denoted as the third display signal. A multimedia connection is established between the external signal source device 80 and the multi-screen interactive device 30, that is, the multimedia interface of the multi-screen interactive device 30 is connected to the corresponding multimedia interface of the external signal source device 80. Optionally, the two devices can be realized through a multimedia transmission line. multimedia connection. Optionally, there is a multimedia connection between the multi-screen interactive device 30 and the external signal source device 80 , and the multimedia connection can send the display signal of the external signal source device 80 to the multi-screen interactive device 30 .

Exemplarily, the third display signal of the external signal source device 80 can be displayed on the first display device 10, at this time, the external signal source device 80 sends the third display signal to the multi-screen interactive device 30, and the multi-screen interactive The device 30 sends the third display signal to the first display device 10 for display through the multimedia connection with the first display device 10 . In one embodiment, the user sends a corresponding control command on the human-computer interaction interface of the central control device 40, and then the central control device receives the control command to generate a fourteenth control signal and a fifteenth control signal, and the fourteenth control The signal and the fifteenth control signal can also be integrated into the same signal. Wherein, the central control device sends the fourteenth control signal to the multi-screen interactive device through the serial port connection, and the fourteenth control signal is used to instruct the multi-screen interactive device 30 to receive the third display signal and send it to the first display device 10 . After receiving the fourteenth control signal, the multi-screen interactive device 30 can specify the multimedia interface connected to the external signal source device 80 according to the fourteenth control signal, and receive the third display signal through the multimedia interface. A display device 10 is connected to a multimedia interface, and the third display signal is sent to the first display device 10 through the multimedia interface. In one embodiment, the calculation control unit of the multi-screen interactive device 30 receives the fourteenth control signal, and then the calculation control unit instructs the video matrix unit to work according to the fourteenth control signal. The central control device 40 sends the fifteenth control signal to the first display device 10 through the network connection, and the first display device determines to receive the third display signal according to the fifteenth control signal and displays it. When displaying, it can use its own internal channel Switch to the external channel and transmit the third display signal through the external channel. Optionally, when the first display device is used as the first target device, the currently displayed third display signal can also be used as the first display signal, and the third display signal is sent to the multi-screen interactive device through the loop-out function. The loop-out function refers to outputting the fourth display signal to be collected intact.

It can be understood that in practical applications, the third display signal of the external signal source device 80 can also be sent to other display devices for display, and the third display signal can also be recorded by the recording device 70 .

The multi-screen interactive system shown above can also generate display signals from external signal source devices and display them in the multi-screen interactive system, which can enrich the display content of the multi-screen interactive system and increase the flexibility of the multi-screen interactive system .

In an embodiment of the present application, after the second target device displays the first display signal according to the second control signal, it further includes: the second target device generates a touch signal according to a user's touch operation on the first display signal, And send the touch signal to the switch 50; the switch 50 sends the touch signal to the first target device; the first target device responds to the touch signal.

Exemplarily, when the first display signal is displayed through the second target device, the user may also perform a reverse touch on the first display signal through the second target device. In one embodiment, when the user performs a touch operation on the second target device, the second target device generates a touch signal according to the touch operation. The touch signal may include a touch event (such as a drop event, a lift event, a movement event, etc.), a touch position, a touch time, and the like. Optionally, the second target device encodes the touch signal to conform to a network transmission standard, and then the second target device sends the touch signal to the switch 50 . After receiving the touch signal, the switch 50 sends the touch signal to the first target device, and the first target device analyzes the touch signal and responds. It can be understood that during the response process, the first display signal of the first target device is also transmitted to the second target device through the multi-screen interactive device 30 in real time, so that the user of the second target device can clearly respond to the situation.

It can be understood that the user can also perform reverse touch through the third display device 60. At this time, when the third display device 60 displays the first display signal or the second display signal, the user can perform touch control on the third display device 60. During operation, the third display device 60 generates a touch signal according to a touch operation. Optionally, the third display device 60 encodes the touch signal to conform to the network transmission standard, and then sends it to the switch 50 . After the switch 50 receives the touch signal, it sends the touch signal to the first target device or the recording and broadcasting device 70, and the first target device or the recording and broadcasting device analyzes the touch signal and responds.

It can be understood that when the multimedia connection is abnormal, when the second target device displays the first display signal through the network connection, the reverse touch can also be performed in the above manner.

The multi-screen interactive system shown above can realize the reverse touch of the display signal through the network connection, without additional arrangement of other connecting lines, which enriches the functionality of the multi-screen interactive system and reduces the wiring of the multi-screen interactive system the complexity.

In one embodiment of the present application, FIG. 5 is a schematic structural diagram of a multi-screen interactive device provided in one embodiment of the present application. Referring to FIG. 5 , the multi-screen interactive device 30 includes a video matrix unit 31 and a computing control unit 32 connected to each other. , the video matrix unit establishes a multimedia connection with the first display device 10 and multiple second display devices 20 , the computing control unit establishes a serial port connection with the central control device 40 , and establishes a network connection with the switch 50 .

Correspondingly, the multi-screen interactive device 30 receives the current first display signal of the first target device according to the first control signal, and sending the first display signal to the second target device includes: the calculation control unit 32 indicates according to the first control signal The video matrix unit 31 receives the first display signal of the first target device and sends the first display signal to the second target device.

Exemplarily, the multi-screen interactive device 30 is composed of a video matrix unit 31 and a calculation control unit 32. The video matrix unit 31 is used to receive display signals and send display signals according to the control of the calculation control unit 32. The calculation control unit 32 is mainly used for processing Display signals received by the video matrix unit, and control the receiving and sending of the video matrix unit.

In one embodiment, the multimedia interface of the multi-screen interactive device 30 is arranged in the video matrix unit 31, or is connected with the video matrix unit 31, so that the video matrix unit 31 can communicate with the first display device 10 and the second display device through the multimedia interface. 20. The connection of the recording device 70 , the third display device 30 and the external signal source device 80 . The serial interface of the multi-screen interactive device 30 is set in the calculation control unit 32, or connected to the calculation control unit 32, so that the calculation control unit 32 realizes the serial port connection with the central control device 40 through the serial interface. The network interface of the multi-screen interactive device 30 is set in the calculation control unit 32, or connected to the calculation control unit 32, so that the calculation control unit 32 realizes the network connection with the switch 50 through the network interface. It can be understood that the receiving and sending of the multimedia connection in FIG. 5 is only an exemplary description, and the number of multimedia interfaces is not limited.

In one embodiment, the first control instruction of the central control device 40 is sent to the calculation control unit 32, and the calculation control unit 32 sends a corresponding control signal to the video matrix unit 31 according to the first control instruction, and the video matrix unit 31 transmits a corresponding control signal according to the control signal. The display signal of the first target device is received and sent to the second target device. In addition, other control commands of the central control device 40 are also sent to the calculation control unit 32, and the calculation control unit 32 controls the video matrix unit 31 to receive a certain display signal and send it to other display devices.

The multi-screen interactive device 30 encodes the first display signal into a second network signal according to the fifth control signal, and sending the first display signal to the switch 50 includes: the calculation control unit 32 acquires the first display signal received by the video matrix unit 31 according to the fifth control signal; The calculation control unit 32 encodes the first display signal into a second network signal; the calculation control unit 32 sends the second network signal to the switch 50 .

Exemplarily, the computing control unit 32 also has the function of encoding and decoding the display signal. In one embodiment, when the multi-screen interactive device 30 encodes the first display signal, mainly the computing control unit 32 encodes the first display signal. At this point, FIG. 6 is a schematic diagram of internal signal transmission of a multi-screen interactive device provided by an embodiment of the present application. With reference to Fig. 6, after the computing control unit 32 receives the 5th control signal by the communication cable of serial interface, send a control signal to video matrix unit 31 according to the 5th control signal, this control signal is used for indicating that video matrix unit 31 will receive The first display signal is sent to the calculation control unit 32, and then the calculation control unit 32 encodes the first display signal to generate a second network signal, and then the calculation control unit 32 sends the second network signal to the switch 50 through a network cable . It can be understood that in practical applications, the computing control unit can also encode other display signals in the above manner and send them to the switch. When the multi-screen interactive device decodes a certain network signal, the calculation control unit may receive the network signal through the network cable, and decode to obtain the corresponding display signal, and then send the display signal to the video matrix unit 31, and instruct the video matrix The unit 31 sends the display signal to a corresponding display device for display.

The above-mentioned multi-screen interactive device is composed of a video matrix unit and a computing control unit, and the data processing and analysis capabilities of the computing control unit are realized through computer programs in the computing control unit, which increases the functionality of the multi-screen interactive device, and not only realizes the display The scheduling of the signal can also encode and decode the display signal. Moreover, when the multi-screen interactive device is used for connection, there is no need to modify the hardware of other devices in the multi-screen interactive system.

The application scenarios of the multi-screen interactive system are described below as examples. The current application scenario is a teaching scenario. The multi-screen interactive system is deployed in the classroom. In the multi-screen interactive system, the first display device is installed on the blackboard side, multiple second display devices are installed on the student side, and the third display device and central control device Integrated mount on the side of the lectern. There are currently no restrictions on the installation locations of multi-screen interactive devices, recording and broadcasting devices, and switches. The multi-screen interactive device establishes HDMI connections with the first display device, the second display device, the third display device and the recording and broadcasting device, establishes an RS-232 standard interface connection with the central control device, and establishes a wired network connection with the switch. The first display device, the second display device, the third display device, the central control device, and the recording and broadcasting device respectively establish wired network connections with the switch, wherein the third display device and the central control device share a network cable. At this time, through the multi-screen interactive system, it is possible to watch the display screen of the first display device through the second display device, watch the display screen of a certain second display device through the first display device, record through the recording and broadcasting device, and Reverse touch can also be realized by using the third display device to display the recording screen, the display screen of the first display device, or the display screen of the second display device. Moreover, the switching between multimedia transmission and network transmission can be realized, which simplifies the wiring complexity of the multi-screen interactive system in the classroom, ensures the stability of the multi-screen interactive system, and enables the normal transmission of display signals.

An embodiment of the present application also provides a multi-screen interactive device, the multi-screen interactive device is provided with a plurality of multimedia interface serial interfaces, and the plurality of multimedia interfaces are respectively used to communicate with the first display device and the plurality of second display The device establishes a multimedia connection, the serial interface is used to establish a serial port connection with the central control device, and the first display device, the central control device, and multiple second display devices all establish network connections with the switch.

The multi-screen interactive device receives the first control signal sent by the central control device through the serial interface, and the first control signal is generated by the central control device according to the user's first control instruction.

The multi-screen interactive device receives the current first display signal of the first target device through the first multimedia interface connected to the first target device according to the first control signal, and transmits the first display signal through the first display signal connected to the second target device. The second multimedia interface sends to the second target device. When the first target device is the first display device, the second target device is the second display device. When the first target device is the second display device, the second target device is The first display device and the second target device display the first display signal according to the second control signal sent by the switch, and the second control signal is generated by the central control device according to the first control instruction and sent to the switch.

In an embodiment of the present application, the multi-screen interactive device is further provided with a network interface, and the network interface establishes a network connection with the switch. After the multi-screen interactive device sends the first display signal to the second target device through the second multimedia interface connected to the second target device, it further includes:

When the multi-screen interactive device determines that the multimedia connection is abnormal through the multimedia interface, it generates a second abnormal signal and sends it to the central control device through the serial interface; the multi-screen interactive device receives the fifth control signal sent by the central control device through the serial interface. The fifth control signal is generated according to the second abnormal signal; the multi-screen interactive device encodes the first display signal into a second network signal according to the fifth control signal, and sends the second network signal to the switch through the network interface, so that the switch converts the second network signal The second network signal is sent to the second target device for display.

In one embodiment of the present application, the multi-screen interactive device further includes: a video matrix unit and a computing control unit connected to each other, the video matrix unit is provided with a plurality of multimedia interfaces, and the computing control unit is provided with a serial interface and a network interface; the multi-screen The interactive device receives the current first display signal of the first target device through the first multimedia interface connected to the first target device according to the first control signal, and transmits the first display signal through the second display signal connected to the second target device. The multimedia interface sending to the second target device includes:

According to the first control signal, the calculation control unit instructs the video matrix unit to receive the current first display signal of the first target device through the first multimedia interface connected to the first target device, and transmit the first display signal to the second target device. The second multimedia interface to which the device is connected sends the message to the second target device.

The multi-screen interactive device encodes the first display signal into a second network signal according to the fifth control signal, and sending the second network signal to the switch through the network interface includes:

The computing control unit acquires the first display signal received by the video matrix unit according to the fifth control signal.

The computing control unit encodes the first display signal into a second network signal.

The computing control unit sends the second network signal to the switch through the network interface.

It can be understood that for the specific description of the multi-screen interactive device, reference may be made to the description related to the multi-screen interactive device in the above multi-screen interactive system embodiment, and it has corresponding functions and beneficial effects.

It should also be noted that the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes Other elements not expressly listed, or elements inherent in the process, method, commodity, or apparatus are also included. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

Note that the above are only preferred embodiments and technical principles used in this application. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present application, and the present application The scope is determined by the scope of the appended claims.

Claims

A multi-screen interactive system, including: a first display device, a plurality of second display devices, a multi-screen interactive device, a central control device and a switch, the first display device and the plurality of second display devices are establishing a multimedia connection with the multi-screen interactive device, establishing a serial connection between the central control device and the multi-screen interactive device, the first display device, the plurality of second display devices, and the central control device The switch establishes a network connection;

The central control device generates a first control signal and a second control signal according to the user's first control instruction, and sends the first control signal to the multi-screen interactive device, and sends the second control signal to the said switch;

The multi-screen interactive device receives the current first display signal of the first target device according to the first control signal, and sends the first display signal to a second target device, and the first target device is the first target device When a display device, the second target device is the second display device, and when the first target device is the second display device, the second target device is the first display device;

the switch sends the second control signal to the second target device;

The second target device displays the first display signal according to the second control signal.
The multi-screen interactive system according to claim 1, wherein, after the second target device displays the first display signal according to the second control signal, it further includes:

When the multi-screen interactive device determines that the multimedia connection is abnormal, it generates a first abnormal signal and sends it to the central control device;

The central control device generates a third control signal and a fourth control signal according to the first abnormal signal, and sends the third control signal and the fourth control signal to the switch;

the switch sends the third control signal to the first target device and sends the fourth control signal to the second target device;

The first target device encodes the first display signal into a first network signal according to the third control signal, and sends it to the switch;

the switch sends the first network signal to the second target device;

The second target device decodes the received first network signal according to the fourth control signal to obtain a first display signal, and displays the first display signal.
The multi-screen interactive system according to claim 1, wherein the multi-screen interactive device establishes a network connection with the switch;

After the second target device displays the first display signal according to the second control signal, it further includes:

When the multi-screen interactive device determines that the multimedia connection is abnormal, it generates a second abnormal signal and sends it to the central control device;

The central control device generates a fifth control signal and a sixth control signal according to the second abnormal signal, and sends the fifth control signal to the multi-screen interactive device, and sends the sixth control signal to the said switch;

The multi-screen interactive device encodes the first display signal into a second network signal according to the fifth control signal, and sends the second network signal to the switch;

the switch sends the sixth control signal to the second target device;

the switch sends the second network signal to the second target device;

The second target device decodes the received second network signal according to the sixth control signal to obtain a first display signal, and displays the first display signal.
The multi-screen interactive system according to claim 2, wherein the second target device displaying the first display signal according to the second control signal comprises:

The second target device switches the currently used internal channel to an external channel according to the second control signal;

The second target device acquires the first display signal through the external channel, and displays the first display signal;

The second target device decodes the received first network signal according to the fourth control signal to obtain a first display signal, and displaying the first display signal includes:

The second target device switches the currently used external channel to the internal channel according to the fourth control signal;

The second target device decodes the first network signal according to the fourth control signal to obtain a first display signal;

The second target device obtains the first display signal through the internal channel, and displays the first display signal.
The multi-screen interactive system according to claim 1, further comprising: a third display device, the third display device establishes a multimedia connection with the multi-screen interactive device, establishes a connection with the central control device, and establishes a connection with the The switch establishes a network connection;

The central control device generates a seventh control signal and an eighth control signal according to the user's second control instruction, and sends the seventh control signal to the multi-screen interactive device, and sends the eighth control signal to the the third display device;

The multi-screen interactive device sends the first display signal to the third display device according to the seventh control signal;

The third display device displays the first display signal according to the eighth control signal.
The multi-screen interactive system according to claim 5, further comprising: a recording and broadcasting device, the recording and broadcasting device establishes a multimedia connection with the multi-screen interactive device, and establishes a network connection with the switch;

The central control device generates a ninth control signal and a tenth control signal according to the third control instruction of the user, and sends the ninth control signal to the multi-screen interactive device, and sends the tenth control signal to the said switch;

The multi-screen interactive device sends the first display signal to the recording and broadcasting device according to the ninth control signal;

The switch sends the tenth control signal to the recording and broadcasting device;

The recording and broadcasting device records the first display signal according to the tenth control signal.
The multi-screen interactive system according to claim 6, wherein, after the recording and broadcasting device records the first display signal according to the tenth control signal, it further includes:

The recording and broadcasting device sends a second display signal generated during the recording process to the multi-screen interactive device, and the second display signal is a recording screen display signal of the recording and broadcasting device;

The multi-screen interactive device sends the second display signal to the third display device for display.
The multi-screen interactive system according to claim 1, further comprising: an external signal source device, the external signal source device establishes a multimedia connection with the multi-screen interactive device;

The external signal source device sends its own third display signal to the multi-screen interactive device;

The multi-screen interactive device sends the third display signal to the first display device for display.
The multi-screen interactive system according to claim 1, wherein, after the second target device displays the first display signal according to the second control signal, it further includes:

The second target device generates a touch signal according to a user's touch operation on the first display signal, and sends the touch signal to the switch;

The switch sends the touch signal to the first target device;

The first target device responds to the touch signal.
The multi-screen interactive system according to claim 3, wherein the multi-screen interactive device includes a video matrix unit and a computing control unit connected to each other, and the video matrix unit is connected to the first display device and a plurality of the first display devices. The second display device establishes a multimedia connection, and the calculation control unit establishes a serial port connection with the central control device and establishes a network connection with the switch;

The multi-screen interactive device receiving the current first display signal of the first target device according to the first control signal, and sending the first display signal to the second target device includes:

The calculation control unit instructs the video matrix unit to receive the first display signal of the first target device and send the first display signal to the second target device according to the first control signal;

The multi-screen interactive device encodes the first display signal into a second network signal according to the fifth control signal, and sending the signal to the switch includes:

The calculation control unit acquires the first display signal received by the video matrix unit according to the fifth control signal;

The computing control unit encodes the first display signal into a second network signal;

The computing control unit sends the second network signal to the switch.
The multi-screen interactive system according to claim 1, wherein the multimedia connection is a high-definition multimedia interface connection, and each of the high-definition multimedia interface connections is used for one-way transmission of one display signal.
A multi-screen interactive device, wherein the multi-screen interactive device is provided with multiple multimedia interfaces and serial interfaces;

The multiple multimedia interfaces are respectively used to establish multimedia connections with the first display device and multiple second display devices, the serial interface is used to establish serial port connections with the central control device, the first display device, the central control device The control device and the multiple second display devices all establish a network connection with the switch;

The multi-screen interactive device receives a first control signal sent by the central control device through the serial interface, and the first control signal is generated by the central control device according to a user's first control instruction;

The multi-screen interactive device receives the current first display signal of the first target device through the first multimedia interface connected to the first target device according to the first control signal, and transmits the first display signal Send to the second target device through the second multimedia interface connected to the second target device, when the first target device is the first display device, the second target device is the second display device device, when the first target device is the second display device, the second target device is the first display device, and the second target device controls the The first display signal is displayed, and the second control signal is generated by the central control device according to the first control instruction and sent to the switch.
The multi-screen interactive device according to claim 12, wherein the multi-screen interactive device is further provided with a network interface, and the network interface establishes a network connection with the switch,

After the multi-screen interactive device sends the first display signal to the second target device through the second multimedia interface connected to the second target device, it further includes:

When the multi-screen interactive device determines that the multimedia connection is abnormal through the multimedia interface, it generates a second abnormal signal and sends it to the central control device through the serial interface;

The multi-screen interactive device receives a fifth control signal sent by the central control device through the serial interface, and the fifth control signal is generated according to the second abnormal signal;

The multi-screen interactive device encodes the first display signal into a second network signal according to the fifth control signal, and sends the second network signal to the switch through the network interface, so that the The switch sends the second network signal to the second target device for display.
The multi-screen interactive device according to claim 13, wherein the multi-screen interactive device further comprises: a video matrix unit and a computing control unit connected to each other, the video matrix unit is provided with a plurality of the multimedia interfaces, the The computing control unit is provided with the serial interface and the network interface;

The multi-screen interactive device receives the current first display signal of the first target device through the first multimedia interface connected to the first target device according to the first control signal, and transmits the first display signal Sending to the second target device through the second multimedia interface connected to the second target device includes:

According to the first control signal, the calculation control unit instructs the video matrix unit to receive the current first display signal of the first target device through the first multimedia interface connected to the first target device and convert the sending the first display signal to the second target device through a second multimedia interface connected to the second target device;

The multi-screen interactive device encodes the first display signal into a second network signal according to the fifth control signal, and sending the second network signal to the switch through the network interface includes:

The calculation control unit acquires the first display signal received by the video matrix unit according to the fifth control signal;

The computing control unit encodes the first display signal into a second network signal;

The computing control unit sends the second network signal to the switch through the network interface.