TWI687102B - Remote video system of bilateral control and method thereof - Google Patents

Abstract

A remote video system of bilateral control and method thereof are provided. The system includes two video mixing devices. Each video mixing device includes a plurality of video input ports, a video output port, a communication module and a controller. Each video input port receives a local video signal respectively. The video output port outputs a local output signal. The communication module communicates with the other video mixing device to receive a remote video signal therefrom. The controller generates a remote switch signal based on a local switch signal, and transmits the remote switch signal to the other video mixing device through the communication module. The video mixing device which generates the remote switch signal determines the content of the local output signal of which based on the local switch signal. The video mixing device which receives the remote switch signal determines the content of the local output signal of which based on the remote switch signal.

Description

Bilaterally controlled remote video system and method

A video switching system, particularly a bilaterally controlled remote video system and method that can switch between each other to share pictures.

When conducting long-distance video conferences, the terminals usually control the content displayed locally. When a collaborative operation is required, the sharing terminal will share the content screen to other terminals, so that each terminal can view a consistent screen, so that users located in front of each terminal can simultaneously view the screen.

However, when conducting a remote video conference, a terminal is often used as the main sharing terminal, and the remaining terminals are connected to this main sharing terminal, and the video screen shared by the main sharing terminal can be seen on each terminal. Therefore, when one of the remaining terminals wants to share the screen, the original main sharing terminal must be disconnected, and the terminal that continues to share the screen should be the main sharing terminal, and then connect the remaining terminals to this connection. The main sharing end of the sharing screen.

In other words, the current screen sharing method can only share the screen in one direction. When you want to switch the sharing screen, you must switch to another terminal as the main sharing terminal. When switching the main sharing end, each terminal needs to be connected to the main sharing end again to further obtain a new sharing screen. As a result, it is extremely inconvenient when sharing pictures.

In view of the above, it is necessary to propose a video switching system, so that any one of the terminals can always provide the screen to be shared to the remaining terminals at any time, so as to smoothly perform collaborative operations.

An embodiment of the present invention provides a bilaterally controlled remote video system, including: two video mixing devices, and each video mixing device includes: a plurality of video input ports, a video output port, a communication module, and a controller. Each video input port receives local video signals separately. Video output port is to output local output signal. The communication module is communicatively connected to another video mixing device to receive the remote video signal it transmits. The controller generates the remote switching signal according to the local switching signal, and transmits the remote switching signal to another video mixing device through the communication module. The video mixing device that generates the remote switching signal generates a local output signal based on at least one of the local video signal and the remote video signal received by the local switching signal. The video mixing device receiving the remote switching signal generates a local output signal based on at least one of the local video signal and the remote video signal received by the remote switching signal.

An embodiment of the present invention further provides a bilaterally controlled remote video method, including: generating a remote switching signal according to a local switching signal with one of the two video mixing devices. Send the remote switching signal to another video mixing device. A video mixing device that generates a remote switching signal generates a local output signal based on at least one of a plurality of local video signals and remote video signals received based on the local switching signal. The video mixing device receiving the remote switching signal generates a local output signal based on at least one of each local video signal and remote video signal received by the remote switching signal.

According to the above, at least one of the local video signal and the remote video signal is further generated as a local output signal by the video mixing device receiving the remote switching signal or the video mixing device generating the remote switching signal. In this way, each video mixing device can be switched at any time to share the image to be shared with another video mixing device, so as to improve the troublesome operation as in the prior art.

Please refer to FIG. 1, the bilaterally controlled remote video system 1 includes multiple video mixing devices 10. Each video mixing device 10 includes a plurality of video input ports 11, a video output port 12, a communication module 13, and a controller 14. The controller 14 is connected between the video input port 11, the video output port 12 and the communication module 13. Each video input port 11 is connected to the video output device 2 respectively. The communication module 13 of the video mixing device 10 is in communication connection with the communication module 13 of another video mixing device 10. The video output ports 12 are respectively connected to the display unit 3.

In this embodiment, the video mixing device 10 includes a first video mixing device 101 and a second video mixing device 102. The present invention is not limited to this. In some embodiments, any video mixing device 10 can be connected to multiple video mixing devices 10 at the same time, that is, the video mixing device 10 of the present invention is not limited to the two shown in FIG. .

Each video input port 11 of each video mixing device 10 receives a local video signal. In other words, each video input port 11 receives the local video signal generated from the video output device 2 respectively.

In one embodiment, the video output device 2 may be a video camera, a computer, a notebook computer, a mobile phone, a tablet computer, an electronic whiteboard, or other electronic devices capable of outputting local video signals of video images. The present invention is not limited thereto.

In one embodiment, each video output port 12 outputs a local output signal to the display unit 3. Therefore, each display unit 3 can display a display screen corresponding to the local output signal.

The communication module 13 of each video mixing device 10 can be connected to the communication module 13 of another video mixing device 10 via a wired mode or a wireless mode.

In an embodiment, the communication module 13 may also be transmitted in a wired transmission method that conforms to Ethernet, HDMI, USB, or other methods. The present invention is not limited to this. In some embodiments, the communication module 13 can comply with WiFi, Bluetooth, WiMAX, or other wireless transmission methods.

The controller 14 includes a display control unit 141 and an image fusion unit 142. The display control unit 141 generates a remote switching signal according to the local switching signal received from each video input port 11. The display control unit 141 then transmits the remote switching signal to another video mixing device 10 through the communication module 13. Furthermore, the image fusion unit 142 can receive a local video signal from each video input port 11 to further generate a remote video signal from one or any combination of the local video signals. In order to further transmit the remote video signal to another video mixing device 10 via the communication module 13.

The display control unit 141 and the image fusion unit 142 in the controller 14 may be microprocessors, microcontrollers, digital signal processors, microcomputers, central processors, and/or any operation signals based on operation instructions (analog and/or Digital) electronic components, the invention is not limited thereto.

Here, each video mixing device 10 further includes an operation interface 15. The operation interface 15 generates a corresponding local switching signal according to the input operation. Here, the controller 14 generates the corresponding remote switching signal from the local switching signal, and then further transmits the corresponding remote switching signal to the other video mixing device 10 through the communication module 13.

In an embodiment, the operation interface 15 may be constituted by buttons, knobs, touch screens, etc. The present invention is not limited to this. In some embodiments, the operation interface 15 can also be constructed on a mobile phone, computer, notebook computer, tablet computer, etc., and then send the local switching signal generated by the user input operation to the corresponding的视讯混合装置10。 The video mixing device 10. Then, the controller 14 of the video mixing device 10 generates the remote switching signal corresponding to the local switching signal.

Here, an example is used as an illustration, but the invention is not limited thereto. In one embodiment, please also refer to FIGS. 1 to 4, the user is located in front of the second video mixing device 102 and wants the display unit 3 connected to the first video mixing device 101 to display the second video mixing device 102 'S local video signal. Therefore, the user can perform the corresponding operation through the input interface 15 of the second video mixing device 102, so that the second video mixing device 102 can generate the corresponding local switching signal (as shown in step S011 of FIG. 3). Then, the display control unit 141 of the second video mixing device 102 can correspondingly convert the local switching signal into a remote switching signal (as shown in step S01 of FIG. 2), and the image fusion unit 142 correspondingly converts the local video signal into a remote video Signal. Then, the remote switching signal is transmitted to the communication module 13 of the first video mixing device 101 through the communication module 13 of the second video mixing device 102 (step S02), that is, the second video mixing device 101 The hybrid device 102 receives the remote switching signal. The image fusion unit 142 of the first video mixing device 101 can mix the remote video signal received from the second video mixing device 102 with the local video signal of the first video mixing device 101 to become a new local output signal (see FIG. 2 Step S03), and output the local output signal to the corresponding connected display unit 3 through the video output port 12 (as shown in step S031 of FIG. 4). In this way, the corresponding screen can be played on the display screen of the display unit 3 of the first video mixing device 101. In addition, the second video mixing device 102 that generates the local switching signal can thereby receive its remote video signal through the first video mixing device 101, and mix its local video signal and reception through the image fusion unit 142 of the second video mixing device 102 The remote video signal becomes the new local output signal (as in step S04), and the corresponding picture is played on the display unit 3 of the second video mixing device 102. In this way, one end of the second video mixing device 102 can be controlled so that one end of the first video mixing device 101 can display the corresponding images.

Similarly, the user at the end of the first video mixing device 101 can also control the operation interface 15 of the first video mixing device 101 at any time, so that the second video mixing device 102 can receive the remote video of the first video mixing device 101 Signal. And the remote video signal is mixed with the local video signal of the second video mixing device 102 to become a local output signal. Moreover, the first video mixing device 101 can also receive the remote video signal from the second video mixing device 102 and the local video signal of the first video mixing device 101 to form the local output signal of the first video mixing device 101. In this way, the second video mixing device 102 can also display a screen corresponding to the display of the first video mixing device 101.

Here, the local output signal output from the video output port 12 of the first video mixing device 101 may be only the local video signal from the first video mixing device 101 or only the remote video from the second video mixing device 102 The signal, or a mixture of the original local video signal of the first video mixing device 101 and the remote video signal of the second video mixing device 102. Similarly, the local output signal output from the video output port 12 of the second video mixing device 102 may be only the remote video signal received from the first video mixing device 101 or only the local from the second video mixing device 102 The video signal, or a mixture of the remote video signal of the first video mixing device 101 and the local video signal of the second video mixing device 102.

Several examples are used here for illustration, but the invention is not limited thereto. In the first embodiment, the video output device 2 of the first video mixing device 101 has a first presentation content frame (CH11) and the frame captured by the first camera (CH12), and the video output device of the second video mixing device 102 2 There is a second presentation content screen (CH21) and a screen captured by the second camera (CH22). In this embodiment, the video output port 12 of the first video mixing device 101 and the video output port 12 of the second video mixing device 102 are local output signals that output the same content. That is to say, the display screen played by the display unit 3 connected to the first video mixing device 101 and the display screen played by the display unit 3 connected to the second video mixing device 102 are the same screen (for example, about CH11, CH12, CH21 are displayed simultaneously Or the screen of CH22, which is the first to fourth modes in the display mode of FIG. 6). In other words, the user located at the end of the first video mixing device 101 or the user located at the end of the second video mixing device 102 can control it at any time as needed to allow the opposite video mixing device 10 to receive the corresponding local video signal. In order to further enable the image fusion unit 142 in each video mixing device 10 to generate the same local output signal, that is, let each display unit 3 display the same screen. For example, each display unit 3 displays the content of the presentation (CH11 or CH21) received from the video output port 12 of the first video mixing device 101 or the video output port 12 of the second video mixing device 102, and the screen captured by the camera (CH12 or CH22), electronic whiteboard content or other screens.

In the second embodiment, referring to FIG. 5, the display screen 30 of each display unit 3 is divided into a main pane 301 and at least one secondary pane 302. The main pane 301 and the sub pane 302 display the main screen and the sub screen according to the local output signal, respectively. That is to say, the image fusion unit 142 generates one or a combination of each local video signal or/and each remote video signal received from another video mixing device 10 according to the remote switching signal or the local switching signal The local output signals arranged in the main pane 301 and the sub pane 302. In this way, the display unit 3 can display the corresponding main screen and sub screen in the main pane 301 and the sub pane 302 according to the local output signal.

For example, the user wants to display the picture (CH12) captured by the camera connected to the first video mixing device 101 in the sub-panel 302 of each display unit 2 and the content of the presentation connected to the second video mixing device 102 (CH21) The main screen (the fifth mode shown in FIG. 6) is displayed on the main pane 301 of each display unit 2. Here, the user can generate the local switching signal through the operation of the operation interface 15 of the first video mixing device 101. Then, the display control unit 141 of the first video mixing device 101 can drive the image fusion unit 142 according to the local switching signal to configure the remote video signal (CH21) from the second video mixing device 102 corresponding to the main window of the display unit 3 The main screen is displayed in the grid. And the picture captured by the camera (CH12) is configured to correspond to the secondary picture displayed in the secondary pane of the display unit 3. Similarly, the display control unit 141 of the second video mixing device 102 drives the image fusion unit 142 of the second video mixing device 102 according to the remote switching signal from the first video mixing device 101 The video signal (CH21) is arranged in the main pane to display the main screen, and the image fusion unit 142 of the second video mixing device 102 arranges the remote video signal (CH12) from the first video mixing device 101 in the sub pane to The secondary screen is displayed.

In one embodiment, in the sixth mode in FIG. 6, the main pane 301 of the display unit 3 connected to the first video mixing device 101 and the display unit 3 connected to the second video mixing device 102 are displayed on CH21 The main screen, and the secondary pane of the display unit 3 connected to the first video mixing device 101 displays CH22 (that is, the screen captured by the camera connected to the second video mixing device 102), and the display connected to the second video mixing device 102 The secondary pane of unit 3 displays CH12 (that is, the screen captured by the camera connected to the first video mixing device 101).

In addition, in an embodiment, in the seventh mode in FIG. 6, the screen of the computer (video output device 2) that the user at one end of the second video mixing device 102 wants to connect to (such as the second presentation content CH21) Share to the display unit 3 connected to the first video mixing device 101. Then, the user can operate through the operation interface 15 of the second video mixing device 102, so that the main pane 301 of the display unit 3 of the first video mixing device 101 displays the local video signal of the computer of the second video mixing device 102 (that is, let The first video mixing device 101 receives the remote video signal from the second video mixing device 102), and causes the local video signal of the first video mixing device 101 (that is, the camera (CH12) and the electronic whiteboard) to be displayed in the sub-pane 302 . Here, the second video mixing device 102 receives the local video signal from the first video mixing device 101, so that the main pane 301 of the display unit 3 of the second video mixing device 102 displays the screen corresponding to the computer, and the secondary pane 302 displays the screen corresponding to the camera and the whiteboard.

In one embodiment, the comparison table 143 shown in FIG. 6 can be stored in the controller 14 so that the display control unit 141 can select the corresponding display mode from the comparison table 143 according to the local switching signal or the remote switching signal. To further drive the image fusion unit 142 to generate a corresponding local output signal according to the display mode. Among them, the comparison table 143 can add or delete its settings as needed, such as increasing or decreasing the display mode, changing the display content or other related settings.

The video input port 11 and the video output port 12 can be USB ports, COM ports, VGA ports, HDMI ports, PCIE ports, or other ports that can transmit audio and video signals. In some embodiments, each video input port 11 and video output port 12 may be any combination of the aforementioned various types of connection ports, and the present invention is not limited thereto.

According to the above-mentioned embodiment, each video mixing device 10 in the present invention can be individually switched as required, so that each video mixing device 10 can generate a corresponding local output signal to further display a corresponding picture. In this way, the users at the ends of different video mixing devices 10 can switch at any time as needed, and the users at the ends of the video mixing devices 10 can see the corresponding screens at any time for collaborative operations.

3 shows the distal end of the video conference system unit 1 video 2 video mixing apparatus 10 the output device 11 outputs video input port 12 port 13 video communication module 141 interface 14 display controller 15 controls operation of the image integration unit 142, 101 of the first table unit 143 video 102 second mixing means mixing the video display screen 30 301 302 main pane pane S01, S02, S03, S04 step S011, S031 step

FIG. 1 is a schematic structural diagram of a bilaterally controlled remote video system according to an embodiment of the present invention. [FIG. 2] is a step diagram of a bilaterally controlled remote video system according to an embodiment of the present invention. [FIG. 3] is a step diagram of a bilaterally controlled remote video method according to an embodiment of the present invention. 4 is another step diagram of a bilaterally controlled remote video method according to an embodiment of the invention. FIG. 5 is a schematic diagram of a display unit according to an embodiment of the invention. 6 is a schematic diagram of a comparison table according to an embodiment of the invention.

3 shows the distal end of the video conference system unit 1 video 2 video mixing apparatus 10 the output device 11 outputs video input port 12 port 13 video communication module 141 interface 14 display controller 15 controls the operation unit 142 image fusion unit 101 of the first video mixing means 102 Second video mixing device

Claims (10)

A bilaterally controlled remote video system, including: two video mixing devices, each of which includes: a plurality of video input ports to receive a local video signal; a video output port to output a local output signal; a communication module Group, communicating with another video mixing device to receive a remote video signal transmitted by it; and a controller storing a comparison table including a plurality of display modes, generating a local switching signal based on a local switching signal A remote switching signal in the same display mode, and sending the remote switching signal to another video mixing device through the communication module, generating the remote video signal according to the local video signals; wherein, the remote The video mixing device of the terminal switching signal changes its own content of the local output signal according to the local switching signal, wherein the content of the changed local output signal is based on the display corresponding to the local switching signal in the comparison table Mode is generated from at least one of the local video signal and the remote video signal; wherein the video mixing device receiving the remote switching signal changes its local output signal according to the remote switching signal Content, wherein the changed content of the local output signal is generated from at least one of the local video signal and the remote video signal according to the display mode corresponding to the remote switching signal in the comparison table . The bilaterally controlled remote video system according to claim 1, wherein the video mixing devices include a first video mixing device and a second video mixing device, the second video mixing device generates the local switching signal, the first A video mixing device receives the remote switching signal corresponding to the local switching signal, the first video mixing device receives the remote video signal from the second video mixing device, and passes the video of the first video mixing device The output port outputs the local output signal corresponding to any combination of the local video signal and the remote video signal from the second video mixing device. The bilaterally controlled remote video system according to claim 2, wherein the local output signal of the first video mixing device is the remote video signal of the second video mixing device. The bilaterally controlled remote video system according to claim 2, wherein the first video mixing device generates the local output signal according to the remote video signal from the second video mixing device, and the second video mixing device depends on the The local video signal of the second video mixing device generates the local output signal. The bilaterally controlled remote video system according to any one of claims 1 to 4, wherein each of the video mixing devices further includes an operation interface that generates the local switching signal according to the input operation. A bilaterally controlled remote video method, comprising: storing a comparison table including a plurality of display modes in two video mixing devices; generating and switching the local switching signal according to a local switching signal with one of the video mixing devices A remote switching signal belonging to the same display mode; sending the remote switching signal to another video mixing device; and The video mixing device receiving the remote switching signal changes its content of a local output signal according to the remote switching signal, wherein the changed content of the local output signal is related to the remote switching signal according to the comparison table Corresponding to the display mode, it is generated from at least one of a plurality of local video signals and a remote video signal, the remote video signal is generated according to the local video signal; wherein, the video generating the remote switching signal The hybrid device changes its own content of the local output signal according to the local switching signal, wherein the changed content of the local output signal is based on the display mode corresponding to the local switching signal in the look-up table from the local At least one of the video signal and the remote video signal is generated. The bilaterally controlled remote video method according to claim 6, further comprising: generating the local switching signal with a second video mixing device of the video mixing devices; mixing with a first video mixing device of the video mixing devices The device receives the remote switching signal corresponding to the local switching signal; the first video mixing device receives the remote video signal from the second video mixing device according to the remote switching signal; and the first video mixing device A video output port outputs the local output signal corresponding to any combination of the remote video signal received from the second video mixing device and the local video signal of the first video mixing device. The bilaterally controlled remote video method according to claim 7, wherein the local output signal of the first video mixing device is the remote video signal of the second video mixing device. The remote control method of bilateral control as described in claim 7 further includes: Using the first video mixing device to generate the local output signal based on the remote video signal from the second video mixing device; and using the second video mixing device to generate the local video signal based on the local video signal of the second video mixing device Output signal. The remote control method for bilateral control as described in any one of claims 6 to 9, further comprising: generating the local switching signal according to an operation input with an operation interface.

Images