WO2018077105A1

WO2018077105A1 - Dual-stream conference device and method

Info

Publication number: WO2018077105A1
Application number: PCT/CN2017/106867
Authority: WO
Inventors: 苏贤续
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-10-25
Filing date: 2017-10-19
Publication date: 2018-05-03
Also published as: CN107979738A

Abstract

A dual-stream conference device, comprising a conference television terminal and a USB auxiliary stream means. The USB auxiliary stream means accesses an auxiliary streaming video source; a communication module of the conference television terminal performs a video conference with multiple terminals, and is bonded with and communicationally connected to the USB auxiliary stream means in a wireless mode. A receiving and storing module of the conference television terminal receives current auxiliary streaming video data sent by the USB auxiliary stream means and acquired from the auxiliary streaming video source, and sends the current auxiliary streaming video data to the multiple terminals in a dual streaming mode. Also provided is a dual-stream conference method. The dual-stream conference device and method improve the transmission distance and flexibility of auxiliary streaming video data in a dual-stream conference process, reduces wiring and maintenance costs, and expands the scope of application of dual-stream conferences.

Description

Dual stream conference device and method

Technical field

The present disclosure relates to the field of control and, more particularly, to a dual stream conferencing apparatus and method.

Background technique

At present, the conference television terminal provides a rich interface, including a video graphics array (VGA), a high definition multimedia interface (HDMI), a color difference component (YPBPR), etc. The input of the video source such as the computer desktop and the video source of the camera is sent to each venue as a secondary video to achieve the purpose of collaborative conference. However, these interfaces use the original wiring technology, which uses a local physical wired connection to connect the dual-stream video source to the video conferencing terminal, which severely limits the transmission distance and flexibility of use. If the physical cable fails, the maintenance cost is also high.

Summary of the invention

In view of this, the embodiment of the present invention provides a dual-stream conference device, where the dual-stream conference device includes a conference television terminal and a USB auxiliary stream device, and the USB auxiliary stream device accesses a secondary stream video source, where the conference television terminal includes :

a communication module, configured to perform video conference with a plurality of terminals, and perform binding and communication connection with the USB auxiliary stream device by using a wireless manner; and

Receiving a storage module, configured to receive current auxiliary stream video data collected by the USB auxiliary stream device and collected from the auxiliary stream video source, and send the current auxiliary stream video data to the multiple stream in a dual stream manner Terminals.

According to an exemplary embodiment, the USB auxiliary stream device includes:

a data sampling module, configured to collect current auxiliary stream video data of the auxiliary stream video source, and encode the collected current auxiliary stream video data according to a preset encoding format and a code rate to obtain encoded auxiliary stream video data;

And a data sending module, configured to send the encoded auxiliary stream video data to the conference television terminal by using the wireless manner.

According to an exemplary embodiment, the USB auxiliary stream device further includes:

a touch sensing module, configured to receive a first touch signal, and trigger the data sampling module to collect the first touch signal according to the first touch signal, before the data sampling module collects current auxiliary stream video data of the auxiliary stream video source The current auxiliary stream video data of the auxiliary stream video source, encoding the collected current auxiliary stream video data according to a preset encoding format and a code rate to obtain the encoded auxiliary stream video data, and triggering the data sending module to The encoded auxiliary stream video data is transmitted to the conference television terminal.

According to an exemplary embodiment, after the data sampling module collects the current auxiliary stream video data of the auxiliary stream video source, the touch sensing module is further configured to receive a second touch signal according to the second touch. The signal control module stops collecting the current auxiliary stream video data of the auxiliary stream video source, and stops according to the preset encoding format and code. Rateing the collected auxiliary stream video data to obtain the encoded auxiliary stream video data, and controlling the data sending module to stop transmitting the encoded auxiliary stream video data to the conference television terminal.

According to an exemplary embodiment, the receiving storage module is further configured to receive the encoded auxiliary stream video data, and determine whether a coding rate of the encoded auxiliary stream video data is consistent with a coding rate of the video conference, when inconsistent Decoding the encoded auxiliary stream video data, re-encoding according to the coding rate of the video conference, and transmitting the re-encoded auxiliary stream video data to the multiple mobile terminals in a dual stream format.

The embodiment of the present invention further provides a dual-stream conference method, where the dual-stream conference method is applied to the dual-stream conference apparatus provided by the present invention, where the dual-stream conference method includes:

The USB auxiliary stream device accesses the auxiliary stream video source;

The conference television terminal performs video conference with a plurality of terminals, and performs binding and communication connection with the USB auxiliary stream device by using a wireless manner; and

The conference television terminal receives the current auxiliary stream video data that is sent by the USB auxiliary stream device and is collected from the auxiliary stream video source, and sends the current auxiliary stream video data to the plurality of streams in the form of a dual stream. terminal.

According to an exemplary embodiment, the sending, by the USB auxiliary stream device, the current auxiliary stream video data collected from the auxiliary stream video source includes:

The USB auxiliary stream device collects current auxiliary stream video data of the auxiliary stream video source, and encodes the collected current auxiliary stream video data according to a preset encoding format and a code rate to obtain encoded auxiliary stream video data;

And the USB auxiliary stream device sends the encoded auxiliary stream video data to the conference television terminal by using a wireless manner.

According to an exemplary embodiment, before the USB auxiliary stream device collects the current auxiliary stream video data from the auxiliary stream video source, the dual stream conference method further includes:

The USB auxiliary stream device receives the first touch signal, and triggers the USB auxiliary stream device to collect the current auxiliary stream video data of the auxiliary stream video source according to the first touch signal, according to a preset encoding format and a code rate pair. The collected current auxiliary stream video data is encoded to obtain the encoded auxiliary stream video data, and the encoded auxiliary stream video data is transmitted to the conference television terminal.

According to an exemplary embodiment, after the USB auxiliary stream device collects current auxiliary stream video data from the auxiliary stream video source, the dual stream conference method further includes:

The USB auxiliary stream device receives the second touch signal, stops collecting the current auxiliary stream video data of the auxiliary stream video source according to the second touch signal, and stops the auxiliary stream from being collected according to a preset encoding format and a code rate. The video data is encoded to obtain the encoded auxiliary stream video data, and the transmission of the encoded auxiliary stream video data to the conference television terminal is stopped.

According to an exemplary embodiment, after the USB auxiliary stream device sends the encoded auxiliary stream video data to the conference television terminal by using a wireless manner, the dual stream conference method further includes:

Receiving, by the conference television terminal, the encoded auxiliary stream video data, determining whether a coding rate of the encoded auxiliary stream video data is consistent with a coding rate of the video conference, and if not, performing the coded auxiliary stream video data Decoding, re-encoding according to the coding rate of the video conference, and transmitting the re-encoded auxiliary stream video data in a dual stream manner Lost to the plurality of mobile terminals.

The dual-stream conference device and method provided by the embodiment of the present invention access the auxiliary stream video source through the USB auxiliary stream device, acquire the current video data of the auxiliary stream video source, that is, obtain the auxiliary stream video data, and transmit the auxiliary stream video data to the wireless channel to the auxiliary stream video data. The conference television terminal transmits the auxiliary stream video data to the multiple terminals for video conference in the form of dual stream, and improves the transmission distance and flexibility of the auxiliary stream video data through wireless transmission, thereby reducing the wiring maintenance cost.

DRAWINGS

1 is a schematic diagram of a dual stream conference device according to an embodiment of the present invention;

2 is a functional block diagram of a conference television terminal in a dual stream conference device according to Embodiment 2 of the present invention;

3 is a functional block diagram of a USB auxiliary stream device in a three-stream conference device according to an embodiment of the present invention;

4 is a schematic diagram of application of a four-stream conference device according to an embodiment of the present invention;

5 is a flowchart of a method for five dual-stream conferences according to an embodiment of the present invention;

FIG. 6 is a flowchart of a six-stream conference method according to an embodiment of the present invention.

Reference mark:

会议电视终端 Conference television terminal	1010
通信模块 Communication module	101101
接收存储模块 Receiving memory module	103103
USB辅流装置USB auxiliary device	2020
数据采样模块 Data sampling module	201201
数据发送模块 Data sending module	203203
触摸传感模块 Touch sensing module	205205
辅流视频源Auxiliary stream video source	3030

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

1-3, FIG. 1 is a schematic diagram of a dual stream conference device according to an embodiment of the present invention. The dual stream conference device shown in FIG. 1 includes a conference television terminal 10 and a USB auxiliary stream device 20. 2 is a functional block diagram of a conference television terminal in a dual stream conference device according to Embodiment 2 of the present invention. 3 is a diagram showing the work of a USB auxiliary stream device in a three-stream conference device according to an embodiment of the present invention; Can module diagram. Referring to FIG. 2, the conference television terminal 10 shown in FIG. 2 includes a communication module 101 and a receiving storage module 103. Referring to FIG. 3 , the USB auxiliary stream device 20 shown in FIG. 3 includes a data acquisition module 201 , a data sending module 203 , and a touch sensing module 205 . The respective modules of the conference television terminal 10 and the USB auxiliary stream device 20 will be described in detail below.

The USB auxiliary stream device 20 is connected to the auxiliary stream video source, wherein the auxiliary stream video source includes a personal computer desktop and a camera video source, and the communication module 101 of the conference television terminal 10 performs video conference with multiple terminals, and wirelessly and the USB auxiliary stream. The device 20 performs binding and communication connection, and the wireless mode includes WIFI, Bluetooth, and the like. The receiving storage module 103 receives the current auxiliary stream video data collected by the USB auxiliary stream device 20 and collected from the auxiliary stream video source, and transmits the current auxiliary stream video data to the plurality of terminals in a dual stream manner, and the USB auxiliary stream device 20 is A convenient and portable wireless device that integrates wireless functions such as WIFI and wireless Bluetooth.

Specifically, the USB auxiliary stream device 20 collects and sends the current auxiliary stream video data from the auxiliary stream video source, and the following steps: the data sampling module 201 of the USB auxiliary stream device 20 collects the current auxiliary stream video data of the auxiliary stream video source, according to The preset encoding format and the code rate encode the collected current auxiliary stream video data to obtain encoded auxiliary stream video data. The data transmitting module 203 of the USB auxiliary stream device 20 transmits the encoded auxiliary stream video data to the conference television terminal 10 by wireless. The receiving storage module 103 of the conference television terminal 10 receives the encoded auxiliary stream video data, and transmits the encoded auxiliary stream video data to the plurality of mobile terminals in the form of a dual stream, where the plurality of mobile terminals are in a video conference with the conference television terminal 10. The terminal can be a video communication device such as a personal computer.

It is to be noted that, when the USB auxiliary stream device 20 is in the auxiliary stream idle state, that is, before the data sampling module 201 collects the current auxiliary stream video data of the auxiliary stream video source 30, the touch sensing module 205 of the USB auxiliary stream device 20 receives The first touch signal triggers the data sampling module 201 to collect the current auxiliary stream video data of the auxiliary stream video source according to the first touch signal, and encodes the collected current auxiliary stream video data according to the preset encoding format and the code rate to obtain the encoded auxiliary stream video. The data and trigger data transmitting module 203 transmits the encoded auxiliary stream video data to the conference television terminal 10. When the USB auxiliary stream device 20 is in the auxiliary stream transmission state, that is, after the data sampling module 201 collects the current auxiliary stream video data of the auxiliary stream video source 30, the touch sensing module 205 receives the second touch signal, according to the second The touch signal control data sampling module 201 stops collecting the current auxiliary stream video data of the auxiliary stream video source, stops encoding the collected auxiliary stream video data according to the preset encoding format and the code rate, and obtains the encoded auxiliary stream video data, and controls the data sending module. The 203 stops transmitting the encoded auxiliary stream video data to the conference television terminal 10, and controls the USB auxiliary stream device 20 to control whether the video data of the current auxiliary stream video source is collected, encoded, transmitted, and the like by the touch sensing module 205. After receiving the encoded auxiliary stream video data transmitted by the data sending module 203, the conference television terminal 10 determines whether the coding rate of the encoded auxiliary stream video data is consistent with the coding rate of the video conference, and when inconsistent, decodes the encoded auxiliary stream video data. And re-encoding according to the coding rate of the video conference, and transmitting the re-encoded auxiliary stream video data to multiple mobile terminals in a dual stream manner, and when consistent, directly transmitting the encoded video data to multiple mobile terminals.

Referring to FIG. 4, FIG. 4 is a schematic diagram of application of a four-stream conference device according to an embodiment of the present invention. The schematic diagram includes a conference television terminal 10, a USB auxiliary stream device 20, and an auxiliary stream video source 30. Specifically, the application of the dual-stream conference device includes the following aspects: the USB auxiliary stream device 20 is connected to the auxiliary stream video source 30 such as a PC, and the conference television terminal 10 is wirelessly connected, and the conference television terminal 10 starts the video conference. After that, touch and tap the USB auxiliary device The triggering USB auxiliary stream device 20 collects the video data of the current auxiliary stream video source, encodes the collected auxiliary stream video data, and transmits the encoded auxiliary stream video data to the conference television terminal 10, and the conference television terminal 10 receives the encoded code. The auxiliary stream video data is sent to other terminals that perform video conferences in a dual stream.

Referring to FIG. 5, FIG. 5 is a flowchart of a method for five dual-stream conferences according to an embodiment of the present invention. The method is applied to the dual stream conference device shown in FIG. 1, the conference television terminal 10 and the USB auxiliary stream device 20 shown in FIG. 2. The method will be described in detail below.

In step S501, the USB auxiliary stream device 20 accesses the auxiliary stream video source.

In step S502, the communication module 101 of the conference television terminal 10 performs video conference with a plurality of terminals, and performs binding and communication connection with the USB auxiliary stream device 20 by wireless.

In step S503, the receiving storage module 103 of the conference television terminal 10 receives the current auxiliary stream video data collected by the USB auxiliary stream device 20 and collected from the auxiliary stream video source, and sends the current auxiliary stream video data to the dual stream. The plurality of terminals, wherein the auxiliary stream video source comprises a personal computer desktop and a camera video source, and the USB auxiliary stream device 20 is a wireless device that integrates wireless functions such as WIFI, wireless Bluetooth, and a USB interface.

Referring to FIG. 6, FIG. 6 is a flowchart of a six-stream conference method according to an embodiment of the present invention. The method is applied to the dual stream conference device shown in FIG. 1, the conference television terminal 10 and the USB auxiliary stream device 20 shown in FIG. 2. The method will be described in detail below.

In step S601, the USB auxiliary stream device 20 accesses the auxiliary stream video source.

In step S602, the communication module 101 of the conference television terminal 10 performs video conference with a plurality of terminals, and performs binding and communication connection with the USB auxiliary stream device 20 by wireless.

In step S603, before the USB auxiliary stream device 20 is in the auxiliary stream idle state, that is, the USB auxiliary stream device 20 collects the current auxiliary stream video data from the auxiliary stream video source 30, the USB auxiliary stream device is touched to generate the first touch signal. The touch sensing module 205 of the USB auxiliary device 20 receives the first touch signal.

In step S604, the data sampling module 201 of the USB auxiliary stream device 20 is triggered to collect the current auxiliary stream video data of the auxiliary stream video source according to the first touch signal, and the collected current auxiliary stream video data is performed according to a preset encoding format and a code rate. Encoding gives encoded auxiliary stream video data.

In step S605, the data transmitting module 203 of the USB auxiliary stream device 20 transmits the encoded auxiliary stream video data to the conference television terminal 10.

In step S606, the conference television terminal 10 transmits the encoded auxiliary stream video data to the plurality of terminals in the form of a dual stream. Specifically, after the conference television terminal 10 receives the encoded auxiliary stream video data transmitted by the data sending module 203, the conference television terminal 10 determines the code supplement. Whether the coding rate of the stream video data is consistent with the coding rate of the video conference. When the data is inconsistent, the coded auxiliary stream video data is decoded, re-encoded according to the coding rate of the video conference, and the re-encoded auxiliary stream video data is dual-streamed. The form is transmitted to a plurality of mobile terminals, and when the agreement is yes, the encoded video data is directly transmitted to the plurality of mobile terminals.

In step S607, after the USB auxiliary stream device 20 collects the current auxiliary stream video data from the auxiliary stream video source 30, the USB auxiliary stream device 20 touches the USB auxiliary stream device 20 to generate a second touch signal. The touch sensing module 205 receives the second touch signal, and controls the data sampling module 201 to stop collecting the auxiliary stream according to the second touch signal. The current auxiliary stream video data of the video source stops encoding the auxiliary stream video data according to the preset encoding format and the code rate to obtain the encoded auxiliary stream video data, and controls the data sending module 203 to stop transmitting the encoded auxiliary stream video data to the conference. Television terminal 10.

The dual-stream conference device and method provided by the present invention accesses the auxiliary stream video source through the USB auxiliary stream device, acquires the current video data of the auxiliary stream video source, that is, acquires the auxiliary stream video data, and transmits the auxiliary stream video data to the conference television through the wireless manner. The terminal, the conference television terminal transmits the auxiliary stream video data to the multiple terminals for video conference in a dual stream manner, improves the transmission distance and flexibility of the auxiliary stream video data by wirelessly transmitting the auxiliary stream video data, reduces the wiring maintenance cost, and expands The scope of application of the dual stream conference.

The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalents, and improvements made within the spirit and scope of the present invention should be included in the scope of the present invention. Inside.

Industrial applicability

The technical solution provided by the embodiment of the present invention can be applied to the field of control. The dual-stream conference device and method provided by the embodiment of the present invention access the auxiliary stream video source through the USB auxiliary stream device, acquire the current video data of the auxiliary stream video source, that is, obtain the auxiliary stream video data, and transmit the auxiliary stream video data to the wireless channel to the auxiliary stream video data. The conference television terminal transmits the auxiliary stream video data to the multiple terminals for video conference in the form of dual stream, and improves the transmission distance and flexibility of the auxiliary stream video data through wireless transmission, thereby reducing the wiring maintenance cost.

Claims

A dual-stream conference device includes a conference television terminal and a USB auxiliary stream device, wherein the USB auxiliary stream device accesses a secondary stream video source, and the conference television terminal includes:

a communication module, configured to perform video conference with a plurality of terminals, and perform binding and communication connection with the USB auxiliary stream device by using a wireless manner;

Receiving a storage module, configured to receive current auxiliary stream video data collected by the USB auxiliary stream device and collected from the auxiliary stream video source, and send the current auxiliary stream video data to the multiple stream in a dual stream manner Terminals.
The dual stream conferencing device of claim 1 wherein said USB auxiliary stream device comprises:

The data sampling module is configured to collect current auxiliary stream video data of the auxiliary stream video source, and encode the collected current auxiliary stream video data according to a preset encoding format and a code rate to obtain encoded auxiliary stream video data;

And a data sending module, configured to send the encoded auxiliary stream video data to the conference television terminal by using the wireless manner.
The dual stream conference device of claim 2, wherein the USB auxiliary stream device further comprises:

a touch sensing module, configured to receive a first touch signal, and trigger the data sampling module to collect the first touch signal according to the first touch signal, before the data sampling module collects current auxiliary stream video data of the auxiliary stream video source The current auxiliary stream video data of the auxiliary stream video source, encoding the collected current auxiliary stream video data according to a preset encoding format and a code rate to obtain the encoded auxiliary stream video data, and triggering the data sending module to The encoded auxiliary stream video data is transmitted to the conference television terminal.
The dual stream conference device of claim 3, wherein after the data sampling module collects the current auxiliary stream video data of the auxiliary stream video source, the touch sensing module is further configured to receive the second touch signal, according to The second touch signal controls the data sampling module to stop collecting the current auxiliary stream video data of the auxiliary stream video source, and stop encoding the collected auxiliary stream video data according to a preset encoding format and a code rate to obtain the Encoding the auxiliary stream video data, and controlling the data sending module to stop transmitting the encoded auxiliary stream video data to the conference television terminal.
The dual stream conference device according to any one of claims 2-4, wherein the receiving storage module is further configured to receive the encoded auxiliary stream video data, and determine whether a coding rate of the encoded auxiliary stream video data is The coding rate of the video conference is consistent. When the video conference is inconsistent, the encoded auxiliary stream video data is decoded, and the re-encoded auxiliary stream video data is transmitted in a dual stream according to the coding rate of the video conference. Giving the plurality of mobile terminals.
A dual stream conference method is applied to any of the dual stream conference apparatuses according to any one of claims 1-5, wherein the dual stream conference method comprises:

The USB auxiliary stream device accesses the auxiliary stream video source;

The conference television terminal performs video conference with a plurality of terminals, and wirelessly installs the USB auxiliary stream Binding and communication connections; and

The conference television terminal receives the current auxiliary stream video data that is sent by the USB auxiliary stream device and is collected from the auxiliary stream video source, and sends the current auxiliary stream video data to the plurality of streams in the form of a dual stream. terminal.
The dual stream conference method of claim 6, wherein the sending, by the USB auxiliary stream device, the current auxiliary stream video data collected from the auxiliary stream video source comprises:

The USB auxiliary stream device collects current auxiliary stream video data of the auxiliary stream video source, and encodes the collected current auxiliary stream video data according to a preset encoding format and a code rate to obtain encoded auxiliary stream video data;

And the USB auxiliary stream device sends the encoded auxiliary stream video data to the conference television terminal by using a wireless manner.
The dual stream conference method according to claim 7, wherein the dual stream conference method further comprises: before the USB slave stream device collects the current auxiliary stream video data from the auxiliary stream video source, the method further includes:

The USB auxiliary stream device receives the first touch signal, and triggers the USB auxiliary stream device to collect the current auxiliary stream video data of the auxiliary stream video source according to the first touch signal, according to a preset encoding format and a code rate pair. The collected current auxiliary stream video data is encoded to obtain the encoded auxiliary stream video data, and the encoded auxiliary stream video data is transmitted to the conference television terminal.
The dual-stream conference method according to claim 8, wherein after the USB auxiliary stream device collects the current auxiliary stream video data from the auxiliary stream video source, the dual stream conference method further includes:

The USB auxiliary stream device receives the second touch signal, stops collecting the current auxiliary stream video data of the auxiliary stream video source according to the second touch signal, and stops the auxiliary stream from being collected according to a preset encoding format and a code rate. The video data is encoded to obtain the encoded auxiliary stream video data, and the transmission of the encoded auxiliary stream video data to the conference television terminal is stopped.
The dual stream conference method according to any one of claims 7 to 9, wherein after the USB auxiliary stream device wirelessly transmits the encoded auxiliary stream video data to the conference television terminal, the dual stream conference method further include:

Receiving, by the conference television terminal, the encoded auxiliary stream video data, determining whether a coding rate of the encoded auxiliary stream video data is consistent with a coding rate of the video conference, and if not, performing the coded auxiliary stream video data Decoding, re-encoding according to the coding rate of the video conference, and transmitting the re-encoded auxiliary stream video data to the multiple mobile terminals in a dual stream format.