CN115412702A - Conference terminal and video wall integrated equipment and system - Google Patents

Abstract

The present invention is applicable to the technical field of video conferencing, and provides an integrated device and system for a conference terminal and a video wall. Conference-related data; a conference processing system communicatively connected to the main control system, used to receive remote audio and video data, local audio and video data, and conference-related data sent by the main control system, and perform corresponding processing according to the first play The rules are sent to the audio and video playback device to play the conference picture and conference audio; the TV wall processing module connected to the main control system is used to receive the remote video data sent by the main control system and perform corresponding After processing, it is sent to the video playing device according to the second playing rule, so as to play the video wall picture. By realizing the function of the conference terminal and the video wall at the same time in one device, the user cost is effectively saved, and the installation is simple.

Description

A conference terminal and video wall integrated equipment and system

technical field

The invention belongs to the technical field of conference video, and in particular relates to an integrated equipment and system of a conference terminal and a video wall.

Background technique

With the continuous development of digital networks and electronic information technology, video conferencing systems have begun to appear and gradually become popular, allowing users to conveniently conduct online meetings, etc., which greatly facilitates the use of users.

In the traditional video conferencing system, the conference terminal and the video wall are regarded as two different types of equipment, which are respectively used to solve the requirements of different types of application scenarios. For example, in some large-scale project applications, the branch venue generally only needs to configure a conference terminal and supporting peripherals to realize the audio and video interaction and communication requirements with the main venue; In addition to the audio and video interaction and communication needs of the venue, an additional video wall device is required for video monitoring and order supervision of all branch venues.

This results in users having to purchase an additional set of video wall-related equipment, which not only increases user costs, but also makes the installation and use of the entire system more cumbersome, which is not conducive to user experience.

Contents of the invention

The present invention provides an integrated device and system for a conference terminal and a video wall, aiming at solving the problems in the prior art that a video wall and a conference terminal need to be arranged at the same time, resulting in high cost and cumbersome installation and use.

The present invention is achieved in this way, a conference terminal and video wall integrated equipment, including:

A main control system, the main control system is used to obtain remote audio and video data, local audio and video data and conference related data;

The conference processing system communicated with the main control system is used to receive the remote audio-video data, local audio-video data and conference-related data sent by the main control system, and send them to the audio system according to the first play rule after corresponding processing. In the video playback device, the conference screen and conference audio can be played;

The TV wall processing module connected in communication with the main control system is used to receive the remote video data sent by the main control system, and after performing corresponding processing, send it to the video playback device according to the second playback rule, so as to process the video wall picture play.

In one embodiment, the device includes:

An audio collection module communicatively connected to the main control system, for collecting local audio data;

A video acquisition module communicatively connected with the main control system is used to acquire local video data.

In one embodiment, the device further includes:

The communication module communicated with the main control system is used to establish a network connection with the remote conference terminals participating in each sub-site of the conference, so as to obtain the remote audio and video data and conference-related data sent by the remote conference terminals.

In one embodiment, the conference processing system includes:

The first video processing module is configured to perform corresponding processing on remote video data and local video data;

The audio processing module is used for correspondingly processing remote audio data and local audio data;

A data processing module, configured to process the conference-related data.

In one embodiment, the video wall processing system includes:

The second video processing module is configured to perform corresponding processing on the remote video data.

In one embodiment, the audio and video playback device includes a plurality of conference video displays and voice playback devices, and the conference processing system is used to communicate with the conference video display through a video output interface, and according to user needs and video The type of data, sending different video data to different conference video displays for display;

The conference processing system is further configured to communicate with the voice playback device through a voice output interface, and to perform voice playback through the voice playback device.

In one embodiment, the video playback device includes a video wall display, and the video wall system is used to determine a split-screen mode according to user requirements or the amount of remote video data, and to display the split-screen mode according to the split-screen mode. Split-screen display is performed on the playback interface of the TV wall display.

In one embodiment, the device includes:

A noise reduction module communicatively connected with the main control system, used to perform noise reduction processing on the local audio data and the environmental noise in the remote language data;

The echo cancellation module communicated with the main control system is used to cancel the echo in the local audio data and the remote language data.

In one embodiment, the device includes:

A subtitle conversion module is used to convert local audio data and remote audio data into subtitles respectively;

The translation module is configured to translate the local audio data and the remote audio data into different languages, and convert the subtitles into corresponding language subtitles through the subtitle conversion module for display.

audio data

In the second aspect, an integrated system of a conference terminal and a video wall is provided, including:

Such as the conference terminal and video wall integrated equipment described above, the conference terminal and video wall integrated equipment is set in the main venue, and is used for audio and video interaction and supervision with each branch venue;

A plurality of meeting terminals respectively set up in each sub-venue, which are integrated with the conference terminal and the video wall equipment, are used to collect the remote audio and video data of each sub-venue, and send them to the conference terminal and the video wall integrated equipment .

In the embodiment of the present invention, a conference terminal and video wall integration device and system are provided, the device includes: a main control system, and the main control system is used to obtain remote audio and video data, local audio and video data, and conference related data A conference processing system connected in communication with the main control system is used to receive the remote audio and video data, local audio and video data and conference related data sent by the main control system, and send corresponding processing to according to the first play rule In the audio and video playback device, the conference picture and conference audio are played; the video wall processing module connected to the main control system is used to receive the remote video data sent by the main control system, and perform corresponding processing according to The second playing rule is sent to the video playing device to play the video wall picture. In the embodiment of the present application, by implementing the functions of the conference terminal and the video wall in one device at the same time, the user cost is effectively saved, and the installation is simple. The user can choose to enable the functions of the conference terminal and the video wall at the same time, or only the conference terminal. Or one of the TV wall functions can meet various needs of users and improve user experience.

Description of drawings

FIG. 1 is a schematic structural diagram of a conference terminal and video wall integrated device provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of an interface display state provided by an embodiment of the present application;

Fig. 3 is a schematic structural diagram of an integrated system of a conference terminal and a video wall provided by an embodiment of the present application.

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

Referring to Fig. 1, the embodiment of the present application provides an integrated device for a conference terminal and a video wall, including:

A main control system, the main control system is used to obtain remote audio and video data, local audio and video data and conference related data;

The conference processing system communicated with the main control system is used to receive the remote audio-video data, local audio-video data and conference-related data sent by the main control system, and send them to the audio system according to the first play rule after corresponding processing. In the video playback device, the conference screen and conference audio can be played;

The TV wall processing module connected in communication with the main control system is used to receive the remote video data sent by the main control system, and after performing corresponding processing, send it to the video playback device according to the second playback rule, so as to process the video wall picture play.

In the embodiment of the present application, the main control system may include controllers such as a single chip microcomputer, a main control chip, and an MCU.

In the embodiment of the present application, the remote audio and video data may specifically include the audio data and video data of each branch venue, that is, remote audio data and remote video data, and specifically, the conference terminals set up in each branch venue may collect the audio data of each venue Audio and video data of conference personnel.

In the embodiment of the present application, the local audio and video data may include audio data and video data of the main venue, that is, local audio data and local video data.

In this embodiment of the present application, the conference-related data may include document data, screen stream data, and the like.

In the embodiment of the present application, after the main control module acquires remote audio-video data, local audio-video data, and meeting-related data, it can According to the type of data meeting needs, determine the data sent to the meeting processing system and the video wall processing system, so as to display the meeting picture and the video wall picture at the same time.

In the embodiment of the present application, the audio collection module connected in communication with the main control system is used to collect local audio data; the video collection module connected in communication with the main control system is used to collect local video data. Specifically, local audio and video data can be collected through the local audio collection module and video collection module, and sent to the main control system to generate audio files and video files.

Further, the device may also include an audio source identification module, which is used to identify the main audio source in the current environment according to the image of the surrounding environment collected by the video collection module, and the audio collection module is also used to collect audio sources related to the audio source. An audio signal corresponding to the audio source identified by the identifying module. Due to the large number of participants, the voice of the speech or discussion in the environment is too loud, and the audio data of the current speaker cannot be collected correctly. Therefore, the current speaker can be determined through the image collected by the video acquisition module, and through Turn off or reduce the audio collection module corresponding to other participants, and collect audio through the audio collection module corresponding to the current speaker.

Wherein, the audio collection module may be a wireless microphone, a wired microphone, a gooseneck microphone, or the like. The audio collection module can include multiple, respectively arranged around different participants, for collecting audio data of different participants

In the embodiment of this application, the device includes:

The noise reduction module communicated with the main control system is used to perform noise reduction processing on the local audio data and the environmental noise in the remote audio data, and remove the interference of the environmental sound on the audio data.

In the embodiment of the present application, the device may further include: an echo cancellation module communicatively connected with the main control system, a module for canceling echoes in local audio data and remote audio data. to improve the fidelity of the sound.

In the embodiment of the present application, the video capture module may include one or more. For example, when there is one video capture module, the rotation function of the video capture module can be used to control the participants and the location of the meeting place through all-round rotation. Shooting at each location, or identify the shooting location according to the audio source, for example, determine the current location to be shot according to the voices of different participants, and turn the video capture device to obtain the corresponding picture.

Wherein, the video acquisition module may be a camera.

In the embodiment of the present application, the device further includes: a communication module communicating with the main control system, configured to establish a network connection with the remote conference terminals of each sub-site participating in the conference, so as to obtain the remote conference terminal Remote audio and video data and conference-related data sent. In order to realize real-time two-way audio and video interaction.

Wherein, the communication module can be 4G, 5G, WIFI and other communication modules.

In the embodiment of the present application, the conference processing system includes: a first video processing module, configured to process remote video data and local video data; an audio processing module, configured to process remote audio data and local audio data Corresponding processing; a data processing module, configured to process the conference-related data.

Specifically, the audio processing module is used to decode the data through the audio decoding sub-module after receiving the audio data, and then put the decoded audio data into respective data buffers; The data packets with the earliest time are taken out from the buffer queue, these audio data packets are mixed, and then the mixed data is passed to the audio playback device for playback.

The first video processing module is used to put each channel of video data into their respective data buffers after receiving remote video data and/or local video data; The data packet is taken out, and the data is decoded by the video decoding sub-module, and the decoded video data of each channel is respectively rendered to the video display area of the corresponding display according to the current preset split-screen mode.

The data processing module is used to put the data packet into the data buffer queue when the received data stream format is the video stream format; the data stream rendering sub-module takes out the data packets sequentially from the buffer queue, and The data is decoded by the video decoding sub-module, and then the decoded data stream is rendered to the data display area. If the received data format is a picture format, the data flow rendering sub-module can directly render the picture to the data display area of the corresponding display.

In the embodiment of the present application, the video wall processing system includes: a second video processing module, configured to perform corresponding processing on remote video data. Specifically, the second video processing module is used to put each channel of video data into their respective data buffers after receiving the remote video data; the video rendering sub-module takes out the data packets sequentially from each buffer queue , and the video decoding sub-module decodes the data, and then renders the decoded video data of each channel to the corresponding video display area of the video wall according to the currently set split-screen mode.

In the embodiment of the present application, the audio and video playback device includes a plurality of conference video displays and voice playback devices, and the conference processing system is used to communicate with the conference video display through a video output interface, and according to the first A play rule sends different video data to different conference video displays for display.

The conference processing system is further configured to communicate with the voice playback device through a voice output interface, and to perform voice playback through the voice playback device.

Specifically, the conference processing system can deliver different video output screens to multiple monitors for playback according to different user needs, conference project requirements, and video types and quantities. The video output displays the video images of each conference site; or both video outputs display the video images of different conference sites. To present data screen + interactive video screen, or main conference screen + interactive video screen on multiple conference monitors,

Among them, the interactive video screen can also be presented according to different split-screen modes, such as single-split screen, quad-split screen, 16-split screen and so on.

Wherein, the voice output interface may include various interface forms such as SDI, HDMI, DVI, CVBS, and YPbPr.

Wherein, the video output interface may include multiple interface forms such as HDMI, DVI, VGA, RGB, and S terminal.

In this embodiment of the present application, the video playback device includes a video wall display, and the video wall system is used to determine a split-screen mode according to user requirements or the amount of remote video data, and to display the split-screen mode according to the split-screen mode. Split-screen display is performed on the playback interface of the TV wall display.

Specifically, according to different user needs and different project requirements, the TV wall subsystem can deliver the TV wall images to multiple monitors for playback in the form of one or more video outputs, and the monitors can also be divided into different screens. The mode presents the video screen of the TV wall, such as 16 split screens, 25 split screens, 36 split screens, 64 split screens, etc.

Furthermore, the number of split screens of the video wall system is more than that of the conference system.

In the embodiment of the present application, the video wall display may include multiple displays.

In the embodiment of this application, the split-screen mode can be switched in real time according to the number of participating clients. For example, in some scenarios, users in some sub-sites may have network delays or other conditions, resulting in gradually joining the conference after the conference starts. Conference. At this time, when the split-screen interface of the TV wall cannot meet the requirements of presenting all the sub-venue videos, the split-screen module can be replaced. When the split-screen mode has reached the maximum, that is, the number of split-screens has reached the limit. Another display is used to display the video wall interface.

In the embodiment of the present application, the remote video data may also include terminal identifiers, and each split-screen interface in the video wall may respectively establish a mapping relationship with the identifiers of different participating terminals. When the corresponding video data is obtained, Then it can be displayed through the corresponding split-screen interface.

In the implementation of this application, the video data displayed on each split-screen interface in the video wall can be determined according to the order in which different participating clients join the conference. The video data of the client that joined first is displayed on the first split-screen interface, and the second The added user terminal video data is displayed on the second split-screen interface, and so on until all of them are displayed.

In the embodiment of the present application, the conference terminal and video wall integrated device may further include: a subtitle conversion module, which is used to convert local audio data and remote audio data into subtitles, and output corresponding video images, so that When the environment is noisy and the user's voice cannot be heard clearly, you can read the subtitles to understand the content of the current meeting.

Further, the subtitles may include multiple language subtitles, for example, Chinese, English, etc., and the device may also include a translation module for translating the local audio data and the remote audio data into different languages, that is, each participating conference The voices output by the users are translated into different voices, and subtitles corresponding to different languages are formed through the subtitle module to be displayed synchronously on different video display interfaces, so as to realize multilingual communication and improve the fluency of interaction.

In the embodiment of the present application, the device also includes a video recording module, which is used to record and store remote audio and video data and local audio and video data. Meeting backtracking.

In the embodiment of the present invention, a conference terminal and video wall integrated device is provided, including: a main control system, the main control system is used to obtain remote audio and video data, local audio and video data and conference related data; The conference processing system connected by communication with the control system is used to receive the remote audio and video data, local audio and video data and conference related data sent by the main control system, and send them to the audio and video playback device according to the first playback rule after corresponding processing , to play the conference picture and conference audio; the video wall processing module communicated with the main control system is used to receive the remote video data sent by the main control system, and send it according to the second playback rule after corresponding processing to the video playback device to play the video wall images. In the embodiment of the present application, by implementing the functions of the conference terminal and the video wall in one device at the same time, the user cost is effectively saved, and the installation is simple. The user can choose to enable the functions of the conference terminal and the video wall at the same time, or only the conference terminal. Or one of the TV wall functions can meet various needs of users and improve user experience.

In an embodiment of the present application, a conference terminal and video wall integration system is also provided, the system includes: the above-mentioned conference terminal and video wall integration equipment, and the conference terminal and the video wall are integrated The equipment is installed in the main venue for audio and video interaction and supervision with each branch venue; multiple conference terminals are respectively installed in each branch venue, and the conference terminals integrated with the conference terminal and the video wall are used to collect information from each branch venue remote audio and video data, and send it to the conference terminal and video wall integrated equipment for display. It can realize the video interaction between the main conference venue and each branch venue, and can display the interactive video screen.

Among them, the conference terminal may include an audio collection unit and a video collection unit, which are used to collect audio and video data of different sub-venues, and the integrated equipment of the conference terminal and the video wall can collect the audio and video data of the main venue and send them to the conference terminal. In order to achieve two-way audio and video interaction.

In the embodiment of the present application, the system further includes a control device, which is used to perform processing such as switching, zooming, and deleting the displayed screen, and to start and stop the device. For example, when a person in a certain branch is reporting work, the video of the branch can be zoomed in on the conference display interface, or moved to a central position for display, so that they can be watched with emphasis.

Wherein, the control device may be a touch device, such as a mobile phone, a tablet computer, etc., and controls the conference terminal and the integrated device through touch commands entered by the user.

In this application, the functions of the conference terminal and the video wall are simultaneously realized in one system, which effectively saves user costs, and the installation is simple. Users can choose to enable the functions of the conference terminal and the video wall at the same time, or only open the conference terminal or the video wall. One of the functions can meet various needs of users and improve user experience.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. within range.

Claims (10)

1. A conference terminal and video wall integrated device, characterized in that the device includes: A main control system, the main control system is used to obtain remote audio and video data, local audio and video data and conference related data; The conference processing system communicated with the main control system is used to receive the remote audio-video data, local audio-video data and conference-related data sent by the main control system, and send them to the audio system according to the first play rule after corresponding processing. In the video playback device, the conference screen and conference audio can be played; The TV wall processing module connected in communication with the main control system is used to receive the remote video data sent by the main control system, and after performing corresponding processing, send it to the video playback device according to the second playback rule, so as to process the video wall picture play. 2. The conference terminal and video wall integrated device according to claim 1, characterized in that the device includes: An audio collection module communicatively connected to the main control system, for collecting local audio data; A video acquisition module communicatively connected with the main control system is used to acquire local video data. 3. The conference terminal and video wall integrated device according to claim 2, characterized in that, the device further comprises: The communication module communicated with the main control system is used to establish a network connection with the remote conference terminals participating in each sub-site of the conference, so as to obtain the remote audio and video data and conference-related data sent by the remote conference terminals. 4. The conference terminal and video wall integrated device according to claim 1, wherein the conference processing system includes: The first video processing module is configured to perform corresponding processing on remote video data and local video data; The audio processing module is used for correspondingly processing remote audio data and local audio data; A data processing module, configured to process the conference-related data. 5. The conference terminal and video wall integrated device according to claim 1, wherein the video wall processing system includes: The second video processing module is configured to perform corresponding processing on the remote video data. 6. The conference terminal and video wall integrated device according to claim 3, wherein the audio and video playback device includes a plurality of conference video displays and voice playback devices, and the conference processing system is used to output the video through the video interface Communicating with the conference video display, and sending different video data to different conference video displays for display according to user needs and types of video data; The conference processing system is further configured to communicate with the voice playback device through a voice output interface, and to perform voice playback through the voice playback device. 7. The conference terminal and video wall integrated device according to claim 5, characterized in that, the video playback device includes a video wall display, and the video wall system is used to , determine the split-screen mode, and perform split-screen display on the playback interface of the video wall display according to the split-screen mode. 8. The conference terminal and video wall integrated device according to claim 1, characterized in that, the device includes: A noise reduction module communicatively connected to the main control system, used to perform noise reduction processing on remote audio data and environmental noise in local audio data; The echo cancellation module communicated with the main control system is used to cancel the echo in the local audio data and the remote audio data. 9. The conference terminal and video wall integrated device according to claim 1, characterized in that, the device includes: A subtitle conversion module is used to convert local audio data and remote audio data into subtitles respectively; The translation module is configured to translate the local audio data and the remote audio data into different languages, and convert the subtitles into subtitles of corresponding languages through the subtitle conversion module for display. 10. An integrated system of a conference terminal and a video wall, characterized in that the system includes: The conference terminal and video wall integrated device according to any one of claims 1-9, wherein the conference terminal and video wall integrated device is set in the main conference site, and is used for audio and video interaction and supervision with each branch conference site; A plurality of meeting terminals respectively set up in each sub-venue, which are integrated with the conference terminal and the video wall equipment, are used to collect the remote audio and video data of each sub-venue, and send them to the conference terminal and the video wall integrated equipment .

Images