CN112866620A - Remote video conference system and method - Google Patents

Remote video conference system and method Download PDF

Info

Publication number
CN112866620A
CN112866620A CN202110055761.7A CN202110055761A CN112866620A CN 112866620 A CN112866620 A CN 112866620A CN 202110055761 A CN202110055761 A CN 202110055761A CN 112866620 A CN112866620 A CN 112866620A
Authority
CN
China
Prior art keywords
multimedia
module
data
distribution
video conference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110055761.7A
Other languages
Chinese (zh)
Inventor
张鑫
廖黔渝
杜剑峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhongke Vision Chongqing Technology Co ltd
Original Assignee
Zhongke Vision Chongqing Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhongke Vision Chongqing Technology Co ltd filed Critical Zhongke Vision Chongqing Technology Co ltd
Priority to CN202110055761.7A priority Critical patent/CN112866620A/en
Publication of CN112866620A publication Critical patent/CN112866620A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/152Multipoint control units therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to the technical field of video conferences, in particular to a remote video conference system and a method, wherein the system comprises: the video conference terminal is in data connection with the multimedia gateway and is used for acquiring multimedia data of a user or a meeting place and uploading the multimedia data to the multimedia gateway; the multimedia gateway comprises a multimedia distribution module, a multimedia output module and a multimedia input module, wherein the multimedia input module is used for receiving multimedia data input by a video conference terminal or superior equipment, a multimedia distribution matrix is stored in the multimedia distribution module, and the multimedia distribution module is used for constructing distribution data according to the multimedia distribution matrix and outputting the distribution data to the corresponding video conference terminal through the multimedia output module. The remote video conference system and the method can solve the problems that the existing video conference system cannot independently distribute, regulate and control multimedia data and is inconvenient to monitor and control.

Description

Remote video conference system and method
Technical Field
The invention relates to the technical field of video conferences, in particular to a remote video conference system and a remote video conference method.
Background
With the development of society, the application of the video conference system is increasingly popularized. The video conference can enable conference representatives in a plurality of different places to simultaneously carry out online inter-translation through a multimedia network technology, and carry out real-time sharing of pictures, forms, files and the like, so that the working efficiency can be obviously improved.
In the existing video conference technology, after multi-channel media stream data are fused and spliced by a server, unified media streams are formed, after the multi-channel video streams uploaded by all participants are fused and spliced by the server, the multi-channel video streams are changed into unified video pictures, the same video picture is seen by all participants of a conference, the flexibility of the mode is poor, and the practical application requirements cannot be met.
Disclosure of Invention
The invention aims to provide a remote video conference system and a remote video conference method, which can solve the problems that in the existing video conference system, the multimedia data merging process cannot be independently distributed and regulated, and the monitoring and control are inconvenient.
The application provides the following technical scheme:
a remote video conferencing system, comprising:
the video conference terminal is connected with the multimedia gateway data, is used for acquiring multimedia data of a user or a conference field and uploading the multimedia data to the multimedia gateway, and is also used for receiving and playing the multimedia data distributed by the multimedia gateway;
the multimedia gateway comprises a multimedia distribution module, a multimedia output module and a multimedia input module, wherein the multimedia input module is used for receiving multimedia data input by a video conference terminal or superior equipment, a multimedia distribution matrix is stored in the multimedia distribution module, and the multimedia distribution module is used for constructing distribution data according to the multimedia distribution matrix and outputting the distribution data to the corresponding video conference terminal through the multimedia output module.
Further, the multimedia distribution module comprises a video fusion module, and the video fusion module is used for selecting a plurality of corresponding paths of multimedia data according to the multimedia distribution matrix to perform video fusion and generate distribution data.
Further, the multimedia gateway further comprises a distribution matrix setting module, wherein the distribution matrix setting module is used for adjusting the multimedia distribution matrix according to the request of the video conference terminal.
Further, the video conference terminal comprises a user conference terminal and meeting place equipment, wherein the meeting place equipment comprises a meeting place screen, a meeting place loudspeaker, a meeting place camera and a meeting place microphone.
The system comprises a video conference server, a multimedia input module, a multimedia output module, a multimedia input module and a remote conference terminal, wherein the video conference server is connected with the video conference terminal;
the multimedia distribution module is used for distributing multimedia data input by the teleconference terminal according to the multimedia distribution matrix and outputting the multimedia data to the video conference terminal through the multimedia output module;
the multimedia distribution module is also used for distributing the multimedia data uploaded by the video conference terminal according to the multimedia distribution matrix and outputting the multimedia data to the remote conference terminal through the multimedia output module.
The system further comprises an AI processing module, wherein the AI processing module is used for carrying out AI processing on the multimedia data uploaded by the video conference terminal.
Further, the AI processing module comprises an intelligent caption processing module, a watching correction module and a privacy processing module, wherein the intelligent caption processing module is used for generating multilingual synchronous captions according to multimedia data, the watching correction module is used for correcting the watching direction of human face eyeballs in the video data of the multimedia data, and the privacy processing module is used for acquiring the video data in the multimedia data, identifying articles in the video data and carrying out privacy processing according to an identification result.
Furthermore, the intelligent subtitle processing module comprises a voice recognition module and a translation module, wherein the voice recognition module is used for generating recognition texts according to audio data in the multimedia data, and the translation module is used for synchronously generating multilingual translation texts.
The multimedia gateway is connected with the media cloud server, the media cloud server comprises a remote multimedia distribution module, and the remote multimedia distribution module is used for distributing the multimedia data uploaded by the multimedia gateway to other multimedia gateways according to the media distribution matrix.
Further, the application also discloses a remote video conference method, and the method uses the remote video conference system.
The technical scheme of the invention has the beneficial effects that:
1. in the technical scheme of the invention, the distributed data can be constructed according to the multimedia distribution matrix through the multimedia gateway, the video fusion is carried out according to the multimedia distribution matrix, the output flow direction of each path of multimedia data can be flexibly controlled, the picture range viewed by each user is controlled, and the users can make different conference participants see different pictures through setting the media distribution matrix, thereby realizing hierarchical control, being convenient for supervision and regulation, being suitable for complex conference scenes and being beneficial to protecting the privacy of the conference participants.
2. In the technical scheme of the invention, the multimedia gateway can be connected in the existing video conference system, namely, between the video conference terminal and the teleconference terminal, and is directly connected with the existing teleconference terminal for use, so that the video conference system is compatible with the existing video conference system, the multimedia processing capacity and the function of the video conference are expanded, a user can realize the characteristics of media distribution control, multi-protocol support and the like on the existing video conference system only by adding the multimedia gateway of the application without carrying out complete modification, and the modification cost is low.
3. Through the AI processing module, the AI function can be added to the traditional non-intelligent audio and video system, and the functions of fixation correction, privacy protection and the like are realized.
4. By connecting the media cloud server, a multi-room video conference and multi-level media distribution control can be realized, so that the conference system has stronger expansibility and is suitable for various complex scenes.
Drawings
Fig. 1 is an architecture diagram of an application scenario in a first embodiment of a remote video conference system according to the present application;
fig. 2 is an application scene architecture diagram in a second embodiment of a remote video conference system according to the present application.
Detailed Description
The technical scheme of the application is further explained in detail through the following specific implementation modes:
example one
As shown in fig. 1, a remote video conference system disclosed in this embodiment includes a video conference terminal, a multimedia gateway, and a remote conference terminal.
The video conference terminal comprises a user conference terminal and meeting place equipment, the user conference terminal comprises a user mobile phone, a notebook computer, a tablet computer and the like, and the meeting place equipment comprises a meeting place screen, a meeting place loudspeaker, a meeting place camera, a meeting place microphone and the like.
The video conference terminal is connected with the multimedia gateway in a data mode, the video conference terminal is used for collecting user or meeting field multimedia data and uploading the user or meeting field multimedia data to the multimedia gateway, and the video conference terminal is further used for receiving the multimedia data distributed by the multimedia gateway and displaying and playing the multimedia data.
The multimedia gateway comprises a multimedia distribution module, a multimedia output module and a multimedia input module, wherein the multimedia input module is used for receiving multimedia data input by a video conference terminal or superior equipment, a multimedia distribution matrix is stored in the multimedia distribution module, and the multimedia distribution module is used for constructing distribution data according to the multimedia distribution matrix and outputting the distribution data to the corresponding video conference terminal through the multimedia output module.
The remote conference terminal is connected with the video conference server, the signal input end of the remote conference terminal is in data connection with the multimedia output module, the signal output end of the remote conference terminal is in data connection with the multimedia input module, and the multimedia input module is used for receiving multimedia data input by the remote conference terminal;
the multimedia distribution module is also used for distributing multimedia data input by the teleconference terminal according to the multimedia distribution matrix and outputting the multimedia data to the video conference terminal through the multimedia output module;
the multimedia distribution module is also used for distributing the multimedia data uploaded by the video conference terminal according to the multimedia distribution matrix and outputting the multimedia data to the remote conference terminal through the multimedia output module.
In this embodiment, the multimedia gateway hardware is provided with a wireless network module and an ethernet module, the support device is accessed through a wireless or wired network, and interfaces such as DP, HDMI, microphone, and speaker are also connected with corresponding video conference terminal devices through corresponding connection wires. The teleconference terminal adopts the existing teleconference equipment, such as VP9830 China center communication M900-16A video conference equipment, and the multimedia gateway is equivalent to output equipment simulating a camera, a microphone input equipment, a display screen and the like of the equipment.
The multimedia distribution module comprises a video fusion module, and the video fusion module is used for selecting a plurality of corresponding paths of multimedia data according to the multimedia distribution matrix to perform video fusion and generate distribution data.
The multimedia gateway also comprises a distribution matrix setting module, and the distribution matrix setting module is used for adjusting the multimedia distribution matrix according to the request of the video conference terminal.
The remote video conference method of the present embodiment uses the remote video conference system in the present embodiment.
Example two
As shown in fig. 2, the difference between this embodiment and the first embodiment is that in this embodiment, the multimedia gateway further includes a media cloud server, the multimedia gateway is further connected to the media cloud server through the internet, the media distribution matrix is provided with a hierarchy, the media cloud server or the multimedia gateway itself is provided with a corresponding distribution hierarchy, the media cloud server includes a remote multimedia distribution module, the remote multimedia distribution module is configured to select a media distribution matrix of the hierarchy corresponding to the media cloud server from the multimedia data uploaded by the multimedia gateway, and distribute the selected media distribution matrix to other multimedia gateways according to the media distribution matrix, and the multimedia gateway that receives the distributed multimedia data can further distribute multimedia according to the media distribution matrix.
The remote video conference method of the present embodiment uses the remote video conference system in the present embodiment.
EXAMPLE III
The difference between this embodiment and the first embodiment is that the multimedia gateway further includes an AI processing module, and the AI processing module is configured to perform AI processing on the multimedia data uploaded by the video conference terminal.
The AI processing module comprises an intelligent caption processing module, a watching correction module and a privacy processing module, wherein the intelligent caption processing module is used for generating multilingual synchronous captions according to multimedia data, the watching correction module is used for correcting the watching direction of human face eyeballs in the video data of the multimedia data, and the privacy processing module is used for acquiring the video data in the multimedia data, identifying articles in the video data and carrying out privacy processing according to an identification result.
The intelligent caption processing module comprises a voice recognition module and a translation module, wherein the voice recognition module is used for generating a recognition text according to audio data in the multimedia data, and the translation module is used for synchronously generating a multilingual translation text.
In this embodiment, the intelligent subtitle processing module, the gaze correction module, the privacy processing module, and the like all adopt the existing artificial intelligent neural network model to realize corresponding functions.
The remote video conference method of the present embodiment uses the remote video conference system in the present embodiment.
Example four
The difference between this embodiment and the first embodiment is that the multimedia input module is further configured to receive multimedia data input by a cascaded multimedia gateway; the multimedia distribution module is used for distributing the multimedia data according to the multimedia distribution matrix and outputting the multimedia data to the cascaded multimedia gateway through the multimedia output module. The media distribution matrix is provided with grades, and the multimedia gateway is provided with corresponding distribution grades to select the corresponding media distribution matrix for multimedia distribution. In the embodiment, the multi-room video conference and the multi-level media distribution control can be realized through the cascade connection of the multi-level multimedia gateways, so that the conference system has stronger expansibility and is suitable for various complex scenes.
The remote video conference method of the present embodiment uses the remote video conference system in the present embodiment.
EXAMPLE five
The difference between this embodiment and the second embodiment is that, in this embodiment, the media cloud server further includes a participating process recording module, a participating state analysis module, an attention analysis module, and a grouping module.
The conference-participating process recording module is used for acquiring the conference-participating process information of each participant through the user terminal, the conference-participating process information comprises actions, expressions, speeches and the like, the conference-participating state analyzing module is used for analyzing the states of the participants at each moment or time period, such as the attention focusing state, the distraction state, the question thinking state and the like, according to the conference-participating process information, dividing the conference-participating process of the participants into a plurality of state time periods,
the attention analysis module is used for analyzing the time period of attention concentration of each participant according to the analysis result of the state analysis module; the grouping module is used for grouping according to the time periods in which the attention of each participant is concentrated, the participants in different time periods in which the attention is concentrated are grouped into one group, the time period in which the attention of the participants in each group is concentrated covers the time length of the conference, for example, the conference time is two hours, the time period is divided into 4 time periods, it is ensured that each time period in each group has the participants in which the attention is concentrated, the attention of the participants cannot be concentrated in the whole process aiming at an academic conference or a training conference with long time, the attention of the participants in each time period in the group is ensured to be concentrated by reasonably allocating and grouping, the complete storage record of the conference content is ensured, and the omission of important conference content due to the non-concentrated personal attention is avoided.
The above are merely examples of the present invention, and the present invention is not limited to the field related to this embodiment, and the common general knowledge of the known specific structures and characteristics in the schemes is not described herein too much, and those skilled in the art can know all the common technical knowledge in the technical field before the application date or the priority date, can know all the prior art in this field, and have the ability to apply the conventional experimental means before this date, and those skilled in the art can combine their own ability to perfect and implement the scheme, and some typical known structures or known methods should not become barriers to the implementation of the present invention by those skilled in the art in light of the teaching provided in the present application. It should be noted that, for those skilled in the art, without departing from the structure of the present invention, several changes and modifications can be made, which should also be regarded as the protection scope of the present invention, and these will not affect the effect of the implementation of the present invention and the practicability of the patent. The scope of the claims of the present application shall be determined by the contents of the claims, and the description of the embodiments and the like in the specification shall be used to explain the contents of the claims.

Claims (10)

1. A remote video conferencing system, characterized by: the method comprises the following steps:
the video conference terminal is connected with the multimedia gateway data, is used for acquiring multimedia data of a user or a conference field and uploading the multimedia data to the multimedia gateway, and is also used for receiving and playing the multimedia data distributed by the multimedia gateway;
the multimedia gateway comprises a multimedia distribution module, a multimedia output module and a multimedia input module, wherein the multimedia input module is used for receiving multimedia data input by a video conference terminal or superior equipment, a multimedia distribution matrix is stored in the multimedia distribution module, and the multimedia distribution module is used for constructing distribution data according to the multimedia distribution matrix and outputting the distribution data to the corresponding video conference terminal through the multimedia output module.
2. A remote video conferencing system as claimed in claim 1, wherein: the multimedia distribution module comprises a video fusion module, and the video fusion module is used for selecting a plurality of corresponding paths of multimedia data according to the multimedia distribution matrix to perform video fusion and generate distribution data.
3. A remote video conferencing system as claimed in claim 2, wherein: the multimedia gateway also comprises a distribution matrix setting module, and the distribution matrix setting module is used for adjusting the multimedia distribution matrix according to the request of the video conference terminal.
4. A remote video conferencing system as claimed in claim 3, wherein: the video conference terminal comprises a user conference terminal and meeting place equipment, wherein the meeting place equipment comprises a meeting place screen, a meeting place loudspeaker, a meeting place camera and a meeting place microphone.
5. The remote video conferencing system of claim 4, wherein: the video conference system further comprises a teleconference terminal, the teleconference terminal is connected with the video conference server, a signal input end of the teleconference terminal is in data connection with the multimedia output module, a signal output end of the teleconference terminal is in data connection with the multimedia input module, and the multimedia input module is used for receiving multimedia data input by the teleconference terminal;
the multimedia distribution module is used for distributing multimedia data input by the teleconference terminal according to the multimedia distribution matrix and outputting the multimedia data to the video conference terminal through the multimedia output module;
the multimedia distribution module is also used for distributing the multimedia data uploaded by the video conference terminal according to the multimedia distribution matrix and outputting the multimedia data to the remote conference terminal through the multimedia output module.
6. The remote video conferencing system of claim 5, wherein: the video conference terminal further comprises an AI processing module, and the AI processing module is used for carrying out AI processing on the multimedia data uploaded by the video conference terminal.
7. The remote video conferencing system of claim 6, wherein: the AI processing module comprises an intelligent caption processing module, a watching correction module and a privacy processing module, wherein the intelligent caption processing module is used for generating multi-language synchronous captions according to multimedia data, the watching correction module is used for correcting the watching direction of human face eyeballs in the video data of the multimedia data, and the privacy processing module is used for acquiring the video data in the multimedia data, identifying articles in the video data and carrying out privacy processing according to an identification result.
8. The remote video conferencing system of claim 7, wherein: the intelligent subtitle processing module comprises a voice recognition module and a translation module, wherein the voice recognition module is used for generating recognition texts according to audio data in multimedia data, and the translation module is used for synchronously generating multilingual translation texts.
9. A remote video conferencing system as in claim 8, wherein: the multimedia gateway is connected with the media cloud server, the media cloud server comprises a remote multimedia distribution module, and the remote multimedia distribution module is used for distributing the multimedia data uploaded by the multimedia gateway to other multimedia gateways according to the media distribution matrix.
10. A remote video conferencing method, characterized by: a remote video conferencing system as claimed in any of claims 1-9 is used.
CN202110055761.7A 2021-01-15 2021-01-15 Remote video conference system and method Pending CN112866620A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110055761.7A CN112866620A (en) 2021-01-15 2021-01-15 Remote video conference system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110055761.7A CN112866620A (en) 2021-01-15 2021-01-15 Remote video conference system and method

Publications (1)

Publication Number Publication Date
CN112866620A true CN112866620A (en) 2021-05-28

Family

ID=76005866

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110055761.7A Pending CN112866620A (en) 2021-01-15 2021-01-15 Remote video conference system and method

Country Status (1)

Country Link
CN (1) CN112866620A (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105993172A (en) * 2013-11-26 2016-10-05 At&T知识产权部有限合伙公司 Manipulation of media content to overcome user impairments
CN111757043A (en) * 2020-06-30 2020-10-09 中科远见(重庆)科技有限公司 Data transmission system and transmission method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105993172A (en) * 2013-11-26 2016-10-05 At&T知识产权部有限合伙公司 Manipulation of media content to overcome user impairments
CN111757043A (en) * 2020-06-30 2020-10-09 中科远见(重庆)科技有限公司 Data transmission system and transmission method

Similar Documents

Publication Publication Date Title
CN102460487B (en) The system and method for mixing course teaching
US20110123972A1 (en) System for automatic production of lectures and presentations for live or on-demand publishing and sharing
US20240179357A1 (en) System and method for producing a video stream
CN112866621A (en) Paperless conference system and implementation method thereof
Indah et al. Multimedia and internetworking architecture infrastructure on interactive e-learning system
US12075191B1 (en) Transparent frame utilization in video conferencing
CN105898235B (en) The remote access system of OSCE Objective Structured Clinical Examination
JP4565232B2 (en) Lecture video creation system
Ramanathan et al. Integrating virtual reality, tele-conferencing, and entertainment into multimedia home computers
CN112837574B (en) Interactive classroom system and method thereof
JP2005524867A (en) System and method for providing low bit rate distributed slide show presentation
CN112866620A (en) Remote video conference system and method
TWI270831B (en) A multimedia learning system with digital archives
KR100451957B1 (en) A Real-Time Remote Education System Using Intercommunication
JPH07162824A (en) Communication system and terminal equipment
US12058020B1 (en) Synchronizing audio playback for co-located devices
US20240177740A1 (en) System and method for producing a video stream
US12069406B2 (en) System and method for producing a video stream
KR20240145474A (en) System and method for generating video streams
KR20240144941A (en) System and method for generating video streams
JP2024538056A (en) System and method for generating a shared video stream - Patents.com
JP2024538087A (en) System and method for generating a video stream - Patent application
Morgan et al. CCNA Collaboration CIVND 210-065 Official Cert Guide: CCNA Col CIVND 210-06 OCG_c1
US20230026467A1 (en) Systems and methods for automated audio transcription, translation, and transfer for online meeting
KR20220131743A (en) Video conference method providing customized user environment based upon AI

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210528