CN112866620A - Remote video conference system and method - Google Patents
Remote video conference system and method Download PDFInfo
- Publication number
- CN112866620A CN112866620A CN202110055761.7A CN202110055761A CN112866620A CN 112866620 A CN112866620 A CN 112866620A CN 202110055761 A CN202110055761 A CN 202110055761A CN 112866620 A CN112866620 A CN 112866620A
- Authority
- CN
- China
- Prior art keywords
- multimedia
- module
- data
- distribution
- video conference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 239000011159 matrix material Substances 0.000 claims abstract description 39
- 238000012545 processing Methods 0.000 claims description 34
- 230000004927 fusion Effects 0.000 claims description 10
- 238000013519 translation Methods 0.000 claims description 10
- 238000012937 correction Methods 0.000 claims description 8
- 210000005252 bulbus oculi Anatomy 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 description 8
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to the technical field of video conferences, in particular to a remote video conference system and a method, wherein the system comprises: the video conference terminal is in data connection with the multimedia gateway and is used for acquiring multimedia data of a user or a meeting place and uploading the multimedia data to the multimedia gateway; the multimedia gateway comprises a multimedia distribution module, a multimedia output module and a multimedia input module, wherein the multimedia input module is used for receiving multimedia data input by a video conference terminal or superior equipment, a multimedia distribution matrix is stored in the multimedia distribution module, and the multimedia distribution module is used for constructing distribution data according to the multimedia distribution matrix and outputting the distribution data to the corresponding video conference terminal through the multimedia output module. The remote video conference system and the method can solve the problems that the existing video conference system cannot independently distribute, regulate and control multimedia data and is inconvenient to monitor and control.
Description
Technical Field
The invention relates to the technical field of video conferences, in particular to a remote video conference system and a remote video conference method.
Background
With the development of society, the application of the video conference system is increasingly popularized. The video conference can enable conference representatives in a plurality of different places to simultaneously carry out online inter-translation through a multimedia network technology, and carry out real-time sharing of pictures, forms, files and the like, so that the working efficiency can be obviously improved.
In the existing video conference technology, after multi-channel media stream data are fused and spliced by a server, unified media streams are formed, after the multi-channel video streams uploaded by all participants are fused and spliced by the server, the multi-channel video streams are changed into unified video pictures, the same video picture is seen by all participants of a conference, the flexibility of the mode is poor, and the practical application requirements cannot be met.
Disclosure of Invention
The invention aims to provide a remote video conference system and a remote video conference method, which can solve the problems that in the existing video conference system, the multimedia data merging process cannot be independently distributed and regulated, and the monitoring and control are inconvenient.
The application provides the following technical scheme:
a remote video conferencing system, comprising:
the video conference terminal is connected with the multimedia gateway data, is used for acquiring multimedia data of a user or a conference field and uploading the multimedia data to the multimedia gateway, and is also used for receiving and playing the multimedia data distributed by the multimedia gateway;
the multimedia gateway comprises a multimedia distribution module, a multimedia output module and a multimedia input module, wherein the multimedia input module is used for receiving multimedia data input by a video conference terminal or superior equipment, a multimedia distribution matrix is stored in the multimedia distribution module, and the multimedia distribution module is used for constructing distribution data according to the multimedia distribution matrix and outputting the distribution data to the corresponding video conference terminal through the multimedia output module.
Further, the multimedia distribution module comprises a video fusion module, and the video fusion module is used for selecting a plurality of corresponding paths of multimedia data according to the multimedia distribution matrix to perform video fusion and generate distribution data.
Further, the multimedia gateway further comprises a distribution matrix setting module, wherein the distribution matrix setting module is used for adjusting the multimedia distribution matrix according to the request of the video conference terminal.
Further, the video conference terminal comprises a user conference terminal and meeting place equipment, wherein the meeting place equipment comprises a meeting place screen, a meeting place loudspeaker, a meeting place camera and a meeting place microphone.
The system comprises a video conference server, a multimedia input module, a multimedia output module, a multimedia input module and a remote conference terminal, wherein the video conference server is connected with the video conference terminal;
the multimedia distribution module is used for distributing multimedia data input by the teleconference terminal according to the multimedia distribution matrix and outputting the multimedia data to the video conference terminal through the multimedia output module;
the multimedia distribution module is also used for distributing the multimedia data uploaded by the video conference terminal according to the multimedia distribution matrix and outputting the multimedia data to the remote conference terminal through the multimedia output module.
The system further comprises an AI processing module, wherein the AI processing module is used for carrying out AI processing on the multimedia data uploaded by the video conference terminal.
Further, the AI processing module comprises an intelligent caption processing module, a watching correction module and a privacy processing module, wherein the intelligent caption processing module is used for generating multilingual synchronous captions according to multimedia data, the watching correction module is used for correcting the watching direction of human face eyeballs in the video data of the multimedia data, and the privacy processing module is used for acquiring the video data in the multimedia data, identifying articles in the video data and carrying out privacy processing according to an identification result.
Furthermore, the intelligent subtitle processing module comprises a voice recognition module and a translation module, wherein the voice recognition module is used for generating recognition texts according to audio data in the multimedia data, and the translation module is used for synchronously generating multilingual translation texts.
The multimedia gateway is connected with the media cloud server, the media cloud server comprises a remote multimedia distribution module, and the remote multimedia distribution module is used for distributing the multimedia data uploaded by the multimedia gateway to other multimedia gateways according to the media distribution matrix.
Further, the application also discloses a remote video conference method, and the method uses the remote video conference system.
The technical scheme of the invention has the beneficial effects that:
1. in the technical scheme of the invention, the distributed data can be constructed according to the multimedia distribution matrix through the multimedia gateway, the video fusion is carried out according to the multimedia distribution matrix, the output flow direction of each path of multimedia data can be flexibly controlled, the picture range viewed by each user is controlled, and the users can make different conference participants see different pictures through setting the media distribution matrix, thereby realizing hierarchical control, being convenient for supervision and regulation, being suitable for complex conference scenes and being beneficial to protecting the privacy of the conference participants.
2. In the technical scheme of the invention, the multimedia gateway can be connected in the existing video conference system, namely, between the video conference terminal and the teleconference terminal, and is directly connected with the existing teleconference terminal for use, so that the video conference system is compatible with the existing video conference system, the multimedia processing capacity and the function of the video conference are expanded, a user can realize the characteristics of media distribution control, multi-protocol support and the like on the existing video conference system only by adding the multimedia gateway of the application without carrying out complete modification, and the modification cost is low.
3. Through the AI processing module, the AI function can be added to the traditional non-intelligent audio and video system, and the functions of fixation correction, privacy protection and the like are realized.
4. By connecting the media cloud server, a multi-room video conference and multi-level media distribution control can be realized, so that the conference system has stronger expansibility and is suitable for various complex scenes.
Drawings
Fig. 1 is an architecture diagram of an application scenario in a first embodiment of a remote video conference system according to the present application;
fig. 2 is an application scene architecture diagram in a second embodiment of a remote video conference system according to the present application.
Detailed Description
The technical scheme of the application is further explained in detail through the following specific implementation modes:
example one
As shown in fig. 1, a remote video conference system disclosed in this embodiment includes a video conference terminal, a multimedia gateway, and a remote conference terminal.
The video conference terminal comprises a user conference terminal and meeting place equipment, the user conference terminal comprises a user mobile phone, a notebook computer, a tablet computer and the like, and the meeting place equipment comprises a meeting place screen, a meeting place loudspeaker, a meeting place camera, a meeting place microphone and the like.
The video conference terminal is connected with the multimedia gateway in a data mode, the video conference terminal is used for collecting user or meeting field multimedia data and uploading the user or meeting field multimedia data to the multimedia gateway, and the video conference terminal is further used for receiving the multimedia data distributed by the multimedia gateway and displaying and playing the multimedia data.
The multimedia gateway comprises a multimedia distribution module, a multimedia output module and a multimedia input module, wherein the multimedia input module is used for receiving multimedia data input by a video conference terminal or superior equipment, a multimedia distribution matrix is stored in the multimedia distribution module, and the multimedia distribution module is used for constructing distribution data according to the multimedia distribution matrix and outputting the distribution data to the corresponding video conference terminal through the multimedia output module.
The remote conference terminal is connected with the video conference server, the signal input end of the remote conference terminal is in data connection with the multimedia output module, the signal output end of the remote conference terminal is in data connection with the multimedia input module, and the multimedia input module is used for receiving multimedia data input by the remote conference terminal;
the multimedia distribution module is also used for distributing multimedia data input by the teleconference terminal according to the multimedia distribution matrix and outputting the multimedia data to the video conference terminal through the multimedia output module;
the multimedia distribution module is also used for distributing the multimedia data uploaded by the video conference terminal according to the multimedia distribution matrix and outputting the multimedia data to the remote conference terminal through the multimedia output module.
In this embodiment, the multimedia gateway hardware is provided with a wireless network module and an ethernet module, the support device is accessed through a wireless or wired network, and interfaces such as DP, HDMI, microphone, and speaker are also connected with corresponding video conference terminal devices through corresponding connection wires. The teleconference terminal adopts the existing teleconference equipment, such as VP9830 China center communication M900-16A video conference equipment, and the multimedia gateway is equivalent to output equipment simulating a camera, a microphone input equipment, a display screen and the like of the equipment.
The multimedia distribution module comprises a video fusion module, and the video fusion module is used for selecting a plurality of corresponding paths of multimedia data according to the multimedia distribution matrix to perform video fusion and generate distribution data.
The multimedia gateway also comprises a distribution matrix setting module, and the distribution matrix setting module is used for adjusting the multimedia distribution matrix according to the request of the video conference terminal.
The remote video conference method of the present embodiment uses the remote video conference system in the present embodiment.
Example two
As shown in fig. 2, the difference between this embodiment and the first embodiment is that in this embodiment, the multimedia gateway further includes a media cloud server, the multimedia gateway is further connected to the media cloud server through the internet, the media distribution matrix is provided with a hierarchy, the media cloud server or the multimedia gateway itself is provided with a corresponding distribution hierarchy, the media cloud server includes a remote multimedia distribution module, the remote multimedia distribution module is configured to select a media distribution matrix of the hierarchy corresponding to the media cloud server from the multimedia data uploaded by the multimedia gateway, and distribute the selected media distribution matrix to other multimedia gateways according to the media distribution matrix, and the multimedia gateway that receives the distributed multimedia data can further distribute multimedia according to the media distribution matrix.
The remote video conference method of the present embodiment uses the remote video conference system in the present embodiment.
EXAMPLE III
The difference between this embodiment and the first embodiment is that the multimedia gateway further includes an AI processing module, and the AI processing module is configured to perform AI processing on the multimedia data uploaded by the video conference terminal.
The AI processing module comprises an intelligent caption processing module, a watching correction module and a privacy processing module, wherein the intelligent caption processing module is used for generating multilingual synchronous captions according to multimedia data, the watching correction module is used for correcting the watching direction of human face eyeballs in the video data of the multimedia data, and the privacy processing module is used for acquiring the video data in the multimedia data, identifying articles in the video data and carrying out privacy processing according to an identification result.
The intelligent caption processing module comprises a voice recognition module and a translation module, wherein the voice recognition module is used for generating a recognition text according to audio data in the multimedia data, and the translation module is used for synchronously generating a multilingual translation text.
In this embodiment, the intelligent subtitle processing module, the gaze correction module, the privacy processing module, and the like all adopt the existing artificial intelligent neural network model to realize corresponding functions.
The remote video conference method of the present embodiment uses the remote video conference system in the present embodiment.
Example four
The difference between this embodiment and the first embodiment is that the multimedia input module is further configured to receive multimedia data input by a cascaded multimedia gateway; the multimedia distribution module is used for distributing the multimedia data according to the multimedia distribution matrix and outputting the multimedia data to the cascaded multimedia gateway through the multimedia output module. The media distribution matrix is provided with grades, and the multimedia gateway is provided with corresponding distribution grades to select the corresponding media distribution matrix for multimedia distribution. In the embodiment, the multi-room video conference and the multi-level media distribution control can be realized through the cascade connection of the multi-level multimedia gateways, so that the conference system has stronger expansibility and is suitable for various complex scenes.
The remote video conference method of the present embodiment uses the remote video conference system in the present embodiment.
EXAMPLE five
The difference between this embodiment and the second embodiment is that, in this embodiment, the media cloud server further includes a participating process recording module, a participating state analysis module, an attention analysis module, and a grouping module.
The conference-participating process recording module is used for acquiring the conference-participating process information of each participant through the user terminal, the conference-participating process information comprises actions, expressions, speeches and the like, the conference-participating state analyzing module is used for analyzing the states of the participants at each moment or time period, such as the attention focusing state, the distraction state, the question thinking state and the like, according to the conference-participating process information, dividing the conference-participating process of the participants into a plurality of state time periods,
the attention analysis module is used for analyzing the time period of attention concentration of each participant according to the analysis result of the state analysis module; the grouping module is used for grouping according to the time periods in which the attention of each participant is concentrated, the participants in different time periods in which the attention is concentrated are grouped into one group, the time period in which the attention of the participants in each group is concentrated covers the time length of the conference, for example, the conference time is two hours, the time period is divided into 4 time periods, it is ensured that each time period in each group has the participants in which the attention is concentrated, the attention of the participants cannot be concentrated in the whole process aiming at an academic conference or a training conference with long time, the attention of the participants in each time period in the group is ensured to be concentrated by reasonably allocating and grouping, the complete storage record of the conference content is ensured, and the omission of important conference content due to the non-concentrated personal attention is avoided.
The above are merely examples of the present invention, and the present invention is not limited to the field related to this embodiment, and the common general knowledge of the known specific structures and characteristics in the schemes is not described herein too much, and those skilled in the art can know all the common technical knowledge in the technical field before the application date or the priority date, can know all the prior art in this field, and have the ability to apply the conventional experimental means before this date, and those skilled in the art can combine their own ability to perfect and implement the scheme, and some typical known structures or known methods should not become barriers to the implementation of the present invention by those skilled in the art in light of the teaching provided in the present application. It should be noted that, for those skilled in the art, without departing from the structure of the present invention, several changes and modifications can be made, which should also be regarded as the protection scope of the present invention, and these will not affect the effect of the implementation of the present invention and the practicability of the patent. The scope of the claims of the present application shall be determined by the contents of the claims, and the description of the embodiments and the like in the specification shall be used to explain the contents of the claims.
Claims (10)
1. A remote video conferencing system, characterized by: the method comprises the following steps:
the video conference terminal is connected with the multimedia gateway data, is used for acquiring multimedia data of a user or a conference field and uploading the multimedia data to the multimedia gateway, and is also used for receiving and playing the multimedia data distributed by the multimedia gateway;
the multimedia gateway comprises a multimedia distribution module, a multimedia output module and a multimedia input module, wherein the multimedia input module is used for receiving multimedia data input by a video conference terminal or superior equipment, a multimedia distribution matrix is stored in the multimedia distribution module, and the multimedia distribution module is used for constructing distribution data according to the multimedia distribution matrix and outputting the distribution data to the corresponding video conference terminal through the multimedia output module.
2. A remote video conferencing system as claimed in claim 1, wherein: the multimedia distribution module comprises a video fusion module, and the video fusion module is used for selecting a plurality of corresponding paths of multimedia data according to the multimedia distribution matrix to perform video fusion and generate distribution data.
3. A remote video conferencing system as claimed in claim 2, wherein: the multimedia gateway also comprises a distribution matrix setting module, and the distribution matrix setting module is used for adjusting the multimedia distribution matrix according to the request of the video conference terminal.
4. A remote video conferencing system as claimed in claim 3, wherein: the video conference terminal comprises a user conference terminal and meeting place equipment, wherein the meeting place equipment comprises a meeting place screen, a meeting place loudspeaker, a meeting place camera and a meeting place microphone.
5. The remote video conferencing system of claim 4, wherein: the video conference system further comprises a teleconference terminal, the teleconference terminal is connected with the video conference server, a signal input end of the teleconference terminal is in data connection with the multimedia output module, a signal output end of the teleconference terminal is in data connection with the multimedia input module, and the multimedia input module is used for receiving multimedia data input by the teleconference terminal;
the multimedia distribution module is used for distributing multimedia data input by the teleconference terminal according to the multimedia distribution matrix and outputting the multimedia data to the video conference terminal through the multimedia output module;
the multimedia distribution module is also used for distributing the multimedia data uploaded by the video conference terminal according to the multimedia distribution matrix and outputting the multimedia data to the remote conference terminal through the multimedia output module.
6. The remote video conferencing system of claim 5, wherein: the video conference terminal further comprises an AI processing module, and the AI processing module is used for carrying out AI processing on the multimedia data uploaded by the video conference terminal.
7. The remote video conferencing system of claim 6, wherein: the AI processing module comprises an intelligent caption processing module, a watching correction module and a privacy processing module, wherein the intelligent caption processing module is used for generating multi-language synchronous captions according to multimedia data, the watching correction module is used for correcting the watching direction of human face eyeballs in the video data of the multimedia data, and the privacy processing module is used for acquiring the video data in the multimedia data, identifying articles in the video data and carrying out privacy processing according to an identification result.
8. The remote video conferencing system of claim 7, wherein: the intelligent subtitle processing module comprises a voice recognition module and a translation module, wherein the voice recognition module is used for generating recognition texts according to audio data in multimedia data, and the translation module is used for synchronously generating multilingual translation texts.
9. A remote video conferencing system as in claim 8, wherein: the multimedia gateway is connected with the media cloud server, the media cloud server comprises a remote multimedia distribution module, and the remote multimedia distribution module is used for distributing the multimedia data uploaded by the multimedia gateway to other multimedia gateways according to the media distribution matrix.
10. A remote video conferencing method, characterized by: a remote video conferencing system as claimed in any of claims 1-9 is used.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110055761.7A CN112866620A (en) | 2021-01-15 | 2021-01-15 | Remote video conference system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110055761.7A CN112866620A (en) | 2021-01-15 | 2021-01-15 | Remote video conference system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112866620A true CN112866620A (en) | 2021-05-28 |
Family
ID=76005866
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110055761.7A Pending CN112866620A (en) | 2021-01-15 | 2021-01-15 | Remote video conference system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112866620A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105993172A (en) * | 2013-11-26 | 2016-10-05 | At&T知识产权部有限合伙公司 | Manipulation of media content to overcome user impairments |
| CN111757043A (en) * | 2020-06-30 | 2020-10-09 | 中科远见(重庆)科技有限公司 | Data transmission system and transmission method |
-
2021
- 2021-01-15 CN CN202110055761.7A patent/CN112866620A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105993172A (en) * | 2013-11-26 | 2016-10-05 | At&T知识产权部有限合伙公司 | Manipulation of media content to overcome user impairments |
| CN111757043A (en) * | 2020-06-30 | 2020-10-09 | 中科远见(重庆)科技有限公司 | Data transmission system and transmission method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102460487B (en) | The system and method for mixing course teaching | |
| US20110123972A1 (en) | System for automatic production of lectures and presentations for live or on-demand publishing and sharing | |
| US20240179357A1 (en) | System and method for producing a video stream | |
| CN112866621A (en) | Paperless conference system and implementation method thereof | |
| Indah et al. | Multimedia and internetworking architecture infrastructure on interactive e-learning system | |
| US12075191B1 (en) | Transparent frame utilization in video conferencing | |
| CN105898235B (en) | The remote access system of OSCE Objective Structured Clinical Examination | |
| JP4565232B2 (en) | Lecture video creation system | |
| Ramanathan et al. | Integrating virtual reality, tele-conferencing, and entertainment into multimedia home computers | |
| CN112837574B (en) | Interactive classroom system and method thereof | |
| JP2005524867A (en) | System and method for providing low bit rate distributed slide show presentation | |
| CN112866620A (en) | Remote video conference system and method | |
| TWI270831B (en) | A multimedia learning system with digital archives | |
| KR100451957B1 (en) | A Real-Time Remote Education System Using Intercommunication | |
| JPH07162824A (en) | Communication system and terminal equipment | |
| US12058020B1 (en) | Synchronizing audio playback for co-located devices | |
| US20240177740A1 (en) | System and method for producing a video stream | |
| US12069406B2 (en) | System and method for producing a video stream | |
| KR20240145474A (en) | System and method for generating video streams | |
| KR20240144941A (en) | System and method for generating video streams | |
| JP2024538056A (en) | System and method for generating a shared video stream - Patents.com | |
| JP2024538087A (en) | System and method for generating a video stream - Patent application | |
| Morgan et al. | CCNA Collaboration CIVND 210-065 Official Cert Guide: CCNA Col CIVND 210-06 OCG_c1 | |
| US20230026467A1 (en) | Systems and methods for automated audio transcription, translation, and transfer for online meeting | |
| KR20220131743A (en) | Video conference method providing customized user environment based upon AI |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210528 |