CN104954729A - Video conference data processing method and system - Google Patents
Video conference data processing method and system Download PDFInfo
- Publication number
- CN104954729A CN104954729A CN201410124762.2A CN201410124762A CN104954729A CN 104954729 A CN104954729 A CN 104954729A CN 201410124762 A CN201410124762 A CN 201410124762A CN 104954729 A CN104954729 A CN 104954729A
- Authority
- CN
- China
- Prior art keywords
- client
- video
- data
- transfer unit
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a video conference data processing system. The system is used for controlling a video transmission unit to receive video data transmitted by each client terminal; generating two copies of the received video data of each client terminal through copying; transmitting one copy of the video data to a main conference place client terminal via the video transmission unit; transmitting the other copy of the video data to a multipoint control unit via the video transmission unit; controlling the multipoint control unit to synthesize the other copy of the video data into combined frame data; and transmitting the synthesized combined frame data to each branch conference place client terminal via the video transmission unit. The invention also provides a video conference data processing method. A high-definition video image conference can be realized without requiring oversized network bandwidth.
Description
Technical field
The present invention relates to a kind of data processing method and system, especially relate to a kind of videoconference data processing method and system of application television wall.
Background technology
Passing video conference adopts MCU(Multi Control Unit, multipoint control unit) receive the video image (1080P) of multiple client, then picture is synthesized road divided video image (1080P), export to each client.If client uses the display (such as video wall) of large-size, for the video wall of nine clients and nine screens, each screen of video wall is 1080P, after the video image of synthesis nine segmentation, the resolution of each divided frame is 640*360, the effect presented on each screen of video wall after expansion is in proportion also bad, cannot meet the demand of user.If do not use MCU, other clients given by each client direct point-to-point transmission high definition image, then in video wall, the picture of each screen has the resolution of 1080P, allows people have to walk back and forth the visual experience that Buddhist is had a meeting at the scene, but also needs larger network bandwidth simultaneously.For the video data of 1080P, at least need the network traffics of 5Mbps.Nine road video datas transmit the network traffics approximately needing to upload and download each 45Mbps simultaneously, could maintain video image normal play.
Summary of the invention
In view of above content, be necessary to provide a kind of videoconference data processing method, the meeting of HD video image can be realized, and do not need too large network bandwidth.
In view of above content, there is a need to provide a kind of videoconference data treatment system, the meeting of HD video image can be realized, and do not need too large network bandwidth.
Described videoconference data processing method comprises step: control the video data that video transfer unit receives the transmission of each client, described client comprises main meeting-place client and sub-venue client; The video data of each client received is copied as two parts; A copy of it video data after copying is sent to described main meeting-place client by video transfer unit; Another part of video data after copying is sent to multipoint control unit by video transfer unit, controls multipoint control unit and described another part of video data is synthesized combined picture data; And the combined picture data after synthesis are sent to each sub-venue client by video transfer unit.
Described videoconference data treatment system comprises: receiver module, and receive the video data of each client transmission for controlling video transfer unit, described client comprises main meeting-place client and sub-venue client; Replication module, for copying as two parts by the video data of each client received; Delivery module, for being sent to described main meeting-place client by a copy of it video data after copying by video transfer unit; Synthesis module, for another part of video data after copying is sent to multipoint control unit by video transfer unit, controls multipoint control unit and described another part of video data is synthesized combined picture data; And described delivery module is also for being sent to each sub-venue client by the combined picture data after synthesis by video transfer unit.
Compared to prior art, described videoconference data processing method and system, can directly send the video data portion of each client received to main meeting-place client, video wall shows the HD video image in each meeting-place, another part synthesizes combined picture data by multipoint control unit, be sent to each sub-venue client to show, both ensure that the definition of the video pictures of main meeting-place client terminal playing, do not needed too large network bandwidth again.
Accompanying drawing explanation
Fig. 1 is the running environment figure of videoconference data treatment system of the present invention preferred embodiment.
Fig. 2 is the schematic diagram of video wall in the present invention.
Fig. 3 is the functional block diagram of videoconference data treatment system of the present invention preferred embodiment.
Fig. 4 is the flow chart of videoconference data processing method of the present invention preferred embodiment.
Fig. 5 is the data flow schematic diagram of videoconference data processing method of the present invention preferred embodiment.
Main element symbol description
| Server | 1 |
| Client | 2 |
| Main meeting-place client | 22 |
| Sub-venue client | 24 |
| Videoconference data treatment system | 10 |
| Video transfer unit | 20 |
| Multipoint control unit | 30 |
| SIP service unit | 40 |
| Memory | 50 |
| Processor | 60 |
| Receiver module | 100 |
| Replication module | 200 |
| Delivery module | 300 |
| Synthesis module | 400 |
Following embodiment will further illustrate the present invention in conjunction with above-mentioned accompanying drawing.
Embodiment
Consulting shown in Fig. 1, is the running environment figure of videoconference data treatment system of the present invention preferred embodiment.Videoconference data treatment system 10 runs in server 1.The video transfer unit (Video Forwarder) 20, multipoint control unit 30, the SIP(Session Initiation Protocol that are connected by data wire or holding wire is also comprised, Session initiation Protocol in server 1) service unit 40, memory 50 and processor 60 etc.
Server 1 to be connected to shown in multiple client 2(Fig. 1 two representatively by network), for realizing the video conference between the plurality of client 2.Video transfer unit 20 is for the video data that receives each client 2 and send and pass on video data to multipoint control unit 30 or each client 2.Multipoint control unit 30 synthesizes for the multi-path video data passed on to described video transfer unit 20.SIP service unit 40 is for carrying out connection management to each client 2, and when carrying out video conference, each client 2 all needs first to log in SIP service unit 40, and carries out communication process by SIP service unit 40, sets up line.Memory 50 is for the data such as program code of store video conferencing data treatment system 10.Processor 60 for performing each functional module of videoconference data treatment system 10, to complete the present invention.
In the present embodiment, have a main meeting-place client 22 in described multiple client 2, other are shown for sub-venue client 24(consults Fig. 5), generally this main meeting-place client 22 and server 1 are in same place.In other embodiments, if network bandwidth allows, server 1 also can be arranged on anywhere, and does not need with main meeting-place client 22 in same place.The present embodiment connects nine clients 2 for server 1 and is described, and one of them client 2 is main meeting-place client 22, and remaining eight clients 2 is sub-venue client 24.
Described main meeting-place client 22 comprises a decoder array (Array Decoder Box, not shown in Fig. 1), described decoder array comprises multiple (such as nine) codec (Codec Box), and this main meeting-place client 22 is connected to video wall (such as nine grids video wall is consulted shown in Fig. 2).Multiple screen of described video wall and described multiple codec and multiple client 2 one_to_one corresponding.Each codec, for the video data of corresponding client 2 of decoding, is then play on the corresponding screen of described video wall.Such as, the first codec in decoder array, for the video data of the first client of decoding (main meeting-place client 22), the first then corresponding in video wall screen is play; Second codec, for the video data of the second client of decoding (sub-venue client 24), the second then corresponding in video wall screen is play; 3rd codec is for the video data of the 3rd client (sub-venue client 24) of decoding, and the 3rd then corresponding in video wall screen is play, and the rest may be inferred.
Each sub-venue client 24 comprises a codec (not shown in figure 1), for the combined picture data after the synthesis that the video data of this sub-venue client 24 of encoding and decoding server 1 send, the screen then described combined picture data connected in this sub-venue client 24 is play.
Consulting shown in Fig. 3, is the functional block diagram of videoconference data treatment system of the present invention preferred embodiment.
Described videoconference data treatment system 10 comprises receiver module 100, replication module 200, delivery module 300 and synthesis module 400.
Described receiver module 100 receives the video data of each client 2 transmission for controlling video transfer unit 20.When carrying out video conference, each client 2 logs in described SIP service unit 40, sets up line, and the codec then in each client 2, by the coding video data in this meeting-place, is sent to server 1.In the present embodiment, video transfer unit 20 will receive the video data (i.e. nine road video datas) of nine clients 2.
Described replication module 200 is for copying as two parts by the video data of each client 2 received.In the present embodiment, only can copy the video data of eight sub-venue clients 24, after copying, a copy of it video data (comprising the video data of eight sub-venue clients 24) will be sent straight to main meeting-place client 22, and another part of video data (comprising the video data of main meeting-place client 22 and the video data of eight sub-venue clients 24) will be transferred into multipoint control unit 30 and synthesize.
Described delivery module 300 is for being sent to main meeting-place client 22 by a copy of it video data (eight road video datas) after copying by video transfer unit 20.After main meeting-place client 22 receives the video data of video transfer unit 20 transmission, the video data of the client 2 of correspondence is decoded by each codec in decoder array, then plays on the corresponding screen of video wall.In the present embodiment, main meeting-place client 22 has the video data corresponding to this main meeting-place, directly corresponding with main meeting-place client 22 in video wall screen can be play, therefore only decode with the video data receiving other eight sub-venues 24 from video transfer unit 20, other eight corresponding screens of video wall are play.Suppose that each screen of video wall is 1080P, the video data that each client 2 sends is 1080P, then video wall can be play-overed the high definition image of the 1080P of corresponding client 2 in each screen.Therefore, can ensure to have higher screen resolution in main meeting-place client 22, less picture postpones.
Described synthesis module 400, for another part of video data (nine road video datas) after copying is sent to multipoint control unit 30 by video transfer unit 20, controls multipoint control unit 30 and described another part of video data is synthesized combined picture data.In the present embodiment, nine road video datas of each client 2 synthesize according to preassigned pattern by multipoint control unit 30, such as, synthesize nine segmentation images, form road combined picture data.
Described delivery module 300 is also for being sent to each sub-venue client 24 by the combined picture data after synthesis by video transfer unit 20.The codec of each sub-venue client 24, to the combined picture decoding data received, the screen then described combined picture data connected in this sub-venue client 24 is play.In the present embodiment, suppose that the video data that each client 2 sends is 1080P, the nine segmentation images of synthesis 1080P, then the screen that each sub-venue client 24 connects can be play the nine segmentation images of 1080P.
Consulting shown in Fig. 4, is the flow chart of videoconference data processing method of the present invention preferred embodiment.Described videoconference data processing method performs the module 100 ~ 400 shown in Fig. 3 by described processor 60 and realizes.
Step S10, described receiver module 100 controls the video data that video transfer unit 20 receives the transmission of each client 2.
Step S12, the video data of each client 2 received is copied as two parts by described replication module 200.
Step S14, a copy of it video data after copying is sent to main meeting-place client 22 by video transfer unit 20 by described delivery module 300.The video data of the client 2 of correspondence is decoded by each codec in the decoder array of main meeting-place client 22, then plays on the corresponding screen of video wall.
Step S16, another part of video data after copying is sent to multipoint control unit 30 by video transfer unit 20 by described synthesis module 400, controls multipoint control unit 30 and described another part of video data is synthesized combined picture data.
Step S18, the combined picture data after synthesis are sent to each sub-venue client 24 by video transfer unit 20 by described delivery module 300.The codec of each sub-venue client 24, to the combined picture decoding data received, the screen then described combined picture data connected in this sub-venue client 24 is play.
Consulting shown in Fig. 5, is the data flow schematic diagram of videoconference data processing method of the present invention preferred embodiment.Visible, only be sent to main meeting-place client 22 Shi eight road video data from server, and be sent to server from each client (main meeting-place client 22 and sub-venue client 24) and be sent to each sub-venue client 24 from server all only have a circuit-switched data, do not need too large network bandwidth.
It should be noted that above-described embodiment is described to only have a main meeting-place client, in other embodiments, if network bandwidth allows, also can have multiple main meeting-places client, namely can play the high definition image of multi-screen on the video wall in multiple meeting-place.
Above embodiment is only in order to illustrate technical scheme of the present invention and unrestricted, although with reference to preferred embodiment to invention has been detailed description, those of ordinary skill in the art is to be understood that, can modify to technical scheme of the present invention or equivalent replacement, and not depart from the spirit and scope of technical solution of the present invention.
Claims (8)
1. a videoconference data processing method, be applied in the server connecting multiple client, this server comprises video transfer unit and multipoint control unit, it is characterized in that, the method comprising the steps of:
Control the video data that video transfer unit receives the transmission of each client, described client comprises main meeting-place client and multiple sub-venue client;
The video data of each client received is copied as two parts;
A copy of it video data after copying is sent to described main meeting-place client by video transfer unit;
Another part of video data after copying is sent to multipoint control unit by video transfer unit, controls multipoint control unit and described another part of video data is synthesized combined picture data; And
Combined picture data after synthesis are sent to each sub-venue client by video transfer unit.
2. videoconference data processing method as claimed in claim 1, it is characterized in that, after described combined picture data are sent to each sub-venue client, are decoded by the codec of each sub-venue client, then play on the screen of this sub-venue client's side link.
3. videoconference data processing method as claimed in claim 1, it is characterized in that, described main meeting-place client comprises a decoder array, described decoder array comprises multiple codec, and this main meeting-place client's side link is in video wall, multiple screen of described video wall and described multiple codec and multiple client one_to_one corresponding.
4. videoconference data processing method as claimed in claim 3, it is characterized in that, the video data transmitted when video transfer unit is decoded by codec corresponding in decoder array, is then play on the corresponding screen of video wall after being received by described main meeting-place client.
5. a videoconference data treatment system, run in the server connecting multiple client, this server comprises video transfer unit and multipoint control unit, it is characterized in that, this system comprises:
Receiver module, receive the video data of each client transmission for controlling video transfer unit, described client comprises main meeting-place client and multiple sub-venue client;
Replication module, for copying as two parts by the video data of each client received;
Delivery module, for being sent to described main meeting-place client by a copy of it video data after copying by video transfer unit;
Synthesis module, for another part of video data after copying is sent to multipoint control unit by video transfer unit, controls multipoint control unit and described another part of video data is synthesized combined picture data; And
Described delivery module is also for being sent to each sub-venue client by the combined picture data after synthesis by video transfer unit.
6. videoconference data treatment system as claimed in claim 5, it is characterized in that, after each sub-venue client receives the combined picture data of video transfer unit transmission, described combined picture data, to the combined picture decoding data received, are then play by the codec of each sub-venue client on the screen of this sub-venue client's side link.
7. videoconference data treatment system as claimed in claim 5, it is characterized in that, described main meeting-place client comprises a decoder array, described decoder array comprises multiple codec, and this main meeting-place client's side link is in video wall, multiple screen of described video wall and described multiple codec and multiple client one_to_one corresponding.
8. videoconference data treatment system as claimed in claim 7, it is characterized in that, after described main meeting-place client receives the video data of video transfer unit transmission, the video data of the client of correspondence is decoded by each codec in decoder array, then plays on the corresponding screen of video wall.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410124762.2A CN104954729B (en) | 2014-03-31 | 2014-03-31 | Videoconference data processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410124762.2A CN104954729B (en) | 2014-03-31 | 2014-03-31 | Videoconference data processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104954729A true CN104954729A (en) | 2015-09-30 |
| CN104954729B CN104954729B (en) | 2019-08-27 |
Family
ID=54169030
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410124762.2A Expired - Fee Related CN104954729B (en) | 2014-03-31 | 2014-03-31 | Videoconference data processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104954729B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107172093A (en) * | 2017-07-04 | 2017-09-15 | 合肥市乐腾科技咨询有限公司 | Video conference data processing method and system |
| CN108134918A (en) * | 2018-01-30 | 2018-06-08 | 苏州科达科技股份有限公司 | Method for processing video frequency, device and multipoint video processing unit, conference facility |
| CN108462854A (en) * | 2017-02-17 | 2018-08-28 | 陈延祚 | video image processing method and related system thereof |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1816134A (en) * | 2005-02-06 | 2006-08-09 | 中兴通讯股份有限公司 | Multi-spot video conference system and media processing method |
| CN101198008A (en) * | 2008-01-03 | 2008-06-11 | 中兴通讯股份有限公司 | Method and system for implementing multi-screen and multi-picture |
| CN101262587A (en) * | 2008-03-31 | 2008-09-10 | 杭州华三通信技术有限公司 | A method and multi-point control units for realizing multi-image video conference |
| CN101437140A (en) * | 2008-12-17 | 2009-05-20 | 杭州华三通信技术有限公司 | Multi-picture transmission method and multi-point control unit |
| CN101478642A (en) * | 2009-01-14 | 2009-07-08 | 镇江畅联通信科技有限公司 | Multi-picture mixing method and apparatus for video meeting system |
| CN101594512A (en) * | 2009-06-30 | 2009-12-02 | 中兴通讯股份有限公司 | Realize terminal, multipoint control unit, the system and method for high definition multiple images |
| CN101640784A (en) * | 2008-07-28 | 2010-02-03 | 上海领世通信技术发展有限公司 | Device and method for controlling multi-image compounding in video conference system |
| CN101959051A (en) * | 2010-09-01 | 2011-01-26 | 华为终端有限公司 | Method and device for choosing screen of remote presentation system |
| CN201789560U (en) * | 2009-09-28 | 2011-04-06 | 北京威方信科科技有限公司 | High-definition television wall server |
| CN102088621A (en) * | 2011-03-10 | 2011-06-08 | 唐杰 | Television wall server |
| CN102547213A (en) * | 2011-12-23 | 2012-07-04 | 南京超然科技有限公司 | Video imaging preview method for video conference system |
| CN102934425A (en) * | 2010-06-10 | 2013-02-13 | 微软公司 | Unified communication based multi-screen video system |
-
2014
- 2014-03-31 CN CN201410124762.2A patent/CN104954729B/en not_active Expired - Fee Related
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1816134A (en) * | 2005-02-06 | 2006-08-09 | 中兴通讯股份有限公司 | Multi-spot video conference system and media processing method |
| CN101198008A (en) * | 2008-01-03 | 2008-06-11 | 中兴通讯股份有限公司 | Method and system for implementing multi-screen and multi-picture |
| CN101262587A (en) * | 2008-03-31 | 2008-09-10 | 杭州华三通信技术有限公司 | A method and multi-point control units for realizing multi-image video conference |
| CN101640784A (en) * | 2008-07-28 | 2010-02-03 | 上海领世通信技术发展有限公司 | Device and method for controlling multi-image compounding in video conference system |
| CN101437140A (en) * | 2008-12-17 | 2009-05-20 | 杭州华三通信技术有限公司 | Multi-picture transmission method and multi-point control unit |
| CN101478642A (en) * | 2009-01-14 | 2009-07-08 | 镇江畅联通信科技有限公司 | Multi-picture mixing method and apparatus for video meeting system |
| CN101594512A (en) * | 2009-06-30 | 2009-12-02 | 中兴通讯股份有限公司 | Realize terminal, multipoint control unit, the system and method for high definition multiple images |
| CN201789560U (en) * | 2009-09-28 | 2011-04-06 | 北京威方信科科技有限公司 | High-definition television wall server |
| CN102934425A (en) * | 2010-06-10 | 2013-02-13 | 微软公司 | Unified communication based multi-screen video system |
| CN101959051A (en) * | 2010-09-01 | 2011-01-26 | 华为终端有限公司 | Method and device for choosing screen of remote presentation system |
| CN102088621A (en) * | 2011-03-10 | 2011-06-08 | 唐杰 | Television wall server |
| CN102547213A (en) * | 2011-12-23 | 2012-07-04 | 南京超然科技有限公司 | Video imaging preview method for video conference system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108462854A (en) * | 2017-02-17 | 2018-08-28 | 陈延祚 | video image processing method and related system thereof |
| CN107172093A (en) * | 2017-07-04 | 2017-09-15 | 合肥市乐腾科技咨询有限公司 | Video conference data processing method and system |
| CN108134918A (en) * | 2018-01-30 | 2018-06-08 | 苏州科达科技股份有限公司 | Method for processing video frequency, device and multipoint video processing unit, conference facility |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104954729B (en) | 2019-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9485466B2 (en) | Video processing in a multi-participant video conference | |
| US8179420B2 (en) | Minimal decoding method for spatially multiplexing digital video pictures | |
| US7710450B2 (en) | System and method for dynamic control of image capture in a video conference system | |
| CN102342066B (en) | Real-time multi-media streaming processing bandwidth management | |
| EP2214410B1 (en) | Method and system for conducting continuous presence conferences | |
| CN101262587B (en) | A method and multi-point control units for realizing multi-image video conference | |
| US11489891B2 (en) | Virtual video driver bridge system for multi-source collaboration within a web conferencing system | |
| CN104580991A (en) | System and method for real-time adaptation of a conferencing system to current conditions of a conference session | |
| US20150341596A1 (en) | Method and system for new layout experience in video communication | |
| KR20130092509A (en) | System and method for handling critical packets loss in multi-hop rtp streaming | |
| CN114600468B (en) | Combiner system, receiver device, computer-implemented method and computer-readable medium for combining video streams in a composite video stream with metadata | |
| CN102387338B (en) | Distributed type video processing method and video session system | |
| CN111147860B (en) | Video data decoding method and device | |
| US10666903B1 (en) | Combining encoded video streams | |
| KR101641184B1 (en) | Method for processing and mixing multiple feed videos for video conference, video conference terminal apparatus, video conference server and video conference system using the same | |
| CN107070671A (en) | The processing method of share desktop in conference system | |
| CN110913165A (en) | Video stream carousel method and device of video conference system based on cascade framework | |
| CN103957391A (en) | Method and system for displaying videos of all parties at same time during multi-party call in video intercom | |
| CN104954729A (en) | Video conference data processing method and system | |
| CN101350908A (en) | Video data transmission system and method for network video conference | |
| CN101141614B (en) | Session television terminal video parameter remote adjusting method | |
| CN108156413B (en) | Video conference transmission method and device and MCU | |
| CN112272281B (en) | Regional distributed video conference system | |
| Shirai et al. | Multi-point 4K/2K layered video streaming for remote collaboration | |
| CN107172093A (en) | Video conference data processing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190827 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |