CN1622620A - A multi-screen display method of multi-point videoconference on Internet - Google Patents
A multi-screen display method of multi-point videoconference on Internet Download PDFInfo
- Publication number
- CN1622620A CN1622620A CN 200410103933 CN200410103933A CN1622620A CN 1622620 A CN1622620 A CN 1622620A CN 200410103933 CN200410103933 CN 200410103933 CN 200410103933 A CN200410103933 A CN 200410103933A CN 1622620 A CN1622620 A CN 1622620A
- Authority
- CN
- China
- Prior art keywords
- user terminal
- mcu
- video
- user
- video data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The multiple screen display method for multipoint video meeting in Internet includes the following steps: 1) for one user terminal to log on MCU and to send local video data to MCU; 2) for MCU to send the log-on user's information of the meeting to the user terminals; 3) for the user terminal to update the user list; 4) for the user terminal to request one or several channels of video data; 5) for the MCU to compound the requested channels of video datan and to send to the requesting user terminal; 6) for the user terminal receiving the compound video data to separate and decode the compound video datan and to display these video images in corresponding areas.
Description
Invention field
The invention belongs to the computer network, multimedia communications field, specifically, relate to a kind of when carrying out multipoint videoconference on the internet, the transmission of many meeting-place video data and the method for demonstration.
Background of invention
Along with computer network and rapid development of multimedia, video conferencing system is applied in many aspects such as government department, commercial field, education sector, medical field and personal lifestyle gradually.After 911 incidents and the SARS epidemic situation, the video conference business demand sharply rises especially both at home and abroad, and video traffic has been penetrated into industry-by-industry.General forecast, global video conference in 5 years from now on will be grown up with the speed of average 35%-45% with relevant voice conferencing market, the data conferencing total market size.In the 2004 annual IT industry circle hot spot technologies of American I DG prediction, video conferencing technology ranks among the best.The famous WainHouse of communications field research institution prediction, 2004 will be the growth " flex point " of video conferencing system.And add up according to IDC: internal video meeting market was general 1,000,000,000 yuan in 2003, and along with the surge of the demand of enterprise group, with hurried rising, 2004 years and 2005 years Chinese video conference growth rates of market will remain on more than 32% in the following 1-2.Quantity according to present China large, medium-sized enterprises calculates that only the potential scale in enterprise's video conference market just has more than 100 hundred million yuan
When carrying out multipoint conference, H.323 system generally, can transmit video image in two ways: a kind of is to mix chart-pattern, be a screen just with the desired several roads of user terminal video mix, and send to conference terminal (typical case for be a screen with 4 tunnel video mix), another kind is chairman's pattern, the special a certain road video that sends by chairman's (or other specific mode for example has one road video of speech) appointment.All there are following two defectives in this dual mode:
1. interactivity is poor, can not see the video image in all meeting-place simultaneously
No matter be to mix chart-pattern or chairman's pattern, the video information that all can not see all participants is (under the mixed chart-pattern of typical case, can only see four tunnel videos that diminish at most), which participant does not even know has, and therefore can't exchange with certain or some participants according to the needs of self.User terminal can only be seen the video image (under the chairman) in a meeting-place or the video image that is formed by many meeting-place image blend (mixing under the figure mode) all the time passively, and the video information that the participant obtains is very limited, has had a strong impact on the effect of meeting.When the network bandwidth fluctuateed, the user can may not see Chu's video.This situation and incompatibility current network bandwidth increase and the big trend of the big amplitude variation of display screen fast.
2. consume a large amount of cpu resources, multi-point control cell capability promotes difficulty.
Multipoint control unit (MCU) all can be decoded it after whenever receiving one road video, is placed in the buffering area.Mixing under the chart-pattern, MCU need carry out layout again with decoded image, forms a vision-mix (being called for short " mixing figure "), and then encodes to mixing figure, just sends to each terminal at last.This step of MCU has expended a large amount of cpu resources, thereby makes the lifting of MCU capacity quite difficult.Under chairman's pattern, though reduced this step of mixed figure, Code And Decode is essential.Therefore the space of MCU capacity lifting is also very limited.
The objective of the invention is to propose a kind of multi-screen display method of multipoint videoconference, it is mutual to make on the one hand the user carry out audio frequency and video easily, effectively improves power system capacity on the other hand, thereby promotes the large-scale application of video conferencing system.
Summary of the invention
At top description, the present invention proposes the method that a kind of multi-screen of multipoint videoconference on the internet shows, and specifically may further comprise the steps: (1) user terminal is logined MCU and the local video data is sent to MCU; (2) the MCU user profile that will sign in in the same meeting room sends to each user terminal; (3) user terminal refreshinguser list; (4) user terminal is applied for a certain road or a few roads video data according to user's requirement to MCU; (5) if user terminal has been applied for a few roads video data to MCU, after MCU receives request so, the video data of being applied for is carried out compound, send to user terminal then; (6) after user terminal is received these video datas, the composite video data are separated and decoded, and, show these video images in corresponding zone according to user's requirement.
According to an aspect of the present invention, wherein step (5) further comprises: each video flowing of being applied for all carries out compound in the mode of son stream, but needs to keep the original flag information of each video flowing.
According to another aspect of the present invention, wherein step (3) further comprises: user terminal shows the user profile of receiving in the mode of tabulating.
According to another aspect of the present invention, wherein step (6) further comprises: user terminal at first reads its CSRC territory behind the video data that receives from MCU, and checks the mapping table of CSRC and decoder; For the CSRC that is present in the mapping table, then the payload of datagram is directly given corresponding decoder; For non-existent CSRC in the mapping table, PT territory in the further reading of data newspaper of user terminal, understand the coding standard that video flowing adopted, start the corresponding codes device then, and in the mapping table of CSRC and decoder, adding corresponding clauses and subclauses, the payload with video data offers decoder at last.
Brief description of drawings
Fig. 1 shows user terminal and MCU interaction flow sketch;
Fig. 2 shows the user terminal working interface;
Fig. 3 shows the process that different meeting-place video flowing mixes;
Fig. 4 shows the repeating process of single video stream;
Fig. 5 shows the flow process of user terminal processes video data.
Embodiment
When carrying out multipoint conference, each terminal of participating in same meeting needs all that to carry out ability mutual and accept the management of MCU with MCU.As shown in Figure 1, need between user terminal and the MCU to carry out alternately.Be to adapt to this method, it is mutual to have defined a locking terminal and MCU, and the control message that is used to transmit the interior user profile of same meeting room is as follows:
Q931pdu{ protocalDiscriminator 8[0x08] callReference valueLength 8 flag 1[0] and value 15 } messageType 8--type of message user-User x h225pdu { h323_uu_pdu x--****-UUIE h245Tunneling 1 } } Q931.MsgTypes{ NationEscapeMsg=0x00 AlertingMsg=0x01 CallProceedingMsg=0x02 SetupMsg=0x05 ... ... UserListMsg=0xe0--MCU sends user list RequestVideoMsg=0xe1--client to the MCU request data stream to client } UserList-UUIE ∷=SEQUENCE{ protocolIdentifier 16 (bits) sessionType 1--conversation type (multi-screen/mixed figure) frameStartFlag 1--frame origin identification frameEndFlag 1--frame termination sign frameSequence 13--number of frames sessionIdentifier 1024--session identification＜!--SIPO＜DP n=" 3 "〉--〉＜dp n=" d3 "/userListData 1024--requesting party sign } RequestVideo-UUIE ∷=SEQUENCE{ protocolIdentifier 16 actionFlag 1--opening/closings sign sessionIdentifier 1023--session identification sourceIdentifier 1024--requesting party identifies targetIdentifier 1024--Requested Party sign }
With reference to figure 1, when user terminal signs in to MCU, can carry the flag information that shows feature: nlsdemeetingendpoint (step 1).MCU can distinguish with this whether user terminal has the ability that receives user list.For the H.323 user terminal of this ability of tool not, then MCU can not send to it with user profile.The user terminal of hereinafter mentioning all refers to the user terminal under this method.
Whenever there being new user to enter " meeting room ", MCU sends to user profile each user terminal (step 2).That transmit this information is control message q931pdu, and messageType territory wherein is set at 0xe0, and h323_uu_pdu adopts the form of UserList-UUIE.
As shown in Figure 2, after user terminal is received user profile from MCU, show (step 3) with the form of tabulation.The user just can understand the other staff's of conference participation situation intuitively like this.When the user wishes to see certain or some participants' video image, the video switch after the user name is opened, then user terminal sends application message to these user video data to MCU.What transmit the video application information is that the control message is still q931pdu, but messageType territory wherein is set at 0xe1, and h323_uu_pdu adopts the form of RequestVideo-UUIE.
After this, the user applies for a certain road or a few roads video data (step 4) according to needs separately to MCU.
When the video flowing of user terminal application is two when above, then MCU also needs video flowing is carried out compound, sends it to user terminal (step 5) then.Each video flowing of being applied for all carries out compound in the mode of son stream, but needs to keep the original flag information of each video flowing.
After this, after user terminal is received these video datas, the composite video data are separated and decoded, and, show these image (step 6) in corresponding zone according to user's appointment.Below with reference to Fig. 5 it is described in detail.After user terminal receives RTP video data stream from MCU, at first read its CSRC territory, and check the mapping table of CSRC and decoder.For the CSRC that is present in the mapping table, then the payload of datagram is directly given corresponding decoder.If for non-existent CSRC in the mapping table, the coding standard that video flowing adopted is understood in the PT territory in the further reading of data newspaper of user terminal, starts the corresponding codes device then, and add corresponding clauses and subclauses in the mapping table of CSRC and decoder.
In order to make the information that is kept former meeting-place by compound video flowing, this method is handled accordingly to SSRC, the CSRC territory of the RTP datagram of transmitting video-frequency flow.Carrying out compound with two video flowings below is the process of the concrete work of example explanation.As shown in Figure 3, suppose that the SSRC territory of MCU is set at 0xFFFFFFFF in a conversation procedure of multipoint conference, the SSRC territory of three user terminals is set at 0x11111111 respectively, 0x22222222 and 0x33333333.By the video data stream that MCU transmits, the SSRC territory of its RTP message all is set to 0xFFFFFFFF.If the video data of user terminal A application B and C, then MCU needs and will carry out compound from the video flowing of B and C.From the video flowing that B sends, the SSRC territory of its RTP datagram is set to 0x22222222.But when it was transmitted by MCU, the SSRC territory of new RTP datagram was set to 0xFFFFFFFF, and the CSRC territory is set at 0x22222222, shows that this Data Source is from user's terminal B.As a same reason, the SSRC territory of the RTP datagram of the video data of the user terminal C that MCU transmits is still 0xFFFFFFFF, and CSRC is 0x33333333.Because SSRC represented transmission source information, therefore it seems from user terminal A, undertaken compound from the video data of user terminal B and C by MCU.Video separator in the user terminal A offers corresponding decoder according to receiving that the CSRC territory of composite video data separates respectively with them.When 3 above video flowings of user terminal application, processing procedure is the same.
If only apply for the image in some meeting-place to MCU at step 4 user terminal, then MCU only transmits the video flowing of being applied for.As shown in Figure 4, when the user has only applied for a video flowing, MCU handles the data that are forwarded equally in the CSRC territory.Main difference is that user terminal is not created video separator, directly will offer decoder from the video data that obtains on the network.
This method can be handled the video flowing of the different compression standard of multichannel simultaneously at user terminal.As shown in Figure 2, there is the video image in 6 tunnel meeting-place to show.They can be based on different video compression standards.
The display mode of this method can be selected flexibly according to the quantity of application video flowing, has 2 * 2,2 * 3, multiple mode such as 5+1.The user can select the display position of video flowing arbitrarily.
What may be obvious that for the person of ordinary skill of the art draws other advantages and modification.Therefore, the present invention with wider aspect is not limited to shown and described specifying and exemplary embodiment here.Therefore, under situation about not breaking away from, can make various modifications to it by the spirit and scope of claim and the defined general inventive concept of equivalents thereof subsequently.
Claims (4)
1, a kind of method of the multi-screen of multipoint videoconference on the internet demonstration comprises:
(1) user terminal is logined MCU and the local video data is sent to MCU;
(2) the MCU user profile that will sign in in the same meeting room sends to each user terminal;
(3) user terminal refreshinguser list;
(4) user terminal is applied for a certain road or a few roads video data according to user's requirement to MCU;
(5) if user terminal has been applied for a few roads video data to MCU, after MCU receives request so, the video data of being applied for is carried out compound, send to user terminal then;
(6) after user terminal is received these video datas, the composite video data are separated and decoded, and, show these video images in corresponding zone according to user's requirement.
2, according to the process of claim 1 wherein that step (5) further comprises: each video flowing of being applied for all carries out compound in the mode of son stream, but needs to keep the original flag information of each video flowing.
3, according to the process of claim 1 wherein that step (3) further comprises: user terminal shows the user profile of receiving in the mode of tabulating.
4, according to the process of claim 1 wherein that step (6) further comprises: user terminal at first reads its CSRC territory behind the video data that receives from MCU, and checks the mapping table of CSRC and decoder; For the CSRC that is present in the mapping table, then the payload of datagram is directly given corresponding decoder; For non-existent CSRC in the mapping table, PT territory in the further reading of data newspaper of user terminal, understand the coding standard that video flowing adopted, start the corresponding codes device then, and in the mapping table of CSRC and decoder, adding corresponding clauses and subclauses, the payload with video data offers decoder at last.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB200410103933XA CN100346647C (en) | 2004-12-31 | 2004-12-31 | A multi-screen display method of multi-point videoconference on Internet |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB200410103933XA CN100346647C (en) | 2004-12-31 | 2004-12-31 | A multi-screen display method of multi-point videoconference on Internet |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1622620A true CN1622620A (en) | 2005-06-01 |
| CN100346647C CN100346647C (en) | 2007-10-31 |
Family
ID=34766881
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB200410103933XA Expired - Fee Related CN100346647C (en) | 2004-12-31 | 2004-12-31 | A multi-screen display method of multi-point videoconference on Internet |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100346647C (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007068194A1 (en) * | 2005-12-16 | 2007-06-21 | Huawei Technologies Co., Ltd. | A method for realizing batch update in subscribing mechanism, subscriber and notifier terminal |
| CN100454821C (en) * | 2006-09-07 | 2009-01-21 | 华为技术有限公司 | Method for resource sharing among MCUs in videoconference system |
| CN1992622B (en) * | 2005-12-29 | 2010-11-17 | 腾讯科技（深圳）有限公司 | Method for implementing group subscriber ballot in instant communication system |
| CN102036053A (en) * | 2009-10-05 | 2011-04-27 | 韩国电子通信研究院 | System for providing multi-angle broadcasting service |
| CN101335869B (en) * | 2008-03-26 | 2011-11-09 | 北京航空航天大学 | Video conference system based on Soft-MCU |
| CN101202568B (en) * | 2006-12-14 | 2012-01-25 | 北京三星通信技术研究有限公司 | Terminal and method for supporting combination playing |
| WO2013113190A1 (en) * | 2012-02-03 | 2013-08-08 | 海尔集团公司 | Method and system for implementing multi-screen synchronous display |
| CN103517137A (en) * | 2013-09-30 | 2014-01-15 | 广州华多网络科技有限公司 | Network video transmission method and system, sending/receiving end processing method and device |
| US8830294B2 (en) | 2009-05-27 | 2014-09-09 | Huawei Device Co., Ltd. | Method and system for video conference control, videoconferencing network equipment, and videoconferencing site |
| CN104156187A (en) * | 2014-07-24 | 2014-11-19 | 惠州Tcl移动通信有限公司 | Multi-screen display equipment |
| CN104414654A (en) * | 2013-08-19 | 2015-03-18 | 上海联影医疗科技有限公司 | Medical image display device and method, and medical workstation |
| CN105306872A (en) * | 2015-10-21 | 2016-02-03 | 华为技术有限公司 | Method, apparatus and system for controlling multipoint video conference |
| CN106528456A (en) * | 2016-11-16 | 2017-03-22 | 湖南国科微电子股份有限公司 | Method and system for improving system bus efficiency in video decoding display |
| CN110708684A (en) * | 2018-07-09 | 2020-01-17 | 上海擎感智能科技有限公司 | Vehicle rear cabin intelligent service interaction method, vehicle-mounted terminal and storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6137485A (en) * | 1995-03-20 | 2000-10-24 | Canon Kabushiki Kaisha | Image transmission method and apparatus, and image transmission system including the apparatus |
| US6037970A (en) * | 1996-04-05 | 2000-03-14 | Sony Corporation | Videoconference system and method therefor |
| JP2000059750A (en) * | 1998-08-12 | 2000-02-25 | Nec Corp | Video conference system |
| JP2002305733A (en) * | 2001-04-06 | 2002-10-18 | Matsushita Electric Ind Co Ltd | Multicast conference device, and multicast conference program |
| CN1195381C (en) * | 2002-12-27 | 2005-03-30 | 北京鼎视通软件技术有限公司 | Multiple-picture output method and system |
-
2004
- 2004-12-31 CN CNB200410103933XA patent/CN100346647C/en not_active Expired - Fee Related
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1984127B (en) * | 2005-12-16 | 2010-05-12 | 华为技术有限公司 | Method for realizing batch refresh in subscribing mechanism |
| WO2007068194A1 (en) * | 2005-12-16 | 2007-06-21 | Huawei Technologies Co., Ltd. | A method for realizing batch update in subscribing mechanism, subscriber and notifier terminal |
| CN1992622B (en) * | 2005-12-29 | 2010-11-17 | 腾讯科技（深圳）有限公司 | Method for implementing group subscriber ballot in instant communication system |
| CN100454821C (en) * | 2006-09-07 | 2009-01-21 | 华为技术有限公司 | Method for resource sharing among MCUs in videoconference system |
| CN101202568B (en) * | 2006-12-14 | 2012-01-25 | 北京三星通信技术研究有限公司 | Terminal and method for supporting combination playing |
| CN101335869B (en) * | 2008-03-26 | 2011-11-09 | 北京航空航天大学 | Video conference system based on Soft-MCU |
| US8830294B2 (en) | 2009-05-27 | 2014-09-09 | Huawei Device Co., Ltd. | Method and system for video conference control, videoconferencing network equipment, and videoconferencing site |
| CN102036053A (en) * | 2009-10-05 | 2011-04-27 | 韩国电子通信研究院 | System for providing multi-angle broadcasting service |
| WO2013113190A1 (en) * | 2012-02-03 | 2013-08-08 | 海尔集团公司 | Method and system for implementing multi-screen synchronous display |
| CN104414654A (en) * | 2013-08-19 | 2015-03-18 | 上海联影医疗科技有限公司 | Medical image display device and method, and medical workstation |
| CN103517137A (en) * | 2013-09-30 | 2014-01-15 | 广州华多网络科技有限公司 | Network video transmission method and system, sending/receiving end processing method and device |
| CN103517137B (en) * | 2013-09-30 | 2017-08-01 | 广州华多网络科技有限公司 | Network video transmission method and system, transmission/receiving terminal treating method and apparatus |
| CN104156187A (en) * | 2014-07-24 | 2014-11-19 | 惠州Tcl移动通信有限公司 | Multi-screen display equipment |
| CN104156187B (en) * | 2014-07-24 | 2018-11-23 | 惠州Tcl移动通信有限公司 | A kind of multi-screen display equipment |
| CN105306872A (en) * | 2015-10-21 | 2016-02-03 | 华为技术有限公司 | Method, apparatus and system for controlling multipoint video conference |
| CN105306872B (en) * | 2015-10-21 | 2019-03-01 | 华为技术有限公司 | Control the methods, devices and systems of multipoint videoconference |
| CN106528456A (en) * | 2016-11-16 | 2017-03-22 | 湖南国科微电子股份有限公司 | Method and system for improving system bus efficiency in video decoding display |
| CN106528456B (en) * | 2016-11-16 | 2020-02-21 | 湖南国科微电子股份有限公司 | Method and system for improving system bus efficiency in video decoding display |
| CN110708684A (en) * | 2018-07-09 | 2020-01-17 | 上海擎感智能科技有限公司 | Vehicle rear cabin intelligent service interaction method, vehicle-mounted terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100346647C (en) | 2007-10-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100346647C (en) | A multi-screen display method of multi-point videoconference on Internet | |
| KR100880150B1 (en) | Multi-point video conference system and media processing method thereof | |
| US11006075B2 (en) | Method and system for conducting video conferences of diverse participating devices | |
| US7921157B2 (en) | Duplicating digital streams for digital conferencing using switching technologies | |
| CN101031065A (en) | Method, apparatus and system for switching pictures in video service | |
| CN101286865B (en) | Electronic white board realizing method, device and system in audio and video meeting | |
| CN101262587B (en) | A method and multi-point control units for realizing multi-image video conference | |
| CN101557496B (en) | Built-in video conference cooperative operation system | |
| US20100194847A1 (en) | Method and System for Conducting Continuous Presence Conferences | |
| CN1571508A (en) | A method for implementing multi-frame | |
| CN102883135A (en) | Screen sharing and control method thereof | |
| CN101404748B (en) | Video data transmission system and method used for large-scale high-definition network video conference | |
| CN1885785A (en) | MCU cascade system and establishing and communication method for the same | |
| WO2013053336A1 (en) | Sound mixing method, device and system | |
| CN1516436A (en) | Voice frequency/video frequency share method and system in instantaneous communication | |
| US20020143994A1 (en) | Transmitting new data format under existing infrastructure | |
| CN1968119A (en) | Method for resource sharing among MCUs in videoconference system | |
| CN101350908A (en) | Video data transmission system and method for network video conference | |
| CN1450763A (en) | Method and device for realizing interactive real time video text communication business | |
| CN1933480A (en) | Method for multimedia data switching gateway | |
| CN1777189A (en) | Method for realizing multimedia information synthesis between different mobile phones | |
| WO2001098929A2 (en) | Electronic chat and instant messaging with ink data | |
| Sarwar | Real time multiple codecs switching architecture for video conferencing | |
| Zhang et al. | Research on user applying mode for video conference system | |
| Perkins et al. | Next Generation Internet (NGI) Multicast Applications and Architecture (NMAA) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20071031 Termination date: 20161231 |