CN1622620A - A multi-screen display method of multi-point videoconference on Internet - Google Patents

A multi-screen display method of multi-point videoconference on Internet Download PDF

Info

Publication number
CN1622620A
CN1622620A CN 200410103933 CN200410103933A CN1622620A CN 1622620 A CN1622620 A CN 1622620A CN 200410103933 CN200410103933 CN 200410103933 CN 200410103933 A CN200410103933 A CN 200410103933A CN 1622620 A CN1622620 A CN 1622620A
Authority
CN
China
Prior art keywords
user terminal
mcu
video
user
video data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200410103933
Other languages
Chinese (zh)
Other versions
CN100346647C (en
Inventor
张玉清
邹建峰
张利斌
陈舟锋
陶学知
沈伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beihang University
Beijing University of Aeronautics and Astronautics
Original Assignee
Beihang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihang University filed Critical Beihang University
Priority to CNB200410103933XA priority Critical patent/CN100346647C/en
Publication of CN1622620A publication Critical patent/CN1622620A/en
Application granted granted Critical
Publication of CN100346647C publication Critical patent/CN100346647C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The multiple screen display method for multipoint video meeting in Internet includes the following steps: 1) for one user terminal to log on MCU and to send local video data to MCU; 2) for MCU to send the log-on user's information of the meeting to the user terminals; 3) for the user terminal to update the user list; 4) for the user terminal to request one or several channels of video data; 5) for the MCU to compound the requested channels of video datan and to send to the requesting user terminal; 6) for the user terminal receiving the compound video data to separate and decode the compound video datan and to display these video images in corresponding areas.

Description

The method that a kind of multi-screen of multipoint videoconference on the internet shows
Invention field
The invention belongs to the computer network, multimedia communications field, specifically, relate to a kind of when carrying out multipoint videoconference on the internet, the transmission of many meeting-place video data and the method for demonstration.
Background of invention
Along with computer network and rapid development of multimedia, video conferencing system is applied in many aspects such as government department, commercial field, education sector, medical field and personal lifestyle gradually.After 911 incidents and the SARS epidemic situation, the video conference business demand sharply rises especially both at home and abroad, and video traffic has been penetrated into industry-by-industry.General forecast, global video conference in 5 years from now on will be grown up with the speed of average 35%-45% with relevant voice conferencing market, the data conferencing total market size.In the 2004 annual IT industry circle hot spot technologies of American I DG prediction, video conferencing technology ranks among the best.The famous WainHouse of communications field research institution prediction, 2004 will be the growth " flex point " of video conferencing system.And add up according to IDC: internal video meeting market was general 1,000,000,000 yuan in 2003, and along with the surge of the demand of enterprise group, with hurried rising, 2004 years and 2005 years Chinese video conference growth rates of market will remain on more than 32% in the following 1-2.Quantity according to present China large, medium-sized enterprises calculates that only the potential scale in enterprise's video conference market just has more than 100 hundred million yuan
When carrying out multipoint conference, H.323 system generally, can transmit video image in two ways: a kind of is to mix chart-pattern, be a screen just with the desired several roads of user terminal video mix, and send to conference terminal (typical case for be a screen with 4 tunnel video mix), another kind is chairman's pattern, the special a certain road video that sends by chairman's (or other specific mode for example has one road video of speech) appointment.All there are following two defectives in this dual mode:
1. interactivity is poor, can not see the video image in all meeting-place simultaneously
No matter be to mix chart-pattern or chairman's pattern, the video information that all can not see all participants is (under the mixed chart-pattern of typical case, can only see four tunnel videos that diminish at most), which participant does not even know has, and therefore can't exchange with certain or some participants according to the needs of self.User terminal can only be seen the video image (under the chairman) in a meeting-place or the video image that is formed by many meeting-place image blend (mixing under the figure mode) all the time passively, and the video information that the participant obtains is very limited, has had a strong impact on the effect of meeting.When the network bandwidth fluctuateed, the user can may not see Chu's video.This situation and incompatibility current network bandwidth increase and the big trend of the big amplitude variation of display screen fast.
2. consume a large amount of cpu resources, multi-point control cell capability promotes difficulty.
Multipoint control unit (MCU) all can be decoded it after whenever receiving one road video, is placed in the buffering area.Mixing under the chart-pattern, MCU need carry out layout again with decoded image, forms a vision-mix (being called for short " mixing figure "), and then encodes to mixing figure, just sends to each terminal at last.This step of MCU has expended a large amount of cpu resources, thereby makes the lifting of MCU capacity quite difficult.Under chairman's pattern, though reduced this step of mixed figure, Code And Decode is essential.Therefore the space of MCU capacity lifting is also very limited.
The objective of the invention is to propose a kind of multi-screen display method of multipoint videoconference, it is mutual to make on the one hand the user carry out audio frequency and video easily, effectively improves power system capacity on the other hand, thereby promotes the large-scale application of video conferencing system.
Summary of the invention
At top description, the present invention proposes the method that a kind of multi-screen of multipoint videoconference on the internet shows, and specifically may further comprise the steps: (1) user terminal is logined MCU and the local video data is sent to MCU; (2) the MCU user profile that will sign in in the same meeting room sends to each user terminal; (3) user terminal refreshinguser list; (4) user terminal is applied for a certain road or a few roads video data according to user's requirement to MCU; (5) if user terminal has been applied for a few roads video data to MCU, after MCU receives request so, the video data of being applied for is carried out compound, send to user terminal then; (6) after user terminal is received these video datas, the composite video data are separated and decoded, and, show these video images in corresponding zone according to user's requirement.
According to an aspect of the present invention, wherein step (5) further comprises: each video flowing of being applied for all carries out compound in the mode of son stream, but needs to keep the original flag information of each video flowing.
According to another aspect of the present invention, wherein step (3) further comprises: user terminal shows the user profile of receiving in the mode of tabulating.
According to another aspect of the present invention, wherein step (6) further comprises: user terminal at first reads its CSRC territory behind the video data that receives from MCU, and checks the mapping table of CSRC and decoder; For the CSRC that is present in the mapping table, then the payload of datagram is directly given corresponding decoder; For non-existent CSRC in the mapping table, PT territory in the further reading of data newspaper of user terminal, understand the coding standard that video flowing adopted, start the corresponding codes device then, and in the mapping table of CSRC and decoder, adding corresponding clauses and subclauses, the payload with video data offers decoder at last.
Brief description of drawings
Fig. 1 shows user terminal and MCU interaction flow sketch;
Fig. 2 shows the user terminal working interface;
Fig. 3 shows the process that different meeting-place video flowing mixes;
Fig. 4 shows the repeating process of single video stream;
Fig. 5 shows the flow process of user terminal processes video data.
Embodiment
When carrying out multipoint conference, each terminal of participating in same meeting needs all that to carry out ability mutual and accept the management of MCU with MCU.As shown in Figure 1, need between user terminal and the MCU to carry out alternately.Be to adapt to this method, it is mutual to have defined a locking terminal and MCU, and the control message that is used to transmit the interior user profile of same meeting room is as follows:
Q931pdu{ protocalDiscriminator 8[0x08] callReference valueLength 8 flag 1[0] and value 15 } messageType 8--type of message user-User x h225pdu { h323_uu_pdu x--****-UUIE h245Tunneling 1 } } Q931.MsgTypes{ NationEscapeMsg=0x00 AlertingMsg=0x01 CallProceedingMsg=0x02 SetupMsg=0x05 ... ... UserListMsg=0xe0--MCU sends user list RequestVideoMsg=0xe1--client to the MCU request data stream to client } UserList-UUIE ∷=SEQUENCE{ protocolIdentifier 16 (bits) sessionType 1--conversation type (multi-screen/mixed figure) frameStartFlag 1--frame origin identification frameEndFlag 1--frame termination sign frameSequence 13--number of frames sessionIdentifier 1024--session identification<!--SIPO<DP n=" 3 "〉--〉<dp n=" d3 "/userListData 1024--requesting party sign } RequestVideo-UUIE ∷=SEQUENCE{ protocolIdentifier 16 actionFlag 1--opening/closings sign sessionIdentifier 1023--session identification sourceIdentifier 1024--requesting party identifies targetIdentifier 1024--Requested Party sign }
With reference to figure 1, when user terminal signs in to MCU, can carry the flag information that shows feature: nlsdemeetingendpoint (step 1).MCU can distinguish with this whether user terminal has the ability that receives user list.For the H.323 user terminal of this ability of tool not, then MCU can not send to it with user profile.The user terminal of hereinafter mentioning all refers to the user terminal under this method.
Whenever there being new user to enter " meeting room ", MCU sends to user profile each user terminal (step 2).That transmit this information is control message q931pdu, and messageType territory wherein is set at 0xe0, and h323_uu_pdu adopts the form of UserList-UUIE.
As shown in Figure 2, after user terminal is received user profile from MCU, show (step 3) with the form of tabulation.The user just can understand the other staff's of conference participation situation intuitively like this.When the user wishes to see certain or some participants' video image, the video switch after the user name is opened, then user terminal sends application message to these user video data to MCU.What transmit the video application information is that the control message is still q931pdu, but messageType territory wherein is set at 0xe1, and h323_uu_pdu adopts the form of RequestVideo-UUIE.
After this, the user applies for a certain road or a few roads video data (step 4) according to needs separately to MCU.
When the video flowing of user terminal application is two when above, then MCU also needs video flowing is carried out compound, sends it to user terminal (step 5) then.Each video flowing of being applied for all carries out compound in the mode of son stream, but needs to keep the original flag information of each video flowing.
After this, after user terminal is received these video datas, the composite video data are separated and decoded, and, show these image (step 6) in corresponding zone according to user's appointment.Below with reference to Fig. 5 it is described in detail.After user terminal receives RTP video data stream from MCU, at first read its CSRC territory, and check the mapping table of CSRC and decoder.For the CSRC that is present in the mapping table, then the payload of datagram is directly given corresponding decoder.If for non-existent CSRC in the mapping table, the coding standard that video flowing adopted is understood in the PT territory in the further reading of data newspaper of user terminal, starts the corresponding codes device then, and add corresponding clauses and subclauses in the mapping table of CSRC and decoder.
In order to make the information that is kept former meeting-place by compound video flowing, this method is handled accordingly to SSRC, the CSRC territory of the RTP datagram of transmitting video-frequency flow.Carrying out compound with two video flowings below is the process of the concrete work of example explanation.As shown in Figure 3, suppose that the SSRC territory of MCU is set at 0xFFFFFFFF in a conversation procedure of multipoint conference, the SSRC territory of three user terminals is set at 0x11111111 respectively, 0x22222222 and 0x33333333.By the video data stream that MCU transmits, the SSRC territory of its RTP message all is set to 0xFFFFFFFF.If the video data of user terminal A application B and C, then MCU needs and will carry out compound from the video flowing of B and C.From the video flowing that B sends, the SSRC territory of its RTP datagram is set to 0x22222222.But when it was transmitted by MCU, the SSRC territory of new RTP datagram was set to 0xFFFFFFFF, and the CSRC territory is set at 0x22222222, shows that this Data Source is from user's terminal B.As a same reason, the SSRC territory of the RTP datagram of the video data of the user terminal C that MCU transmits is still 0xFFFFFFFF, and CSRC is 0x33333333.Because SSRC represented transmission source information, therefore it seems from user terminal A, undertaken compound from the video data of user terminal B and C by MCU.Video separator in the user terminal A offers corresponding decoder according to receiving that the CSRC territory of composite video data separates respectively with them.When 3 above video flowings of user terminal application, processing procedure is the same.
If only apply for the image in some meeting-place to MCU at step 4 user terminal, then MCU only transmits the video flowing of being applied for.As shown in Figure 4, when the user has only applied for a video flowing, MCU handles the data that are forwarded equally in the CSRC territory.Main difference is that user terminal is not created video separator, directly will offer decoder from the video data that obtains on the network.
This method can be handled the video flowing of the different compression standard of multichannel simultaneously at user terminal.As shown in Figure 2, there is the video image in 6 tunnel meeting-place to show.They can be based on different video compression standards.
The display mode of this method can be selected flexibly according to the quantity of application video flowing, has 2 * 2,2 * 3, multiple mode such as 5+1.The user can select the display position of video flowing arbitrarily.
What may be obvious that for the person of ordinary skill of the art draws other advantages and modification.Therefore, the present invention with wider aspect is not limited to shown and described specifying and exemplary embodiment here.Therefore, under situation about not breaking away from, can make various modifications to it by the spirit and scope of claim and the defined general inventive concept of equivalents thereof subsequently.

Claims (4)

1, a kind of method of the multi-screen of multipoint videoconference on the internet demonstration comprises:
(1) user terminal is logined MCU and the local video data is sent to MCU;
(2) the MCU user profile that will sign in in the same meeting room sends to each user terminal;
(3) user terminal refreshinguser list;
(4) user terminal is applied for a certain road or a few roads video data according to user's requirement to MCU;
(5) if user terminal has been applied for a few roads video data to MCU, after MCU receives request so, the video data of being applied for is carried out compound, send to user terminal then;
(6) after user terminal is received these video datas, the composite video data are separated and decoded, and, show these video images in corresponding zone according to user's requirement.
2, according to the process of claim 1 wherein that step (5) further comprises: each video flowing of being applied for all carries out compound in the mode of son stream, but needs to keep the original flag information of each video flowing.
3, according to the process of claim 1 wherein that step (3) further comprises: user terminal shows the user profile of receiving in the mode of tabulating.
4, according to the process of claim 1 wherein that step (6) further comprises: user terminal at first reads its CSRC territory behind the video data that receives from MCU, and checks the mapping table of CSRC and decoder; For the CSRC that is present in the mapping table, then the payload of datagram is directly given corresponding decoder; For non-existent CSRC in the mapping table, PT territory in the further reading of data newspaper of user terminal, understand the coding standard that video flowing adopted, start the corresponding codes device then, and in the mapping table of CSRC and decoder, adding corresponding clauses and subclauses, the payload with video data offers decoder at last.
CNB200410103933XA 2004-12-31 2004-12-31 A multi-screen display method of multi-point videoconference on Internet Expired - Fee Related CN100346647C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB200410103933XA CN100346647C (en) 2004-12-31 2004-12-31 A multi-screen display method of multi-point videoconference on Internet

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB200410103933XA CN100346647C (en) 2004-12-31 2004-12-31 A multi-screen display method of multi-point videoconference on Internet

Publications (2)

Publication Number Publication Date
CN1622620A true CN1622620A (en) 2005-06-01
CN100346647C CN100346647C (en) 2007-10-31

Family

ID=34766881

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB200410103933XA Expired - Fee Related CN100346647C (en) 2004-12-31 2004-12-31 A multi-screen display method of multi-point videoconference on Internet

Country Status (1)

Country Link
CN (1) CN100346647C (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007068194A1 (en) * 2005-12-16 2007-06-21 Huawei Technologies Co., Ltd. A method for realizing batch update in subscribing mechanism, subscriber and notifier terminal
CN100454821C (en) * 2006-09-07 2009-01-21 华为技术有限公司 Method for resource sharing among MCUs in videoconference system
CN1992622B (en) * 2005-12-29 2010-11-17 腾讯科技(深圳)有限公司 Method for implementing group subscriber ballot in instant communication system
CN102036053A (en) * 2009-10-05 2011-04-27 韩国电子通信研究院 System for providing multi-angle broadcasting service
CN101335869B (en) * 2008-03-26 2011-11-09 北京航空航天大学 Video conference system based on Soft-MCU
CN101202568B (en) * 2006-12-14 2012-01-25 北京三星通信技术研究有限公司 Terminal and method for supporting combination playing
WO2013113190A1 (en) * 2012-02-03 2013-08-08 海尔集团公司 Method and system for implementing multi-screen synchronous display
CN103517137A (en) * 2013-09-30 2014-01-15 广州华多网络科技有限公司 Network video transmission method and system, sending/receiving end processing method and device
US8830294B2 (en) 2009-05-27 2014-09-09 Huawei Device Co., Ltd. Method and system for video conference control, videoconferencing network equipment, and videoconferencing site
CN104156187A (en) * 2014-07-24 2014-11-19 惠州Tcl移动通信有限公司 Multi-screen display equipment
CN104414654A (en) * 2013-08-19 2015-03-18 上海联影医疗科技有限公司 Medical image display device and method, and medical workstation
CN105306872A (en) * 2015-10-21 2016-02-03 华为技术有限公司 Method, apparatus and system for controlling multipoint video conference
CN106528456A (en) * 2016-11-16 2017-03-22 湖南国科微电子股份有限公司 Method and system for improving system bus efficiency in video decoding display
CN110708684A (en) * 2018-07-09 2020-01-17 上海擎感智能科技有限公司 Vehicle rear cabin intelligent service interaction method, vehicle-mounted terminal and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6137485A (en) * 1995-03-20 2000-10-24 Canon Kabushiki Kaisha Image transmission method and apparatus, and image transmission system including the apparatus
US6037970A (en) * 1996-04-05 2000-03-14 Sony Corporation Videoconference system and method therefor
JP2000059750A (en) * 1998-08-12 2000-02-25 Nec Corp Video conference system
JP2002305733A (en) * 2001-04-06 2002-10-18 Matsushita Electric Ind Co Ltd Multicast conference device, and multicast conference program
CN1195381C (en) * 2002-12-27 2005-03-30 北京鼎视通软件技术有限公司 Multiple-picture output method and system

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1984127B (en) * 2005-12-16 2010-05-12 华为技术有限公司 Method for realizing batch refresh in subscribing mechanism
WO2007068194A1 (en) * 2005-12-16 2007-06-21 Huawei Technologies Co., Ltd. A method for realizing batch update in subscribing mechanism, subscriber and notifier terminal
CN1992622B (en) * 2005-12-29 2010-11-17 腾讯科技(深圳)有限公司 Method for implementing group subscriber ballot in instant communication system
CN100454821C (en) * 2006-09-07 2009-01-21 华为技术有限公司 Method for resource sharing among MCUs in videoconference system
CN101202568B (en) * 2006-12-14 2012-01-25 北京三星通信技术研究有限公司 Terminal and method for supporting combination playing
CN101335869B (en) * 2008-03-26 2011-11-09 北京航空航天大学 Video conference system based on Soft-MCU
US8830294B2 (en) 2009-05-27 2014-09-09 Huawei Device Co., Ltd. Method and system for video conference control, videoconferencing network equipment, and videoconferencing site
CN102036053A (en) * 2009-10-05 2011-04-27 韩国电子通信研究院 System for providing multi-angle broadcasting service
WO2013113190A1 (en) * 2012-02-03 2013-08-08 海尔集团公司 Method and system for implementing multi-screen synchronous display
CN104414654A (en) * 2013-08-19 2015-03-18 上海联影医疗科技有限公司 Medical image display device and method, and medical workstation
CN103517137A (en) * 2013-09-30 2014-01-15 广州华多网络科技有限公司 Network video transmission method and system, sending/receiving end processing method and device
CN103517137B (en) * 2013-09-30 2017-08-01 广州华多网络科技有限公司 Network video transmission method and system, transmission/receiving terminal treating method and apparatus
CN104156187A (en) * 2014-07-24 2014-11-19 惠州Tcl移动通信有限公司 Multi-screen display equipment
CN104156187B (en) * 2014-07-24 2018-11-23 惠州Tcl移动通信有限公司 A kind of multi-screen display equipment
CN105306872A (en) * 2015-10-21 2016-02-03 华为技术有限公司 Method, apparatus and system for controlling multipoint video conference
CN105306872B (en) * 2015-10-21 2019-03-01 华为技术有限公司 Control the methods, devices and systems of multipoint videoconference
CN106528456A (en) * 2016-11-16 2017-03-22 湖南国科微电子股份有限公司 Method and system for improving system bus efficiency in video decoding display
CN106528456B (en) * 2016-11-16 2020-02-21 湖南国科微电子股份有限公司 Method and system for improving system bus efficiency in video decoding display
CN110708684A (en) * 2018-07-09 2020-01-17 上海擎感智能科技有限公司 Vehicle rear cabin intelligent service interaction method, vehicle-mounted terminal and storage medium

Also Published As

Publication number Publication date
CN100346647C (en) 2007-10-31

Similar Documents

Publication Publication Date Title
CN100346647C (en) A multi-screen display method of multi-point videoconference on Internet
US9537667B2 (en) Duplicating digital streams for digital conferencing using switching technologies
KR100880150B1 (en) Multi-point video conference system and media processing method thereof
US10455196B2 (en) Method and system for conducting video conferences of diverse participating devices
US8228363B2 (en) Method and system for conducting continuous presence conferences
CN101286865B (en) Electronic white board realizing method, device and system in audio and video meeting
CN101031065A (en) Method, apparatus and system for switching pictures in video service
CN1571508A (en) A method for implementing multi-frame
CN102883135A (en) Screen sharing and control method thereof
WO2009140913A1 (en) Controlling method and device of multi-point meeting
CN1516436A (en) Voice frequency/video frequency share method and system in instantaneous communication
CN1871825A (en) Managing a packet switched conference call
CN101262587A (en) A method and multi-point control units for realizing multi-image video conference
WO2013053336A1 (en) Sound mixing method, device and system
CN1885785A (en) MCU cascade system and establishing and communication method for the same
CN1450763A (en) Method and device for realizing interactive real time video text communication business
CN101557496A (en) Built-in video conference cooperative operation system
CN101404748A (en) Video data transmission system and method used for large-scale high-definition network video conference
US20020143994A1 (en) Transmitting new data format under existing infrastructure
CN1968119A (en) Method for resource sharing among MCUs in videoconference system
CN101350908A (en) Video data transmission system and method for network video conference
CN1253000C (en) Method and system for realizing meeting appointment business
Sarwar Real time multiple codecs switching architecture for video conferencing
WO2001098929A2 (en) Electronic chat and instant messaging with ink data
CN1777189A (en) Method for realizing multimedia information synthesis between different mobile phones

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20071031

Termination date: 20161231