Summary of the invention
The object of the present invention is to provide a kind of multipart video-meeting method that is used to support portable equipment and wireless network.
The technical scheme that the present invention solves its technical problem employing is as follows:
1) support pc user and portable equipment user simultaneously: in native system, the different participant of four classes is arranged: the first kind is a central server, is responsible for the establishment of each meeting and the record of conferencing information; Other three class participants are present in the concrete meeting, are respectively the hosts of meeting, common pc user member and common portable equipment member; The host of meeting is served as by the pc user who creates meeting, is the manager of its place meeting, is responsible for service quality (QoS) management of place meeting; Except supporting the pc user, this conference system is also supported the portable equipment user;
2) by Real-time Transport Protocol unicast mode transmission data;
3) reliable meeting control protocol: used traditional centralized control mechanism and decentralized control mechanism simultaneously, realized a reliable meeting control protocol; In system, design a feedback mechanism, strengthened the reliability that control information is transmitted; Simultaneously in control protocol, designed retransmission mechanism and for abnormity processing;
4) adopt different transmission mechanisms for dissimilar users, different medium: for portable equipment, native system only guarantees the full connection of audio session; For audio session, all members can be connected with other a plurality of members simultaneously, and can carry out encoding and decoding to voice data and handle; And for video session, portable equipment is only done the decoding of video, does not participate in coding; And the pc user supports the encoding and decoding of video simultaneously;
5) video session is selected: the portable equipment user is because the restriction of resource can only be carried out video session with other member at synchronization; But designed a kind of user's choice mechanism in system, the user can switch to another video flowing from a video flowing.
The present invention compares with background technology, and the useful effect that has is:
1) supports the employed wireless network of communicating by letter between portable equipment and portable equipment.Central server is designed to fixed address, has avoided the ill effect that dynamic IP is brought under the wireless environment.Simultaneously, adopt centralized control mechanism and disperse transmission mechanism, can not only be fully and effectively utilize the bandwidth of wireless network, also can strengthen the flexibility of whole system.On this basis, designed the simple and effective control protocol of a cover, the system that makes can stablize, effectively, operation safely.Although in system, the portable equipment user can only carry out video conference with another PC user at synchronization,, the user still can independently select and which user interactions by mode conveniently.
2) not only support wireless network, also support the hybrid network of forming by Internet and wireless network.Traditional video conferencing system is only supported local area network (LAN) and Internet net, and system is designed to support the hybrid network be made up of Internet and wireless network.Like this, the founder of central server and meeting all can be connected in the online PC of Internet by one and serve as, and has avoided the restriction of portable equipment bandwidth and disposal ability; Each participant then pays close attention to the transmission of payload data more.
Embodiment
One, the system that the present invention introduced mainly is made up of the two large divisions.First is the central server of a fixed address, is used for the establishment and the registration of each meeting.Second portion is a series of independent and also independently meetings each other with central server itself.At first meeting of registration on central server of the founder of meeting, after conference creation, the founder will manage and control this meeting as the host of this meeting of new establishment.Yet a meeting is in case after successfully creating, the transfer of data on it is just no longer relevant with central server with meeting control.Only when a new user wants to add certain meeting, just can use central server again.This is because have only the address of central server to be only addressing, and the user need pass through central server and obtain the host address of wanting the meeting that adds and member's tabulation of that meeting.
The architecture of native system mainly comprises four parts: group administration module, media management module, Subscriber Interface Module SIM and RTP transport module.Group administration module and media transmission module are the nucleus modules of present architecture.Wherein, the media management module mainly is responsible for the encoding and decoding of media data, and the group administration module not only will be responsible for control message processing, also will be responsible for the Data Transmission Controlling in the RTP transport module, for example create a data transmission channel, stop a data transmission channel etc.In system, each member of meeting is based on that this architecture makes up and operation.Certainly, because in system, different participants might play the part of different roles, for example, central server, host or general conference member, therefore same module is for different participants, and the effect of residing status and performance still has some fine distinctions.
In native system, mainly contain the different participant of four classes.The first kind is a central server, and it mainly is responsible for the information of the establishment and the record meeting of each meeting.Central server is a fixed address, and in a system, generally has only a central server.Other three class participants are present in the concrete meeting, and they are respectively the hosts of meeting, common pc user member and common portable equipment member.The host of meeting is the manager of its place meeting, is responsible for the QoS management of that meeting.Because the restriction of portable devices handle ability, the bandwidth of being occupied etc., the host of meeting is generally also served as by the pc user.
System topological figure of the present invention as shown in Figure 1.Wherein C-S represents central server, and P represents the host of meeting, and M and C represent common portable equipment member and common pc user member respectively.Each star-plot by host, portable equipment member and pc user's member composition is represented the meeting that each is concrete respectively.
Two, all media datas all transmit by Real-time Transport Protocol.The RTP host-host protocol is supported two kinds of patterns, i.e. clean culture and multicast.Unicast mode is simple, be easy to control, and multicast then can effectively reduce the use of bandwidth.But owing to lack at present support to multicast on Internet net and wireless network, therefore, native system has been selected the clean culture RTP transmission mode that is easy to control.Can regard the RTP pattern of clean culture as used the Real-time Transport Protocol characteristic point-to-point transmission pattern.In the process that realizes, introduce a destination address chained list, the BYE bag in the RTCP bag, each RTP bag or RTCP bag send portion all can for the member in the destination address chained list.Therefore, create a transmission channel that is connected to certain member if desired, only that member's address need be added the destination address chained list and get final product.Also only need be and close a transmission channel to the BYE bag of a clean culture of purpose machine transmission.
Three, on controlling mechanism, native system has used traditional centralized control mechanism and decentralized control mechanism simultaneously, has realized one simply but reliable meeting control protocol.In order to reduce the time of response, the transmission of bottom udp protocol is all passed through in all control informations.But in order to strengthen the reliability that control information is transmitted, in system, designed a simple feedback mechanism, promptly required each control messages that a feedback message is all arranged.If in the back regular hour is sent in request, do not receive feedback message, then must retransmit control messages.If still do not receive the feedback message that should return behind the several times having retransmitted, think that then the other side has left meeting, and carry out some corresponding abnormality processing.
According to above-mentioned feature, in the control protocol of native system, mainly designed six kinds of control messages, as follows respectively:
1) create: the host of meeting has wherein comprised the password of this meeting that sets in advance to the message of a meeting of establishment of central server transmission.
2) close: to the message of closing active conference that central server sends, wherein comprised meeting title and password by the host of meeting.But when the meeting presider leaves unusually, then send this message by certain rank and file in the meeting.
3) add: the title and the password that in this message, have comprised meeting.It wants the rank and file who adds certain meeting to send to central server by one, and central server returns that meeting presider's IP address after having verified meeting title and password.After obtaining host IP address, this member sends " adding " message once more and gives the meeting presider.The host of meeting returns member current in the meeting and tabulates to this member after receiving this message.
4) leave: when the rank and file in the meeting wanted to leave meeting, beard and hair sent " a leaving " message to give the host of meeting.But,, then must send a close message if the host of meeting wants to leave meeting.
5) feedback: this message has comprised the feedback information of other message, and therefore, for different request messages, the content that is comprised in feedback message is also different.
6) refusal: when a request is unaccepted, just need to send " refusal " message.The reason that in this message, has generally also comprised refusal.
Four, the dispersion transmission mechanism in system is mainly realized by the RTP of clean culture.Usually, the code check of video flowing is more much higher than audio stream, and also many than audio frequency complexity to the encoding and decoding of video, therefore in view of the limitation of portable equipment, in system, has only guaranteed the full connection of audio session.Like this, the assurance system can not only satisfy the PC user of high computing capability and high bandwidth, also can satisfy the portable equipment user of those low computing capabilitys and low bandwidth.For audio session, all members can be connected with other a plurality of members simultaneously, and can carry out encoding and decoding to voice data and handle.And for the video session regulation, the portable equipment user only does the decoding of video, does not participate in coding; And the pc user not only can do the decoding of video, can also carry out the coding of video.Like this, the PC user still can be connected with a plurality of other users simultaneously, but the portable equipment user can only be connected with some pc user members in the meeting at synchronization.
Although five for the portable equipment user, can only carry out video session with other member at synchronization.But for the flexibility of enhanced system,, in system, designed a kind of choice mechanism of user flexibly, so that the user can switch to another video flowing from a video flowing easily to satisfy user's demand.By the RTP of clean culture, can realize such purpose easily.The portable equipment user at first sends a BYE and wraps to current and the pc user who oneself carries out video conference to interrupt current video flowing, and the member address after will switching then joins in the local destination address chained list.All handover operations are all finished in the RTP of portable equipment transport module, need not the intervention of host and central server.Also this choice mechanism can be applied among the PC user, allow them can select or change a series of target source easily.
Six, in native system, also considered the safety issue of abnormity processing and system.
Owing to adopted centralized control mechanism, native system can not produce concurrent problem.Yet system still might produce the unusual situation of two classes, the one, and when physical equipment is paralysed, the 2nd, after having retransmitted certain number of times, control messages still do not receive feedback message.In both cases, system mode will become unstable.Because host and rank and file's institute's role in a meeting have very big difference, therefore they are also had any different in abnormity processing and recovery.When the host was collapsed, the meeting parliament at its place became and no longer allows the newcomer to add.But that meeting is not collapse therefore and fully but, still can continue the session of audio frequency and video between other members.When in a single day arbitrary rank and file detects host's collapse in the meeting, promptly send " a closing " message, the minutes of this meeting are removed from central server to central server.Have only after all members leave in the meeting, this meeting is just actual deleted.Can see that system has guaranteed host's the paralysis that can not cause current whole meeting of leaving.When a rank and file was collapsed, other members can be by the RTCP feedback information detection to this unusual generation, and the current state with this member is changed to inactive then.And if the control messages that the meeting presider has retransmitted certain number of times to this member when still not receiving feedback message, the meeting presider is this member's of deletion information from member's tabulation directly.The member who adds this meeting like this, later on can not communicate by letter with this member.
The fail safe of native system is by host's control of central server and each meeting.Each minutes all comprises meeting title and meeting password.The meeting title be produce by central server and be meeting of unique identification, the meeting password then is that the host of meeting provides when creating a meeting.When each newcomer wants to add a meeting, at first all must provide the title and the password of this meeting.Central server is at first verified meeting title and password, and meeting presider's IP address just is provided to this newcomer then.Then, this newcomer can go to connect the host of meeting with the IP address that obtains.The host of meeting has the right to determine acceptance or does not accept this member.
After the framework of this video conferencing system is finished, just can utilize the designed meeting control protocol of the present invention in this system, to create and use video conference.Meeting is from being created to the process of closing as shown in Figure 2.Specify as follows:
1) certain member in the meeting sends " establishment " message to central server, and uniquely identified meeting title of central server feedback is given this member, and at this moment, this member has just become the host of new meeting.In central server, also to register new minutes simultaneously in order to write down this meeting of new establishment.Record format is as follows:
{ title, password, host IP address, control port }
2) each wants to add the necessary in advance title and the password that obtains that meeting of member of meeting, sends " adding " message to central server then.After central server authentication is passed through, host's IP address can be returned to this member.Like this, this member just can utilize the host's of acquisition IP address to connect to the meeting of wanting to add.
3) after the newcomer obtains host IP address, also need to send " adding " message to the host of meeting, wait for host's checking.When it adds meeting when host's permission, will in feedback information, return member's address link list of active conference and give this user.Each address information is according to following formal definition:
{ IP address, audio port, video port, control port }
4) behind newcomer's address acquisition chained list, promptly can carry out the session of video or audio frequency with other conference members.
5) after in a single day original conference member detects newcomer's adding, promptly need information with this newcomer join in separately the local information about firms storehouse.
6) when the member wants to leave a meeting, send " a leaving " message and give the meeting presider.After obtaining host's feedback message, can leave, close the session of all audio frequency and video simultaneously.At this moment, the meeting presider also can delete this member from address link list.
7) when the meeting presider wants to close a meeting, can realize by send one " closing " order to central server.