CN104902111B - A kind of method, apparatus and system established based on Web RTC multi-party call - Google Patents

A kind of method, apparatus and system established based on Web RTC multi-party call Download PDF

Info

Publication number
CN104902111B
CN104902111B CN201410081884.8A CN201410081884A CN104902111B CN 104902111 B CN104902111 B CN 104902111B CN 201410081884 A CN201410081884 A CN 201410081884A CN 104902111 B CN104902111 B CN 104902111B
Authority
CN
China
Prior art keywords
user
party call
call
request
message
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410081884.8A
Other languages
Chinese (zh)
Other versions
CN104902111A (en
Inventor
徐明远
胡彬
陈鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201410081884.8A priority Critical patent/CN104902111B/en
Priority to PCT/CN2015/072829 priority patent/WO2015131750A1/en
Publication of CN104902111A publication Critical patent/CN104902111A/en
Application granted granted Critical
Publication of CN104902111B publication Critical patent/CN104902111B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1818Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present invention provides a kind of method, apparatus and system established based on Web RTC multi-party call, it is related to the communications field, to the higher requirement of equipment performance caused by can reduce as carrying out local audio mixing, cumbersome meeting-place resource bid can also be carried out without contacting pts server, further save the waste of meeting-place resource caused by when multi-party call reverts to double-talk, the establishment step for finally reducing multi-party call, improves the service efficiency of the communication resource.The request for establishing multi-party call is sent to conference applications server especially by: the first user, conference applications server judges whether the first user has the permission for establishing multi-party call, and the request that Multi-Party Conference is added is sent to the user of multi-party call to be participated in, the first user is enabled to send the invitation for establishing media channel to other users, eventually by the media channel of foundation, and the technology of audio-video label in Media Stream multiplexing and browser is combined, to realize multi-party call.The present invention is for realizing multi-party call.

Description

A kind of method, apparatus and system established based on Web RTC multi-party call
Technical field
The present invention relates to the communications field more particularly to a kind of method established based on Web RTC multi-party call, equipment and it is System.
Background technique
The method that currently call is changed to multi-party call by both party mainly passes through terminal audio mixing mode and meeting-place audio mixing mode It realizes, wherein the former mainly application and scene for participating in such as double-talk fewer in number and being changed to Three-Way Calling, and the latter Then it is applied to the scene that more number participates in.
The realization of terminal audio mixing mode is in business side A and user B in call hold mode, while just with user C In call, the Media Stream of A and B, A and C are carried out respectively by audio mixing by the terminal device of user A, then by the matchmaker after audio mixing Body stream is respectively sent to user B and user C again, and user B and user C is enabled to receive the image and sound of A Yu C, A and B, To realize the effect of Three-Way Calling indirectly.
The realization of meeting-place audio mixing mode is that have business side A and user B to be in call hold mode, while just with user C In call, business side A passes through the meeting of pts server (Media Resource Server, MRS) application Multi-Party Conference first Field resource, then passes through session for the call of A and B, A and C respectively and negotiates again, is transferred to the matchmaker established with pts server respectively In body channel, eventually by the connection with pts server, the effect of multi-party call is realized.
Although above-mentioned terminal audio mixing mode and meeting-place audio mixing mode has been able to achieve double-talk and has been changed to multi-party call Requirement, but the former is required to carry out the support of the terminal device of local audio mixing, and if in the multi-party call carried out When comprising video, there can be very high requirement to the performance of audio mixing equipment;The realization of the latter is even more to need the support of MRS, otherwise without Method is realized, further, realizes that multi-party call requires application meeting-place resource each time by meeting-place audio mixing mode, step is numerous Trivial, when reverting to double-talk by multi-party call, the meeting-place resource of application can not discharge in time, lead to the wasting of resources.
Summary of the invention
The embodiment of the present invention provides a kind of method, apparatus and system established based on Web RTC multi-party call, can drop It, can also be cumbersome without contacting pts server progress to the higher requirement of equipment performance caused by the low local audio mixing as progress Meeting-place resource bid, further save when multi-party call reverts to double-talk caused by meeting-place resource waste, finally The establishment step for reducing multi-party call improves the service efficiency of the communication resource.
In order to achieve the above objectives, the embodiment of the present invention adopts the following technical scheme that
In a first aspect, providing a kind of method established based on Web RTC multi-party call, which comprises
It receives the multi-party call that the first user to converse sends and establishes request, the request includes that the first extension disappears It ceases, needs the information for establishing the second user of multi-party call with first user in the first extension message;
Judge that first user establishes the permission of the multi-party call;
When first user has the permission for establishing the multi-party call, confirmation is sent to first user and is established Second extension message of the multi-party call, and send third extension to the third user to converse with first user and disappear Breath, it includes the list information for participating in the multi-party call member in message that the third, which extends,;
The request that the multi-party call is added is sent to the second user, includes that participation is described multi-party logical in the request Talk about the list information of member;
Receive the information that the confirmation that the second user is sent is added;
It establishes and uses between first user and the second user, between the third user and the second user respectively In the media channel of multi-party call;
By being used for the media channel of multi-party call described in having built up, the multi-party call is carried out.
In the first possible implementation, with reference to first aspect, the multi-party call includes at least audio stream and view The transmission of frequency stream.
In the second possible implementation, with reference to first aspect, the method also includes:
As the dialogue-based initiation protocol of the multi-party call (Session Initiation Protocol, SIP), institute Stating the first extension message, the second extension message, third extension message is the extension message based on the SIP.
In the third possible implementation, with reference to first aspect, the second user is at least one user terminal.
Second aspect provides a kind of method established based on Web RTC multi-party call, which comprises
Multi-party call is sent to application server and establishes request, and the request includes the first extension message, and described first expands Open up the message of the second user of multi-party call to be established in message;
It receives the application server and sends the second extension message for building vertical multi-party call really;
Establish the media channel for multi-party call with the second user;
Multi-party call is carried out by the media channel.
In the first possible implementation, in conjunction with second aspect, the foundation is with the second user for more The media channel just conversed includes:
The message request for establishing the media channel is sent to the second user;
The information that the reply that the second user is sent is invited is received, the media channel with the second user is established.
In the second possible implementation, in conjunction with second aspect, which comprises
Local Media Stream is obtained, the local Media Stream is saved;
The local Media Stream is sent to the second user by the media channel between the second user, from Media channel between the second user receives the Media Stream of the second user.
In the third possible implementation, in conjunction with second aspect, the method also includes:
The local Media Stream is sent to the third user by the media channel between third user, from institute State the Media Stream that the media channel between third user receives the third user.
The third aspect, provides a kind of equipment based on Web RTC multi-party call, and the equipment includes:
First receiving unit establishes request for receiving the multi-party call that the first user to converse sends, described to ask It asks and extends message including first, need the second user for establishing multi-party call with first user in the first extension message Information;
Permission judging unit, for judging that first user establishes the permission of the multi-party call;
First message transmission unit, for when first user have establish the multi-party call permission when, to institute It states the first user and sends the second extension message that the multi-party call is established in confirmation, and to conversing with first user Third user sends third and extends message, includes the list letter for participating in the multi-party call member in the third extension message Breath;
First request transmitting unit, it is described to ask for sending the request that the multi-party call is added to the second user It include participating in the list information of the multi-party call member, and receive the letter that the confirmation that the second user is sent is added in asking Breath;
First passage establishes unit, is used for respectively between first user and the second user, the third user The media channel for being used for multi-party call is established between the second user;
First multi-party call unit carries out institute for passing through the media channel described in having built up for multi-party call State multi-party call.
In the first possible implementation, in conjunction with the third aspect, the multi-party call includes at least audio stream and view The transmission of frequency stream.
In the second possible implementation, in conjunction with the third aspect, in the apparatus, when the multi-party call is based on When Session initiation Protocol (Session Initiation Protocol, SIP), the first extension message, second extension Message, third extension message are the extension message based on the SIP.
In the third possible implementation, in conjunction with the third aspect, the second user is at least one user terminal.
Fourth aspect provides a kind of system established based on Web RTC multi-party call, and the equipment includes at least:
The conference applications server as shown in first aspect, or the conference applications server as described in the third aspect;
The first user as shown in second aspect.
The embodiment of the present invention provides a kind of method, apparatus and system established based on Web RTC multi-party call, passes through first User sends the request for establishing multi-party call to conference applications server, and conference applications server judges whether the first user builds The permission of vertical multi-party call, after determining that the first user has and establishes the request of multi-party call, to the use of multi-party call to be participated in Family sends the request that Multi-Party Conference is added and is accompanied with the member list information of the multi-party call, in order to other users to whether Multi-party call is added to be judged, after other users send to conference applications server and the information of Multi-Party Conference is added, enables the One user sends the invitation for establishing media channel to other users, and replys in other users and receive the letter for establishing media channel Breath, to be successfully established the media channel of the first user and other users.Eventually by the media channel of foundation, and combine media The technology of audio-video label in stream multiplexing and browser, to realize multi-party call;It can reduce due to carrying out local audio mixing Caused by the higher requirement of equipment performance, cumbersome meeting-place resource bid can also be carried out without contacting pts server, into One step saves the waste of meeting-place resource caused by when multi-party call reverts to double-talk, finally reduces building for multi-party call Vertical step, improves the service efficiency of the communication resource.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.
Fig. 1 is the hierarchy chart that browser provided in an embodiment of the present invention carries Web RTC application;
Fig. 2 is a kind of flow chart of method established based on Web RTC multi-party call provided in an embodiment of the present invention;
Fig. 3 is a kind of detail flowchart of method established based on Web RTC multi-party call provided in an embodiment of the present invention;
Fig. 4 is a kind of flow chart of method established based on Web RTC multi-party call provided in an embodiment of the present invention;
Fig. 5 is a kind of detail flowchart of method established based on Web RTC multi-party call provided in an embodiment of the present invention;
Fig. 6 provides a kind of structural schematic diagram of equipment established based on Web RTC multi-party call for the embodiment of the present invention;
Fig. 7 provides the structural schematic diagram of another device established based on Web RTC multi-party call for the embodiment of the present invention;
Fig. 8 provides the structural schematic diagram of another system established based on Web RTC multi-party call for the embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
The embodiment of the present invention is based on Web RTC agreement, the real-time point pair based on web browser provided by the agreement Point technology (Peer to Peer, P2P) realizes the communication including voice, video, live collaboration, data transmission etc..With it is existing Unlike the communication technology based on web, which needs not go through device and installs any plug-in unit and Add-ons, passes through browser The protocol stack of built-in audio/video decoder and signaling plane and medium surface, along with to JavaScript control session establishment Process agreement, that is, JSEP agreement support, so that it may realize voice-over-net telephone service (the Voice over based on Web RTC Internet Phone, VoIP).
Specifically in the application of Web RTC, signalling path, the generation of signaling message and parsing, the control of session and pipe Reason is realized by JavaScript application layer;And media parameter negotiation, ICE negotiation, rtp stack, media encoding and decoding etc. It is by browser bottom layer realization.The hierarchy chart of detailed browser carrying Web RTC application is as shown in Figure 1.
In Web RTC application shown in Fig. 1, media negotiation, NAT are passed through, the acquisition of rtp stack, Media Stream is presented, Coding and decoding has browser bottom layer realization, and browser passes through open JavaScript API for application call, answers Therefore browser bottom can be controlled according to the state of current sessions with program and make corresponding movement.In addition to this, using journey Sequence is also responsible for the maintenance of signalling path, and the media parameter from browser bottom is packaged into corresponding signaling information, or parsing Signaling message etc. from other side.Browser bottom is joined by the application program on upper layer with communication another party's switched-media Number, to complete media negotiation.
The embodiment of the present invention provides a kind of method established based on Web RTC multi-party call, as shown in Fig. 2, this method packet It includes:
In the initial phase of the present embodiment, the first user carries out two side's calls with third user, but the first user needs Multi-party call is established, newly-increased user is second user.
101, the first user sends multi-party call to conference applications server and establishes request.It include the first extension in the request Message, described first extends the information for establishing the second user of multi-party call in message up for the first user.
Above-mentioned multi-party call includes at least the transmission of audio stream and video flowing.Further, when above-mentioned multi-party call is base When Session initiation Protocol (Session Initiation Protocol, SIP), the first extension message, described second are expanded Open up message, third extension message is the extension message based on the SIP.
Specifically, passing through the XML redefined when the signaling protocol in above-mentioned multi-party call is using Session Initiation Protocol Data format extends Message message body in Session Initiation Protocol, is carried out using the routing mechanism of Session Initiation Protocol to Message message Routing, and then realize the information exchange between application server and client.
Illustratively, by taking the first user as an example, client initiates MPTY request to the extension message of application server It is as follows:
It include sequence number " 4001 ", the title " A " of sender of the message, connection type of the message in above-mentioned message And the information such as corresponding sessions participant " web RTC---B ", " web---C ".
102, the multi-party call that conference applications server receives that the first user to converse sends establishes request.The request In include first extension message, it is described first extension message in need the second user that multi-party call is established with first user Information.
103, conference applications server judges that the first user establishes the permission of multi-party call.
104, when the first user has the permission for establishing multi-party call, application server is established more to the first user transmission The the second extension message just conversed, and third extension message is sent to the third user to converse with the first user.The third Extending includes the list information for participating in the multi-party call member in message.
As info class in step 101, application server sends the corresponding message for establishing multi-party call to the first user It is exemplified below.
Above-mentioned message includes the result res and the multi-party call of the serial number cmd of the message, multi-party call foundation Serial number id, specifically, the value 4002 of cmd is the message sequence number for the multi-party call established, 0 table of value of res by taking above-mentioned message as an example Show that the multi-party call is successfully established, the value 0001 of id indicates the serial number 0001 of the multi-party call, if the value of res is not 0, Show that the multi-party call is failed foundation due to other.
105, conference applications server sends the request that multi-party call is added to second user, includes participating in institute in the request State the list information of multi-party call member.
The request of the multi-party call is that conference applications server is multi-party with establishing in the promoter that confirmed multi-party call After the permission of call, the request that Multi-Party Conference is added is sent to the third party for needing to be added multi-party call, and carry multi-party call The list information of member, in order to which third party carries out the judgement of permission to meeting promoter.
In the present embodiment, conference applications server sends adding by the first Client-initiated multi-party call to second user Enter request, and further comprise member list information relevant to this multi-party call in addition request, in order to the second use The necessity that this multi-party call is added in family judges, and is determined whether that the multi-party call is added according to judging result.
106, second user receives the request for the multi-party call that application server is sent, and includes that participation is described more in the request The list information just conversed.
In the request for the multi-party call for receiving application server transmission, according to the participation multi-party call for including in request List information judges the necessity of the multi-party call.
107, it is more to send confirmation addition to application server after the correctness for confirming the MPTY request for second user The information just conversed.
The information expression second user that the confirmation is added is after judging the necessity that the multi-party call is added, certainly It is fixed to be added by the first Client-initiated multi-party call.
If second user decides not to join the multi-party call after judgement, then refusal is sent to application server and be added Message.
108, the information that the confirmation that application server receives that second user is sent is added.
109, application server respectively between the first user and second user, establish and be used between third user and second user The media channel of multi-party call.
Here the media channel established is respectively used to the first user and leads to second user, third user and second user Words, so that in the multi-party call, have direct point-to-point between any two side is used for transmission audio stream and video flowing Transmission channel finally makes in entire multi-party call, each with there is the channel being connected with any other user per family, into one Step, each use per family as a Web RTC client, get user itself including at least audio stream and video The Media Stream of stream, by the Media Stream after locally being saved, the Media Stream that will acquire can be by being connected with other users Media channel be sent at other users, to realize multi-party call.
Further, each user i.e. each Web RTC client is receiving other clients by corresponding matchmaker When the Media Stream that body channel transfer comes,<Audio>label of multiple HTML5 is created on the page of user browser, each The source Source of label is arranged with the Media Stream of a client, in this way can be simultaneously by multiple<Audio>labels Multiple Media Streams are played, that is, can hear the sound of multiple client simultaneously in the client;In corresponding Media Stream The processing method of video flowing is similar, by establishing multiple<Video>labels, so that can play multiple visitors simultaneously in the client The video image at family end, by the above-mentioned Media Stream for carrying out being multiplexed and handling simultaneously multichannel to Media Stream, to realize multiple pass Words.
Similar with the message format in step 101 and 104, it is multi-party that conference applications server controls user's access to be added The Examples of information of call are as follows:
Above- mentioned information include main control side's (also referred to as multi-party call of the serial number cmd of the message, the multi-party call Chairman) serial number userid and the multi-party call other participants serial number attendee.
Specifically, the value 4003 of cmd is the serial number of the multi-party call by taking above-mentioned message as an example, the value of userID shows for a The serial number of the main control side (or chairman of the multi-party call) of the multi-party call, the value of attendee are respectively that b, c show that this is more The serial number of other participants just to converse.
According to foregoing description, as shown in figure 3, the specific steps for establishing media channel include:
1091, the first user sends the message request for establishing media channel to second user.
1092, second user receives the message request for establishing media channel that the first user sends.
1093, second user judges the correctness of message request sender.
It here is list information of the second user according to the participation multi-party call member received in advance from application server, Judge whether sender's namely correctness of the first user or the first user of message request has initiation multi-party call Permission.
1094, after second user determines that message request sender is correct, the information for receiving and inviting is replied to the first user, and Build on the media channel of the first user.
Due to second user it is determined that crossing the permission that message request sender namely the first user initiates multi-party call, Therefore, second user is after the media channel for building on the first user, then receives after the message of the first user, takes It is different from the processing mode of normal talking message.
Under normal talking mode, since second user has been in the environment of multi-party call, that is, in logical Therefore speech phase, then receives after the call request of other users, default is to return to that " you dial to other users The user beaten is busy now " etc. similar the line is busy information;But currently due to the first user be in second user in advance from In the information list of the multi-party call member of conference applications server, therefore, for as the first user from multi-party The call request and call-information, second user that user in the information list of conversation member sends can take session in meeting to ask Processing mode is sought, i.e., do not pop up dialog box or does not trigger Ring Mode, it is directly automatic to receive call.
Especially in first call after second user and the first user establish media channel, take above-mentioned " quiet It is silent " processing the advantages of be that second user can be enabled to enter the state for having accessed multi-party call faster, that is, be only Second user to conference applications processor return be added multi-party call after, be directed to by the first user or other users transmission The request of media channel is established, extra prompt is no longer carried out, facilitates that second user is enabled to enter multi-party call as soon as possible in this way State in, avoid second user can receive repeatedly be added multi-party call prompt, to promote the experience of second user.
So far, the information transfer channel between the first user and second user, which has been completely set up, finishes, as before with First user is carrying out the third user of double-talk, and the mode that it establishes media channel with second user is directed to above-mentioned The method that first user and second user establish media channel is completely the same, and it is noted that third user here Establish the time of media channel with second user and the first user and second user establish media channel in time be simultaneously into Capable, the time for establishing IMS conference medium channel can be saved to the full extent in this way, it is clear in order to state in the present embodiment, therefore The two is separated and is described, and is illustrated herein.
110, according to method shown in step 1091 to 1094, the first user, third user is sequentially completed and needs to be joined The foundation of the media channel of the side's of adding calling user, and by established media channel, carry out multi-party call.
The embodiment of the present invention provides a kind of method established based on Web RTC multi-party call, passes through the first user to meeting Application server sends the request for establishing multi-party call, and conference applications server judges whether the first user establishes multi-party call Permission, determine the first user have establish the request of multi-party call after, to the user of multi-party call to be participated in send be added The request of Multi-Party Conference and the member list information for being accompanied with the multi-party call, in order to other users to whether be added it is multi-party logical Words are judged, after other users send the information of addition Multi-Party Conference to conference applications server, enable the first user Xiang Qi His user sends the invitation for establishing media channel, and replys in other users and receive the information for establishing media channel, thus success Establish the media channel of the first user and other users.Eventually by the media channel of foundation, and combine Media Stream multiplexing and The technology of audio-video label in browser, to realize multi-party call;To setting caused by can reduce as carrying out local audio mixing The standby higher requirement of performance can also carry out cumbersome meeting-place resource bid without contacting pts server, further save and work as The waste of meeting-place resource caused by when multi-party call reverts to double-talk, finally reduces the establishment step of multi-party call, mentions The high service efficiency of the communication resource.
The embodiment of the present invention provides a kind of method established based on Web RTC multi-party call, as shown in figure 4, this method packet It includes:
The present embodiment is used for two sides that will be being conversed, and is altered to the call form of Three-Way Calling.Due to use scope compared with It is small, therefore double-talk is only changed to as a upper embodiment special case of multi-party call, also assisted as a kind of based on Web RTC View, realizes the supplement of multiside calling method.
In the initial phase of the present embodiment, the first user and second user are in call hold mode, while the first user It is in and is busy now with third user.
201, the first user sends the first information for establishing multi-party call to application server.
Above-mentioned multi-party call includes at least the transmission of audio stream and video flowing.Further, when above-mentioned multi-party call is base When Session initiation Protocol (Session Initiation Protocol, SIP), the first extension message, described second are expanded Open up message, third extension message is the extension message based on the SIP.
Specifically, passing through the XML redefined when the signaling protocol in above-mentioned multi-party call is using Session Initiation Protocol Data format extends Message message body in Session Initiation Protocol, is carried out using the routing mechanism of Session Initiation Protocol to Message message Routing, and then realize the information exchange between application server and client.
202, application server judges that the first user establishes the permission of multi-party call.
203, after the first user has the permission for establishing multi-party call, application server sends to the first user and successfully builds The second message of vertical multi-party call.
204, application server sends third message to third user, includes the correlation of second user in the third message Information and the first user are successfully established the message of multi-party call.
It 205, is " multi-party call " by the Status Change of itself after third user receives third message.
206, application server sends the 4th message to second user, includes the correlation of third user in the 4th message Information and the first user are successfully established the message of multi-party call.
207, the Status Change of itself is " multi-party call " by second user, and establishes media channel with third user.
208, after second user and third user establish media channel, in conjunction with the first user on call With third user, multi-party call is realized.
Here the media channel established is respectively used to second user and converses with third user, so that in the multi-party call In, there is the transmission channel for being used for transmission audio stream and video flowing of direct point-to-point between any two side, finally makes In entire multi-party call, each with there is the channel being connected with any other user per family, and further, each with making per family For a WebRTC client, in the Media Stream including at least audio stream and video flowing for getting user itself, by the media It flows after locally being saved, the Media Stream that will acquire can be sent to other by the media channel being connected with other users At user, to realize multi-party call.
Further, each user i.e. each Web RTC client is receiving other clients by corresponding matchmaker When the Media Stream that body channel transfer comes,<Audio>label of multiple HTML5 is created on the page of user browser, each The source Source of label is arranged with the Media Stream of a client, in this way can be simultaneously by multiple<Audio>labels Multiple Media Streams are played, that is, can hear the sound of multiple client simultaneously in the client;In corresponding Media Stream The processing method of video flowing is similar, by establishing multiple<Video>labels, so that can play multiple visitors simultaneously in the client The video image at family end, by the above-mentioned Media Stream for carrying out being multiplexed and handling simultaneously multichannel to Media Stream, to realize multiple pass Words.
In step 207, as described in Figure 5, second user is established media channel with third user and is specifically included:
2071, second user restores the talking state with the first user, and establishes media channel to application server transmission Message request, include the property parameters of second user in the message request.
2072, application server judges that the invitation message for the call request in multi-party call, is not triggering supplement industry Under the premise of business, the message request is forwarded to third user.
2073, third user is multi-party logical according to the state of fixed " multi-party call ", and in conjunction with the invitation message Call request in words sends the 5th message to application server, and the 5th message includes the property parameters of third user.
2074, the 5th message is sent to second user by application server, is successfully established second user and third user's Media channel.
Since third user is on call with the first user, in step 2072, application server to Before third user forwards the message request, the sender to the message request is needed to judge.
Under normal talking mode, due to third, user has been in the environment of multi-party call, that is, in logical Therefore speech phase, then receives after the information of other users, default will return to that " you are dialed to other users User is busy now " etc. similar the line is busy information;But currently since the second user for sending message is in application service In the multi-party call member that device has been got, therefore, for as second user in multi-party call member The call request and call-information, third user that user sends can take session request processing mode in meeting, i.e., do not pop up pair Words window does not trigger Ring Mode, directly automatic to receive call.
Especially when oneself state is changed to " multi-party call " by third user, above-mentioned " silence " is taken to handle Advantage is that third user can be enabled to enter the state for having accessed multi-party call faster, that is, is only in third user After the third message for receiving application processor transmission, it is directed to and establishes media channel by what second user or other users were sent Request, no longer carry out extra prompt, facilitate in the state for enabling third user enter multi-party call as soon as possible in this way, avoid Third user can receive the prompt that multi-party call is repeatedly added, to promote the experience of third user.
In above-mentioned steps, the information between each user and meeting application server and Call Application Server is transmitted, Be required to the forwarding by session manager Session Manager, may be implemented in this way message transmission accuracy and in time Property, in order to avoid since conference applications server and call server are since information caused by information processing not in time is lost or is postponed. Because above-mentioned steps are numerous, information transmission path is complicated, just the information repeating process not by session manager in step into Row description, is only its function to be carried out Unify legislation herein, but do not represent session manager and be not engaged in above-mentioned steps Information transmission.
The embodiment of the present invention provides a kind of method established based on Web RTC multi-party call, by the first user to application Server sends the first message for establishing multi-party call, and application server judges whether the first user has and establishes multi-party call Permission, and determine the first user have establish the permission of multi-party call after, to the first user send be successfully established multi-party call Second message, while application server sends third, the 4th message to third user and second user respectively, so as to third use Family and second user obtain the first user and have been successfully established the message of multi-party call and have changed oneself state, in second user and It is final to realize in many ways in conjunction with the first user and third user on call after third user establishes media channel Call;It, can also be without contacting meeting-place clothes to the higher requirement of equipment performance caused by can reduce as carrying out local audio mixing Business device carries out cumbersome meeting-place resource bid, further saves meeting-place resource caused by when multi-party call reverts to double-talk Waste, finally reduce the establishment step of multi-party call, improve the service efficiency of the communication resource.
The embodiment of the present invention provides a kind of equipment 1 established based on Web RTC multi-party call, as shown in fig. 6, the equipment has Body includes:
First receiving unit 11 establishes request for receiving the multi-party call that the first user to converse sends, described Request includes the first extension message, needs to be established the second of multi-party call with first user in the first extension message and uses The information at family;
Permission judging unit 12, for judging that first user establishes the permission of the multi-party call;
First message transmission unit 13, for when first user have establish the multi-party call permission when, to First user sends confirmation and establishes the second extension message of the multi-party call, and is conversing to first user Third user send third and extend message, include the list letter for participating in the multi-party call member in third extension message Breath;
First request transmitting unit 14, it is described for sending the request that the multi-party call is added to the second user It include participating in the list information of the multi-party call member, and receive the letter that the confirmation that the second user is sent is added in request Breath;
First passage establishes unit 15, is used for respectively between first user and the second user, third use The media channel for being used for multi-party call is established between family and the second user;
First multi-party call unit 16 is carried out for passing through the media channel described in having built up for multi-party call The multi-party call.
In the device 1, the multi-party call includes at least the transmission of audio stream and video flowing.
Further, the multi-party call includes at least the transmission of audio stream and video flowing.
As the dialogue-based initiation protocol of the multi-party call (Session Initiation Protocol, SIP), institute Stating the first extension message, the second extension message, third extension message is the extension message based on the SIP.
The second user is at least one user terminal.
The embodiment of the present invention provides a kind of equipment established based on Web RTC multi-party call, which receives the first user The multi-party call of transmission establishes request, and judges that the first user establishes the permission of multi-party call, builds when first user has When founding the permission of the multi-party call, the second extension message that the multi-party call is established in confirmation is sent to first user, And third extension message is sent to the third user to converse with first user, it is sent to the second user and institute is added The request of multi-party call is stated, includes participating in the list information of the multi-party call member, and receive described second in the request The information that the confirmation that user sends is added, respectively between first user and the second user, the third user and institute The media channel established between second user and be used for multi-party call is stated, it is logical by the media described in having built up for multi-party call Road carries out the multi-party call;It, can be with to the higher requirement of equipment performance caused by can reduce as carrying out local audio mixing Cumbersome meeting-place resource bid is carried out without contacting pts server, is further saved when multi-party call reverts to double-talk Caused by meeting-place resource waste, finally reduce the establishment step of multi-party call, improve the service efficiency of the communication resource.
The embodiment of the present invention also provides a kind of device 2 established based on Web RTC multi-party call, as shown in fig. 7, the device 2 include: bus 21;And it is connected to memory 22, processor 23, receiver 24 and transmitter 25 in bus 21, wherein depositing For storing dependent instruction, which executes the instruction and is used to receive the more of the first user transmission conversed reservoir 22 Request is established in side's call, and the request includes the first extension message, is needed and first user in the first extension message Establish the information of the second user of multi-party call;The processor 23 executes dependent instruction and is also used to judge that first user establishes The permission of the multi-party call;The processor 23 execution dependent instruction is also used to described multi-party with establishing as first user When the permission of call, to first user send confirmation establish the multi-party call second extension message, and to it is described The third user that first user is conversing sends third and extends message, includes that participation is described multi-party in the third extension message The list information of conversation member;The processor 23 execution dependent instruction is also used to send addition to the second user described multi-party The request of call includes the list information for participating in the multi-party call member in the request;The processor 23 executes correlation and refers to It enables and is also used to receive the information that the confirmation that the second user is sent is added;The processor 23 executes dependent instruction and is also used to distinguish It establishes between first user and the second user, between the third user and the second user for multi-party call Media channel;The processor 23 executes dependent instruction and is also used to by logical for the media of multi-party call described in having built up Road carries out the multi-party call.
In embodiments of the present invention, optionally, the multi-party call which executes that dependent instruction carries out includes at least The transmission of audio stream and video flowing.
In embodiments of the present invention, optionally, which it is dialogue-based to execute the multi-party call that dependent instruction carries out When initiation protocol (Session Initiation Protocol, SIP), the first extension message, second extension disappear Breath, third extension message are the extension message based on the SIP.
In embodiments of the present invention, optionally, which executes dependent instruction carries out in multi-party call second and uses Family is at least one user terminal.
The embodiment of the present invention provides a kind of device established based on Web RTC multi-party call, which receives the first user The multi-party call of transmission establishes request, and judges that the first user establishes the permission of multi-party call, builds when first user has When founding the permission of the multi-party call, the second extension message that the multi-party call is established in confirmation is sent to first user, And third extension message is sent to the third user to converse with first user, it is sent to the second user and institute is added The request of multi-party call is stated, includes participating in the list information of the multi-party call member, and receive described second in the request The information that the confirmation that user sends is added, respectively between first user and the second user, the third user and institute The media channel established between second user and be used for multi-party call is stated, it is logical by the media described in having built up for multi-party call Road carries out the multi-party call;It, can be with to the higher requirement of equipment performance caused by can reduce as carrying out local audio mixing Cumbersome meeting-place resource bid is carried out without contacting pts server, is further saved when multi-party call reverts to double-talk Caused by meeting-place resource waste, finally reduce the establishment step of multi-party call, improve the service efficiency of the communication resource.
The embodiment of the present invention provides a kind of system 3 established based on Web RTC multi-party call, as shown in figure 8, the system 3 It includes at least:
The conference applications server as shown in equipment 1 in above-described embodiment, or the meeting as described in above-mentioned embodiment device 2 Application server;
The first user as shown in above-described embodiment.
The embodiment of the present invention provides a kind of system established based on Web RTC multi-party call, by receiving application server The request of the addition multi-party call of transmission includes the list information for participating in the multi-party call member in the request, is confirming After the correctness of the MPTY request, the information that the multi-party call is added in confirmation is sent to the application server, is built The vertical media channel for multi-party call with the first user carries out multi-party call eventually by the media channel;It can drop It, can also be cumbersome without contacting pts server progress to the higher requirement of equipment performance caused by the low local audio mixing as progress Meeting-place resource bid, further save when multi-party call reverts to double-talk caused by meeting-place resource waste, finally The establishment step for reducing multi-party call improves the service efficiency of the communication resource.
In several embodiments provided herein, it should be understood that disclosed method, device and system, it can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit It is that the independent physics of each unit includes, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit being realized in the form of SFU software functional unit can store and computer-readable deposit at one In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are used so that a computer Equipment (can be personal computer, server or the network equipment etc.) executes the portion of each embodiment the method for the present invention Step by step.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, abbreviation RAM), magnetic or disk etc. are various can store The medium of program code.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims (11)

1. a kind of method established based on Web RTC multi-party call, which is characterized in that the described method includes:
It receives the multi-party call that the first user to converse sends and establishes request, the request includes the first extension message, institute State the information for needing to be established the second user of multi-party call in the first extension message with first user;
Judge that first user establishes the permission of the multi-party call;
When first user has the permission for establishing the multi-party call, sent described in confirmation foundation to first user Second extension message of multi-party call, and third extension message is sent to the third user to converse with first user, It include the list information for participating in the multi-party call member in the third extension message;
The request that the multi-party call is added is sent to the second user, include in the request participate in the multi-party call at The list information of member;
Receive the information that the confirmation that the second user is sent is added;
It establishes between first user and the second user, between the third user and the second user for more respectively The media channel just conversed;
By being used for the media channel of multi-party call described in having built up, the multi-party call is carried out;
When carrying out the multi-party call, the second user is to the user in the list information from the multi-party call member The call request and call-information of transmission take the processing mode of session request in meeting.
2. the method according to claim 1, wherein the multi-party call includes at least audio stream and video flowing Transmission.
3. the method according to claim 1, wherein the method also includes:
As the dialogue-based initiation protocol of the multi-party call (Session Initiation Protocol, SIP), described One extension message, the second extension message, third extension message are the extension message based on the SIP.
4. a kind of method established based on Web RTC multi-party call, which is characterized in that the described method includes:
Multi-party call is sent to application server and establishes request, and the request includes the first extension message, and first extension disappears Need to be established the information of the second user of multi-party call in breath;
It receives the application server and sends the second extension message for building vertical multi-party call really;
It is built between the first user established by the application server and the second user, third user and the second user The vertical media channel for multi-party call carries out multi-party call;Wherein, the third user be with first user The user of call;
When carrying out the multi-party call, the second user sends the user in the list information from multi-party call member Call request and call-information take the processing mode of session request in meeting.
5. according to the method described in claim 4, it is characterized in that, the foundation is with the second user for multi-party call Media channel include:
The message request for establishing the media channel is sent to the second user;
The information that the reply that the second user is sent is invited is received, the media channel with the second user is established.
6. according to the method described in claim 4, it is characterized in that, which comprises
Local Media Stream is obtained, the local Media Stream is saved;
The local Media Stream is sent to the second user by the media channel between the second user, from institute State the Media Stream that the media channel between second user receives the second user.
7. according to the method described in claim 4, it is characterized in that, the method also includes:
Local Media Stream is obtained, the local Media Stream is saved;
The local Media Stream is sent to the third user by the media channel between third user, from described Media channel between three users receives the Media Stream of the third user.
8. a kind of equipment established based on Web RTC multi-party call, which is characterized in that the equipment includes:
First receiving unit establishes request, the request packet for receiving the multi-party call that the first user to converse sends The first extension message is included, needs the letter for establishing the second user of multi-party call with first user in the first extension message Breath;
Permission judging unit, for judging that first user establishes the permission of the multi-party call;
First message transmission unit, for when first user has the permission for establishing the multi-party call, to described the One user sends the second extension message that the multi-party call is established in confirmation, and to the third conversed with first user User sends third and extends message, includes the list information for participating in the multi-party call member in the third extension message;
First request transmitting unit, for sending the request that the multi-party call is added to the second user, in the request Including participating in the list information of the multi-party call member, and receive the information that the confirmation that the second user is sent is added;
First passage establishes unit, for respectively between first user and the second user, the third user and institute State the media channel established between second user and be used for multi-party call;
First multi-party call unit carries out described more for passing through the media channel described in having built up for multi-party call Side's call;
Wherein, when carrying out the multi-party call, the second user is in the list information from the multi-party call member The call request that sends of user and call-information take the processing mode of session request in meeting.
9. equipment according to claim 8, which is characterized in that the multi-party call includes at least audio stream and video flowing Transmission.
10. equipment according to claim 8, which is characterized in that in the apparatus, when the multi-party call is dialogue-based When initiation protocol (Session Initiation Protocol, SIP), the first extension message, second extension disappear Breath, third extension message are the extension message based on the SIP.
11. a kind of system established based on Web RTC multi-party call, which is characterized in that the system includes at least:
Such as realize the conference applications server of claims 1 to 3 any one the method, or as claim 8 to 10 is any Equipment described in one;
Such as realize first user of claim 4 to 7 any one the method.
CN201410081884.8A 2014-03-06 2014-03-06 A kind of method, apparatus and system established based on Web RTC multi-party call Active CN104902111B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201410081884.8A CN104902111B (en) 2014-03-06 2014-03-06 A kind of method, apparatus and system established based on Web RTC multi-party call
PCT/CN2015/072829 WO2015131750A1 (en) 2014-03-06 2015-02-12 Method, device and system for establishing multi-party call based on web rtc

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410081884.8A CN104902111B (en) 2014-03-06 2014-03-06 A kind of method, apparatus and system established based on Web RTC multi-party call

Publications (2)

Publication Number Publication Date
CN104902111A CN104902111A (en) 2015-09-09
CN104902111B true CN104902111B (en) 2019-02-01

Family

ID=54034502

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410081884.8A Active CN104902111B (en) 2014-03-06 2014-03-06 A kind of method, apparatus and system established based on Web RTC multi-party call

Country Status (2)

Country Link
CN (1) CN104902111B (en)
WO (1) WO2015131750A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105743889B (en) * 2016-01-27 2019-05-17 福建星网智慧科技股份有限公司 A kind of method and system for realizing multi-party audio call based on webrtc
CN105915521B (en) * 2016-04-18 2020-05-19 北京小米移动软件有限公司 Multi-party call management method, device and terminal
CN108270584A (en) * 2016-12-30 2018-07-10 展讯通信(上海)有限公司 Realize the method, apparatus of conference telephone capabilities and mostly logical terminal
CN107682657B (en) * 2017-09-13 2020-11-10 中山市华南理工大学现代产业技术研究院 WebRTC-based multi-user voice video call method and system
CN109660491A (en) * 2017-10-10 2019-04-19 中国移动通信有限公司研究院 A kind of point-to-point call method and device, equipment, storage medium in many ways
CN110401623A (en) * 2018-04-25 2019-11-01 中国移动通信有限公司研究院 A kind of multiside calling method, platform, terminal, medium, equipment and system
CN112019791A (en) * 2019-05-30 2020-12-01 广州云积软件技术有限公司 Multi-party audio and video call method and system based on education examination
CN114710461B (en) * 2022-03-31 2024-03-12 中煤科工集团重庆智慧城市科技研究院有限公司 Multi-terminal audio and video instant messaging method and system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101547107A (en) * 2008-03-27 2009-09-30 天津德智科技有限公司 Method and device for establishing multi-channel point-to-point connection
CN102571758A (en) * 2011-12-16 2012-07-11 华为技术有限公司 Method and device for realizing seamless transfer of two-party call transfer conference
CN103404132A (en) * 2013-03-08 2013-11-20 华为终端有限公司 Video communication method, home terminal, and home server

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100571104C (en) * 2005-07-12 2009-12-16 华为技术有限公司 A kind of method that realizes Multi-Party Conference by next generation network
CN1933482B (en) * 2005-09-16 2010-08-11 腾讯科技(深圳)有限公司 Method for initiating speech conversation
DE102006004819B4 (en) * 2006-01-27 2007-12-20 Nokia Siemens Networks Gmbh & Co.Kg A multi-party communication method, arrangement, communication management server and communication terminal for carrying out a communication procedure with a plurality of participants
CN101106536B (en) * 2006-07-15 2011-04-13 华为技术有限公司 A method for establishing group session
CN101237336B (en) * 2007-02-01 2011-10-05 华为技术有限公司 Multi-party communication method, system and method for distribution event status
CN102625080B (en) * 2012-04-23 2014-09-10 广东大晋对接信息科技有限公司 P2P-based WEB video conference system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101547107A (en) * 2008-03-27 2009-09-30 天津德智科技有限公司 Method and device for establishing multi-channel point-to-point connection
CN102571758A (en) * 2011-12-16 2012-07-11 华为技术有限公司 Method and device for realizing seamless transfer of two-party call transfer conference
CN103404132A (en) * 2013-03-08 2013-11-20 华为终端有限公司 Video communication method, home terminal, and home server

Also Published As

Publication number Publication date
CN104902111A (en) 2015-09-09
WO2015131750A1 (en) 2015-09-11

Similar Documents

Publication Publication Date Title
CN104902111B (en) A kind of method, apparatus and system established based on Web RTC multi-party call
CN102347950B (en) Communication network provides the method and system of conversational services to internet
WO2017129129A1 (en) Instant call method, device, and system
CN113746808A (en) Converged communication method for online conference, gateway, electronic device, and storage medium
US7573837B1 (en) Establishment of multicast Push-to-X over Cellular (PoC) communication
CN109802913B (en) Fusion conference implementation method and device, electronic equipment and readable storage medium
CN101674305B (en) Method and system for realizing multimedia conference
CN102123211B (en) Realizing method and system of multi-party calling service
CN103475499A (en) Voice intercom method and system based on internet teleconference
US8391908B2 (en) Communication systems
CN103491106A (en) Method and system for recording IP (internet protocol) calls based on SIP (session initiation protocol) protocol
EP2738999B1 (en) Method and device for realizing a seamless switch from a two-party call to a conference
CN101459880A (en) Session request method and system for establishing temporary group call
CN112751827B (en) Application method and system of SIP multi-party session in broadband cluster
EP2466842B1 (en) Method and service device for private call of conference in ip multimedia subsystem
WO2010078781A1 (en) Ptt group talk control method, user terminal and network side device
CN100366038C (en) PTT conversation controlling method based on cellular network
CN109067659B (en) Session establishing method, router and session system
WO2011140744A1 (en) Multimedia conference system in next generation network and realization method thereof
CN101686138A (en) Method, device and system for realizing tripartite conference
CN101335908B (en) Method for transmitting media content and network side equipment
WO2023273369A1 (en) Conference call method and apparatus, and storage medium and electronic device
CN102546994B (en) Method and system for realizing information interaction of multimedia conference members
JP2007228506A (en) Multi-subscriber call system, call terminal and call server in the multi-subscriber call system, and talking method for multi-subscribers
CN109714560A (en) A kind of mobile terminal video conference system and its implementation

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant