CN108234398B - Multimedia communication method and system and related equipment - Google Patents
Multimedia communication method and system and related equipment Download PDFInfo
- Publication number
- CN108234398B CN108234398B CN201611156259.0A CN201611156259A CN108234398B CN 108234398 B CN108234398 B CN 108234398B CN 201611156259 A CN201611156259 A CN 201611156259A CN 108234398 B CN108234398 B CN 108234398B
- Authority
- CN
- China
- Prior art keywords
- media
- communication
- server
- client
- invitation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/09—Mapping addresses
- H04L61/25—Mapping addresses of the same type
- H04L61/2503—Translation of Internet protocol [IP] addresses
- H04L61/256—NAT traversal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Telephonic Communication Services (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a multimedia communication method and system and related equipment, and relates to the field of multimedia communication. The multimedia communication method comprises the following steps: the conference control server initiates a multiparty communication invitation to the client and the media server respectively and receives the media address information which is sent by the media server and used for the communication; the conference control server sends the media address information to the client so that the client can send the uplink media stream to the media server, and the media server can obtain the public network mapping address of the uplink media stream on the NAT device through the uplink media stream. The conference control server is adopted to obtain the address information of the media server for the communication at this time and send the address information to the client, so that the media server can obtain the public network mapping address of the uplink media stream sent by the client on the NAT equipment, the media server and the client can complete the communication without the TURN server, the consumption of platform resources is reduced, and the bandwidth cost of Internet access is reduced.
Description
Technical Field
The present invention relates to the field of multimedia communication, and in particular, to a multimedia communication method and system, and related devices.
Background
Internet audio-video Communication technology represented by WebRTC (Web Real-Time Communication, Web page Real-Time Communication) has developed rapidly in recent years, and many internet companies invest in a large amount of resource development and development of Communication technology in OTT (Over The Top, which provides application services to users via The internet) manner. Both W3C (World Wide Web Consortium) and IETF (Internet Engineering Task Force) have established a specialized working group to study related technologies and to formulate specifications.
In order to implement wide NAT (Network Address Translation) Traversal, both communication parties need to utilize an ICE (Interactive connectivity establishment, IETF RFC5245) mechanism to perform peer-to-peer communication in transit of a TURN (switching Using relay around NAT, which traverses NAT, RFC5766) server.
As shown in fig. 1, the client a111 and the client B112 located behind the NAT acquire the address of the relay server 15 through the conference control server 13, and connect with the media server 14 through the relay server 15 so that the NAT devices 121 and 122 can be traversed. When a call is made, the multimedia data of the client a111 needs to be transmitted to the media server 14 through the relay server 15, and the media server 14 transmits the multimedia data to the client B112 through the relay server 15.
When a multi-person conversation is carried out, the ICE process is also triggered during multi-party communication, and then the participation of relay servers such as TURN servers and the like is introduced in the media plane. When multiparty communication is performed, more clients are included in the scene, and the multimedia data generated by the clients occupy a large amount of bandwidth of the relay server.
The method can normally establish the call and the media stream between each participating client and the media server, but can increase the public network bandwidth consumption of the TURN server, thereby increasing the consumption of platform resources and improving the bandwidth cost of Internet access.
Disclosure of Invention
The embodiment of the invention aims to solve the technical problem that: how to reduce resource consumption in multimedia communication.
According to a first aspect of embodiments of the present invention, there is provided a multimedia communication method, including: the conference control server initiates a multiparty communication invitation to the client and the media server respectively; the conference control server receives the media address information used for the communication of the media server sent by the media server in response to the multi-party communication invitation; the conference control server sends the media address information used by the media server for the communication to the client so that the client can send the uplink media stream to the media server, and the media server can obtain the public network mapping address of the uplink media stream on the network address conversion equipment through the uplink media stream.
According to a second aspect of the embodiments of the present invention, there is provided a multimedia communication method, including: the media server receives a multiparty communication invitation initiated by the conference control server; the media server responds to the multi-party communication invitation and sends the media address information used by the media server for the current communication to the conference control server, so that the conference control server sends the media address information used by the media server for the current communication to the client; the media server acquires a public network mapping address of the uplink media stream on the network address translation equipment according to the uplink media stream sent by the client; the media server sends the downlink media stream to the client through the public network mapping address of the uplink media stream on the network address translation device.
According to a third aspect of the embodiments of the present invention, there is provided a multimedia communication method, including: the client receives a multiparty communication invitation initiated by a conference control server; the client sends a multiparty communication invitation response to the conference control server so that the conference control server continues to initiate the multiparty communication invitation to the media controller and obtains the media address information used by the media server for the communication; the client receives media address information used for the communication of the media server sent by the conference control server; the client sends the upstream media stream to the media server through the media address information used by the media server for the communication so that the media server can obtain the public network mapping address of the upstream media stream on the network address conversion equipment through the upstream media stream.
According to a fourth aspect of the embodiments of the present invention, there is provided a conference control server including: the multi-party communication invitation module is used for respectively initiating multi-party communication invitation to the client and the media server; the media address acquisition module is used for receiving media address information which is sent by the media server in response to the multi-party communication invitation and is used for the current communication by the media server; and the media address sending module is used for sending the media address information used by the media server for the communication to the client so that the client sends the uplink media stream to the media server, and the media server obtains the public network mapping address of the uplink media stream on the network address conversion equipment through the uplink media stream.
According to a fifth aspect of the embodiments of the present invention, there is provided a media server, including: the server invitation receiving module is used for receiving the multiparty communication invitation initiated by the conference control server; the media address feedback module is used for responding to the multiparty communication invitation and sending the media address information used by the media server for the communication to the conference control server so that the conference control server can send the media address information used by the media server for the communication to the client; the uplink media stream receiving module is used for acquiring a public network mapping address of the uplink media stream on the network address translation equipment according to the uplink media stream sent by the client; and the downlink media stream sending module is used for sending the downlink media stream to the client through the public network mapping address of the uplink media stream on the network address conversion equipment.
According to a sixth aspect of the embodiments of the present invention, there is provided a client, including: the client invitation receiving module is used for receiving the multiparty communication invitation initiated by the conference control server; the invitation response module is used for sending a multiparty communication invitation response to the conference control server so that the conference control server can continuously initiate the multiparty communication invitation to the media controller and obtain the media address information used by the media server for the communication; the media address receiving module is used for receiving media address information which is sent by the conference control server and is used for the communication of the time by the media server; and the uplink media stream sending module is used for sending the uplink media stream to the media server through the media address information used by the media server for the communication so that the media server can obtain the public network mapping address of the uplink media stream on the network address conversion equipment through the uplink media stream.
According to a seventh aspect of the embodiments of the present invention, there is provided a multimedia communication system, including any one of the conference control servers, any one of the media servers, and any one of the clients.
The invention adopts the conference control server to obtain the address information of the media server and send the address information to the client, so that the media server can obtain the public network mapping address of the uplink media stream on the network address conversion equipment according to the uplink media stream sent by the client, thereby the media server and the client can complete the multimedia communication process without the TURN server, the consumption of platform resources is reduced, and the bandwidth cost of Internet access is reduced.
Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic view of an application scenario of a multimedia communication method in the prior art.
Fig. 2 is a schematic view of an application scenario of the multimedia communication method of the present invention.
Fig. 3 is a flow chart of an embodiment of a multimedia communication method of the present invention.
Fig. 4 is a flowchart of another embodiment of the multimedia communication method of the present invention.
Fig. 5 is a block diagram of an embodiment of a multimedia communication system of the present invention.
Fig. 6 is a block diagram of one embodiment of a conference control server of the present invention.
Fig. 7 is a block diagram of one embodiment of a media server of the present invention.
Fig. 8 is a block diagram of one embodiment of a client of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 2 is a schematic diagram of an application scenario of the multimedia communication method according to the present invention, wherein the application scenario is a multi-party communication scenario. In the communication scenario shown in fig. 2, the client a211 and the media server 24 first receive a communication invitation from the conference control server 23, and the conference control server 23 obtains media address information used by the media server 24 for this communication. After the invitation confirmation is completed, the client a211 obtains the media address information used by the media server 24 for the communication, and first sends the upstream media stream to the media server 24. The media server 24 can obtain the public network mapping address of the uplink media stream on the NAT device 221 according to the uplink media stream sent by the client a211, so that the downlink media stream can be directly sent to the client a211 without being relayed by a relay server.
Likewise, the client B212 also receives a communication invitation of the conference control server 23. After the invitation confirmation is completed, the client B212 obtains the media address information used by the media server 24 for the communication, and first sends the upstream media stream to the media server 24. The media server 24 can obtain the public network mapping address of the uplink media stream on the NAT device 221 according to the uplink media stream sent by the client B212, so that the downlink media stream can be directly sent to the client B212.
Thus, client a211 and client B212 may communicate only through the media server 24.
It will be clear to those skilled in the art that other clients that may be present in the system may connect to the media server 24 and interact with the multimedia data in a similar manner. And, fig. 2 is only a schematic illustration of an application scenario of the multimedia communication method of the present invention. According to needs, the scene may include other devices, or may include other numbers of clients, which are not described herein again.
A multimedia communication method of an embodiment of the present invention is described below with reference to fig. 3.
Fig. 3 is a flow chart of an embodiment of a multimedia communication method of the present invention. As shown in fig. 3, the method of this embodiment includes:
step S302, the conference control server initiates a multiparty communication invitation to the client and the media server respectively.
The conference control server may be a server dedicated to multiparty communication, and at this time, the client and the media server may determine that the invitation is a multiparty communication invitation according to address information of the conference control server and the like. In addition, the conference control server may also add the multiparty communication identifier to the multiparty communication invitation, for example, the multiparty communication identifier may be added to the header part of the invite request, so that the client and the media server can identify the type of the communication at this time through the multiparty communication identifier.
Step S304, the conference control server receives the media address information used by the media server for the current communication, which is sent by the media server in response to the multi-party communication invitation.
The media address information used by the media server for the current communication may be, for example, an IP (Internet Protocol) address and a port number of the media server.
Step S306, the conference control server sends the media address information used by the media server for this communication to the client, so that the client sends the uplink media stream to the media server, and the media server obtains the public network mapping address of the uplink media stream on the NAT device through the uplink media stream.
After the invitation confirmation is completed, the media server does not send the media stream temporarily, but waits for the client to send the upstream media stream, so that the public network mapping address of the upstream media stream on the NAT device can be obtained through the upstream media stream.
The conference control server is adopted to acquire the address information of the media server and send the address information to the client, so that the media server can acquire the public network mapping address of the uplink media stream on the network address conversion equipment according to the uplink media stream sent by the client, the media server and the client can complete the multimedia communication process without the TURN server, the consumption of platform resources is reduced, and the bandwidth cost of internet access is reduced.
The method can replace the original ICE process in the multimedia communication. Thus, in carrying out the present invention, the various devices may be instructed not to perform the ICE process while the methods of the above-described embodiments are being performed. The interaction process between the devices in the multimedia communication method of the present invention is further described with reference to fig. 4.
Fig. 4 is a flowchart of another embodiment of the multimedia communication method of the present invention. As shown in fig. 4, the method of this embodiment includes:
step S402, the conference control server initiates a client communication invitation to the client, wherein the client communication invitation comprises a multi-party communication identifier.
For example, when communicating using the SIP protocol, the conference control server may initiate an Invite request to the client and add the multiparty communication identity in the header of the Invite request.
In step S404, the client sends a client communication invitation response to the conference control server in response to the client communication invitation.
Wherein, after receiving the invitation, the client can determine whether the invitation is a multiparty communication invitation. For example, it may be checked whether the client communication invitation is from a multiparty conference control server or whether a multiparty communication identity is included in the client communication invitation. If the multi-party communication invitation is received, the method can be continuously executed; if the communication is not the multiparty communication invitation, the communication can be continued in the original way.
The client communication invitation response sent by the client may be, for example, 200OK, and SDP (Session Description Protocol) information including content required for multimedia communication, such as an encoding format and a video resolution, may be added to the client communication invitation response.
If the client communication invitation response returned by the client includes the field of the client address information, the client address information can be any address information.
Furthermore, the client may instruct the conference control server not to perform the ICE procedure, for example, the SDP information may not be added with a collection address related to the ICE procedure, and the client may apply for the relay server from the TURN, or the like, to perform the ICE procedure.
In step S406, the conference controller initiates a server communication invitation to the media server.
Wherein the conference controller may initiate a call to the media server, e.g. with SDP information returned by the client. The call may also not include instructions for performing the ICE procedure.
If address information of the client needs to be added in the invitation, the address information of the client can also be any address information.
Wherein, the server communication invitation can also represent the communication invitation as a multiparty communication invitation through multiparty communication identification. In addition, if the conference control server first sends the communication invitation to the client, the media server may also determine that the communication invitation is a multiparty communication invitation according to a feedback result of the client included in the server communication invitation.
For example, if the server communication request does not include the indication to perform the ICE procedure, the invitation is a multiparty communication invitation.
In step S408, the media server sends address information of the media server to the conference control server in response to the multiparty communication invitation.
If the server communication invitation received by the media server does not include the indication information for executing the ICE process, the media server does not enable the ICE process.
The media server may send a 200OK response to the conference control server, where the response carries SDP information of the media server, where the SDP information includes media address information used by the media server for the current communication.
Step S410, the conference control server sends the media address information used by the media server for the current communication to the client.
The conference control server may send an acknowledgement response, e.g. an ACK response, to the client and the media server, respectively, after receiving the response of the media server. And the response sent to the client carries the media address information used by the media server for the communication.
Step S412, the client sends the upstream media stream to the media server.
And after the client confirms that the connection is successful, for example, after receiving an ACK response sent by the conference control server, the client sends the upstream media stream to the media server. The media stream may also be a content stream in a multimedia communication, such as video, voice sent by a user, or a media stream for testing and connection.
Due to the existence of the NAT device, the upstream media stream sent by the client may form a public network mapping address on the NAT device, and the address may be different from the client address information in steps S404 to S406. Therefore, the client address information sent by the client may be any content, because in the subsequent communication process, the media server does not send data to the address corresponding to the client address information, but forms a public network mapping address on the NAT device according to the uplink media stream for communication.
Before the client sends the media stream, the media server does not send the media stream to the client and does not perform connectivity test. Even if the media server obtains the address information of the client, the media server is not used, but waits for the uplink media stream sent by the client, so as to obtain the public network mapping address of the uplink media stream on the NAT equipment.
Step S414, the media server obtains the public network mapping address of the uplink media stream on the NAT device through the uplink media stream.
In step S416, the media server sends the downlink media stream to the client through the public network mapping address of the uplink media stream on the NAT device.
Therefore, data receiving and sending between the client and the media server are realized.
The above process describes a connectivity process for one of the clients in a multi-party communication with the media server. Each client participating in communication can adopt the method to carry out multimedia communication with the media server, and then communication among the clients is realized.
By adopting the method, each device can be instructed not to execute the ICE process, but the communication method of the invention is adopted to transmit the multimedia data, thereby establishing the bidirectional media flow between the client and the media server without a relay server.
A multimedia communication system of an embodiment of the present invention is described below with reference to fig. 5.
Fig. 5 is a block diagram of an embodiment of a multimedia communication system of the present invention. As shown in fig. 5, the system of this embodiment includes: a conference control server 60, a media server 70, and a client 80.
A conference control server according to one embodiment of the present invention is described below with reference to fig. 6.
Fig. 6 is a block diagram of one embodiment of a conference control server of the present invention. As shown in fig. 6, the conference control server 60 of this embodiment includes: a multiparty communication invitation module 61 for initiating a multiparty communication invitation to the client 80 and the media server 70, respectively; a media address obtaining module 62, configured to receive media address information, sent by the media server 70 in response to the multiparty communication invitation, of the media server 70 for the current communication; the media address sending module 63 is configured to send the media address information used by the media server 70 for the current communication to the client 80, so that the client 80 sends the upstream media stream to the media server 70, and the media server 70 obtains the public network mapping address of the upstream media stream on the network address translation device through the upstream media stream.
The multiparty communication invitation module 61 may include: the client 80 communication invitation unit 611 is configured to initiate a client 80 communication invitation to the client 80, where the client 80 communication invitation includes a multiparty communication identifier; an invitation confirmation receiving unit 612, configured to receive an invitation confirmation returned by the client 80 in response to the multiparty communication identifier, where the session description information in the invitation confirmation does not include indication information for executing the ICE procedure; a server communication invitation unit 613, configured to initiate a server communication invitation to the media server 70, where the session description information in the server communication invitation does not have indication information for executing the ICE procedure. The media address obtaining module 62 may be further configured to receive a response to the server communication invitation returned by the media server 70, where the session description information in the response includes media address information used by the media server 70 for the current communication, and does not include instruction information for executing the ICE procedure.
A media server of one embodiment of the invention is described below with reference to fig. 7.
Fig. 7 is a block diagram of one embodiment of a media server of the present invention. As shown in fig. 7, the media server 70 of this embodiment includes: a server invitation receiving module 71, configured to receive a multiparty communication invitation initiated by the conference control server 60; a media address feedback module 72, configured to send, in response to the multiparty communication invitation, media address information used by the media server 70 for the current communication to the conference control server 60, so that the conference control server 60 sends the media address information used by the media server 70 for the current communication to the client 80; an upstream media stream receiving module 73, configured to obtain, according to the upstream media stream sent by the client 80, a public network mapping address of the upstream media stream on the network address translation device; and a downstream media stream sending module 74, configured to send the downstream media stream to the client 80 through the public network mapping address of the upstream media stream on the network address translation device.
Wherein the session description information in the multiparty communication invitation does not include the indication information for executing the ICE procedure. The media address feedback module 72 may be further configured to send a response to the multiparty communication invitation to the conference control server 60 in response to the multiparty communication invitation, where the session description information in the response to the multiparty communication invitation includes media address information used by the media server 70 for the communication, and does not include indication information for performing the ICE procedure.
A client of one embodiment of the present invention is described below with reference to fig. 8.
Fig. 8 is a block diagram of one embodiment of a client of the present invention. As shown in fig. 8, the client 80 of this embodiment includes: a client invitation receiving module 81, configured to receive a multiparty communication invitation initiated by the conference control server 60; an invitation response module 82, configured to send a multiparty communication invitation response to the conference control server 60, so that the conference control server 60 continues to initiate a multiparty communication invitation to the media controller and obtains media address information used by the media server 70 for this communication; a media address receiving module 83, configured to receive media address information, which is sent by the conference control server 60 and used by the media server 70 for the current communication; the upstream media stream sending module 84 is configured to send the upstream media stream to the media server 70 through the media address information used by the media server 70 for the communication, so that the media server 70 obtains the public network mapping address of the upstream media stream on the network address translation device through the upstream media stream.
Wherein the indication information for executing the ICE procedure may not be included in the multiparty communication invitation response.
Wherein the conference control server 60 may include the multiparty communication identification in the initiated multiparty communication invitation.
Furthermore, the method according to the invention may also be implemented as a computer program product comprising a computer readable medium having stored thereon a computer program for performing the above-mentioned functions defined in the method of the invention. Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (13)
1. A method of multimedia communication, comprising:
the conference control server initiates a multiparty communication invitation to the client and the media server respectively, comprising: a conference control server initiates a client communication invitation to a client, wherein the client communication invitation comprises a multi-party communication identifier; the conference control server receives an invitation response returned by the client in response to the multiparty communication identification, wherein the client address information in the invitation response is any address information; the conference control server initiates a server communication invitation to the media server, wherein the address information of the client in the communication invitation is any address information;
the conference control server receives the media address information used by the media server for the communication sent by the media server in response to the multiparty communication invitation;
the conference control server sends the media address information used by the media server for the communication to the client so that the client can send an uplink media stream to the media server, and the media server can obtain the public network mapping address of the uplink media stream on the network address conversion equipment through the uplink media stream.
2. The method of claim 1,
the session description information in the invitation response does not have indication information for executing the ICE process, and the session description information in the server communication invitation does not have indication information for executing the ICE process;
the conference control server receiving the address information of the media server sent by the media server in response to the server communication invitation comprises:
the conference control server receives a response to the server communication invitation returned by the media server, and the session description information in the response comprises media address information used by the media server for the communication and does not comprise indication information for executing an ICE (Internet access computer) process.
3. A method of multimedia communication, comprising:
the media server receives a multiparty communication invitation initiated by a conference control server, wherein the address information of a client in the communication invitation is any address information, the any address information comes from an invitation response returned by the client, and the client returns the invitation response in response to a multiparty communication identifier in the client communication invitation initiated by the conference control server to the client;
the media server responds to the multiparty communication invitation and sends the media address information used by the media server for the communication to the conference control server so that the conference control server sends the media address information used by the media server for the communication to the client;
the media server acquires a public network mapping address of the uplink media stream on the network address translation equipment according to the uplink media stream sent by the client;
and the media server sends the downlink media stream to the client through the public network mapping address of the uplink media stream on the network address conversion equipment.
4. The method of claim 3,
the session description information in the multiparty communication invitation does not include indication information for executing an ICE (Internet authentication and accounting) process;
the media server responding to the multiparty communication invitation and sending the media address information used by the media server for the communication to the conference control server comprises:
the media server responds to the multiparty communication invitation and sends a response to the multiparty communication invitation to the conference control server, and the session description information in the response to the multiparty communication invitation comprises media address information used by the media server for the communication and does not comprise indication information for executing an ICE (Internet authentication and charging) process.
5. A method of multimedia communication, comprising:
a client receives a multiparty communication invitation initiated by a conference control server, wherein the multiparty communication invitation comprises a multiparty communication identifier;
responding to the multiparty communication identification, the client sends a multiparty communication invitation response to the conference control server so that the conference control server continuously initiates the multiparty communication invitation to the media server and obtains the media address information used by the media server for the communication, wherein the client address information in the invitation response and the multiparty communication invitation initiated to the media server is any address information;
the client receives media address information used for the communication of the media server sent by the conference control server;
the client sends the uplink media stream to the media server through the media address information used by the media server for the communication so that the media server can obtain the public network mapping address of the uplink media stream on the network address conversion equipment through the uplink media stream.
6. The method of claim 5,
the multiparty communication invitation response does not include indication information for executing the ICE procedure.
7. A conference control server, comprising:
the multiparty communication invitation module is used for respectively initiating multiparty communication invitation to the client and the media server and comprises: a conference control server initiates a client communication invitation to a client, wherein the client communication invitation comprises a multi-party communication identifier; the conference control server receives an invitation response returned by the client in response to the multiparty communication identification, wherein the client address information in the invitation response is any address information; the conference control server initiates a server communication invitation to the media server, wherein the address information of the client in the communication invitation is any address information;
a media address acquisition module, configured to receive media address information used by the media server for the current communication, where the media server sends the media address information in response to the multiparty communication invitation;
and the media address sending module is used for sending the media address information used by the media server for the communication to the client so that the client sends an uplink media stream to the media server, and the media server obtains the public network mapping address of the uplink media stream on the network address conversion equipment through the uplink media stream.
8. The server according to claim 7,
the multiparty communication invitation module includes:
the client communication invitation unit is used for initiating a client communication invitation to a client, wherein the client communication invitation comprises a multi-party communication identifier;
an invitation confirmation receiving unit, configured to receive an invitation confirmation returned by the client in response to the multiparty communication identifier, where session description information in the invitation confirmation does not include indication information for executing an ICE procedure;
a server communication invitation unit, configured to initiate a server communication invitation to a media server, where session description information in the server communication invitation does not include indication information for executing an ICE procedure;
the media address acquisition module is further configured to receive a response to the server communication invitation returned by the media server, where session description information in the response includes media address information used by the media server for the current communication, and does not include instruction information for executing an ICE process.
9. A media server, comprising:
the system comprises a server invitation receiving module, a conference control server and a client side communication invitation receiving module, wherein the server invitation receiving module is used for receiving the multiparty communication invitation initiated by the conference control server, the address information of the client side in the communication invitation is any address information, the any address information comes from an invitation response returned by the client side, and the client side returns the invitation response in response to a multiparty communication identifier in the client side communication invitation initiated by the conference control server to the client side;
the media address feedback module is used for responding to the multiparty communication invitation and sending the media address information used by the media server for the communication to the conference control server so that the conference control server can send the media address information used by the media server for the communication to the client;
the uplink media stream receiving module is used for acquiring a public network mapping address of the uplink media stream on the network address translation equipment according to the uplink media stream sent by the client;
and the downlink media stream sending module is used for sending the downlink media stream to the client through the public network mapping address of the uplink media stream on the network address conversion equipment.
10. The server according to claim 9,
the session description information in the multiparty communication invitation does not include indication information for executing an ICE (Internet authentication and accounting) process;
the media address feedback module is further configured to send a response to the multiparty communication invitation to the conference control server in response to the multiparty communication invitation, where session description information in the response to the multiparty communication invitation includes media address information used by the media server for the current communication, and does not include instruction information for executing an ICE process.
11. A client, comprising:
the client invitation receiving module is used for receiving a multiparty communication invitation initiated by the conference control server, wherein the multiparty communication invitation comprises a multiparty communication identifier;
the invitation response module is used for responding to the multiparty communication identification and sending a multiparty communication invitation response to the conference control server so that the conference control server can continuously initiate the multiparty communication invitation to the media server and obtain the media address information used by the media server for the communication, wherein the client address information in the invitation response and the multiparty communication invitation initiated to the media server is any address information;
the media address receiving module is used for receiving media address information which is sent by the conference control server and is used for the communication of the time by the media server;
and the uplink media stream sending module is used for sending the uplink media stream to the media server through the media address information used by the media server for the communication so that the media server can obtain the public network mapping address of the uplink media stream on the network address conversion equipment through the uplink media stream.
12. The client of claim 11,
the multiparty communication invitation response does not include indication information for executing the ICE procedure.
13. A multimedia communication system, comprising:
the conference control server of claim 7 or 8,
the media server of claim 9 or 10, and,
the client of claim 11 or 12.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611156259.0A CN108234398B (en) | 2016-12-15 | 2016-12-15 | Multimedia communication method and system and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611156259.0A CN108234398B (en) | 2016-12-15 | 2016-12-15 | Multimedia communication method and system and related equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108234398A CN108234398A (en) | 2018-06-29 |
| CN108234398B true CN108234398B (en) | 2021-01-08 |
Family
ID=62651046
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611156259.0A Active CN108234398B (en) | 2016-12-15 | 2016-12-15 | Multimedia communication method and system and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108234398B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112769818A (en) * | 2021-01-05 | 2021-05-07 | 武汉球之道科技有限公司 | Video processing method based on webpage instant messaging and IP communication |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1968226A (en) * | 2006-04-18 | 2007-05-23 | 华为技术有限公司 | Method for crossing network address conversion in point-to-point communication |
| EP2193649A1 (en) * | 2007-09-28 | 2010-06-09 | Siemens Enterprise Communications GmbH & Co. KG | Method and device for connecting packet-oriented communication terminals |
| CN101860536A (en) * | 2010-05-31 | 2010-10-13 | 北京邮电大学 | Private network access system based on SIP soft phone and method thereof |
| CN102801725A (en) * | 2012-08-06 | 2012-11-28 | 苏州工业园区云视信息技术有限公司 | Method for transmitting audio/video media in SIP audio/video conference |
| CN103391334A (en) * | 2013-06-28 | 2013-11-13 | 贵阳朗玛信息技术股份有限公司 | Network crossing method, device and system |
| CN106161179A (en) * | 2015-03-26 | 2016-11-23 | 中兴通讯股份有限公司 | The media processing method of a kind of real-time Communication for Power based on webpage and device |
| CN106233704A (en) * | 2013-12-27 | 2016-12-14 | 华为技术有限公司 | There is provided by Relay mode network address translation hole punching voucher and the method and apparatus of server |
-
2016
- 2016-12-15 CN CN201611156259.0A patent/CN108234398B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1968226A (en) * | 2006-04-18 | 2007-05-23 | 华为技术有限公司 | Method for crossing network address conversion in point-to-point communication |
| EP2193649A1 (en) * | 2007-09-28 | 2010-06-09 | Siemens Enterprise Communications GmbH & Co. KG | Method and device for connecting packet-oriented communication terminals |
| CN101860536A (en) * | 2010-05-31 | 2010-10-13 | 北京邮电大学 | Private network access system based on SIP soft phone and method thereof |
| CN102801725A (en) * | 2012-08-06 | 2012-11-28 | 苏州工业园区云视信息技术有限公司 | Method for transmitting audio/video media in SIP audio/video conference |
| CN103391334A (en) * | 2013-06-28 | 2013-11-13 | 贵阳朗玛信息技术股份有限公司 | Network crossing method, device and system |
| CN106233704A (en) * | 2013-12-27 | 2016-12-14 | 华为技术有限公司 | There is provided by Relay mode network address translation hole punching voucher and the method and apparatus of server |
| CN106161179A (en) * | 2015-03-26 | 2016-11-23 | 中兴通讯股份有限公司 | The media processing method of a kind of real-time Communication for Power based on webpage and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108234398A (en) | 2018-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10893080B2 (en) | Relaying multimedia conferencing utilizing software defined networking architecture | |
| CN107682657B (en) | WebRTC-based multi-user voice video call method and system | |
| CN106161179B (en) | Media processing method and device based on real-time communication of webpage | |
| CN104253742B (en) | Virtual WEB real-time Communication for Power gateway is with and related methods, system | |
| CN104333550B (en) | The methods, devices and systems of the seamless mobility of the electronic equipment of session initiation protocol (SIP) session are participated in for support | |
| CN103227788B (en) | Realize the method and system that Web page application program and SIP equipment carry out communicating | |
| CN106850399B (en) | Communication method based on WebRTC technology instant message | |
| CN111147506A (en) | Method, system and storage device for playing streaming media data based on HTML5 | |
| US10601880B2 (en) | Conference reconstruction in SIP networks | |
| CN107612931B (en) | Multipoint conversation method and multipoint conversation system | |
| CN105657368A (en) | Method for rapidly switching IPC (Inter Process Communication) camera into IP (Internet Protocol) multimedia system IMS | |
| CN102215276A (en) | Video monitoring system and method of media traverse of network address translation equipment | |
| CN101895590A (en) | UDT-based system and method for realizing network address translator traversal | |
| CN101924772A (en) | Communication system and method supporting cross-network and cross-terminal realization of multimedia session merging | |
| US20240292363A1 (en) | Information transmission method and apparatus | |
| CN103384247A (en) | Video multicast achieving method based on session initiation protocol (SIP) monitoring system | |
| CN108337241B (en) | Multimedia data transmission method and system | |
| CN108234398B (en) | Multimedia communication method and system and related equipment | |
| CN101094159B (en) | Method for penetrating through private network of media stream | |
| CN104994067A (en) | System and method for SIP network to access RTSP monitoring network | |
| CN111818010A (en) | Data transmission method and device, electronic equipment and storage medium | |
| CN109120578B (en) | Method and device for realizing link connection processing | |
| Karam et al. | Using Socket. io Approach for Many-to-Many Bi-Directional Video Conferencing | |
| CN102546644B (en) | Method, equipment and system for implementing SIP (Session Initiation Protocol) calling | |
| CN115134336A (en) | Augmented reality communication method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |