WO2018050116A1 - 一种视频会议系统中端口复用方法和服务器和计算机存储介质 - Google Patents

一种视频会议系统中端口复用方法和服务器和计算机存储介质 Download PDF

Info

Publication number
WO2018050116A1
WO2018050116A1 PCT/CN2017/102111 CN2017102111W WO2018050116A1 WO 2018050116 A1 WO2018050116 A1 WO 2018050116A1 CN 2017102111 W CN2017102111 W CN 2017102111W WO 2018050116 A1 WO2018050116 A1 WO 2018050116A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
video conference
connection
server
conference server
Prior art date
Application number
PCT/CN2017/102111
Other languages
English (en)
French (fr)
Other versions
WO2018050116A9 (zh
Inventor
苏达峰
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to EP17850317.3A priority Critical patent/EP3515032B1/en
Priority to RU2019107805A priority patent/RU2740305C9/ru
Publication of WO2018050116A1 publication Critical patent/WO2018050116A1/zh
Publication of WO2018050116A9 publication Critical patent/WO2018050116A9/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1101—Session protocols
    • H04L65/1104—Session initiation protocol [SIP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10—Architectures or entities
    • H04L65/1063—Application servers providing network services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1818—Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1073—Registration or de-registration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H04L65/4038—Arrangements for multi-party communication, e.g. for conferences with floor control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/752—Media network packet handling adapting media to network capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor

Definitions

  • the present disclosure relates to the field of communications technologies, and in particular, to a port multiplexing method and a server and a computer storage medium in a video conferencing system.
  • Port multiplexing means that during the process of establishing a multimedia session, the video conference server provides one or more fixed ports, and sends and receives audio and video media streams on these ports and each participant terminal, thereby finally implementing video conference service functions and reducing products. Difficulties in on-site engineering implementation.
  • a video conference server receives/sends different media streams of different terminals on different ports through an open port address range.
  • this solution will cause the customer's network equipment to open more ports, which has potential security risks, and also increases system engineering implementation complexity and increases costs.
  • the port multiplexing scheme of the traditional H.323 video conferencing system adopts the H.460 protocol.
  • the video conferencing system provides several fixed signaling ports, such as registration, call, and conference control. All terminals are registered on the designated port of the video conference server. Establish a call connection and establish a conference control connection.
  • the media port is specified; in the process of signaling interaction, the video conference server allocates a multiplexed ID to the connected terminal device, and the terminal device that sends the media stream fills the multiplexed ID into the real-time transport protocol of the RTP (Realtime Transport Protocol) to be sent.
  • RTP Real-time Transport Protocol
  • the terminal device that accepts the media stream distinguishes the media stream corresponding to the sending terminal or the terminal according to the multiplexing ID, and replaces the function of determining the media stream corresponding to the terminal and the terminal through the IP port in the conventional solution.
  • SIP Session Initiation Protocol
  • the SIP protocol itself defines a signaling port for terminal registration, call, and conference control, and implements signaling part port multiplexing;
  • the media part has not been considered, and there is no unified solution at present. Therefore, the enterprise network site still has a multi-port problem and there are security risks.
  • the embodiment of the invention provides a port multiplexing method and a server in a video conference system, which solves the problem that the video conference system in the video conference system is not implemented by the multi-port, security risks and complicated deployment in the prior art. High degree and high cost.
  • the embodiment of the invention provides a port multiplexing method in a video conference system, including:
  • the receiving terminal converts each media stream into a format recognizable by the video conference server through each media stream sent by the at least one connection, and then sends the media stream to the video conference server.
  • the embodiment of the invention further provides a server, including:
  • the receiving module is configured to receive the first connection initiated by the terminal, receive the registration message sent by the terminal through the first connection, receive the invitation message sent by the invitation end, and perform conversion; the invitation end is one of the video conference server corresponding to the terminal and the terminal. Receiving at least one other connection initiated by the terminal; receiving each media stream sent by the terminal through the other at least one connection;
  • a processing module configured to convert the registration message sent by the terminal into a format recognizable by the video conference server; convert the invitation message to the conference; convert the media stream sent by the terminal through the other at least one connection into a format recognizable by the video conference server ;
  • the sending module is configured to send the converted registration message to the corresponding video conference server, so that the video conference server completes the registration of the terminal according to the registration message; the converted invitation message is sent to the response end, and the response end is the terminal and the terminal corresponding to the terminal.
  • the other of the video conference servers is configured to respond to the incoming invitation message, establish a session with the inviter, and send the converted media streams to the video conference server.
  • An embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores one or more programs executable by a computer, and when the one or more programs are executed by the computer, causing the computer to execute the foregoing method .
  • the embodiment of the invention discloses a port multiplexing method and a server in a video conference system, which can receive a first connection initiated by a terminal by using a server set in a terminal and a video conference server, and receive a registration message sent by the terminal through the first connection, and Forward the registration message to the corresponding video conference server to implement the terminal in the video conference Registration on the server; afterwards, the conference invitation message sent by one of the terminal or the video conference server may be received and forwarded to the other party to establish a session between the terminal and the video conference server, and then at least one connection initiated by the terminal may be accepted.
  • the receiving terminal sends each type of media stream sent by the at least one connection, and converts the data stream to the video conference server to implement the video conference.
  • the invention achieves the effect that the video conference server provides a port to the terminal, reduces the engineering complexity of the on-site deployment of the video conference system, reduces the security risk, and improves the user experience.
  • FIG. 1 is a flowchart of a port multiplexing method of a video conference system according to Embodiment 1 of the present invention
  • FIG. 2 is a flowchart of a method for multiplexing a port of another video conference system according to Embodiment 2 of the present invention
  • FIG. 3 is a schematic diagram of a module of a server according to Embodiment 3 of the present invention.
  • Embodiment 1 is a diagrammatic representation of Embodiment 1:
  • the embodiment provides a port multiplexing method in a video conference system, which can perform signaling transmission and media stream transmission between a video server and a terminal, and can establish a first with a server for a terminal. Connecting, registering with the video conference server through the server, and then implementing a session establishment process with the video conference server through the first connection established with the server, after which the server can receive other connections initiated by the terminal, and after establishing the connection, receiving the terminal
  • Each of the media streams sent by each connection is converted into a format recognizable by the video conference server and then forwarded to the video conference server.
  • the video conference server in this embodiment is equivalent to providing a port to the terminal. When implementing a video conferencing system, construction difficulty and cost can be reduced.
  • the port multiplexing method in the video conference system of this embodiment includes:
  • the receiving message sent by the terminal through the first connection is converted into a format recognizable by the video conference server, and then sent to the corresponding video conference server, so that the video conference server completes registration of the terminal according to the registration message.
  • S103 Receive an invitation message sent by the inviter and convert the message, and send the converted invitation message to the invitation. Sending to the responding end, so that the responding end responds to the incoming invitation message, and establishes a session with the inviting end; wherein the inviting end is one of the terminal and the video conferencing server, and the responding end is another;
  • the receiving terminal converts each media stream into a format recognizable by the video conference server through each media stream sent by the at least one connection, and then sends the media stream to the video conference server.
  • the terminal is an electronic device having a video and audio collection function, including but not limited to a mobile phone, a computer, and a tablet.
  • the first connection is initiated to implement session creation of the terminal and the video conference server.
  • the connection initiated by the terminal including the first connection belongs to a websocket connection.
  • Each time the terminal initiates a connection it is initiated based on the websocket protocol.
  • All of the above S101-S105 can be implemented by a logical device-server, which also provides an interface to the terminal by using the websocket protocol, and establishes a connection with each websocket of the terminal.
  • the manner in which the terminal initiates the first connection may be to send a connection request, and the server receives the connection request and responds, and completes the process of accepting the first connection request.
  • a bidirectional channel is established between the terminal and the server, and information can be transmitted bidirectionally through the first connection.
  • the information transmitted on the first connection is used to implement a session creation function between the terminal and the video conference server.
  • the terminal may send a registration message to the server through the first connection, in the server.
  • the step of S102 can be performed.
  • the session creation process is generally implemented based on a SIP (Session Initiation Protocol) protocol, so in S102 and S103, the first connection is between the terminal and the server. Data is transmitted based on the SIP protocol. Therefore, for the terminal, when the registration message is packaged, it is performed according to the original SIP method. For the server, the package registration message needs to be parsed, and the source end of the registration message, the terminal that sends the message, and the corresponding video are corresponding. The conference server also needs to process the registration message as a SIP message recognizable by the video conference server and send it to the video conference server. It can be understood that the connection between the server and the video conference server is also required to establish a connection to implement registration information and the like.
  • the data transmission to the video conference server may be implemented based on RTP/RTCP (Real Time Control Protocol).
  • a plurality of terminals generally establish multiple connections on the server, so in S102, not only the registration message sent by the first connection but also other terminals may be received through other connections.
  • the information of the correspondence between the connection and the terminal is preferably written by the terminal into the corresponding transmission information when the information is transmitted through the connection.
  • the information may be identity information of the terminal, including but not limited to a terminal number, a terminal IMEI number, an IP address, and the like.
  • the terminal establishes three connections with the server, and can write its own terminal number in the data sent on the three connections.
  • the server determines the terminal corresponding to each connection according to the terminal number carried in the data, and saves the corresponding The relationship can be used to determine the terminal corresponding to the connection when needed.
  • the terminal can send special signaling to the server through the established connection after the server accepts the connection.
  • the special information can be used to set the identity information of the terminal corresponding to the connection transmitting the special signaling. That is, after accepting the first connection in S101, the special signaling sent by the terminal through the first connection may be received, and the correspondence between the first connection and the terminal is set according to special signaling, and the corresponding relationship is saved.
  • the video conference server receives the registration message. It can be understood that if the identity information of the terminal required for registration is included in the registration message after S101, the video conference server can distinguish the different terminals. Therefore, after the terminal is registered, the identity information of the terminal already exists on the video conference server.
  • session establishment between the terminal and the video conference server can be implemented.
  • the establishment of the session between the terminal and the video conference server includes two methods, one is a session establishment method initiated by the video conference server, and the other is a session established by the terminal initiated by the terminal. method.
  • the process of the first method includes:
  • the incoming invitation message sent by the video conference server is received; wherein the invitation message is used to invite the corresponding terminal, and it is foreseen that the invitation message carries the identity information of the invitation object, considering that the connection transmission is received.
  • the correspondence between the connection and the terminal identity information can be determined. According to the identity information of the terminal in the invitation message and the correspondence between the connection and the terminal identity information, the object to be sent by the invitation message can be determined, and the specific Which connection is established for transmission.
  • the second way of the process includes:
  • the incoming invitation message sent by the terminal is received, and the identity information of the video conference server can be carried in the invitation message, so that the forwarding destination of the invitation message is determined according to the identity information.
  • the incoming invitation message is processed as a Session Initiation Protocol (SIP) message, and the (processed session initiation protocol message) is forwarded to the video conference server according to the corresponding routing rule (SIP routing rule) for video.
  • SIP Session Initiation Protocol
  • the conference server responds, establishes a session, and completes media capability negotiation of the terminal and the video conference server;
  • the call session is established.
  • the terminal and the video server negotiate media capabilities, and negotiate media functions such as audio and video formats, audio and video codec algorithms, and bandwidth parameters through the intermediate forwarding function of the server.
  • step S104 of the embodiment at least one connection initiated by the terminal needs to be accepted, and the connection belongs to the websocket connection.
  • the number of connections initiated by the terminal is corresponding to the number of types of media streams (audio media streams, video media streams, and second video media streams) that the terminal needs to send.
  • the terminal needs to send one audio media stream and one channel of video.
  • the media stream is in S104, specifically accepting two connections initiated by the terminal.
  • the separately transmitted video media stream and audio media stream transmitted by the receiving terminal through the two connections established in S104 are included in S105.
  • converting the media streams to a video conferencing server identifiable format in S105 includes: processing the media stream data into data that satisfies the RTP/RTCP protocol format.
  • the terminal side signaling data and the video conference server side signaling data difference conversion are completed; during the media session, the terminal side media data and the video conference server side media data difference conversion are completed.
  • the received media stream since there are types such as a video media stream and an audio media stream, the received media stream needs to be unpacked and analyzed, and then repackaged, and each media stream is unpacked. Analysis to determine the type of media stream will undoubtedly increase the complexity of the unpacking analysis process.
  • the embodiment can set the connection bearer by using special signaling.
  • type of data Specifically, the data type of the connection bearer transmitting the special signaling may be written in the special signaling.
  • the special signaling write data type transmitted in the first connection is signaling data
  • the data type is audio media stream data written in the special signaling corresponding to the connection of the transmission audio media stream.
  • the special signaling includes two fields customized outside the protocol standard header, which are respectively used to describe the terminal number of the corresponding connection and the data type of the corresponding connection bearer.
  • the special signaling in this embodiment can also be used to set the data type of the connection bearer that transmits the signaling. It can be foreseen how many types of media streams need to be transmitted by the terminal, and the number of other at least one connection is S104. The number of other at least one connection is determined by the number of types of media streams that the terminal wants to send.
  • the server that implements the embodiment is a logical device, and may be set up with the device of the video conference server when the actual application is networked or productized, or may be separately set. This embodiment does not limit the specific form of the server.
  • the server may be configured according to the requirements of the product, and only the port multiplexing of the signaling layer or the multiplexing of the real-time signaling media port is implemented, and the present invention is not limited thereto.
  • the terminal may initiate the disconnection of the connection and the logout of the session by itself, or the server may detect and implement the disconnection of the connection and the logout of the session.
  • the method initiated by the terminal itself includes: receiving a logout session request sent by the terminal through the first connection, and then removing the established connection with the terminal, and controlling the video conference server to cancel the session of the terminal. If there are multiple sessions established by the terminal, the correct session is logged out according to the session information carried in the logout session request.
  • the method for actively removing by the server includes: determining whether the terminal needs to tear down the established connection by connecting the heartbeat check, and if necessary, removing the connection of the terminal, and canceling the account of the terminal on the video conference server.
  • the connection heartbeat check can help determine whether the connection is abnormal. When the connection is abnormal (for example, there is no data transmission for a long time), it is judged that the connection needs to be removed.
  • the video conference server is equivalent to providing services to the terminal through one port.
  • the video conferencing server provides a multiplexing port externally, which effectively reduces the engineering complexity of the video conferencing system and on-site deployment, solves the problem of engineering site firewall and NAT traversal, and avoids signaling packet loss on the Internet.
  • the method of this embodiment has strong comprehensive competitiveness.
  • Embodiment 2 is a diagrammatic representation of Embodiment 1:
  • this embodiment shows a port multiplexing method of a video conference system.
  • four processes are included to establish a connection between a terminal and a server, and the terminal is registered on the video conference server through the server.
  • the session between the terminal and the video conference server is established, and the terminal transmits the media stream data to the video conference server.
  • the method in this embodiment specifically includes:
  • the terminal initiates establishing a websocket connection with the server.
  • the terminal sends special signaling on the connection, and carries a terminal type and a data type definition of the connection bearer.
  • the server receives special signaling, and establishes a matching relationship between the terminal number and the connection.
  • the terminal sends the packaged SIP registration message to the server through the connection.
  • the server forwards the SIP registration message to the video conference server according to the SIP routing rule processing.
  • the video conference server receives a normal SIP registration message, and completes the registration process according to a normal processing procedure.
  • the video conference server sends the invitation message to the server through the SIP method.
  • the server finds a corresponding connection according to the matching relationship between the terminal number and the connection, and sends an invitation message to the terminal through the connection.
  • the server needs to complete the matching relationship between the terminal number and the connection.
  • the protocol conversion work of the incoming invitation message is a protocol conversion work of the incoming invitation message.
  • the terminal receives the enrollment invitation message, and completes the establishment of the session according to a normal call session process.
  • the media capability negotiation has been completed, and the audio and video media is ready to be sent (this embodiment is described by taking one audio and one video as an example).
  • the terminal establishes two connections with the server according to the negotiation result.
  • the terminal sends special signaling to the video conference server through two connections, and sets attributes of the two connections, including a terminal number and a data type.
  • the terminal sends the designated data on each connection.
  • the server receives the data of each connection, performs protocol conversion, and performs adaptive forwarding.
  • the terminal and the server can transmit signaling data and media stream data through one port, thereby achieving the effect that the video conference server provides a port externally, and reducing the engineering complexity of the on-site deployment of the video conference system;
  • the deployment cost can also avoid the problem of call signaling loss on the Internet and improve the comprehensive competitiveness of product solutions.
  • Embodiment 3 is a diagrammatic representation of Embodiment 3
  • the embodiment shows a server, including: a receiving module 31, configured to accept a first connection initiated by a terminal, receive a registration message sent by the terminal through the first connection, and receive an invitation message sent by the invitation end and convert the message.
  • the invitation end is one of a video conference server corresponding to the terminal and the terminal; accepting at least one other connection initiated by the terminal; and receiving, by the terminal, the media streams sent by the other at least one connection;
  • the processing module 32 is configured to convert the registration message sent by the terminal into a format recognizable by the video conference server, convert the invitation message into the conference, and convert the media stream sent by the terminal through the other at least one connection into a video conference server identifiable format;
  • the sending module 33 is configured to send the converted registration message to the corresponding video conference server, so that the video conference server completes the registration of the terminal according to the registration message, and sends the converted invitation message to the response end, where the response terminal is the terminal and the terminal.
  • the transmitting module 33 and the receiving module 31 can be implemented by an antenna and a hardware module that cooperates with the antenna.
  • Processing module 32 may be implemented by an actual processor.
  • the server of this embodiment further includes a detecting module 34, and the detecting module 34 is configured to determine whether the terminal needs to tear down the established connection by connecting the heartbeat check; when the processing module 32 is used to remove the established connection, The connection with the terminal is removed, and the account of the video conference server to log off the terminal is controlled.
  • the receiving module 31 is further configured to receive the logout session request sent by the terminal; the processing module 33 is configured to tear down the established connection with the terminal according to the logout session request, and control the video conference server to log off the session of the terminal.
  • a plurality of terminals generally establish multiple connections on the server, so the server not only receives the registration message sent by the first connection, but also may receive other terminals to send through other connections.
  • Message In order to correctly match the data transmitted by the terminal through the connection with the terminal, it is necessary to determine the correspondence between the connection and the terminal, and the information is preferably written into the corresponding transmission information when the terminal transmits the information through the connection.
  • the information may be identity information of the terminal, including but not limited to a terminal number, a terminal IMEI number, an IP address, and the like.
  • the terminal establishes three connections with the server, and can write its own terminal number in the data sent on the three connections.
  • the server After receiving the data, the server determines the terminal corresponding to each connection according to the terminal number carried in the data, and saves the corresponding The relationship can be used to determine the terminal corresponding to the connection when needed.
  • the server needs to parse the information, and analyze the terminal identity information from the complex information, which will undoubtedly increase the server.
  • the analysis work increases the burden on the server.
  • the terminal can send special signaling to the server through the established connection after the server accepts the connection.
  • the special information can be used to set the identity information of the terminal corresponding to the connection transmitting the special signaling.
  • the receiving module 31 of the embodiment is further configured to: after the processing module 33 accepts each connection initiated by the terminal, receive the special signaling sent by the terminal through the connection; the special signaling is used to set the connection station for transmitting the special signaling. Corresponding to the identity information of the terminal.
  • the establishment of the session between the terminal and the video conference server also includes two methods, one is a session establishment method initiated by the video conference server, and the other is a call setup initiated by the terminal. Session method.
  • the receiving module 31 is configured to receive an enrollment invitation message sent by the terminal by using the first connection;
  • the processing module 32 is configured to process the enrollment invitation message as a session initiation protocol message
  • the sending module 33 is configured to forward the session initiation protocol message to the video conference server according to the corresponding routing rule, so that the video conference server responds, establishes a session, and completes media capability negotiation of the terminal and the video conference server;
  • the receiving module 31 is configured to receive an invitation invitation message of the video conference server.
  • the processing module 32 is configured to determine, according to the identity information of the terminal corresponding to the first connection, a terminal that receives the invitation to join the message;
  • the sending module 33 is configured to send the enrollment invitation message to the terminal determined by the processing module by using the first connection, so that the terminal responds, establishes a session, and completes media capability negotiation of the terminal and the video conference server.
  • media capabilities include, but are not limited to, audio and video formats, audio and video codec algorithms, and bandwidth parameters.
  • the data type of each connection bearer can be set by using special signaling.
  • the data type of the connection bearer transmitting the special signaling may be written in the special signaling.
  • the special signaling write data type transmitted in the first connection is signaling data
  • the data type is audio media stream data written in the special signaling corresponding to the connection of the transmission audio media stream.
  • the special signaling includes two fields customized outside the protocol standard header, which are respectively used to describe the terminal number of the corresponding connection and the data type of the corresponding connection bearer.
  • the structure of special signaling see Embodiment 1.
  • the server in this embodiment is a logical device, and may be set up with the device of the video conference server when the actual application networking or productization is performed. This embodiment does not limit the specific form of the server.
  • a logical device server can be added between the terminal and the video conference server, which solves the shortcomings of the SIP video conferencing system considering only the signaling port multiplexing in the prior art, and provides a video conference server to provide a external video conference server.
  • the effect of the port reduces the engineering complexity of the on-site deployment of the video conferencing system; solves the problem of traversing the firewall and network address translation (NAT) of the project site, and avoids the problem of packet signaling loss on the Internet, improving product resolution.
  • NAT network address translation
  • each module or step in the above embodiments of the present invention can be implemented by a general computing device, which can be concentrated on a single computing device or distributed in multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device, thereby They may be stored in a storage medium (ROM/RAM, disk, optical disk) by a computing device, and in some cases, the steps shown or described may be performed in an order different from that herein, or They are fabricated as individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated into a single integrated circuit module. Therefore, the invention is not limited to any particular combination of hardware and software.
  • the server set in the terminal and the video conference server can accept the first connection initiated by the terminal, receive the registration message sent by the terminal through the first connection, and forward the registration message to the corresponding video conference server.
  • the conference invitation message sent by one of the terminal or the video conference server may be received and forwarded to the other party to establish a session between the terminal and the video conference server, and then the terminal may be accepted.
  • At least one connection initiated receiving each type of media stream sent by the terminal through the at least one connection, and converting and forwarding to the video conference server to implement the video conference.
  • the technical solution provided by the embodiment of the invention achieves the effect that the video conference server provides a port to the terminal, reduces the engineering complexity of the on-site deployment of the video conference system, reduces the security risk, and improves the user experience.

Abstract

本公开涉及一种视频会议系统中端口复用方法和服务器和计算机存储介质，可以利用设置在终端和视频会议服务器的服务器接受终端发起的第一连接，接收终端通过第一连接发送的注册消息，并将注册消息转发给对应的视频会议服务器，实现终端在视频会议服务器上的注册；之后，可以接收终端或视频会议服务器其中之一发送的入会邀请消息，将其转发给另一方，实现终端与视频会议服务器会话建立，之后，可以接受终端发起的至少一个连接，接收终端通过至少一个连接发送的各类型的媒体流，并转化后转发给视频会议服务器，实现视频会议。通过本公开，达到了视频会议服务器对终端提供一个端口的效果，降低了视频会议系统现场部署的工程复杂度，降低了安全隐患，提升了用户体验。

Description

一种视频会议系统中端口复用方法和服务器和计算机存储介质 技术领域
本公开涉及通信技术领域，具体涉及一种视频会议系统中端口复用方法和服务器和计算机存储介质。
背景技术
端口复用是指在建立多媒体会话过程中，视频会议服务器提供某一个或者多个固定的端口，在这些端口上和各个与会终端发送/接收音视频媒体流，最终实现视频会议业务功能，降低产品现场工程实施难度。
目前常见的端口复用解决方案：视频会议服务器通过开放端口地址范围，在不同端口接收/发送不同终端不同的媒体码流。但是该解决方案会导致客户的网络设备需要开放较多端口，存在安全隐患，同时还增加系统工程实施复杂度，增加成本。
传统的H.323视频会议系统的端口复用方案采用H.460协议，视频会议系统提供注册、呼叫和会议控制等几个固定的信令端口，所有终端都在视频会议服务器指定端口上注册，建立呼叫连接，建立会议控制连接。同时指定媒体端口；在信令交互过程中，视频会议服务器为连接的终端设备分配复用ID，发送媒体流的终端设备把复用ID填写到待发送的RTP(Realtime Transport Protocol)实时传输协议)包的头域部分，接受媒体流的终端设备依据复用ID区分发送终端或终端对应的媒体流，替代传统方案中的通过IP端口确定终端和终端对应媒体流的功能。
现有技术中，基于互联网发展的SIP(Session Initiation Protocol，会话初始化协议)视频会议系统，其SIP协议本身定义了终端注册、呼叫和会议控制的信令端口，实现了信令部分端口复用；但是对于媒体部分并没有考虑，目前也没有统一的解决方案，所以，企业网现场还是具有多端口问题，存在安全隐患。
发明内容
本发明实施例提供一种视频会议系统中端口复用方法和服务器，解决现有技术中对于视频会议系统中传输媒体的端口未实现复用导致的视频会议系统存在多端口、安全隐患以及部署复杂度高、成本高的问题。
本发明实施例提供一种视频会议系统中端口复用方法，包括：
接受终端发起的第一连接；
接收终端通过第一连接发送的注册消息，并将其转换为视频会议服务器可识别的格式后，发送给对应的视频会议服务器，以便视频会议服务器根据注册消息完成终端的注册；
接收邀请端发送的入会邀请消息并进行转换，将转换后的入会邀请消息发送给响应端，以便响应端响应入会邀请消息，建立与邀请端的会话；其中，邀请端为终端和视频会议其中之一，响应端为另一个；
接受终端发起的其他至少一个连接；
接收终端通过至少一个连接发送的各路媒体流，将各路媒体流转换为视频会议服务器可识别的格式后，发送给视频会议服务器。
本发明实施例还提供一种服务器，包括：
接收模块，用于接受终端发起的第一连接，接收终端通过第一连接发送的注册消息；接收邀请端发送的入会邀请消息并进行转换；邀请端为终端和终端对应的视频会议服务器其中之一；接受终端发起的其他至少一个连接；接收终端通过其他至少一个连接发送的各路媒体流；
处理模块，用于将终端发送的注册消息转换为视频会议服务器可识别的格式；对入会邀请消息进行转换；将终端通过其他至少一个连接发送的各路媒体流转换为视频会议服务器可识别的格式；
发送模块，用于将转换后的注册消息发送给对应的视频会议服务器，以便视频会议服务器根据注册消息完成终端的注册；将转换后的入会邀请消息发送给响应端，响应端为终端和终端对应的视频会议服务器中的另一个，以便响应端响应入会邀请消息，建立与邀请端的会话；将转换后的各路媒体流发送给视频会议服务器。
本发明实施例还提供一种计算机存储介质，所述计算机存储介质中存储有计算机可执行的一个或多个程序，所述一个或多个程序被所述计算机执行时使所述计算机执行前述方法。
本发明实施例公开了一种视频会议系统中端口复用方法和服务器，可以利用设置在终端和视频会议服务器的服务器接受终端发起的第一连接，接收终端通过第一连接发送的注册消息，并将注册消息转发给对应的视频会议服务器，实现终端在视频会议 服务器上的注册；之后，可以接收终端或视频会议服务器其中之一发送的入会邀请消息，将其转发给另一方，实现终端与视频会议服务器会话建立，之后，可以接受终端发起的至少一个连接，接收终端通过至少一个连接发送的各类型的媒体流，并转化后转发给视频会议服务器，实现视频会议。通过本发明，达到了视频会议服务器对终端提供一个端口的效果，降低了视频会议系统现场部署的工程复杂度，降低了安全隐患，提升了用户体验。
附图说明
图1为本发明实施例一提供的一种视频会议系统的端口复用方法的流程图；
图2为本发明实施例二提供的另一种视频会议系统的端口复用方法的流程图；
图3为本发明实施例三提供的一种服务器的模块示意图。
具体实施方式
下面通过具体实施方式结合附图对本发明作进一步详细说明。
实施例一：
参见图1，本实施例提供一种视频会议系统中端口复用方法，可以在视频服务器和终端之间进行信令的传输和媒体流的传输，对于终端而言，可以建立与服务器的第一连接，通过服务器向视频会议服务器进行注册，然后通过与服务器建立的第一连接，实现与视频会议服务器的会话建立过程，之后，服务器可以接收终发起的其他连接，并在建立连接后，接收终端通过各连接发送的各媒体流，并将接收的各媒体流转换为视频会议服务器可识别的格式后转发给视频会议服务器，由此，本实施例中视频会议服务器相当于对终端提供了一个端口，在实施视频会议系统时，可以降低施工难度和成本。本实施例的视频会议系统中端口复用方法包括：
S101、接受终端发起的第一连接；
S102、接收终端通过第一连接发送的注册消息，并将其转换为视频会议服务器可识别的格式后，发送给对应的视频会议服务器，以便视频会议服务器根据注册消息完成终端的注册；
S103、接收邀请端发送的入会邀请消息并进行转换，将转换后的入会邀请消息发 送给响应端，以便响应端响应入会邀请消息，建立与邀请端的会话；其中，邀请端为终端和视频会议服务器其中之一，响应端为另一个；
S104、接受终端发起的其他至少一个连接；
S105、接收终端通过至少一个连接发送的各路媒体流，将各路媒体流转换为视频会议服务器可识别的格式后，发送给视频会议服务器。
在本实施例中，终端是具有视频和音频采集功能的电子设备，包括但不限于手机、电脑、平板。S101中，第一连接是为了实现终端与视频会议服务器的会话创建而发起的。
优选的，在本实施例中，终端发起的包括第一连接在内的连接都属于websocket连接。终端每次发起的连接都是在采用websocket协议基础上发起的。上述的S101-S105均可以由逻辑设备-服务器实现，该服务器也是采用websocket协议向终端提供接口，建立与终端的各个websocket连接。
S101中，终端发起第一连接的方式可以是发送连接请求，服务器接收连接请求并响应，完成接受第一连接请求的过程。在接受连接后，终端与服务器之间建立了双向通道，可以通过该第一连接双向传输信息。在本实施例中，第一连接上传输的信息是为了实现终端与视频会议服务器之间的会话创建等功能，在第一连接建立后，终端可以通过第一连接发送注册消息给服务器，在服务器侧，可以进行S102的步骤，其中，可以理解的是会话的创建过程一般是基于SIP(Session Initiation Protocol，会话初始化协议)协议实现的，所以S102、S103中，终端和服务器之间通过第一连接基于SIP协议传输数据。所以对于终端而言，在打包注册消息时是依据自身原有的SIP方法进行，对于服务器而言，需要解析打包注册消息，确定注册消息的源端-发送消息的终端和目的端-对应的视频会议服务器，并且还需要将该注册消息处理为视频会议服务器可以识别的SIP消息，发送给视频会议服务器。可以理解的是服务器与视频会议服务器之间也是需要建立连接实现注册消息等信息的传输的。其中，向视频会议服务器传输数据可以是基于RTP/RTCP(实时传输控制协议(Real Time Control Protocol)协议实现。
可以预见，在本实施例中，在服务器上一般会有多个终端各自建立多个连接，所以S102中，不止会接收到第一连接发送的注册消息，可能还会接收到其他终端通过其他连接发送的消息。为了将终端通过连接发送的数据和终端正确对应，需要能确定 连接和终端对应关系的信息，该信息最好由终端在通过连接发送信息时，写入对应的发送信息中。该信息可以是终端的身份信息，包括但不限于终端号码、终端IMEI号、IP地址等等。例如终端与服务器建立了三个连接，可以在三个连接上发送的数据中分别写入自身的终端号码，服务器接收数据后，根据数据中携带的终端号码确定各连接对应的终端，保存该对应关系，在需要的时候，即可使用该对应关系确定连接对应的终端。
可以预见，若是采用在通过连接传输的信息中写入终端身份信息的方式确定连接与终端的对应关系，服务器需要对信息进行解析，从复杂的信息中分析出终端身份信息，无疑会加大服务器的分析工作，增加服务器的负担，为此，优选地，终端可以在服务器接受连接后，通过已建立的连接，向服务器发送特殊信令。该特殊信息可以用来设置传输该特殊信令的连接所对应终端的身份信息。也即在S101中接受第一连接后，可以接收终端通过第一连接发送的特殊信令，根据特殊信令设置第一连接与终端的对应关系，并保存该对应关系。
在S102之后，视频会议服务器接收到注册消息，可以理解，若S101之后，在注册消息中必定包含了注册需要的终端的身份信息，才能使得视频会议服务器对不同的终端进行分辨。所以，对终端进行了注册后，在视频会议服务器上已经存在终端的身份信息。
在S103中，可以实现终端与视频会议服务器之间的会话建立。在本实施例中，终端与视频会议服务器会话的建立包括两种方式，一种是由视频会议服务器主动发起的上呼流程建立会话方法，另一种是由终端主动发起的下呼流程建立会话方法。
第一种方式的过程包括：
1、接收视频会议服务器发送的入会邀请消息；其中入会邀请消息是用来邀请对应终端的消息，可以预见，该入会邀请消息中携带有邀请对象的身份信息，考虑到在接收到各连接传输的特殊信令后，各连接和终端身份信息的对应关系可以确定，根据入会邀请消息中终端的身份信息以及各连接和终端身份信息的对应关系可以确定入会邀请消息需要发送的对象，以及具体通过已建立的哪个连接进行传输。
2、根据第一连接对应的终端的身份信息，将入会邀请消息通过第一连接发送给终端，以便终端进行响应，建立会话，完成终端和视频会议服务器的媒体能力协商；
第二种方式的过程包括：
1、接收终端发送的入会邀请消息，入会邀请消息中可以携带视频会议服务器的身份信息，便于根据该身份信息确定入会邀请消息的转发目的端。
2、将入会邀请消息处理为会话初始化协议(SIP，Session Initiation Protocol)消息，并根据对应的路由规则(SIP路由规则)将其(处理后的会话初始化协议消息)转发到视频会议服务器，以便视频会议服务器进行响应，建立会话，完成终端和视频会议服务器的媒体能力协商；
在上述的过程中，呼叫会话建立完成。在会话建立的过程中，终端和视频服务器会进行媒体能力的协商，通过服务器的中间转发作用，对音视频格式、音视频编解码算法、带宽参数等媒体能力进行协商。
呼叫会话建立完成后，还需要向服务器发起多个连接传输不同类型的媒体流，所以在本实施例的步骤S104，需要接受终端发起的至少一个连接，该连接属于websocket连接。一般终端发起的连接个数与终端需要发送的媒体流(音频媒体流、视频媒体流、第二路视频媒体流)的类型的个数是对应的，例如终端需要发送一路音频媒体流、一路视频媒体流，则在S104中，具体是接受终端发起的两个连接。在S105中包括接收终端通过S104中建立的两个连接发送的分别发送的视频媒体流和音频媒体流。
可以预见，接收到终端侧发送的媒体流数据后，为了使得视频会议服务器可以使用，还需要对接收的媒体流数据按照协议进行转换，鉴于一般服务器与视频会议服务器采用RTP/RTCP协议，本实施例中，S105中将各路媒体流转换为视频会议服务器可识别的格式包括：将媒体流数据处理为满足RTP/RTCP协议格式的数据。
在本实施例中，会完成终端侧信令数据和视频会议服务器侧信令数据差异转换；媒体会话过程中，完成终端侧媒体数据和视频会议服务器侧媒体数据差异转换。其中，在媒体流数据的转换过程中，由于存在视频媒体流和音频媒体流等类型，需要对接收到的媒体流进行解包分析，然后再进行重打包，对每一个媒体流都进行解包分析确定媒体流类型无疑会增加解包分析过程的复杂度。
为了降低服务器转发终端的媒体数据流之前的对数据的解包分析过程，需要确定对每一路连接传输的媒体流数据的类型，鉴于此，本实施例可以利用特殊信令设置每一连接承载的数据类型。具体的，可以在特殊信令中写入传输特殊信令的连接承载的数据类型。例如，在第一连接传输的特殊信令写入数据类型为信令数据，在传输音频媒体流的连接对应的特殊信令中写入数据类型为音频媒体流数据。
优选的，特殊信令包括在协议标准头外自定义的两个字段，分别用于描述对应连接的终端号码和对应连接承载的数据类型。
特殊信令的结构如下图所示：
Figure PCTCN2017102111-appb-000001
所以，本实施例的特殊信令还可以用来设置传输该信令的连接承载的数据类型，可以预见，终端需要传输多少类型的媒体流，其他至少一个连接的数量就为多少，也即S104中，其他至少一个连接的数量由终端欲发送的媒体流的类型个数确定。
可以预见，实现本实施例的服务器是逻辑设备，在实际应用组网或者产品化的时候，可以与视频会议服务器的设备合设，当然，也可以是单独设置。本实施例对服务器的具体形态不作限制。
在本实施例中，服务器可以按照产品需求定义，只实施信令层的端口复用或者实时信令媒体端口的复用，对此，本发明不作限制。
在本实施例中，可以由终端自行发起连接的拆除和会话的注销，也可以由服务器检测并实现连接的拆除和会话的注销。
由终端自行发起的方法包括：接收终端通过第一连接发送的注销会话请求，之后，拆除与终端已建立的连接，并控制视频会议服务器注销终端的会话。若终端建立的会话有多个，则根据注销会话请求中携带的会话信息，注销正确的会话。
由服务器主动拆除的方法包括；通过连接心跳检查确定终端是否需要拆除已建立的连接，若需要，则拆除终端的连接，同时在视频会议服务器上注销终端的账号。其中，连接心跳检查可以帮助确定连接是否异常，在连接异常时(如，很久未有数据传输)判断该连接需要被拆除。
采用本实施例，可以与终端建立不同的连接，接收终端通过各连接发送的数据，并转发给对应的视频会议服务器，本实施例中，视频会议服务器相当于通过一个端口对终端提供服务，达到了视频会议服务器对外提供一个复用端口的效果，有效地降低了视频会议系统与现场部署的工程复杂度，解决了工程现场防火墙和NAT穿越问题，还能避免互联网上信令丢包问题，使得本实施例的方法具有较强的综合竞争力。
实施例二：
参见图2，本实施例示出了一种视频会议系统的端口复用方法，在本实施例中，包括了四个过程，建立终端与服务器的连接，通过服务器实现终端在视频会议服务器上的注册、终端与视频会议服务器之间的会话建立、终端向视频会议服务器传输媒体流数据，本实施例的方法具体包括：
S201、终端发起建立和服务器的websocket连接；
S202、终端在该连接之上发送特殊信令，携带终端号码和连接承载的数据类型定义；
S203、服务器接收特殊信令，把终端号码和该连接建立匹配关系；
S204、终端把打包好的SIP注册消息，通过此连接发送到服务器；
S205、服务器把SIP注册消息按照SIP路由规则处理转发给视频会议服务器；
S206、视频会议服务器收到一个普通的SIP注册消息，按照正常处理流程完成注册流程
S207、视频会议服务器把入会邀请消息通过SIP方法下呼服务器；
S208、服务器按照终端号码和连接的匹配关系，找到对应的连接，通过该连接把入会邀请消息发送给终端；其中，服务器需要依据终端号码和连接的匹配关系，来完 成入会邀请消息的协议转换工作。
S209、终端接收入会邀请消息，按照正常的呼叫会话流程完成会话的建立。
其中，终端入会后，已经完成了各个媒体能力协商，准备发送音视频媒体了(本实施例按照一路音频，一路视频为例说明)。
S210、终端按照协商结果，和服务器建立两个连接；
S211、终端通过两个连接分别向视频会议服务器发送特殊信令，设置这两个连接的属性，包括终端号码和数据类型；
S212、终端在各个连接上发送指定数据；
S213、服务器接收各连接的数据，进行协议转换后，进行适配转发。
采用本实施例，终端与服务器之间可以通过一个端口进行信令数据和媒体流数据的传输，达到了视频会议服务器对外提供一个端口的效果，降低了视频会议系统现场部署的工程复杂度；降低了部署成本，还能避免互联网上呼叫信令丢包问题，提升产品解决方案的综合竞争力。
实施例三：
参见图3，本实施例示出一种服务器，包括：接收模块31，用于接受终端发起的第一连接，接收终端通过第一连接发送的注册消息；接收邀请端发送的入会邀请消息并进行转换；邀请端为终端和终端对应的视频会议服务器其中之一；接受终端发起的其他至少一个连接；接收终端通过其他至少一个连接发送的各路媒体流；
处理模块32，用于将终端发送的注册消息转换为视频会议服务器可识别的格式；对入会邀请消息进行转换；将终端通过其他至少一个连接发送的各路媒体流转换为视频会议服务器可识别的格式；
发送模块33，用于将转换后的注册消息发送给对应的视频会议服务器，以便视频会议服务器根据注册消息完成终端的注册；将转换后的入会邀请消息发送给响应端，响应端为终端和终端对应的视频会议服务器中的另一个，以便响应端响应入会邀请消息，建立与邀请端的会话；将转换后的各路媒体流发送给视频会议服务器。
在实施例中，发送模块33和接收模块31可以由天线以及与天线配合的硬件模块实现。处理模块32可以由实际的处理器实现。
其中，在视频会议完成后，需要拆除连接，并注销会话，以便节约服务器资源， 注销会话可以由终端主动发起，也可以由本实施例的服务器实现。为了由服务器主动实现，本实施例的服务器还包括检测模块34，检测模块34用于通过连接心跳检查确定终端是否需要拆除已建立的连接；处理模块32用于需要拆除已建立的连接时，对与终端的连接进行拆除，并控制视频会议服务器注销终端的账号。
由终端主动发起注销时，接收模块31还用于接收终端发送的注销会话请求；处理模块33用于根据注销会话请求拆除与终端已建立的连接，并控制视频会议服务器注销终端的会话。
可以预见，在本实施例中，在服务器上一般会有多个终端各自建立多个连接，所以服务器不止会接收到第一连接发送的注册消息，可能还会接收到其他终端通过其他连接发送的消息。为了将终端通过连接发送的数据和终端正确对应，需要能确定连接和终端对应关系的信息，该信息最好由终端在通过连接发送信息时，写入对应的发送信息中。该信息可以是终端的身份信息，包括但不限于终端号码、终端IMEI号、IP地址等等。例如终端与服务器建立了三个连接，可以在三个连接上发送的数据中分别写入自身的终端号码，服务器接收数据后，根据数据中携带的终端号码确定各连接对应的终端，保存该对应关系，在需要的时候，即可使用该对应关系确定连接对应的终端。
可以预见，若是采用在通过连接传输的信息中写入终端身份信息的方式确定连接与终端的对应关系，服务器需要对信息进行解析，从复杂的信息中分析出终端身份信息，无疑会加大服务器的分析工作，增加服务器的负担，为此，优选地，终端可以在服务器接受连接后，通过已建立的连接，向服务器发送特殊信令。该特殊信息可以用来设置传输该特殊信令的连接所对应终端的身份信息。
所以，本实施例的接收模块31，还用于在处理模块33接受终端发起的每个连接后，接收该终端通过连接发送的特殊信令；特殊信令用于设置传输特殊信令的连接所对应终端的身份信息。
在本实施例中，终端与视频会议服务器会话的建立也包括两种方式，一种是由视频会议服务器主动发起的上呼流程建立会话方法，另一种是由终端主动发起的下呼流程建立会话方法。
在第一种方法中：接收模块31，用于通过第一连接接收终端发送的入会邀请消息；
处理模块32，用于将入会邀请消息处理为会话初始化协议消息；
发送模块33，用于根据对应的路由规则将会话初始化协议消息转发到视频会议服务器，以便视频会议服务器进行响应，建立会话，完成终端和视频会议服务器的媒体能力协商；
在第二种方法中，接收模块31，用于接收视频会议服务器的入会邀请消息；
处理模块32，用于根据第一连接对应的终端的身份信息确定接收入会邀请消息的终端；
发送模块33，用于将将入会邀请消息通过第一连接发送给处理模块确定的终端，以便终端进行响应，建立会话，完成终端和视频会议服务器的媒体能力协商。
其中，媒体能力包括但不限于音视频格式、音视频编解码算法、带宽参数。
为了降低服务器转发终端的媒体数据流之前的对数据的解包分析过程，需要确定对每一路连接传输的媒体流数据的类型，鉴于此，可以利用特殊信令设置每一连接承载的数据类型。具体的，可以在特殊信令中写入传输特殊信令的连接承载的数据类型。例如，在第一连接传输的特殊信令写入数据类型为信令数据，在传输音频媒体流的连接对应的特殊信令中写入数据类型为音频媒体流数据。
优选的，特殊信令包括在协议标准头外自定义的两个字段，分别用于描述对应连接的终端号码和对应连接承载的数据类型。特殊信令的结构参见实施例一。
可以预见，本实施例的服务器是逻辑设备，在实际应用组网或者产品化的时候，可以与视频会议服务器的设备合设，当然，也可以是单独设置。本实施例对服务器的具体形态不作限制。
采用本实施例，可以在终端和视频会议服务器之间增设一个逻辑设备服务器，解决了现有技术中，基于SIP视频会议系统只考虑信令端口复用的缺点，达到了视频会议服务器对外提供一个端口的效果，降低了视频会议系统现场部署的工程复杂度；解决了工程现场防火墙和NAT(Network Address Translation，网络地址转换)穿越问题，还能避免互联网上呼叫信令丢包问题，提升产品解决方案的综合竞争力。
显然，本领域的技术人员应该明白，上述本发明实施例中的各模块或各步骤可以用通用的计算装置来实现，它们可以集中在单个的计算装置上，或者分布在多个计算装置所组成的网络上，可选地，它们可以用计算装置可执行的程序代码来实现，从而， 可以将它们存储在存储介质(ROM/RAM、磁碟、光盘)中由计算装置来执行，并且在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤，或者将它们分别制作成各个集成电路模块，或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。所以，本发明不限制于任何特定的硬件和软件结合。
以上内容是结合具体的实施方式对本发明所作的进一步详细说明，不能认定本发明的具体实施只局限于这些说明。对于本发明所属技术领域的普通技术人员来说，在不脱离本发明构思的前提下，还可以做出若干简单推演或替换，都应当视为属于本发明的保护范围。
工业实用性
本发明实施例提供的技术方案可以应用于通信技术领域。本发明实施例的技术方案中，可以利用设置在终端和视频会议服务器的服务器接受终端发起的第一连接，接收终端通过第一连接发送的注册消息，并将注册消息转发给对应的视频会议服务器，实现终端在视频会议服务器上的注册；之后，可以接收终端或视频会议服务器其中之一发送的入会邀请消息，将其转发给另一方，实现终端与视频会议服务器会话建立，之后，可以接受终端发起的至少一个连接，接收终端通过至少一个连接发送的各类型的媒体流，并转化后转发给视频会议服务器，实现视频会议。通过本发明实施例提供的技术方案，达到了视频会议服务器对终端提供一个端口的效果，降低了视频会议系统现场部署的工程复杂度，降低了安全隐患，提升了用户体验。

Claims (11)

  1. 一种视频会议系统中端口复用方法，包括：
    接受终端发起的第一连接；
    接收所述终端通过所述第一连接发送的注册消息，并将其转换为视频会议服务器可识别的格式后，发送给对应的视频会议服务器，以便所述视频会议服务器根据所述注册消息完成所述终端的注册；
    接收邀请端发送的入会邀请消息并进行转换，将转换后的入会邀请消息发送给响应端，以便所述响应端响应所述入会邀请消息，建立与所述邀请端的会话；其中，所述邀请端为所述终端和所述视频会议服务器其中之一，所述响应端为另一个；
    接受所述终端发起的其他至少一个连接；
    接收所述终端通过所述至少一个连接发送的各路媒体流，将所述各路媒体流转换为视频会议服务器可识别的格式后，发送给所述视频会议服务器。
  2. 如权利要求1所述的视频会议系统中端口复用方法，其中，还包括：
    通过连接心跳检查确定所述终端是否需要拆除已建立的连接，若需要，则拆除所述终端已建立的连接，并控制所述视频会议服务器注销所述终端的会话；
    或者，接收所述终端发送的注销会话请求；
    拆除与所述终端已建立的连接，并控制所述视频会议服务器注销所述终端的会话。
  3. 如权利要求1或2所述的视频会议系统中的端口复用方法，其中，在接受所述终端发起的每个连接后，还包括：接收所述终端通过所述连接发送的特殊信令；所述特殊信令用于设置传输所述特殊信令的连接所对应终端的身份信息。
  4. 如权利要求3所述的视频会议系统中端口复用方法，其中，所述接收邀请端发送的入会邀请消息并进行转换，将转换后的入会邀请消息发送给响应端，以便所述响应端响应所述入会邀请消息，建立与所述邀请端的会话；其中，所述邀请端为所述终端和所述视频会议服务器其中之一，所述响应端为另一个包括：
    通过所述第一连接接收所述终端发送的入会邀请消息；
    将所述入会邀请消息处理为会话初始化协议消息，并根据对应的路由规则将其转发到视频会议服务器，以便所述视频会议服务器进行响应，建立与所述终端的会 话，完成所述终端和所述视频会议服务器的媒体能力协商；
    或者接收所述视频会议服务器的入会邀请消息；
    根据所述第一连接对应的终端的身份信息，将所述入会邀请消息通过所述第一连接发送给所述终端，以便所述终端进行响应，建立与所述视频会议服务器的会话，完成所述终端和所述视频会议服务器的媒体能力协商。
  5. 如权利要求3所述的视频会议系统中端口复用方法，其中，所述特殊信令在协议标准包头外，定义两个字段，用于描述传输所述特殊信令的连接对应的终端身份信息和承载的数据类型。
  6. 一种服务器，包括：
    接收模块，设置为接受终端发起的第一连接，接收所述终端通过所述第一连接发送的注册消息；接收邀请端发送的入会邀请消息并进行转换；所述邀请端为所述终端和所述终端对应的视频会议服务器其中之一；接受所述终端发起的其他至少一个连接；接收所述终端通过其他至少一个连接发送的各路媒体流；
    处理模块，设置为将所述终端发送的注册消息转换为视频会议服务器可识别的格式；对所述入会邀请消息进行转换；将所述终端通过其他至少一个连接发送的各路媒体流转换为视频会议服务器可识别的格式；
    发送模块，设置为将转换后的注册消息发送给对应的视频会议服务器，以便所述视频会议服务器根据所述注册消息完成所述终端的注册；将转换后的入会邀请消息发送给响应端，所述响应端为所述终端和所述终端对应的视频会议服务器中的另一个，以便所述响应端响应入会邀请消息，建立与所述邀请端的会话；将转换后的所述各路媒体流发送给所述视频会议服务器。
  7. 如权利要求6所述的服务器，其中，还包括检测模块，所述检测模块设置为通过连接心跳检查确定所述终端是否需要拆除已建立的连接；所述处理模块设置为需要拆除已建立的连接时，对与所述终端的连接进行拆除，并控制所述视频会议服务器注销所述终端的会话；
    或者，所述接收模块还设置为接收所述终端发送的注销会话请求；所述处理模块设置为根据所述注销会话请求拆除与所述终端已建立的连接，并控制所述视频会议服务器注销所述终端的会话。
  8. 如权利要求6或7所述的服务器，其中，所述接收模块，还设置为在所述处 理模块接受所述终端发起的每个连接后，接收所述终端通过所述连接发送的特殊信令；所述特殊信令用于设置传输所述特殊信令的连接所对应终端的身份信息。
  9. 如权利要求8所述的服务器，其中，所述接收模块，设置为通过所述第一连接接收所述终端发送的入会邀请消息；
    所述处理模块，设置为将所述入会邀请消息处理为会话初始化协议消息；
    所述发送模块，设置为根据对应的路由规则将所述会话初始化协议消息转发到视频会议服务器，以便所述视频会议服务器进行响应，建立与所述终端会话，完成所述终端和所述视频会议服务器的媒体能力协商；
    或者，所述接收模块，设置为接收所述视频会议服务器的入会邀请消息；
    所述处理模块设置为根据所述第一连接对应的终端的身份信息确定接收所述入会邀请消息的终端；
    所述发送模块，设置为将所述入会邀请消息通过所述第一连接发送给所述处理模块确定的终端，以便所述终端进行响应，建立与所述视频会议服务器会话，完成所述终端和所述视频会议服务器的媒体能力协商。
  10. 如权利要求8所述的服务器，其中，所述特殊信令在协议标准包头外，定义两个字段，用于描述传输所述特殊信令的连接对应的终端身份信息和承载的数据类型。
  11. 一种计算机存储介质，所述计算机存储介质中存储有计算机可执行的一个或多个程序，所述一个或多个程序被所述计算机执行时使所述计算机执行如根据权利要求1-5中任一项所述的方法。
PCT/CN2017/102111 2016-09-18 2017-09-18 一种视频会议系统中端口复用方法和服务器和计算机存储介质 WO2018050116A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP17850317.3A EP3515032B1 (en) 2016-09-18 2017-09-18 Port multiplexing method and server in video conference system and computer storage medium
RU2019107805A RU2740305C9 (ru) 2016-09-18 2017-09-18 Способ мультиплексирования порта и сервер в системе видеоконференций и машиночитаемый носитель информации

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610828557.3 2016-09-18
CN201610828557.3A CN107846379B (zh) 2016-09-18 2016-09-18 一种视频会议系统中端口复用方法和服务器

Publications (2)

Publication Number Publication Date
WO2018050116A1 true WO2018050116A1 (zh) 2018-03-22
WO2018050116A9 WO2018050116A9 (zh) 2018-04-12

Family

ID=61619339

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/102111 WO2018050116A1 (zh) 2016-09-18 2017-09-18 一种视频会议系统中端口复用方法和服务器和计算机存储介质

Country Status (4)

Country Link
EP (1) EP3515032B1 (zh)
CN (1) CN107846379B (zh)
RU (1) RU2740305C9 (zh)
WO (1) WO2018050116A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113676694A (zh) * 2021-08-23 2021-11-19 京东方科技集团股份有限公司 会议一体化系统、网关、无线终端及工作状态切换方法
CN114554129A (zh) * 2020-11-25 2022-05-27 北京字节跳动网络技术有限公司 一种连麦系统、方法、装置、设备及存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110798651A (zh) * 2019-10-16 2020-02-14 平安科技（深圳）有限公司 视频会议方法、装置、设备及存储介质
CN115484469B (zh) * 2021-06-15 2024-01-09 北京字节跳动网络技术有限公司 一种连麦系统、方法、装置、设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003259323A (ja) * 2002-02-26 2003-09-12 Megafusion Corp テレビ会議システムおよび方法、並びに表計算データ共有装置およびシステム
CN1921403A (zh) * 2006-09-02 2007-02-28 华为技术有限公司 Sip终端进行会议控制的方法及信息转换装置
CN101986696A (zh) * 2010-11-30 2011-03-16 上海华平信息技术股份有限公司 信息中转设备及视频会议系统
US20120163577A1 (en) * 2010-12-27 2012-06-28 Avaya Inc. Method and system for automatic conference call session migration
CN102868837A (zh) * 2012-09-27 2013-01-09 深圳中兴网信科技有限公司 电话会议控制系统和电话会议控制方法
CN103457746A (zh) * 2012-06-05 2013-12-18 中兴通讯股份有限公司 会议数据的传输方法及装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050076128A1 (en) * 2003-09-24 2005-04-07 Mingtar Tsai Method to allow voice, video and data conference with minimum bandwidth consumption between two or more geological locations and achieve quality of service (QoS) and scalability
CN100440968C (zh) * 2004-04-09 2008-12-03 华为技术有限公司 一种点播流媒体信息的系统及其实现方法
US7176957B2 (en) * 2004-05-25 2007-02-13 Seiko Epson Corporation Local video loopback method for a multi-participant conference system using a back-channel video interface
US8064580B1 (en) * 2004-09-03 2011-11-22 Confinement Telephony Technology, Llc Telephony system and method with improved fraud control
RU2321183C2 (ru) * 2005-12-23 2008-03-27 Григорий Гемфриевич Дмитриев Способ и система осуществления видеоконференций
CN101222290B (zh) * 2007-11-09 2013-01-02 北京创毅视讯科技有限公司 一种广播系统中的数据传输方法、发射系统和终端
US9087080B2 (en) * 2009-10-14 2015-07-21 Trice Imaging, Inc. Systems and methods for converting and delivering medical images to mobile devices and remote communications systems
CN102547144A (zh) * 2012-02-28 2012-07-04 深圳市诺威达科技有限公司 一种支持多路视频信号切换的装置和系统
US9467480B2 (en) * 2013-09-16 2016-10-11 Qualcomm Incorporated Selectively multiplexing incoming WebRTC traffic and/or de-multiplexing outgoing WebRTC traffic by a client-based WebRTC proxy on behalf of a WebRTC multimedia client application
KR102105641B1 (ko) * 2014-04-04 2020-04-29 한국전자통신연구원 분산형 텔레프레즌스 플랫폼에서 영상 회의를 지원하는 방법 및 시스템
CN104836811A (zh) * 2015-05-26 2015-08-12 武汉兴图新科电子股份有限公司 一种保持传输数据完整的通信端口复用方法
CN105262744B (zh) * 2015-10-10 2018-06-01 北京佳讯飞鸿电气股份有限公司 一种多媒体调度系统中实现媒体端口复用的方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003259323A (ja) * 2002-02-26 2003-09-12 Megafusion Corp テレビ会議システムおよび方法、並びに表計算データ共有装置およびシステム
CN1921403A (zh) * 2006-09-02 2007-02-28 华为技术有限公司 Sip终端进行会议控制的方法及信息转换装置
CN101986696A (zh) * 2010-11-30 2011-03-16 上海华平信息技术股份有限公司 信息中转设备及视频会议系统
US20120163577A1 (en) * 2010-12-27 2012-06-28 Avaya Inc. Method and system for automatic conference call session migration
CN103457746A (zh) * 2012-06-05 2013-12-18 中兴通讯股份有限公司 会议数据的传输方法及装置
CN102868837A (zh) * 2012-09-27 2013-01-09 深圳中兴网信科技有限公司 电话会议控制系统和电话会议控制方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3515032A4 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114554129A (zh) * 2020-11-25 2022-05-27 北京字节跳动网络技术有限公司 一种连麦系统、方法、装置、设备及存储介质
CN114554129B (zh) * 2020-11-25 2023-10-31 北京字节跳动网络技术有限公司 一种连麦系统、方法、装置、设备及存储介质
CN113676694A (zh) * 2021-08-23 2021-11-19 京东方科技集团股份有限公司 会议一体化系统、网关、无线终端及工作状态切换方法
CN113676694B (zh) * 2021-08-23 2022-12-20 京东方科技集团股份有限公司 会议一体化系统、网关、无线终端及工作状态切换方法

Also Published As

Publication number Publication date
EP3515032B1 (en) 2021-09-15
RU2740305C2 (ru) 2021-01-13
CN107846379A (zh) 2018-03-27
EP3515032A1 (en) 2019-07-24
EP3515032A4 (en) 2019-07-24
CN107846379B (zh) 2021-09-07
WO2018050116A9 (zh) 2018-04-12
RU2740305C9 (ru) 2021-06-18
RU2019107805A (ru) 2020-09-25
RU2019107805A3 (zh) 2020-11-10

Similar Documents

Publication Publication Date Title
US11108570B2 (en) Method and apparatus for multimedia communication, and storage medium
EP3552364B1 (en) Conferencing server
US9602553B2 (en) Method, apparatus, and system for implementing VOIP call in cloud computing environment
US9282125B2 (en) Apparatus and method for communications involving a legacy device
CN106850399B (zh) 一种基于WebRTC技术即时消息的通信方法
WO2018050116A1 (zh) 一种视频会议系统中端口复用方法和服务器和计算机存储介质
US8767590B2 (en) Multimedia conference system and method which enables communication between private network and internet
EP3145129B1 (en) Method and gateway for communication between browser and telecommunication network
US20050066038A1 (en) Session control system, communication terminal and servers
WO2007036160A1 (fr) Appareil, systeme et procede assurant la communication entre un client et un serveur
CN107612931B (zh) 多点会话方法及多点会话系统
CN108881149B (zh) 一种可视电话设备的接入方法和系统
US20130007291A1 (en) MEDIA INTERWORKING IN IPv4 AND IPv6 SYSTEMS
WO2019184262A1 (zh) 多类型媒体数据网络地址转换穿越方法、终端及系统
JP3698698B2 (ja) Ｄｍｚを介したイントラネットおよび外部ネットワーク上の呼の確立
WO2010020169A1 (zh) 一种媒体旁路的方法、系统和装置
US20140337478A1 (en) Peer-to-peer network communications
US10091255B2 (en) Local control of additional media session for a packet based call
US8879538B2 (en) Method and gateway for connecting IP communication entities via a residential gateway
WO2019041332A1 (zh) 一种加速网络传输优化方法以及系统
WO2020098712A1 (zh) 数据传输通道的建立方法及设备、存储介质、系统
US8667149B2 (en) Communication device, communication method, and computer-readable storage medium storing communication program
CN106921624B (zh) 会话边界控制器及数据传输方法
CN114553567B (zh) 多方安全计算中的网络传输方法、系统、存储介质及计算设备
US20240098147A1 (en) Method and system for managing user interactions

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17850317

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2017850317

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2017850317

Country of ref document: EP

Effective date: 20190418