CN106559639B - Method and system for processing relay video of teleconference - Google Patents

Method and system for processing relay video of teleconference Download PDF

Info

Publication number
CN106559639B
CN106559639B CN201510630503.1A CN201510630503A CN106559639B CN 106559639 B CN106559639 B CN 106559639B CN 201510630503 A CN201510630503 A CN 201510630503A CN 106559639 B CN106559639 B CN 106559639B
Authority
CN
China
Prior art keywords
conference
video
conference server
user
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510630503.1A
Other languages
Chinese (zh)
Other versions
CN106559639A (en
Inventor
杨蕾
宋伟
朱业恒
海江
赵建华
徐晓峰
李夏宾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GRANDSTREAM NETWORK Inc
SHENZHEN GRANDSTREAM NETWORKS Inc
Original Assignee
GRANDSTREAM NETWORK Inc
SHENZHEN GRANDSTREAM NETWORKS Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GRANDSTREAM NETWORK Inc, SHENZHEN GRANDSTREAM NETWORKS Inc filed Critical GRANDSTREAM NETWORK Inc
Priority to CN201510630503.1A priority Critical patent/CN106559639B/en
Publication of CN106559639A publication Critical patent/CN106559639A/en
Application granted granted Critical
Publication of CN106559639B publication Critical patent/CN106559639B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention provides a relay video processing method for a telephone conference, which comprises at least one UA device with multimedia mixed processing capability and a plurality of conference-participating terminal UA users in a telephone conference system, wherein the UA device can carry out media interaction in a conference server, and the video processing method mainly comprises the following steps: step a: the UA user initiates a call to enter a telephone conference; step b: the conference server will inquire the media ability database stored in the database, judge whether the UA device has multimedia mixed processing ability in the local area network N of the UA user account, if yes, start the intra-office mixing conference mode, and the UA device will perform video compression processing according to the resolution information of each video stream sent by the conference server, thereby achieving the purpose of saving bandwidth.

Description

Method and system for processing relay video of teleconference
Technical Field
The invention belongs to the field of communication, and particularly relates to a video hybrid processing technology based on mobile communication equipment.
Background
With the development of the voip (voice over Internet protocol) technology, a video conference has a large market space, and the contradiction between the high definition and ultra-high definition video communication requirements and the bandwidth is increasingly sharp, so the invention provides a method for improving the video communication quality under the condition of limited bandwidth. At present, a conference server implemented based on the SIP (Session initiation protocol) standard can also be implemented based on a non-SIP structure, and the structure diagram is as follows: all the clients independently send RTP streams to the conference server, and the conference server decodes, codes and groups all the RTP streams to all persons in the conference. In this way, although the functions of the modules of the design mechanism are independent and clear, the requirement on the network bandwidth is higher, the characteristic that all UAs (User agents) in a private network are in the same network is not utilized, and the RTP is directly transferred to a conference server; too much pressure can be caused to the conference server; at present, SIP and other related standards do not provide a standard for optimizing and solving the problem, and the invention discloses a method for processing the conference call relay video to solve the problem.
Disclosure of Invention
The invention aims to provide a method for processing relay video of a teleconference, so that a terminal of the same private network can perform media interaction with a conference server through a terminal with video mixing capability.
A kind of telephone conference relay video processing method, in the telephone conference system, include at least one UA apparatus with multimedia mixed processing ability, and several conference-joining terminal UA users, this UA apparatus can carry on the media interaction in the office with the conference server, this video processing method mainly includes the following steps: step a: the UA user initiates a call to enter a telephone conference; step b: the conference server will inquire the media capability database stored in the database, and judge whether the UA device with multimedia hybrid processing capability exists in the local area network N of the UA user account. If the judgment result in the step b is yes, starting an intra-office mixing conference mode; and if the judgment result in the step b is negative, starting a common conference mode, namely carrying out multimedia mixing processing by the conference server. The method further includes the following steps in the local mixing conference mode: step c: the conference server modifies SDP information of the SIP signaling into UA equipment; step d: the UA user transfers and sends the RTP stream to the IP and the port of the UA device, and the UA device performs a first multimedia mixing process, namely, the mixing process generates an intra-office mixed RTP stream.
Preferably, in the video processing method for the teleconference, when the UA user and the UA device start or quit, the broadcast signaling in the local area network N carries the media capability information that the UA user has, and the other UA users in the local area network N record the media capability information and the SIP account of the UA user to generate the media capability data table.
Preferably, in the video processing method for the teleconference, when the UA user and the UA device are respectively registered to the conference server at intervals, the respective media capability information and the SIP account number are carried in the SIP registration signaling, and the conference server reads the media capability data table and stores the media capability data table in the database to generate the media capability database.
Preferably, in the video processing method for the teleconference, when the UA device exits the conference, the method further includes the following steps: judging whether other UA equipment with multimedia hybrid processing capability exists in the local area network N in the conference; if other UA equipment exists, the SDP content is renegotiated, and in the subsequent conference process, the other UA equipment carries out mixing processing; if no other UA device exists or the SDP negotiation with other UA device fails, the conference server will fill the media information of the conference server in the SDP content and re-enter the ordinary conference mode.
Preferably, in the video processing method for the teleconference, if the conference includes the UA user of the non-local area network N at the same time, the method further includes a second multimedia mixing process for generating a conference mixed RTP stream, that is, the conference server performs mixing processing on the intra-office mixed RTP stream and the media stream of the UA user in the non-local area network N; the conference mixed RTP stream may be forwarded by the UA device to a UA user of the local area network N.
Preferably, in the video processing method for the teleconference, if the intra-office audio mixing conference mode is adopted, the conference server judges whether the UA user and the UA device belong to the same conference; if not, the conference server sends a private message to the UA device, so that the UA device automatically generates a bridge to the conference server, and when the UA user sends the RTP stream to the UA device, the UA device uses the bridge to relay the RTP stream to the conference server.
Preferably, the video display of the conference is composed of a main video and a plurality of small window videos, the UA device performs video compression processing on the small window videos according to resolution information of each path of video stream sent by the conference server, and after the conference server receives the RTP streams subjected to the compression processing through the bridge, the conference server decodes each path of RTP streams subjected to the compression processing according to a preset video layout, and then encodes each path of video frames into new frame data again.
The present invention also provides a video processing system for a teleconference, comprising: the conference server, several UA users and at least one UA device, the UA device has multimedia mixed processing ability, the conference server mainly includes: the network service module is responsible for reading data of a media capability data table from a UA user during registration to perform recording and sorting so as to generate a media capability database; the media capability database is used for storing and recording UA users, lists of associated in-office SIP accounts and media information of the UA users, and SIP accounts and media capability information of the UA equipment; and the local media processing control module is used for controlling whether to start an internal audio mixing conference mode during the conference call, further modifying SDP information into the UA equipment, and controlling and sending resolution information of each path of video stream to the UA equipment.
Preferably, the conference server further comprises an SIP communication control module, configured to control and take over a conference call request from a UA user to the conference server, and analyze and process an SIP signaling in a conference process; the UA device can perform video compression processing on a small window video in a conference display according to resolution information of each path of video stream sent by a conference server, and after the conference server receives an RTP stream subjected to compression processing through the bridge connection, each path of RTP stream subjected to compression processing is decoded according to a preset video layout, and then each path of video frame is encoded into new frame data again.
In addition, the UA user mainly includes the following functional units: the media capability data table comprises SIP accounts of all other UA users and UA equipment in the UA user SIP account bureau and corresponding media capability information; and the media transmission control unit is used for controlling the transmission flow direction of the UA user multimedia data, cooperating with the network data transmission unit when the called conference enters an in-office audio mixing conference mode, and sending the RTP flow of the audio and video data to the UA equipment end in the local area network according to the modified SDP information of the conference server, wherein in the ordinary conference mode, the audio and video data of the UA user are directly sent to the conference server for processing.
The invention utilizes the characteristic that a plurality of terminals are in the same local area network, each UA user/UA device carries processing capacity in signaling, the conference server selects one UA device as a frequency mixing processing unit of the local area network according to the related information, and sends related SIP signaling to control other UA users to communicate with the UA device, thereby achieving the purpose of saving bandwidth. The technical scheme provided by the invention can ensure that the conference server saves bandwidth and pressure, and all UAs in the office can quickly and clearly see the video from the office.
Drawings
Fig. 1 is a diagram of networking in a conventional conference mode;
fig. 2 is a first networking diagram of implementing an intra-office mixing conference mode according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating UA device start/registration according to an embodiment of the present invention;
fig. 4 is a flowchart of implementing an intra-office mixing conference mode according to an embodiment of the present invention;
fig. 5 is a second networking diagram of implementing an intra-office mixing conference mode according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a conference video in an embodiment of the present invention;
fig. 7 is a functional block diagram of a conferencing server and a UA in accordance with an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more clearly and clearly understood, the technical solutions in the embodiments of the present invention are described below in conjunction with the accompanying drawings and the embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. All other embodiments that can be derived by one skilled in the art from the embodiments given herein are intended to be within the scope of the invention.
The invention utilizes the characteristic that a plurality of terminals are in the same local area network, each UA user carries respective video processing capability information in the signaling, the conference server selects one UA device as a frequency mixing processing unit of the local area network according to the related information, and sends the related SIP signaling to control other UA users to communicate with the UA device, thereby achieving the purpose of saving bandwidth. For convenience of description, common terminal devices are collectively referred to as UA users, and those with video processing capability are collectively referred to as UA devices.
The basic principle of the invention is as follows: the conference server will modify the SDP information of 200OK to UA device, the SDP content is information stored in database by the conference server, the called UA user will communicate with the UA device, the communication only has RTP stream, SIP signaling or interaction with the conference server of public network. When a user enters a meeting, the conference server actively pushes a message to the UA device, the pushing mode may be a subscription mode of an SIP, the device with a relay video subscribes to the conference server after the registration is successful, and the conference server needs to push the message, which of course may be other pushing modes or private message notification modes. The contents of the push message are: the conference server of the external network, the resolution of the video of the path needing to be compressed and the address information in the video bureau of the path.
Fig. 2 is a first networking diagram of implementing an intra-office mixing conference mode according to an embodiment of the present invention. As can be seen from this figure, the conference system specifically includes: conference server, UA1 user, UA2 device, UA 3 user.
The conference system in fig. 2 provides a mixing UA2 device with video mixing, RTP relaying, and SIP proxy capabilities, where the UA2 device is in the same private network as other UA users. Meanwhile, when all the UA users/UA devices are started or quit, the device logs in or logs out in the broadcast station, and carries the capability information of the device, such as: the mixing capability provided. In addition, the UA user takes the SIP account numbers and media capabilities of other UA users in the local office at the time of interval SIP registration, so that the conference server preferentially selects the UA device with the mixing capability to communicate when entering a meeting.
In order to implement mixing processing of UA devices in a teleconference, in the present invention, when all UA users/devices are started/closed and perform registration with a public network conference server, the following operation steps of registration configuration must be completed, and we now use UA1 user to describe:
step 310: the UA1 user broadcasts all other UA users in the station at startup and shutdown, and carries own media capability information, such as: the client can broadcast the intra-office information, wherein Mix Video:1 indicates that the client has audio mixing capability:
Sip-account:1000
Media Attribute (a): rtpmap:0 PCMU/8000
Media Attribute (a): rtpmap:8 PCMA/8000
MixVideo:1
Addr:172.172.172.36
step 320: after receiving the broadcast information, the other UA users in the local area network record the media capabilities of the UA1 user in a media capability data table in a local memory, so as to use the media capabilities in subsequent steps. Similarly, the UA1 user may also receive broadcast information of other UA users and UA devices in the office, read media capability information and SIP account of the UA users in each office, and store them in a media capability data table stored in the UA1 user memory.
Step 330: when the UA1 user registers to the public network conference server at intervals, the UA1 user takes the information of the SIP account numbers and the media capabilities of other UA users in the bureau, which is recorded in the memory of the UA1 user in step 320.
Step 340: the conference server receives the registration information of the UA1 user, and after the UA1 user successfully registers, the conference server starts the media capability recording function of the conference server, that is: reading and saving a media capability data table of the user of the UA1, that is, recording a SIP account list and corresponding media capabilities in the local area network associated with the registration account of the user of the UA1, and saving and generating a media capability database in a database of the conference server. In the invention, the media capability database comprises SIP account lists and corresponding media capability information in the associated offices of all UA users registered on the conference server. Through the reading analysis of the media capability database, it can know which UA users belong to a local area network, and can judge those UA devices with mixing processing capability.
In addition, in step 340, since the media capability recording function of the conference server is not the SIP standard function, in order to implement this function, a switch may be provided on the conference server to control whether to turn on this function.
Fig. 4 is a flowchart illustrating operation of implementing the intra-office mixing conference mode according to an embodiment of the present invention.
Step 410: the UA1 user initiates a call INVITE to a conference call.
Step 420: upon receiving the conference call from UA1, the conference server searches the UA media capabilities database in the database to determine whether a UA device with a mixing function exists in the call account lan, and writes this information to the database in step 340 above.
Step 430: when the conference server finds the UA device having the frequency mixing function in the office, in the embodiment of the present invention, if the UA2 device has the frequency mixing function and the UA1 user and the UA2 user both belong to a lan, step 440 is performed again to further determine whether the UA1 user and the UA2 user both belong to a conference, otherwise, the conference mode is entered into the normal conference mode.
Step 440: the conference server continuously judges whether the UA2 user is in the same conference, at this time, the conference server stores the number corresponding to each call, and this number is the conference number, if the numbers are the same, it indicates that the UA1 user and the UA2 device belong to the same conference, the operation of step 450 is continued, the intra-office mixing conference mode is started, otherwise, the ordinary conference mode is entered.
Step 450: and (3) starting an intra-office mixing conference mode, and modifying the SDP information of 200OK into UA2 equipment by the conference server, namely modifying the contact IP and the port of the corresponding mixing UA2 equipment in the SDP protocol of 200 OK. At the UA1 user end, after receiving 200OK, it takes out the SDP information in the packet and gets the IP and port of the new contact UA2 device, so that during the subsequent conference call, the UA1 user will forward the RTP stream to the port and IP. The SDP content is brought by the UA2 in the INVITE to the conference server of the public network, and can be used as a standard SIP flow, and the conference server records the SDP content thereof to the database, and the information can be stored in the database by the conference server.
Step 460: calling UA1 the user is in RTP stream communication with UA2 device. At this point UA1 sends RTP to the IP and port of the SDP, according to the IP and port. When INVITE, the UA2 device should start the mixing function to mix the RTP streams received from the office and send the mixed RTP streams to the conference server. SIP signaling of UA1 user and UA2 user interacts with conference server of public network in conference process.
Step 470: and opening a common conference mode, wherein the conference server does not modify the 200OK SDP, and according to the prior art, the conference server fills the media information supported by the conference server into the 200OK SDP, namely the 200OK SDP is filled with the IP and the port of the conference server. The subsequent UA user initiating the call communicates the RTP stream directly with the conference server.
If the UA2 device exits the conference, the UA user relaying the RTP stream below the UA2 device will receive a request from a conference server in the public network to request for the negotiated SDP content, and then check whether there are other UA users capable of mixing in the office of the conference, and if so, renegotiate the SDP content, and switch the RTP to other UA users in the conference to mix. If the media server can not find the mixing UA user in the station, or fails to negotiate with the SDP of the new mixing UA user, the conference server will fill the SDP content into the media information of the server, so that the media stream of the UA user end is automatically switched from the UA2 to the server of the public network.
In addition, at this time, the conference server may also make a query once again to see whether there is another UA device mixing, if there is another UA device mixing, the SDP of this device is read, otherwise, this SDP is the own supportable media information of the conference server.
Fig. 5 is a second networking diagram illustrating an intra-office mixing conference mode according to an embodiment of the present invention. At this time, among the conference users of the teleconference, the conference users include both UA users in the local area network and UA users in the non-local area network, the UA devices mix other UA users in the office, and then transmit the RTP stream to the conference server after the mixing is completed, and the conference server mixes and forwards the mixed RTP stream to other UA users in the conference place after receiving the RTP stream, where the other UA users should exclude the UA users in the office. And for the UA users in the bureau, the mixed RTP stream is transferred to the UA equipment, and then the UA equipment transfers the RTP stream to the UA users in each bureau.
As a third specific embodiment of the present invention, a UA device with a mixing capability in an authority can forward an RTP stream to other UA users without mixing capability in the authority without a conference.
Fig. 6 is a schematic diagram of a conference video in an embodiment of the present invention, and it can be known from the schematic diagram that one path is a main video, and the other paths are widget videos, when the main video is sent to the UA device, the UA device is required to compress the video of the widget user and then transmit the video to the conference server, and the main video is required to the UA device for clear presentation, and the path of video stream does not need to be compressed. The UA device compresses the video stream according to the resolution information issued by the external network server for each video stream, and then the video stream is the resolution of the video required by the conference server, and certainly the main video is not compressed, so that the consumption of compressing the video stream of a small window and the video by the conference server is saved. At this time, the UA device actively bridges a line to the conference server, and sends the RTP stream of the video in the office through the path. After receiving each RTP stream, the conference server decodes each RTP stream according to a preset video layout, and then encodes one frame of each video frame into new frame data, but the specific position and size need to be specifically determined by the video layout. For example, if there are multiple users participating in a conference, the conference server is pre-laid out as shown in fig. 6, so that the conference server receives each RTP decoding and encodes the RTP decoding to a corresponding area, and then the conference server obtains a new frame of data and encodes the data into a video format to form an RTP stream, and the conference server sends the RTP stream to all other UA users in the conference venue, thereby completing the function of the conference server; and after receiving the RTP stream of the conference server, the UA device with the frequency mixing capability sends the RTP stream to other UA devices in other offices connected with the UA device. If not, the conference server does not modify the SDP of the 200OK, which is now the SDP information supported by the server of the conference, and the user of the device UA that calls communicates directly with the conference server in RTP.
If the UA device exits the conference, the UA user relaying the RTP stream below the UA device will receive the request of REINVITE sent by the conference server of the public network and the requested negotiated SDP content, and then check whether there are other UA devices capable of relaying video in this office of the conference, if so, renegotiate the SDP content, and switch the RTP to other relaying video UA devices in the conference. If the media server can not find the relay video UA device in the station or fails to negotiate with a new relay video UA device SDP, the conference server will fill the SDP content in the media information of the server, so that the media stream of the UA client is automatically switched to the server of the public network.
Fig. 7 is a functional block diagram of a conferencing server and a UA in accordance with an embodiment of the present invention. As can be seen from the figure, in order to implement the intra-office audio mixing conference mode of the present invention, the related conference server mainly includes the following functional modules: the system comprises a media capability database, a network service module, an in-office media processing control module, a sound mixing processing module, a frequency mixing processing module and an SIP communication control module.
The network service module is responsible for reading a media capability data table from the registered and connected UA user and generating the media capability database by the conference server. Because the reading and recording function of the network service module is not the SIP standard function, in order to realize the function, a switch can be arranged on the conference server to control whether the function is started or not.
And the media capability database is used for recording and sorting the UA user media capability data table read by the network service module to form a media capability database of the conference server and used as a judgment and query basis for judging whether to start an intra-office audio mixing conference mode during subsequent conference calling.
The in-office media processing control module analyzes according to the SIP account number of the UA user of the current conference call and the information of the media capability database, and can start an in-office mixing conference mode when the UA device with the mixing function in the local area network of the UA user is searched. And further, the SDP information of the 200OK is modified to be UA equipment, and the transmission and the processing of the UA user video data are closed. Otherwise, in a normal conference mode, controlling the audio mixing processing module and the frequency mixing processing module according to the prior art, and establishing a video processing channel with the UA user.
In addition, the module can also control the resolution information of each video stream. In the conference video display process, one path of video is main video, the other paths of video are small-window video, when the video is sent to the UA equipment, the UA equipment is required to compress the video of a small-window user and then transmit the video to a conference server, and the main video is presented clearly, the UA equipment is required, and the path of video stream is not required to be compressed. The UA device compresses the video stream according to the resolution information issued by the external network server for each video stream, and then the video stream is the resolution of the video required by the conference server, and certainly the main video is not compressed, so that the consumption of compressing the video stream of a small window and the video by the conference server is saved.
And the SIP communication control module is used for controlling and taking over the conference call request of the UA user to the conference server and is used for the communication and analysis processing of SIP signaling in the whole conference process.
And the frequency mixing processing modules are respectively used for carrying out mixing processing on the received video streams.
In the UA client, the following functional units are mainly included: the system comprises a media capability data table, a network data transmission unit, a media transmission control unit, an audio processing unit, a video processing unit and an SIP communication unit.
The media capability data table includes SIP accounts and corresponding media capability information of all other UA users and UA devices in the UA user SIP account bureau. The data is that other UA users carry their own media capability information when starting and closing, and other UA users and UA devices in the broadcast station.
And the media transmission control unit is used for controlling the transmission flow direction of the UA user multimedia data, cooperating with the network data transmission unit when the called conference enters an in-office audio mixing conference mode, and sending the RTP flow of the audio and video data to the UA equipment end in the local area network according to the modified SDP information of the conference server, wherein in the ordinary conference mode, the audio and video data of the UA user are directly sent to the conference server for processing.
And the SIP communication unit is used for carrying out SIP signaling communication with an SIP communication control module of the conference server.
The audio unit and the video unit are respectively used for coding and decoding the local audio and video.
At the UA device end, its internal functional units are basically consistent with the UA users, the only difference is that the UA devices have stronger multimedia capability, and can perform audio mixing and/or frequency mixing processing on the audio/video RTP stream of the local area network. Therefore, the UA device has a mixing unit and a mixing unit corresponding to each other.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.

Claims (1)

1. A kind of telephone conference relay video processing method, characterized by, in the telephone conference system, include at least one UA apparatus with multimedia mixed processing ability, and several conference terminal UA users, said UA apparatus can carry on the media stream interaction in the office with the conference server, the said video processing method mainly includes the following steps: step a: the UA user initiates a call to enter a telephone conference;
step b: the conference server will inquire the media capability database stored in the database and judge whether the UA equipment has the multimedia hybrid processing capability in the local area network N of the UA user account; if the judgment result in the step b is yes, starting an intra-office mixing conference mode; if the judgment result in the step b is negative, starting a common conference mode, namely performing multimedia mixing processing by the conference server; wherein the intra-office mixing conference mode comprises the following two steps:
step c: the conference server modifies SDP information of SIP signaling into the UA equipment;
step d: the UA user transfers and sends the RTP stream to the UA equipment, and the UA equipment performs first multimedia mixing processing, namely frequency mixing processing to generate an intra-office mixed RTP stream; when the UA user and the UA equipment are started or quit, carrying media capability information in a broadcast signaling in the local area network N, and recording the media capability information and an SIP account number of the UA user by other UA users in the local area network N to generate a media capability data table; when the UA user and the UA equipment are respectively registered to the conference server at intervals, the conference server additionally carries other SIP accounts and a list of corresponding media capability information in the local area network N in an SIP registration signaling, reads the media capability and the SIP accounts and stores the media capability and the SIP accounts in a database to generate a media capability database; when the UA device exits the conference, further comprising the steps of: judging whether other UA equipment with multimedia hybrid processing capability exists in the local area network N in the conference; if the other UA equipment exists, the SDP content is renegotiated, and the other UA equipment carries out mixing processing in the subsequent conference process; if the other UA equipment does not exist or the SDP negotiation with the other UA equipment fails, the conference server fills the media information of the conference server in the SDP content and reenters the common conference mode; if the conference includes the UA user of the non-local area network N at the same time, the video processing method further includes a second multimedia mixing process for generating a conference mixed RTP stream, that is, the conference server performs a mixing process on the intra-office mixed RTP stream and the media stream of the UA user in the non-local area network N; the conference mixed RTP stream can be forwarded to the UA user of the local area network N by the UA equipment; in the intra-office mixing conference mode, the conference server judges whether the UA user and the UA equipment belong to the same conference; if not, the conference server sends a private message to the UA device, so that the UA device automatically generates a bridge to the conference server, and after the UA user sends the RTP stream to the UA device, the UA device uses the bridge to relay the RTP stream to the conference server; the video display of the conference is composed of a main video and a plurality of small window videos, the UA device can perform video compression processing on the small window videos according to resolution information of each path of video stream sent by the conference server, and after the conference server receives the RTP stream subjected to compression processing through the bridge connection, each path of RTP stream subjected to compression processing is decoded firstly according to the video layout arranged in advance, and then each path of video frame is encoded into new frame data again.
CN201510630503.1A 2015-09-29 2015-09-29 Method and system for processing relay video of teleconference Active CN106559639B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510630503.1A CN106559639B (en) 2015-09-29 2015-09-29 Method and system for processing relay video of teleconference

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510630503.1A CN106559639B (en) 2015-09-29 2015-09-29 Method and system for processing relay video of teleconference

Publications (2)

Publication Number Publication Date
CN106559639A CN106559639A (en) 2017-04-05
CN106559639B true CN106559639B (en) 2020-08-14

Family

ID=58417123

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510630503.1A Active CN106559639B (en) 2015-09-29 2015-09-29 Method and system for processing relay video of teleconference

Country Status (1)

Country Link
CN (1) CN106559639B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110049276A (en) * 2019-05-13 2019-07-23 广州北辰信息科技有限公司 A kind of high-definition image transmission system based on intelligent meeting all-in-one machine
CN112995567A (en) * 2021-02-03 2021-06-18 游密科技(深圳)有限公司 Video call method, device, server and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101207798A (en) * 2006-12-18 2008-06-25 中兴通讯股份有限公司 Method for implementing video distortion based on media server
CN102137080A (en) * 2010-06-30 2011-07-27 华为技术有限公司 Method, device and system for cross-platform conference convergence
CN104486518A (en) * 2014-12-03 2015-04-01 中国电子科技集团公司第三十研究所 Distributed voice mixing method for teleconference under bandwidth-constrained network environment
CN106331396A (en) * 2015-06-15 2017-01-11 深圳市潮流网络技术有限公司 Multimedia processing method and system for telephone conference

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060152577A1 (en) * 2004-12-13 2006-07-13 Pierre Hagendorf Systems and methods for incorporating video into voice-only call centers

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101207798A (en) * 2006-12-18 2008-06-25 中兴通讯股份有限公司 Method for implementing video distortion based on media server
CN102137080A (en) * 2010-06-30 2011-07-27 华为技术有限公司 Method, device and system for cross-platform conference convergence
CN104486518A (en) * 2014-12-03 2015-04-01 中国电子科技集团公司第三十研究所 Distributed voice mixing method for teleconference under bandwidth-constrained network environment
CN106331396A (en) * 2015-06-15 2017-01-11 深圳市潮流网络技术有限公司 Multimedia processing method and system for telephone conference

Also Published As

Publication number Publication date
CN106559639A (en) 2017-04-05

Similar Documents

Publication Publication Date Title
US9537667B2 (en) Duplicating digital streams for digital conferencing using switching technologies
US8239547B2 (en) Method and arrangement for providing different services in a multimedia communication system
US20060256748A1 (en) System and method for interworking between IMS network and H.323 network
US8643695B2 (en) Videoconferencing endpoint extension
US6963352B2 (en) Apparatus, method, and computer program for supporting video conferencing in a communication system
US20080024593A1 (en) Multimedia Communication System
US20080031161A1 (en) Method and system for establishing a conference call between a remote and a local endpoint
CN101924772B (en) Communication system and method supporting cross-network and cross-terminal realization of multimedia session merging
CN101895569B (en) Implementation method of video browsing, IMS video monitoring system and front monitoring front-end
CN101360091B (en) Apparatus, system and method realizing session initial protocol terminal conference accessing
JP2011508546A (en) Audio processing method, system, and control server
US10523730B2 (en) Real-time transport protocol (RTP) media conference server routing engine
US20240292363A1 (en) Information transmission method and apparatus
CN112543301A (en) Intelligent conference system based on IMS and implementation method thereof
US20060140175A1 (en) System and method for controlling coupling between communication terminals for audio-video communication
CN106331396B (en) Multimedia processing method and system for telephone conference
CN103595948A (en) Resolution self-adaptation video conversation system and resolution self-adaptation method of video conversation system
CN106559639B (en) Method and system for processing relay video of teleconference
EP2884743A1 (en) Process for managing the exchanges of video streams between users of a video conference service
CN114710821A (en) Method, system and storage medium for VoLTE relay to access SIP contact center
CN101668092B (en) Method for realizing supplementary service dialing tone by network multimedia terminal and device
CN101166314A (en) Enhancement of signalling in a 'push to talk' type communication session by insertion of a visiting card
EP2227013A2 (en) Virtual distributed multipoint control unit
CN113709081B (en) IMS and mobile interconnection technology-based converged communication method and system
JP2006020158A (en) Data transmission management device, data transmission system, and data transmission method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant