WO2011020354A1

WO2011020354A1 - Method for switching video, media server and conference system

Info

Publication number: WO2011020354A1
Application number: PCT/CN2010/073134
Authority: WO
Inventors: 刘坤; 韩银俊; 罗会平; 郭斌
Original assignee: 中兴通讯股份有限公司
Priority date: 2009-08-18
Filing date: 2010-05-24
Publication date: 2011-02-24
Also published as: BR112012003198B1; BR112012003198A2; CN101631222B; CN101631222A

Abstract

The present invention discloses a method for switching video, a media server (MS) and a conference system. Wherein the method includes: the MS receives a switching control message sent by an application server (AS); according to the switching control message, the MS stops playing the first media file, which is played by a first terminal to a second terminal in a video telephone service; with the playback function, the MS plays the second media file, which is to be played by the first terminal to the second terminal. The present invention provides a video replacement function in a video conference service. By the negotiation and cooperation of conference media control signaling between the MS and the AS, the present invention provides a function that a communication user can switch video and audio smoothly in a video conference, play a preset video or audio to the other side and simultaneously adjust the volume of the background sound. The present invention provides flexible and varied functions, enriching the original video conference functions with a prospect of large-scale applications.

Description

Video switching method, media server and conference system

TECHNICAL FIELD The present invention relates to a multimedia value-added service in the field of communications, and more particularly to a video switching method, a media server, and a conference system.

Background technique

SIP (Session Initiation Protocol) is an application layer control protocol used to establish, modify, and terminate multimedia sessions. It mainly performs functions such as user location, user capability exchange, call setup, and call processing. SIP video conferencing uses SIP signaling as the basic protocol for the establishment and control of video conferencing systems. At present, there are two mainstream technical standards for video conferencing systems, one H.323, one SIP, and SIP. Compared with H.323, SIP is simple, flexible, and easy to expand. It can be easily combined with other Internet protocols. IP multimedia services for deployment in a variety of network environments. With the development of third-generation mobile communication technologies, the application of SIP video conferencing has become more and more popular. When the number of conference members in the video conference system is two, the one-to-one videophone function is actually realized. Compared with the ordinary videophone, the videophone realized by using the video conference introduces the MS. (Media Server, Media Server), can easily achieve audio mixing, picture-in-picture and other functions, more flexible and powerful.

SUMMARY OF THE INVENTION The technical problem to be solved by the present invention is to provide a video switching method, a media server, and a conference system, which can enable a party to talk to switch from the current call video to other video or audio, and the other party of the call can see that the other party plays for itself. Other video or audio, not just the original call video. In order to solve the above technical problem, the present invention provides a video switching method, including: a media server MS receiving a handover control message sent by an application server AS; The MS stops playing the first media file played by the first terminal in the videophone service to the second terminal according to the handover control message; the MS uses the playback function to play the first terminal to a second media file played by the second terminal; wherein, the first terminal is a calling terminal in the videophone service, and the second terminal is a called terminal in the videophone service; or The first terminal is a called terminal in the videophone service, and the second terminal is a calling terminal in the videophone service. Preferably, the first media file is: a call video file of the first terminal or a video file and/or an audio file played by the first terminal to the second terminal; the second media file is: Video files and/or audio files. Preferably, before the media server MS receives the handover control message sent by the application server AS, the method further includes: when the AS negotiates with the MS according to the videophone service request of the first terminal, The video media direction of a terminal is set to receive only and not sent. Preferably, the step of the MS playing the second media file to be played by the first terminal to the second terminal by using the playback function of the MS further comprises: the MS receiving the resume call video control message sent by the AS The MS stops playing the second media file according to the resume call video control message, and modifies the video media direction of the first terminal to both transmit and receive. Preferably, the MS uses the playback function thereof to play the second media file to be played by the first terminal to the second terminal, and further includes: the MS receiving the volume adjustment control message sent by the AS; And the MS performs volume adjustment on the second media file according to the volume adjustment control message. In order to solve the above technical problem, the present invention provides a media server, including a receiving module, a first control module, and a second control module, where: The receiving module is configured to: receive a handover control message sent by the application server AS; the first control module is configured to: stop playing the first media file played by the first terminal to the second terminal according to the handover control message; The second control module is configured to: play a second media file to be played by the first terminal to the second terminal by using a playback function of the media server; wherein, the first terminal is the videophone service a calling terminal, the second terminal is a called terminal in the videophone service; or, the first terminal is a called terminal in the videophone service, and the second terminal is the The calling terminal in the videophone service. Preferably, the media server further includes a setting module, where: the setting module is configured to: when the AS negotiates with the media server according to the videophone service request of the first terminal, The video media direction of the terminal is set to receive only and not sent. Preferably, the media server further includes a modification module, where: the modifying module is configured to: stop playing the second media file according to the resume call video control message sent by the AS, and the first The video media direction of the terminal is modified to both send and receive. Preferably, the media server further includes a volume adjustment module, wherein: the volume adjustment module is configured to: play the first terminal to the second control module by using a playback function of the media server During the second media file played by the terminal, the second media file is volume-adjusted according to the volume adjustment control message sent by the AS. In order to solve the above technical problem, the present invention provides a conference system, including the media server and the application server as described above, wherein: the application server is configured to: generate a handover control message according to a video handover request of the first terminal.

Embodiments of the present invention have the following beneficial effects: In the above solution, the AS controls the MS to play the second media file to one of the parties in the call, and overwrites the previous first media file, so that the calling party can switch from the current call video to other video or audio, or switch between video and audio. The other party to the call can see other videos or audio played by the other party for themselves, not just the original call video. In addition, smooth switching can be performed in the video call screen and other video or audio. At the same time, the volume of the background sound can be adjusted, and the terminal does not need special support, and has strong practicability and flexible application prospects.

1 is a schematic flowchart of a video switching method for a videophone service in a conference system according to an embodiment of the present invention; FIG. 2 is a schematic flowchart of a specific implementation process of the process shown in FIG. Figure 4 is a schematic diagram of a specific structure of the media server shown in Figure 3; Figure 5 is a schematic diagram of another specific structure of the media server shown in Figure 3; Figure 6 is a schematic diagram of the overall structure of a conference system according to an embodiment of the present invention.

The preferred embodiments of the present invention will be described in detail with reference to the drawings and specific embodiments. In the existing video conferencing system, both sides of the video call see the video of the other party. When one of the parties wants the other party to see not the video of their own, but another piece of audio or video, the existing video conferencing system Still not implemented or functionally flawed. For example, in a video call, the user may not want the peer to see his or her video at the beginning. If the video is replaced after the call is established, the other party may still have a short chance to see their video, and there is a difference. When switching between video files, the other party may also see their own call video for a short time. The invention provides a video switching method for a videophone service, a media server and a conference system, which can enable a party to talk to switch from the current call video to other video or audio, and the other party of the call You can see other videos or audio played by the other party for yourself, not just the original call video. Moreover, you can avoid the above-mentioned defects when switching, and achieve smooth switching between the call video and other audio. As shown in FIG. 1 , an embodiment of the present invention is applicable to a video switching method of a telephony service, where the conference system includes at least: an AS (Application Server, an application server) and an MS (Media Server, a media server). The method includes: Step 11: The MS receives the handover control message sent by the AS. Step 12: The MS stops playing the first media file played by the calling terminal to the called terminal according to the handover control message. Step 13 The MS uses its playback function to play a second media file that the calling terminal wants to play to the called terminal. The first media file is specifically: a call video file of the calling terminal, or a video file and/or an audio file that the calling terminal plays to the called terminal; and the second media file includes : Video files and/or audio files. The playback function of the MS means that the AS can control the MS to play media files according to the service types supported by the MS, such as simple applications including network prompts, service prompts, and the like. In this embodiment, under the condition that the terminal may not support video switching, the AS controls the MS to play a video or audio file to one of the parties in the call, overwriting the previous call video, if the original MS is playing a video to a certain party in the call. File A, AS controls the MS to stop the playback of the current video file A, and then plays the substitute video file B, so that the original call video and different audio and video files can be switched. It can make the party of the call switch from the current call video to the preset other video or audio, and the other party of the call can see other videos or audio played by the other party for themselves, not just the original call video. The video file and/or the audio file in the second media file are saved on the MS, and the AS sends a SIP notification message (INFO message) to the MS, carries the relevant file path, volume, and other parameters, and controls the MS to play the video to the terminal. Audio file. In addition, before the foregoing step 11, the method may further include: the MS, when the AS negotiates with the MS according to the videophone service request of the calling terminal, the video media side of the calling terminal The setting is set to receive only and not sent. Specifically, the method includes: the calling terminal initiates a videophone service request to the application server AS; the AS negotiates with the MS according to the videophone service request, and sets the video media direction of the calling terminal to receive only Do not send. That is to say, in the case that the first media file is a call video file of the calling terminal, if the calling terminal does not want the called terminal to see its own call video at the beginning, the AS initially gives the calling terminal to the MS. When the leg of the conference is established, the video media direction of the calling terminal is set to receive only and not sent, that is, the calling terminal can receive the video information from the MS, but does not send any video information of the call to the MS. The conference leg refers to the session data corresponding to a member of the conference on the MS. For the case where the first media file is a video/audio file played by the calling terminal to the called terminal, when the calling terminal plays the substitute video file A to the called terminal after the video call is established, the calling terminal requests to use the video. If the file B replaces the original video file A, the AS first sends a control command to the MS to stop the playback of the video file A, and then uses the playback method to request the MS to play the video file B to the called terminal. Since the MS cannot obtain the calling party. The call video of the terminal, so that the called terminal cannot see the call video of the calling terminal, instead the substitute video B played by the MS to the called terminal, and there is no short-time video flashing, and the call is reached. Smooth switching between video and other video and audio. When the video flashes, it means: In a video call, if the video switch is made after the call is established, the other party may still have a short chance to see the video, or when switching between different video files, the other party also has I may see my call video for a short time. The above embodiment of the present invention solves this problem well. In addition, after the foregoing step 13, the method may further include: the MS receiving the resume call video control message sent by the AS; the MS stopping the playing of the second media file according to the resume call video control message, and The video media direction of the calling terminal is modified to be both sent and received. That is, in the process of the calling terminal playing the substitute video to the called terminal, if the calling terminal ends The end needs to restore the original call video, that is, the called terminal can see the call video of the calling terminal, and the AS can first request the MS to stop playing the currently replaced video file by signaling, and then modify the video media that the calling terminal joins the conference. The direction, from the original only to not receive, modified to both send and receive, so that the called terminal can successfully see the call video of the calling terminal. In addition, in the foregoing step 13, the MS uses the playback function to play the second media file that the calling terminal wants to play to the called terminal, and further includes: the MS receives the volume sent by the AS Adjusting the control message; the MS performs volume adjustment on the second media file according to the volume adjustment control message. That is to say, in the process of the MS playing the substitute video to the called terminal, the AS can also adjust the volume of the video and audio played by the MS through the command, the function is flexible and varied, and has strong versatility, which is favorable for large-scale development. And application. The above embodiment is only used as an example to switch the media file played by the calling terminal to the called terminal. The same is true for the media file that is played by the called terminal to the calling terminal. For example, in the above step, the method may also be: The MS stops playing the first media file played by the called terminal to the calling terminal according to the handover control message; in step 13, the MS uses the playback function to play the called terminal to the calling terminal. The second media file played. That is, in step 12, the MS stops playing the first media file played by the first terminal to the second terminal according to the switching control message; in step 13, the MS uses the playback function to play the first a second media file to be played by the terminal to the second terminal; wherein the first terminal is a calling terminal in the videophone service, and the second terminal is a called party in the videophone service Or the first terminal is a called terminal in the videophone service, and the second terminal is a calling terminal in the videophone service. In other steps, the calling terminal and the called terminal may also be interchanged, and details are not described herein again. The specific implementation process of the foregoing method is specifically described below with reference to FIG. 2, as shown in FIG. 2, the control flow of the video replacement, handover, and recovery video functions of the SIP conference service is as follows: Let the calling terminal be the terminal, and the called terminal be Terminal B, AS is the application server, and MS is the media server. The signaling 201-210 is a process in which the AS negotiates with the terminal and the MS to create and join the conference; 211-212 is the process of playing the substitute video file A; 213-216 is the view The frequency file B switches the flow of the video file A; 217-218 is the background sound volume adjustment process; 219-222 is the resume call video flow. The calling terminal 曱 commands to the business process are implemented by pressing the button, and then the AS obtains the command of the terminal by receiving the number. This detail is not described in the following process. Step 201: The terminal initiates an invite request to the AS, and requests a video call with the terminal B. After receiving the request, the AS performs media negotiation with the MS to establish a calling conference leg on the MS. Step 202: After the media negotiation between the AS and the MS is completed, the terminal responds with a success response (200OK). Step 203: The AS replies with an acknowledgement (ACK) response to the terminal. Step 204: The AS sends an information (Info) request message carrying the conference to create a conference and join the terminal to the conference command, and sets the direction of the video media of the terminal to be received only. Step 205: After the MS successfully creates and joins the conference, the MS returns a 200 OK of the Info request message to the AS. Step 206: The AS sends an invite call request to the called terminal B, and then negotiates with the MS for media negotiation, and creates a called conference leg. Step 207: The terminal B sends a 200 OK to the AS to receive the call. Step 208: The AS replies to the terminal B with an ACK. Step 209: The AS sends an Info request message carrying the terminal B to the conference command to the MS. Step 210: After the MS successfully joins the conference, the MS returns the 200 OK of the Info to the AS. Step 211: The AS requests the MS to play the media file A to the called terminal B to perform video replacement. Step 212: After the MS successfully plays the substitute video, return the 200 OK of the Info request to the AS. Step 213: The calling terminal requests to switch to the video file (that is, the calling terminal sends a video switching request to the AS), and the AS sends an Info request to the MS to stop the playback of the current video file A. Step 214: After the MS stops playing the video A, the MS returns the 200 OK of the Info request to the AS. Step 215: The AS sends an Info request to the MS, and requests the terminal B to play the video file B. Step 216: After the MS successfully plays the video file B, it returns 200 OK to the AS. Step 217: The calling terminal requests to adjust the volume of the video file to be played, and the AS sends an Info request message carrying the volume adjustment command to the MS.

Step 218: After the MS successfully adjusts the volume, it returns 200 OK to the AS. Step 219: The calling terminal requests to resume the call video, and the AS sends an Info request message to the MS to stop the currently playing video B. Step 220: After the MS stops playing the video file B, it returns the 200OK of the Info request. Step 221: The AS sends an Info request, and asks the MS to modify the media direction of the terminal, and then change to both send and receive. Step 222: After the MS modifies the media direction of the terminal, the MS returns an Info request to the AS.

200 OK. In this way, the called terminal B can see the video of the call of the terminal. In addition, the following code shows an example of an XML (Extensible Markup Language) code stream sent by the AS to the MS to adjust the background sound volume of the second media file,

<?xml version="1.0" encoding="US-ASCII"?> <msml version:" 1.1">

</stream> </modifystream>

</msml> The attribute background of the label modifystream in the stream indicates whether it is a background sound. If "yes" is the background sound volume, "no" or if there is no such attribute, it indicates the volume of the call within the conference. The attribute of the tag stream media= "audio" indicates that the audio is adjusted, and the attribute dir= "to-idl" indicates that the direction of the volume adjustment is the transmission volume of the background sound, and the attribute amt in the tag gain indicates the adjustment. The volume of the volume, in decibels. With this command, the user can adjust the volume of the call within the conference, and adjust the volume of the background sound of the substitute audio and video. The control is flexible and comprehensive. In the existing conference system, the control signaling between the AS and the MS can only control the volume of the call in the conference. The present invention adds an adjustment to the volume of the background sound in the conference, that is, the second media file. Play volume adjustment. The specific implementation process of the foregoing method is an example of switching a media file played by a calling terminal to a called terminal. The media file that is used to switch the called terminal to the calling terminal is also similar.

As shown in FIG. 3, an embodiment of the present invention further provides a media server (MS) 20, including: a receiving module 21, configured to: receive a handover control message sent by an application server AS; a first control module 22, which is configured The first media file that is played by the calling terminal to the called terminal is stopped according to the switching control message; wherein the first media file is specifically: the calling video file of the calling terminal or the calling terminal a video file and/or an audio file played to the called terminal; a second control module 23 configured to: play the first to be played by the calling terminal to the called terminal by using a playback function of the media server Two media files; wherein the second media files include: video files and/or audio files. As shown in FIG. 4, on the basis of the foregoing embodiment shown in FIG. 3, the media server 20 may further include: a setting module 24 configured to: request, according to the videophone service of the calling terminal, at the AS When negotiating with the media server, the video media direction of the calling terminal is set to receive only and not to be sent. In this way, the media server cannot obtain the call video of the calling terminal, and the call video of the calling terminal cannot be played to the called terminal, so that the calling terminal realizes the purpose that the called terminal does not want to be seen by the called terminal. When the calling terminal needs to resume the video of the call with the called terminal, the media server 20 may further include: a modifying module 25, configured to: stop the second according to the resume call video control message sent by the AS The media file is played, and the video media direction of the calling terminal is modified to be both sent and received. In addition, as shown in FIG. 5, on the basis of the foregoing embodiment shown in FIG. 3, the media server 20 may further include: a volume adjustment module 26 configured to: utilize the media server in the second control module 23 The playing function, in the process of playing the second media file to be played by the calling terminal to the called terminal, performing volume adjustment on the second media file according to the volume adjustment control message sent by the AS. Of course, the volume adjustment module 26 of this embodiment can also be combined with the embodiment shown in FIG. 4, that is, based on the embodiment shown in FIG. 3, and can include a setting module 24, a modification module 25, and a volume adjustment module 26 at the same time. . In this embodiment, the AS controls the MS to play a video or audio file to one of the parties in the call, and overwrites the previous call video. If the MS is playing the video file A to a certain party in the call, the AS controls the MS to stop the current video file A first. Play, then play the alternate video file B, so you can switch between the original call video and different audio and video files. It allows the party to the call to switch from the current call video to other video or audio, and the other party to the call can see other videos or audio played by the other party for themselves, not just the original call video. The video or audio file in the second media file is saved on the MS, and the AS sends the SIP INFO message to the MS, carries the relevant file path, volume, and other parameters, and controls the MS to play the video and audio file to the terminal. In addition, as shown in FIG. 6, an embodiment of the present invention further provides a conference system, including: an application server (AS) 30, configured to: generate a handover control message according to a video handover request of a calling terminal; MS) 20, configured to: stop playing the first media file that the calling terminal plays to the called terminal according to the switching control message, and use the playback function of the media server to play the calling terminal to a second media file played by the called terminal; wherein the first media file is: a call video file of the calling terminal or a video/audio file played by the calling terminal to the called terminal; Two media files include: Video/audio files. Since the media file played by the called terminal to the calling terminal is similar, in the embodiment of the media server and the conference system, the calling terminal can be replaced with the called terminal, and the called party will be called at the same time. By replacing the terminal with the calling terminal, the function of switching the media file played by the called terminal to the calling terminal can be realized. All the features of the video switching method of the videophone service in the conference system shown in FIG. 1 and FIG. 2 and all the features of the media server (MS) 20 shown in FIG. 3, FIG. 4 and FIG. 5 can be applied to the system. No longer. The solution of the invention does not require special support of the terminal, and has strong practicality and flexible application prospects.

While the invention has been described in connection with the specific embodiments, the modifications and variations may be Such modifications and variations are considered to be within the scope of the invention and the scope of the appended claims.

Industrial Applicability The present invention provides a video switching method, a media server, and a conference system. The AS controls the MS to play a second media file to one of the parties in the call, and overwrites the previous first media file, so that the calling party can make the current call. The video switches to other video or audio, or between video and audio. The other party on the call can see other videos or audio played by the other party, not just the original call video. The invention provides the communication user with the function of smoothly switching the video and audio in the video conference, playing the preset video or audio to the other party, and also adjusting the volume of the background sound, and the function control is flexible and changeable. It enriches the functions of the original video conference and has the prospect of large-scale application.

Claims

Claim

A video switching method, comprising: the media server MS receiving a handover control message sent by the application server AS; the MS stopping playing the first terminal in the videophone service to the second terminal according to the handover control message a first media file; the MS uses a playback function to play a second media file that the first terminal is to play to the second terminal; wherein the first terminal is a calling party in the videophone service a terminal, the second terminal is a called terminal in the videophone service; or, the first terminal is a called terminal in the videophone service, and the second terminal is the videophone service The calling terminal in the middle.

2. The method according to claim 1, wherein: the first media file is: a call video file of the first terminal or a video file and/or audio played by the first terminal to the second terminal. Document

The second media file is: a video file and/or an audio file.

The method according to claim 1, wherein: the media server MS before receiving the handover control message sent by the application server AS further includes: the MS in the AS according to the video service request of the first terminal When the MS negotiates, the video media direction of the first terminal is set to receive only and not to be sent.

The method according to claim 3, wherein: the step of the MS playing the second media file to be played by the first terminal to the second terminal by using the playback function thereof further comprises: the MS receiving a resume call video control message sent by the AS; the MS stops playing the second media file according to the resume call video control message, and modifies the video media direction of the first terminal to both transmit and receive.

The method according to any one of claims 1 to 4, wherein: the MS uses the playback function thereof to play the second media file to be played by the first terminal to the second terminal, and further includes: Receiving, by the MS, a volume adjustment control message sent by the AS; the MS performing volume adjustment on the second media file according to the volume adjustment control message.

A media server, comprising: a receiving module, a first control module, and a second control module, wherein: the receiving module is configured to: receive a switching control message sent by the application server AS; the first control module is configured to: The switching control message stops playing the first media file played by the first terminal to the second terminal; the second control module is configured to: play the first terminal to use the playback function of the media server a second media file played by the second terminal; wherein, the first terminal is a calling terminal in the videophone service, and the second terminal is a called terminal in the videophone service; or The first terminal is a called terminal in the videophone service, and the second terminal is a calling terminal in the videophone service.

The media server according to claim 6, further comprising a setting module, wherein: the setting module is configured to: when the AS negotiates with the media server according to the videophone service request of the first terminal, The video media direction of the first terminal is set to receive only and not to be sent.

The media server according to claim 7, further comprising a modification module, wherein: the modifying module is configured to: stop playing the second media file according to the resume call video control message sent by the AS, and The video media direction of the first terminal is modified to be both transmitted and received.

9. The media server of any of claims 6-8, further comprising a volume adjustment module, wherein: The volume adjustment module is configured to: send, according to the AS, the second control module by using the playback function of the media server to play the second media file to be played by the first terminal to the second terminal a volume adjustment control message, and volume adjustment of the second media file.

A conference system, comprising the media server and the application server according to any one of claims 6 to 9, wherein: the application server is configured to: generate a handover control message according to a video handover request of the first terminal.