WO2009012714A1

WO2009012714A1 - A method and a device for controlling streaming media

Info

Publication number: WO2009012714A1
Application number: PCT/CN2008/071740
Authority: WO
Inventors: Baojian Qi; Peng Wang; Xiaosong Lei
Original assignee: Huawei Technologies Co., Ltd.
Priority date: 2007-07-25
Filing date: 2008-07-24
Publication date: 2009-01-29
Also published as: CN101355552A

Abstract

The invention discloses a method and a device for controlling streaming media. The method includes: controlling server to receive streaming media control message through the SIP initial streaming media negotiation, via which transmitting the streaming media to client. The invention decreases occupancy of the system resource and the answering time, and achieves controlling the streaming media.

Description

Method and device for controlling streaming media

The present invention relates to streaming media services in a communication network, and in particular, to a method and apparatus for controlling streaming media.

Background technique

The streaming media service is a new service that has developed rapidly in recent years. The service uses streaming technology to transmit multimedia files, including video and audio files, on a packet-switched network, such as an IMS network. The user equipment (UE, User Equipment) can be played immediately after being completely downloaded. The key technology for streaming media service implementation is streaming technology. Streaming technology processes continuous video and audio files and stores them on servers in the packet switching network, so that UEs can access the server and download files. Content, while listening to the contents of the file, you do not need to wait until the entire file content is downloaded before you can watch the contents of the file.

In the 3GPP Release 5 (R5, Release) phase, IMS is introduced. The IMS is superimposed on the packet domain network, and is called a Call Control Function (CSCF), and a Media Gateway Control Function (MGCF). A media resource function (MRF) and a functional entity such as a Home Subscriber Server (HSS). The CSCF can be divided into three logical entities: the service CSCF (S-CSCF), the proxy CSCF (P-CSCF), and the query CSCF (I-CSCF). The S-CSCF is a service switching center of the IMS, performs session control, maintains session state, is responsible for managing UE information, and generates charging information. The P-CSCF is an access point for the UE to access the IMS, completes UE registration, and is responsible for quality of service ( QoS) control and security management; The I-CSCF is responsible for interworking between IMS domains, managing the allocation and selection of S-CSCFs, hiding network topology and configuration, and generating billing data. The MGCF controls the gateway to implement interworking between the IMS and other networks. MRF provides media resources. The HSS stores subscription data, configuration information, and the like of the UE. The IMS network mainly uses the Session Initiation Protocol (SIP) and the Diameter protocol. SIP is an application layer control protocol that can be used to establish, modify, and terminate multimedia sessions or conferences. SIP also supports inviting participants to participate in existing sessions, such as multiparty conferences.

RTA (Rea l Time Streaming Protocol) is an application-level protocol that controls the transmission of real-time data and is mainly used for real-time data transmission of streaming media services. RTSP provides an extensible framework for real-time data such as controlled delivery of audio and video as well as on-demand delivery. The purpose of the RTSP is to control multiple data transfer sessions, provide a method for selecting a transport channel, and provide a method for selecting a transport mechanism based on the Real Time Transport Protocol (RTP, Rea l Time Transpor Protocol).

RTSP can provide professional support for streaming media, but it overlaps with SIP in some basic functions, because SIP has good routing, easy extension, mobility support and session support functions, and SIP + service discovery functional entity (SDP, Ses) The s ion Descr ipt ion protocol can provide some basic streaming control functions. Therefore, it is proposed to negotiate the RTSP channel through the SIP negotiation media control channel mode, so that the existing functions of the SIP can be utilized, and the specialization can be utilized. The media control operation performs a dedicated media control operation on the negotiated RTSP channel, avoiding the extension of the RTSP with the existing functions of the SIP.

The IMS-based Internet Protocol Television (IPTV) service provides IPTV services under the overall IMS architecture, making full use of the existing registration, authentication, routing, session control and establishment, service triggering, and charging in the IMS network. End-to-end QoS (QoS) guarantees mechanisms to provide streaming media services and streaming media services for streaming media and real-time session services. That is to say, the UE-to-content multimedia session is completed through the existing session control mechanism of the IMS. During the establishment of the session, the bearer resource needs to be reserved for the transmission of the streaming media.

1 is a schematic diagram of a service function architecture of an IMS-based IPTV service in the prior art, in which an IPTV media function entity (MF, Media Funct ion) is responsible for controlling and delivering streaming media through the IMS to the UE. IPTV Media Function can be decomposed into a Media Control Function (MCF) and a Media Delivery Function (MDF) from a functional perspective. The MDF is usually a media server that transmits streaming media to the UE under the control of the MCF. The MCF can also receive and process control operation commands sent by the UE. These commands are usually implemented by RTSP. For example, operational commands such as fast forward, backward, pause, and position of streaming media. The IPTV Service Control Functions are used to process the MF for the UE when receiving the IPTV service request sent by the UE through the Core (IMS) IMS. The Core IMS may reserve resources for the IPTV service of the UE. The Figure 1 also includes a User Profile Server Function (UPSF) that is connected to the UE, and is used to store the subscription information of the UE. The Service Selection Function (SSF) is used to send the UE. Provide business order information that can be browsed and selected. Before the UE and the IPTV MF and the UE, a transport processing function is further included, which includes a transport control sublayer and a transport function entity, which is used to transmit the broadcast media of the LTV service by using the bearer resource reserved by the IMS Core. Between the transport layer and the Core IMS, a Network Attachment Subsystem (NASS) and a Resource and Adission Control Subsystem (RACS) are also included.

In the prior art, RTSP is selected to implement streaming media control, and also has some session control functions and media control functions. When encountering new convective media control, it is usually extended to RTSP, but the introduced extension Usually defined in SIP, causing duplication of functions, and conflicts may occur in the case where both protocols work together.

Currently, in order to control the streaming media, first, the SIP protocol message needs to be used to negotiate the RTSP channel and the media channel between the Control Client and the Control Server; and then, on the RTSP channel established according to the negotiation. The streaming media is controlled; finally, the negotiated media channel transmits the streaming media according to the control of the streaming media on the RTSP channel. The Control Client can be a UE; the Control Server can be an MCF or an MF. The RTSP channel is used to complete the control of the streaming media, and the RTSP defined SETUP message, ANNOUNCE message, description (DESCRIBE) message, and offload (TEARD0WN) message can all be replaced by the SIP negotiation process.

FIG. 1 is a flowchart of a method for controlling streaming media in the prior art, and the network entities involved include a Control CI ient and a Control Server, and the specific steps are as follows:

Step 201: The Control Client sends an access (INVITE) message to the Control Server. Carrying RTSP parameters for performing RTSP channel negotiation and streaming media request information for media channel negotiation;

Step 202: The Control Server that receives the INVITE message returns a 200 message to the Control Cl ient, where the message carries an RTSP response parameter for performing RTSP channel negotiation and a media related response (answer) for performing media channel negotiation.

Step 203: Control C l ient sends an acknowledgement (ACK) message to the Cont rol Server, and establishes an RTSP channel with the Control Server;

Step 204: On the established RTSP channel, the Control Cl ient sends a PLAY control operation command to the Control Server, where the playback information of the streaming media is played, including: streaming media playback initial location information, or/and streaming media playback. End location information, or / and duration;

Step 205: The Control Server that receives the PLAY control operation command determines the streaming media to be played according to the playback information carried by the command, returns a 200 message to the Control CI ient, and establishes a media channel with the Control Server.

Step 206: The Control Server plays the determined streaming media to the Control Cl ient through the media channel.

In this embodiment, the negotiation of the RTSP channel and the media channel is completed through the INVITE/200/ACK message in the SIP, and the RTSP channel is established after the negotiation is completed, and the control operation command of the streaming media is sent on the RTSP channel, for example: PLAY control operation The command, the establishment of the media channel is executed after the RTSP message. However, for some streaming media control, there is no need to perform complex control on the streaming media at first, but only simple control. For example, using the PLAY control operation command requires the Control Server to distribute the streaming media with the determined location or set duration to Control C. l ient , you only need to play streaming media through the media channel, without complicated control of the streaming media.

In Figure 1, the establishment of the media channel must be performed after the RTSP channel is established, and the streaming media transmitted on the media channel is controlled through the RTSP channel, so that for simple streaming control, such as streaming or recording only. Control, without controlling the time-shifting operation of streaming media, It is still necessary to establish an RTSP channel, which will occupy the connection resources of the system and cause a waste of connection resources of the system.

At the same time, because the establishment of the RTSP channel needs to traverse the NASS, it will also waste resources on the NASS device. For example, the NASS needs to open the RTSP channel and the corresponding anti-aging operation will waste resources on the NASS device.

In the prior art, there is another method for implementing control of the streaming media, as shown in FIG. 3, the specific steps are as follows:

Step 301: The Control C l ient sends an INVITE message to the Cont rol Server, and carries the streaming media request information used for media channel negotiation.

Step 302: The Control Server that receives the INVITE message returns a 200 message to the Control Cl ient, where the message carries a stream-related answer for media channel negotiation. Step 303: Control Cl ient sends an ACK message to the Control Server to establish a media. aisle;

Step 304: Contro Client performs a control operation on the streaming media, and sends a Re-INVITE message to the Cont rol Server, carrying the RTSP parameters for performing RTSP channel negotiation and the streaming media request information for media channel negotiation;

In this step, the streaming media request information for media channel negotiation is the same as that requested in step 301;

Step 305: The Control Server that receives the Re-INVITE message returns a 200 message to the Control C l ient, where the message carries the RTSP response parameter for performing the RTSP channel negotiation and the streaming media response information for performing the media channel negotiation.

In this step, the streaming media response information for media channel negotiation is the same as the response in step 302;

Step 306: Control C l ient sends an ACK message to the Control Server to establish an RTSP channel with the Control Server.

Step 307, on the established RTSP channel, Control Cl ient to Control Server Sending a PLAY control operation command, where the playback information of the streaming media to be played, including: streaming media playback initial location information, or/and streaming media playback end location information, or/and streaming media playback duration, and the like;

Step 308: The Control Server that receives the PLAY control operation command determines the streaming media to be played according to the playback information carried by the command, returns a 200 message to the Control Cl ient, and the Control Server determines to play the media channel established by the Step 303 by the Control Server. stream media.

In the process of implementing the present invention, the inventors have found that at least the following technical problems exist in the prior art: (1) As can be seen from FIG. 3, if the RTSP control channel is not established immediately after the initial SIP INVITE-200-ACK negotiation process Then, in the subsequent control of the streaming media transmitted by the media channel, the three-way handshake interaction of the SIP renegotiation and the establishment of the RTSP channel can be performed, which not only occupies the resources of the system, but also enables the flow transmitted on the media channel. The media's control response time is longer, which reduces the user's experience of receiving streaming media.

(2) As can be seen from Fig. 2, if the RTSP control channel is established immediately after the initial INVITE-200-ACK negotiation process, but the user does not subsequently perform a streaming media control operation such as "fast forward" operation, the established RTSP After the channel is established, it is not used, which wastes system resources. If the RTSP channel also spans the NAT entity, it will also waste resources on the intermediate NAT entity.

Summary of the invention

Embodiments of the present invention provide a method for controlling streaming media, which can implement control of streaming media while reducing system resources and controlling reaction time.

Embodiments of the present invention also provide an apparatus for controlling streaming media, which can implement control of streaming media while reducing occupied system resources and controlling reaction time.

According to the above objective, the technical solution of the embodiment of the present invention is implemented as follows:

A method of controlling streaming media, the method comprising:

The control server receives the streaming media control information during the SIP initial streaming media negotiation process with the control client, and controls the streaming media transmitted to the control client according to the streaming media control information. An apparatus for implementing streaming media control, the apparatus comprising a negotiation module and a receiving module, wherein the negotiation module is configured to negotiate the streaming media control information during the SIP initial streaming media negotiation process with the streaming media control; Receiving a streaming media that implements streaming media control.

An apparatus for implementing streaming media control, the apparatus includes a negotiation module and a sending module, wherein the negotiation module is configured to negotiate streaming media control information during a SIP initial streaming media negotiation process with a control client; and a sending module, configured to The streaming media control information negotiated by the negotiation module determines the streaming media to be transmitted and sends the streaming media to the controlling client.

It can be seen from the foregoing solution that the embodiment of the present invention does not need to establish a media control channel for controlling the streaming media when the complex control of the streaming media transmitted by the media channel is not required, but only controls the streaming media when performing SIP negotiation. The information is sent to the Cont rol Server by the Cont rol CI ient. The Control Server performs streaming control on the media channel according to the information, so that no resources need to be reserved for the media control channel, and the system resources and control reaction time are reduced. Realize the control of streaming media.

DRAWINGS

1 is a schematic diagram of a service function architecture of an IMS-based IPTV service according to the prior art;

1 is a flow chart of a method for controlling streaming media in the prior art;

3 is a flow chart of a second method for controlling streaming media in the prior art;

4 is a flowchart of a method for controlling streaming media according to an embodiment of the present invention;

FIG. 5 is a flowchart of a method for controlling streaming media according to a specific embodiment of the present invention; FIG.

6 is a flowchart of a method for controlling streaming media according to a second embodiment of the present invention;

7 is a schematic diagram of a system for controlling streaming media according to an embodiment of the present invention;

8 is a schematic diagram of Cont rol Cl ient for controlling streaming media according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of a Cont rol Server for controlling streaming media according to an embodiment of the present invention.

detailed description

The embodiments of the present invention are further described in detail below with reference to the accompanying drawings. In order to realize the control of the streaming media in the case of reducing the occupied system resources and reducing the control reaction time, the embodiment of the present invention does not need to perform complex control operations on the streaming media transmitted by the media channel, such as playing or recording control operations. The media control channel is established to control the streaming media, and the streaming media control information is sent to the Control Server by the Control Cl ient only during the SIP negotiation, and the Control Server controls the streaming media on the media channel according to the information, thereby reducing The resources occupied by the media control channel and the time required to establish the media control channel.

Further, in the embodiment of the present invention, the media control channel to be established may be negotiated in the SIP negotiation process, and when complex control is required on the streaming media, such as performing time shift operation (including fast forward and fast rewind of the streaming media) Or suspend control operations, etc., establish a media control channel according to the pre-negotiated media control channel parameters, and send control operation commands on the media control channel to control the streaming media transmitted in the media channel. In this way, control of the convective medium is achieved with reduced control reaction time.

In the embodiment of the present invention, the RTSP channel is used as a media control channel for detailed description. The method provided by the embodiment of the present invention mainly includes: specifying streaming media control information, including streaming media identifiers to be played or recorded, and streaming media locations, etc., in the SIP initial streaming media negotiation process, without transmitting control through the established RTSP channel. The operation command indicates that the RTSP channel is established by negotiation delay in the initial SIP media negotiation process. If both parties are accepted by the negotiation, the RTSP channel is not established immediately after the negotiation is completed, but only the media channel is established, and the negotiation delay is optionally established during the negotiation. The time range of the RTSP channel is not specified by default. The third technical feature is that the timing of establishing the RTSP channel depends on the Control Cl ient. For example, the Control CI ient receives complex control of the streaming media, and determines that only the RTSP message is received. The interaction can complete the control of the streaming media. At this time, the RTSP channel is established according to the negotiated RTSP parameters in the SIP initial streaming negotiation process.

4 is a flowchart of a method for controlling a streaming media according to an embodiment of the present invention. The specific steps are as follows: Step 401: A Control Pri sends an INVITE message, where the RTSP parameter used for negotiating a delay to establish an RTSP channel is used to negotiate to establish a media channel. Media request information and streaming media Body control information.

In this step, in order to control the streaming media of the media channel without the control operation command of the streaming media that does not pass through the RTSP channel, the streaming media control information is added to the INVITE message, and the streaming media control information is generally only preset. Simple control of the streaming media, such as playing or recording one or more of setting the initial position, ending position, and duration of the streaming media.

For example, the INVITE message may be (the embodiment does not have a SIP message part, only the SDP part is included): v=0 〃 version number

o=alice 2890844526 2890844526 IN IP4 a. atlanta. example. com II represents the session ID, the user name is Alice, the session ID is 2890844526, the version number is 2890844526, the network type is Internet, the address type is IPV4, and the address is expressed in URI format. a. atlanta. example, com

s=Streaming Session //session name is "Streaming"

Sess ion"

i=A Streaming sess ion declaration within the sess ion description protocol 〃 session information is described as "streaming session session using SDP"

C=IN IP4 a. atlanta. example, com 〃 connection information, where the network type is Internet, the address type is IPV4, and the address is a. atlanta. example, com

t=0 0 〃The media session start and end times are both set to 0, indicating that the start and end times are not limited.

m=application 9 TCP/RTSP rtsp 〃 indicates RTSP media control channel information, where application indicates that the media line is used for application, and 9 is a meaningless TCP default listening port (because the local end is the originating connection party, it is a dynamic port, so This parameter has no specific meaning. It is indicated later that the TCP connection is used for RTSP.

a=fmtp: rtsp reques t-ur i: rts : //b. biloxi. exam le, com/ scene // indicates the server side address of rts (ie request-uri )

a=fmtp: rtsp vers ion: 2.0 // indicates rtsp version number a=fmtp: rtsp h-accept-ranges: NPT // indicates that the time used by r ts indicates that the type is NPT

a=fmtp: rtsp h-range clock=19960213T143205Z-; time=19970123T143720Z 位置The position information of the ready-to-play media is given here, starting from the position indicated by clock.

a=fmtp: rtsp h-supported: deferred 〃 indicates that the local end supports delay establishment of RTSP channel mode.

a=connection: new // indicates that the TCP connection is a new connection.

a=setup: active // indicates that the local end is the connection initiator.

a=rtspid m-stream: 10 〃 gives the media control channel number for association with the media channel

m=audio 6666 RTP/AVP 0 〃Used to describe the media channel information, expressed as audio, receive media on port 6666, media type number is 0

a=rtpmap: 0 PCMU/8000 〃 indicates that the media type is G711U, 8KHZ a a=recvonly 〃 indicates that the media is only used for receiving

a=label: 10 〃 Give the media channel an identifier for association with the description in the previous media control channel a=r tsp-id m-stream: 10

In the message, by providing & = 1"11^ : rtsp h_range...., the streaming media control information such as one or more of the streaming start position, the end position, and the duration of the playback is specified, so that The streaming media control information is sent to the Control Server directly during the SIP negotiation process without establishing an RTSP channel.

In this message, the Control Server is notified by providing a=fmtp: rtsp h-supported: deferred , and Control CI ient supports delayed establishment of the RTSP channel. If the Control Server does not support delay establishment of the RTSP channel, it can take a =fmtp: rtsp h-unsupported: deferred or ignore the response of the 200 message. At this time, both parties need to immediately establish the RTSP channel mode to successfully complete the SIP. After initial streaming negotiation, establish an RTSP channel; Control Server If you agree to delay the establishment of the RTSP channel, carry the a=fmtp: rtsp h-required: deferred in the response of the 200 message to complete the initial SIP media negotiation. This indicates that the two parties will delay the establishment of the RTSP channel, and the timing of the establishment will be controlled by the Control Client. It is determined that the Control Server listens to the Control Client during the entire transport streaming process to determine when the Control Client initiates the process of establishing an RTSP channel.

In the embodiment of the present invention, in order to prevent the Control Client from subsequently establishing the RTSP channel, it is also possible to increase the mouth expires parameter in the a line, ^ port a=fmtp: rtsp h-supported: deferred; a=fmtp: h-expires= 60, indicating that if the Control Client does not initiate the process of establishing an RTSP channel within 60 minutes, the Control Server directly initiates the process of establishing an RTSP channel in 60 minutes.

Step 402: The Control Server returns a 200 message, where the RTSP response parameter used to negotiate the delay to establish the RTSP channel, the flow-related answer used to negotiate the establishment of the media channel, and the control streaming media response information are carried.

For example, the response carried by the 200 message may be (the SIP message part is not included in this embodiment, and only the SDP part is included):

V=0 〃 version number

= 〃〃 example example 808 808 808 808 808 808 808 808 B. biloxi. example, com

s=Streaming Session II session name is "Streaming Session" i=A Streaming session declared within the session description protocol 〃 Session information is described as "streaming session using SDP"

C=IN IP4 b. biloxi. example, com 〃 connection information, where the network type is Internet, the address type is IPV4, and the address is b. bi loxi. example, com

t=0 0 〃The media session start and end times are both set to 0 to indicate that the start and end times are not Limit

m=application 554 TCP/RTSP rtsp 〃 indicates RTSP media control channel information, where application indicates that the media line is used for application, 554 is the TCP connection used by RTSP to connect to the local listening port, and the latter indicates that the TCP connection is used for RTSP.

a=connection: new // indicates that the TCP connection is a new connection.

a=setup: passive // indicates that the local end is the receiving receiver.

a=control: rtsp: //b. biloxi. example, com/scene //RTSP control URI, representing the URI of the local server

a=fmtp: rtsp version: 2.0 〃RTSP version number

a=fmtp: rtsp h- accept- ranges: NPT 〃 indicates the accepted timestamp processing type a=fmtp: rtsp h-session: 6238237 //The local end generates the RTSP session ID a=fmtp: rtsp h-date: Tue , 05 Sep 2006 09: 56: 44 GMT 〃 gives time a=fmtp: rtsp hr tp-inf o: url="rtsp: //b. biloxi. example, com/ scene"

Ssrc=1631654733: seq=53961; rtptime=0

〃 denotes RTP information related to RTSP controlled media sessions, such as the ssrc attribute.

a=rtspid m-stream: 10 〃 Give the media control channel an identifier for association with its controlled media channel

m=audio 8888 RTP/AVP 0 描述 Description of the media channel, indicating media port 8888,

PT value is 0

a=rtpmap: 0 PCMU/8000 〃 indicates that the codec type is G711U, 8KHZ is the same. a=sendonly 〃 indicates that the local media is only used for sending.

a=label: 10 〃 Give the media channel a representation for association with the previous media control channel

In this message, if the Control Server does not need to delay establishing the RTSP channel, then you need to discard a=fmtp: rtsp h-suppor ted: deferred or carry a=fmtp: rtsp H-unsuppor ted: deferred (In the example, a=fmtp: rtsp h-supported: deferred has been discarded, indicating that the Control Server does not delay establishing the RTSP channel); if the Control Server does not support RTSP, U'J if tm = appl The icat ion 0... method uses 4 jugs to establish the RTSP channel, ie the port number is 0 (in the example, the Control Server supports RTSP). Note that discarding a=fmtp: rtsp h-supported: deferred or carrying a=fmtp: rtsp h-unsupported: deferred does not affect the success of the SIP initial streaming negotiation process. It can only indicate that the RTSP channel cannot be delayed.

Step 403: The Control Client sends an ACK message to the Control Server to indicate confirmation. Step 404: The Control Server establishes a media channel according to the negotiated media channel information, and transmits the determined streaming media according to the established media channel according to the streaming media control information sent by the Control CI ient during the SIP initial streaming media negotiation process.

Step 405: The Control Client controls the streaming media transmitted by the media channel, and the control process needs to be completed by using the RTSP message, and then initiates the process of establishing the RTSP channel (if the RTSP channel is to be delayed), that is, according to the initial streaming media in the SIP. Negotiate the negotiated RTSP channel parameters to establish an RTSP channel with the Control Server.

In this step, a control operation command corresponding to the RTSP channel to be established and a control rule for the streaming media are preset in the Control Client. When the Control Client wants to control the streaming media, it is determined whether the control rule is met or not. The set control operation command, if yes, initiates the process of establishing an RTSP channel; if not, it does not.

In this step, the set control operation command corresponding to the RTSP channel to be established may be a fast reverse, fast forward, pause, record, etc. time shift control operation command, or a space shift control operation command for controlling the streaming media screen. The set control rule corresponding to the streaming media to establish the RTSP channel may also be to change the location information of the streaming media currently played or recorded on the media channel.

Step 406: After the Control Client establishes the RTSP channel, the Control Client sends a control operation command to the Control Server for the streaming media transmitted by the media channel.

Step 407: After receiving the control operation command, the Control Server transmits the message to the media channel. The input streaming media executes the control operation command and returns a 200 message.

The process of executing this control operation command is the same as the prior art.

In the embodiment of the present invention, the flow control information may also be indicated in the Reques t Uniform Resource Identifier (URI) in the INVITE message by carrying a parameter, and the user type (user)=rtsp is added to the Request URI. The URI parameter is used to indicate that the flow control information is carried and carries the range feature information. The specific meaning of the Range may refer to the RTSP definition of the header field in the RFC2326 standard, and generally indicates the initial location information of the broadcast or recorded streaming media. And ending the location information, and one or more of the streaming media duration, and the like. E.g:

Sip:

r tspcl ientSexamplem. com; user=r tsp?range=clock%3Dx960213T143205Z-%3 Bx; time%3Dxl9970123T143720Z II user=rtsp indicates that the streaming control information is carried.

Among them, the ABNF syntax of the header field relative to the RFC3261 standard can be defined as follows:

SIP-URI "sip: " [ user inf o ] hostport

Ur i-parameters [ headers ]

SIPS-URI "sips: " [ userinfo ] hostport

Ur i-parameters [ headers ]

Ur i-parameters = * ( "; " ur i-parameter)

Ur i-parameter = transpor t-param / user-param method-pa ram

/ ttl-param / maddr-param lr-param / other-param

User-param user=" ( "phone ^; r tsp"/other-user) 〃Instructs rts negotiation

Headers "?" header * ( "&" header )

Header (hname " = " hvalue) / ("range="Range) //In the header field, carry Range Range = "Range" HCOLON ranges-list [exec-t ime] CRLF Adds a header carried in the SIP URI

Ranges-list = ranges-spec * (COMMA ranges-spec)

Exec-t ime = SEMI "time" EQUAL utc-time

Ranges-spec = npt-range / utc-range / smpte-range

I range-ext

Range- -ext = extension_format "=" range-value

Range- -value = 1* (rtsp-unreserved / quoted-string / ": " ) smpte- -range = smpte-type "=" smpte-range-spec

Smpte- -range- spec = ( smpte-t ime "-" [ smpte-t ime ] )

I ( "-" smpte-t ime )

Smpte-type = " smpte" I " smpte-30-drop"

I " smpte-25" / smpte-type-extens ion ; other t imecodes may be added

Smpte- -type-extension = token

Smpte-t ime 1*2DIGIT ": " 1*2DIGIT ": " 1*2DIGIT

[ ": " 1*2DIGIT [ ". " 1*2DIGIT ] ] npt-range "npt=" npt-range-spec ; Sect ion 3.5 npt-range-spec = ( npt-t ime "-" [ npt-t Ime ] ) / ( "- npt-t ime )

Npt-t ime "now" I npt-sec / n t-hhmms s

Npt-sec 1*DIGIT [ ". " *DIGIT ]

Npt-hhmms s npt-hh ": " n t-mm ": " npt-ss [ ". " *DIGIT npt-hh 1*DIGIT ; any positive number

n t-mm 1*2DIGIT ; 0-59

Npt-ss 1*2DIGIT : 0-59 Utc-range "clock="utc-range-spec; Sect ion 3.6 utc-range-spec ( utc-time "-" [ utc-time ] ) / ( "-" utc-t ime )

Utc-t ime utc-date "T" utc-clock "Z"

Utc-date 8DIGIT ; < YYYYMMDD >

Utc-clock 6DIGIT [ ". " fraction ]; < HHMMSS. fraction fraction = 1*DIGIT

The parameter of the SIP URI carries the playback location information (including the clock/time or the smpte or npt indication) of the streaming media, so that even if the Control Server does not support the RTSP at all, the RTSP parameter in the SIP cannot be identified. Or corresponding processing, it is also possible to locate the streaming media according to the SIP URI and start playing from the located location. In this embodiment, clock/time or smpte or npt is a representation of the clock. Smpte ( Society of Motion Picture and Television Engineers ) is used to represent the standard definition information of streaming media moving images. Its representation of time war is: hour: minutes: seconds: f rames. subf rames , ^ smpte=10: 00 : 00-10: 07: 00: 05.01; npt is Normal Play Time, which is used to indicate the absolute position information of the streaming media relative to the starting position, such as npt=12: 05: 03.3- means from time 12: 05: 03 Frame to end; clock/time is the absolute time information defined by the ISO 8601 standard, giving the absolute time UTC. For example, November 8, 1996, 14:37:20.25 seconds can be expressed as: 19961108T143720.25Z.

In the embodiment of the present invention, the following two methods can also be used for the SIP-URI:

The first way:

Sip: rtspcl ientSexamplem. com; r tsp-range=clock%3Dx960213T143205Z -%3Bx; time%3Dxl9970123T143720Z

The range header field information is directly carried to represent the streaming media control information without carrying the user=rtsp parameter; The second way:

Sip: rtspc l ient; rtsp-range=c lock%3Dx960213T143205Z-%3Bx; t ime%3D xl9970123T143720Zo) examplem. com

The content of the range information is placed in the user information (user info) part before S), which can indicate the media location information that needs to be played, that is, the streaming media control information. FIG. 5 is a flowchart of a method for implementing control flow media according to Embodiment 1 of the present invention. The method is applied to an IMS-based IPTV service architecture, where a Control Cl ient is a UE and a Control Server is an MF. In this embodiment, for Content On Demend (COD) or Time-Shifted TV in the IPTV service, the UE obtains the network side RTSP channel parameter in the acquired electronic program menu (EPG). And the media channel information may be carried in the I NV I TE message. After the SCF forwarding on the network side and the SIP initial streaming media negotiation with the MF is completed, the UE does not need to establish an RTSP channel immediately between the MF and the MF. The UE may only need to browse the COD content or start playing from the initial position of the TV program (TsTV service) in the INVITE message. In this case, it is not necessary to establish an RTSP channel, but only the INVITE message needs to carry the streaming media control information; In the subsequent process, when time shift control or pause control is required for the streaming media, the control needs to be completed after the RTSP channel is established. At this time, the RTSP channel can be established by means of the pre-negotiated RTSP parameters and the stream transmitted through the media channel can be established thereon. The media controls.

The specific steps to implement Figure 5 are:

Step 501: The UE sends an INVITE message to the Core IMS, where the RTSP parameter used to negotiate the establishment of the RTSP channel, the media request information used to negotiate to establish the media channel, and the flow media control information are carried.

Step 502: The Core IMS and the Border Gateway Function Entity (BGF) perform resource reservation on the media resource according to the INVITE message.

Step 503: The Core IMS forwards the INVITE message to the SCF.

Step 504: The SCF selects an MF that processes the INVITE message, and sends an INVITE to the selected MF. Message.

In this step, how to select the MF that processes the I NV I TE message can use the prior art. Step 505: After receiving the INVITE message, the MF processes, according to its own policy, an RTSP parameter carried in the message for negotiating a delay to establish an RTSP channel, media request information for negotiating to establish a media channel, and streaming media control information, and generates Negotiating the delay to establish the RTS response parameter of the RTSP channel, the streaming-related answer for negotiating the establishment of the media channel, and the control streaming response information are carried in 200 and sent to the SCF.

Step 506: The SCF forwards the 200 to the Core IMS.

Step 507: The Core IMS and the BGF perform resource reservation on the media resource according to the 200 message.

Step 508: The Core IMS forwards the 200 message to the UE.

Step 509: A media channel is established between the UE and the MF according to the negotiated media request information, and the MF transmits the corresponding streaming media to the UE through the media channel according to the negotiated control media information.

Step 510: The user performs a control operation on the streaming media received by the UE, and the UE determines that the control operation requires the RTSP message to complete, and then initiates the process of establishing the RTSP channel according to the negotiated RTSP parameter.

Step 511: The UE sends an RTSP message carrying a streaming media control operation command to the MF on the established RTSP channel, and controls the streaming media transmitted by the media channel.

Step 512: After the MF completes the control operation on the streaming media according to the RTSP message, the MF returns a control result to

UE.

The RTSP parameters and the streaming media control information carried in the INVITE message and the MF returned in the 200 message carrying the SDP description for carrying out the negotiation to delay the establishment of the RTSP channel are the same as those described in FIG. 4, and are not described here.

FIG. 6 is a flowchart of a method for implementing control flow media according to Embodiment 2 of the present invention. The method is applied to an IMS-based IPTV service architecture, where Cont ro l C l ient is nPVR SCF and Cont ro l Server is nPVR MF. . This embodiment implements personal video recording provided to the network. (nPVR, Ne twork Per sona l Video Recorder) The control method of the service, which uses the delay to establish the RTSP channel. In this embodiment, for the nPVR service, the nPVR SCF initiates a SIP session when the event is recorded according to the recording plan submitted by the UE. At this time, the nPVR MF of the nPVR SCF is managed and the COD SCF for recording the streaming media is managed. The negotiation between the media channel and the media control channel between the COD MFs, after the negotiation of the media channel and the RTSP channel between the nPVR MF and the COD MF, the nPVR MF does not immediately establish an RTSP channel with the COD MF, so at this time Both are limited to very simple streaming recording control, nPVR MF only needs to receive streaming media and record locally. However, depending on the recording schedule, you may need to perform other control operations on the streaming media during recording or after recording. For example, according to the recording schedule, when recording to a certain moment, start rewinding to a streaming media location and then re-recording. The nPVR SCF will generate complex control of the streaming media according to the pre-recording plan. At this time, the nPVR SCF will notify the event to the nPVR MF, and the nPVR MF will establish an RTSP channel between the negotiated RTSP channel parameters and the COD MF to complete the streaming media. Complex control.

The specific implementation steps of the method shown in Figure 6 are:

Step 601: The nPVR SCF sends an S IP message to the nPVR MF, requesting an RTSP parameter for negotiating a delay to establish an RTSP channel, media request information for negotiating establishing a media channel, and streaming media control information.

Step 602: The nPVR MF returns an S IP response message to the nPVR according to the policy set by itself, and carries an RTSP parameter for negotiating a delay to establish an RTSP channel, media request information for negotiating establishing a media channel, and streaming media control information.

Step 603: The nPVR SCF initiates an initial IP media negotiation process to the COD SCF, that is, sends an S IP negotiation message, where the information carried in the S IP response message replied by the nPVR MF in step 602 is carried.

Step 604: The COD SCF forwards the S IP negotiation message to the COD MF.

Step 605: The COD MF generates an RTSP response parameter for negotiating a delay to establish an RTSP channel, a streaming media related answer for establishing a media channel, and a control streaming media response information according to the policy set by itself and the received SIP negotiation message. And returning an IP negotiation response message to the COD SCF, where the generated response information is carried. Step 606: The COD SCF forwards the SIP negotiation response message to the nPVR SCF.

Step 607: The nPVR SCF sends an ACK message to the nPVR MF, and carries the information carried in the S IP negotiation response message in step 606.

In this step, the negotiation of the RTSP channel and the media channel has been completed on both sides of the nPVR and COD.

Step 608: The nPVR MF notifies the nPVR that the SCF starts recording the streaming media transmitted by the established media channel according to the control streaming response information.

In this step, it is reported through the Y2 interface defined by TISPAN.

In this step, the COD MF can transmit the streaming media to the nPVR MF through the established media channel, and the nPVR MF locally records the transmitted streaming media.

Step 609, the nPVR SCF according to the set recording schedule or the recording operation received by the SSF, at some point in time, need to skip the current advertisement or irrelevant content, for example, a 10-minute event of the midfield break of the ball game, then determine the media channel. The transmitted streaming media pauses for 10 minutes or fast forwards for 10 minutes. At this time, the nRVR SCF notifies the nPVR MF that complex control of the streaming media transmitted through the media channel is required, and the RTSP channel needs to be initiated.

Step 610: The nPVR MF and the COD MF establish an RTSP channel of the RTSP channel according to the negotiated delay. After the RTSP channel is established, the control operation command for the streaming media is sent, such as sending the pause recording for 10 minutes or fast forwarding for 10 minutes, and then streaming the media again. For recording, the COD MF operates on the streaming media in accordance with the control operation commands.

For the operation of delaying the establishment of the RTSP channel and the recording of the streaming media, the steps described in FIG. 4 may be referred to in FIG. 6, and details are not described herein again.

In Figure 6, Control Cl ient is nPVR MF and Control Server is COD MF. The embodiment of the present invention further provides a system for implementing streaming media control. As shown in FIG. 7, the system includes: Control C l ient ^ Cont rol Server , where

The Control Cl ient and the Control Server negotiate the streaming media control information during the initial SIP media negotiation process, and the Control Server determines the transmission to be performed according to the negotiated streaming media control information. Streaming media, sent to Control Client.

In the embodiment of the present invention, the Control Client is a first Control Client, and the Control Server is a first Control Server, and the first Control Client negotiates for delay establishment in an initial SIP media negotiation process with the first Control Server. Media control parameters of the media control channel, after the first Control Client and the first Control Server delay the establishment of the media control channel according to the media control parameter, the first Control Client is on the established media control channel to the first Con tr 01 C 1 i en t sends a control operation command, and the first Con tro 1 Client receives the control operation command according to the media control channel established by the delay, and controls the streaming media transmitted through the media channel.

In a specific implementation, the flow control information exchanged between the Control CI ient and the Control Server is carried by the SIP message, and may be carried in the range field of the SIP message or carried in the URI of the SIP message.

Correspondingly, the media control parameters used by the Control CI ient and the Control Server to delay the establishment of the media control channel are also carried through the SIP message.

The specific structure of the Control Client is as shown in FIG. 8, and includes a negotiation module 1 and a receiving module 2, wherein the negotiation module 1 negotiates the streaming media control information during the initial SIP media negotiation process with the Control Server; the receiving module 2 receives the Control Server. Streaming media sent.

In FIG. 8, the Control Client further includes a channel module 3 and a sending module 4, and the negotiation module 1 further negotiates media control for delaying establishment of a media control channel during a SIP initial streaming negotiation process with the Control Server. The parameter is sent to the establishing channel module 3. The establishing channel module 3 delays establishing the media control channel according to the received media control parameter, and the sending module 4 sends a control operation command on the established media control channel.

The specific structure of the Control Server is as shown in FIG. 9 , and includes a negotiation module 1 and a sending module 4, wherein the negotiation module 1 negotiates the streaming media control information to the sending module 4 during the initial SIP media negotiation process with the Control Client. The sending module 4 determines the streaming media to be transmitted according to the received streaming media control information negotiated by the negotiating module 1 and sends the streaming media to the Control Client. In a specific implementation, the flow media control information sent and received by the Control Client is carried by the SIP message, and may be carried in the range field of the SIP message or carried in the URI of the SIP message.

Correspondingly, the media control parameters sent and received by the Control Client for delaying the establishment of the media control channel are also carried through the SIP message.

In FIG. 9, the Control Server further includes a receiving module 2 and an executing module 5, wherein the negotiating module 1 further negotiates media for delaying establishment of the media control channel during the initial SIP media negotiation process with the Control CI ient. The control module 2 receives the control operation command sent by the Control Client through the media control channel that is delayed, and sends the control operation command to the execution module 5, and the execution module 5 performs the streaming media transmitted through the media channel according to the command received by the receiving module 1. control.

In a specific implementation, the flow media control information sent and received by the Control Server is carried by the SIP message, and can be carried in the range field of the SIP message or carried in the URI of the SIP message.

Correspondingly, the media control parameters sent and received by the Control Server for delaying the establishment of the media control channel are also carried through the SIP message.

The method and apparatus described in detail above in the embodiments of the present invention can be:

First, when there is only simple control of the streaming media, such as recording or playing, the embodiment of the present invention implements the control of the streaming media transmitted in the media channel by negotiating the streaming media control information in the SIP initial streaming media negotiation process. There is no need to separately establish a media control channel to control the streaming media.

Second, when it is impossible to determine whether there is any other control or complex control on the streaming media in the future, in order to avoid waste of resources caused by establishing the media control channel, a mechanism for establishing a media control channel by delaying negotiation in the initial SIP media negotiation process is extended. Then establish a media control channel. Until the subsequent control or complex operation of the streaming media, the media control channel is sent to control the streaming media transmitted by the media channel by establishing a media control channel after the media control parameters are negotiated in the initial SIP media negotiation process.

Third, in the process of transmitting streaming media through the media channel, no media control is currently established. When the channel needs to be established later, the media control parameters are negotiated in advance during the initial SIP media negotiation process to avoid excessive message interaction when the media control channel is subsequently established, which improves the response time of the control media stream and improves the user's response time. Experience.

The above is a description of specific embodiments of the present invention, and the method of the present invention may be appropriately modified in a specific implementation process to suit the specific needs of a specific situation. Therefore, it is to be understood that the specific embodiments of the present invention are not intended to limit the scope of the invention.

Claims

Claim

A method for controlling streaming media, the method comprising:

The control server receives the streaming media control information during the SIP initial streaming media negotiation process with the control client, and controls the streaming media transmitted to the controlling client according to the streaming media control information.

The method according to claim 1, wherein the streaming media control information is carried in a media control channel description information in a SIP message or carried in a uniform resource identifier in a SIP message.

3. The method according to claim 1, wherein the streaming media control information is playback streaming media location information.

4. The method of claim 3, wherein the process of specifying the streaming media control information by the uniform resource identifier in the SIP message is:

The streaming media control information is carried by the usage type designation in the uniform resource identifier; or the streaming media control information is specified by the user information or the uniform resource identifier-parameter designation in the uniform resource identifier.

The method of claim 1, wherein the method further comprises: during the initial media negotiation of the S IP with the control client, the method further comprises:

The control server negotiates and delays establishing a media control channel during the initial SIP media negotiation process with the control client;

The control server receives a control operation command that controls the client to transmit through the delayed media control channel, and controls the streaming media transmitted to the control client.

The method of claim 5, further comprising: before receiving the control operation command that is transmitted by the control medium through the delayed media control channel, the method further includes:

The control client determines whether the control operation command to be sent conforms to the set control rule or the set control operation command according to the control operation command corresponding to the control operation command or the streaming media to be established, and is extended according to the negotiation result. After that, the media control channel is established, and the control operation command is sent through the delayed media control channel.

7. A device for implementing streaming media control, characterized in that the device comprises a negotiation module (1) And receiving module (2), wherein

The negotiation module (1) is configured to negotiate with the control server for streaming media control information during the initial SIP media negotiation process;

The receiving module (2) is configured to receive the streaming media sent by the control server.

8. The device according to claim 7, wherein the device further comprises a channel module (3) and a transmitting module (4), wherein

The negotiation module (1) is further configured to negotiate, with the control server, a media control parameter for delaying establishment of the media control channel during the initial SIP media negotiation process;

Establishing a channel module (3), configured to delay establishing a media control channel according to the media control parameter; and a sending module (4), configured to send a control operation command on the established media control channel.

A device for implementing streaming media control, characterized in that the device comprises a negotiation module (1) and a sending module (4), wherein

The negotiation module (1) is configured to negotiate streaming media control information during the initial SIP media negotiation process with the control client;

The sending module (4) is configured to determine, according to the streaming media control information negotiated by the negotiation module, the streaming media to be transmitted, and send the streaming media to the control client.

10. The apparatus according to claim 9, wherein the apparatus further comprises a receiving module (2) and an execution module (5), wherein

The negotiation module (1) is further configured to negotiate media control parameters for delaying establishment of the media control channel during the initial SIP media negotiation process with the control client;

a receiving module (2), configured to receive, by using a media control channel that is deferred, a control operation command sent by the control client;

The executing module (5) is configured to control the streaming media transmitted through the media channel according to the command received by the receiving module.