WO2009049509A1

WO2009049509A1 - A stream media data playing control method and apparatus

Info

Publication number: WO2009049509A1
Application number: PCT/CN2008/071710
Authority: WO
Inventors: Futang Li
Original assignee: Shenzhen Coship Electronics Co., Ltd.
Priority date: 2007-10-17
Filing date: 2008-07-22
Publication date: 2009-04-23
Also published as: CN101202640A

Abstract

A stream media data playing control method, includes: transmitting session connection SIP message to a stream media server, and establishing SIP session connection channel with the stream media server; transmitting a stream media playing control SIP message to the stream media server through the SIP session connection channel, and stream media playing control information is carried. A stream media data playing method, includes: receiving SIP session connection message transmitted by a playing terminal, and establishing SIP session connection channel with the playing terminal; receiving a stream media data playing control SIP message transmitted by the playing terminal through the SIP session connection channel, and the carried stream media data playing control information is extracted; transmitting multimedia data flow to the playing terminal according to stream media data playing control information.

Description

Streaming media data playing control method and device

This application claims priority to Chinese Patent Application No. 200710124023.3, entitled "A Streaming Media Data Playback Control Method and Apparatus", filed on October 17, 2007, the entire contents of which are incorporated by reference. In this application.

Technical field

The invention belongs to the field of streaming media data processing, and in particular relates to a streaming media data playing control method and device.

Background technique

Streaming Media, also known as Streaming Media, is a new way of media delivery. In this way, the entire audio/video (Audio/Video) and three-dimensional (3D) multimedia files are divided into compression packages by special compression methods, and are continuously and real-time transmitted by the streaming media server to the user computer. The user does not have to wait for the entire file to be downloaded as in the download mode, and only needs a few seconds or tens of seconds of startup delay to decompress the compressed Audio/Video, 3D and other multimedia files on the user's computer using the decompression device. After playing and watching.

In the prior art, streaming media data playback is generally controlled by a Microsoft Media Server (MMS) protocol or a Real Time Streaming Protocol (RTSP) protocol. However, the MMS protocol and the RTSP protocol have incomplete definitions of the streaming media data playback control, and can only realize the operations of playing and stopping the single stream, and the playback control mode of the streaming media data stream is single, and the playback control function is limited.

Summary of the invention

The object of the embodiments of the present invention is to provide a method for controlling streaming data playback, which aims to solve the problem that the definition of the streaming media data playing control is incomplete in the prior art, and the playback control mode of the streaming media data stream is single, and the playback control is performed. A problem with limited functionality.

The embodiment of the present invention is implemented as follows. A streaming media data playing control method, where the method includes the following steps:

Sending a session connection SIP message to the streaming server, and establishing a SIP session connection channel with the streaming server;

And sending, by the SIP session connection channel, a streaming media play control SIP message to the streaming media server, and carrying the streaming media play control information. Another object of the present invention is to provide a streaming media data playing terminal, where the terminal includes:

a session connection unit, configured to send a session connection SIP message to the streaming media server, and establish a SIP session connection channel with the streaming media server;

a play control message sending unit, configured to send a streaming media play control SIP message to the streaming media server by using the SIP session connection channel, and carry the streaming media play control information;

a data playing unit, configured to receive and play a multimedia data stream transmitted by the streaming media server. Another object of the embodiments of the present invention is to provide a streaming media data playing method, the method comprising the following steps:

Receiving a session connection SIP message sent by the playing terminal, and establishing a SIP session connection channel with the playing terminal;

Receiving, by using the SIP session connection channel, a streaming media data play control SIP message sent by the play terminal, and extracting the streaming media data play control information carried in the message;

And transmitting, according to the streaming media data playing control information, a multimedia data stream to the playing terminal.

Another object of the present invention is to provide a streaming media data playing device, which is configured in a streaming media server, and the device includes:

a session connection unit, configured to receive a session connection SIP message sent by the play terminal, and establish a SIP session connection channel with the play terminal;

a play control message receiving unit, configured to receive, by using the SIP session connection channel, a streaming media data play control SIP message sent by the play terminal, and extracting the streaming media data play control information carried in the message;

And a playing control unit, configured to transmit the multimedia data stream to the playing terminal according to the streaming media data playing control information.

In the embodiment of the present invention, the SIP message is extended to enrich the manner in which the streaming media server controls the streaming media data stream, and the control function of the streaming media server is enhanced.

DRAWINGS

1 is a flowchart of streaming media data playback control according to an embodiment of the present invention;

2 is a structural diagram of a playback terminal according to an embodiment of the present invention;

FIG. 3 is a structural diagram of a streaming media server according to an embodiment of the present invention. detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In the embodiment of the present invention, the play terminal establishes a session connection with the streaming media server through the SIP protocol, and controls the playing of the streaming media data by using the streaming media data playing control information carried in the SIP message.

The Session Initiation Protocol (SIP) protocol provides a common signaling control protocol for deploying streaming media data services and video conferencing services on heterogeneous networks, enabling session-based services such as streaming media data and video conferencing. It has nothing to do with the specific access means and the underlying network. Since it is only a signaling control protocol, the SIP protocol is generally not used independently, and needs to be combined with other protocols such as the Transmission Control Protocol (TCP) protocol and the User Datagram Protocol (UDP) protocol. The SIP protocol is only responsible for the establishment of the session between the communicating parties and provides the communication party with the session negotiation function that determines the media types of the parties. Once the communication parties establish contact, the real service control will be realized by the business agreement or even the private agreement of both parties.

The SIP protocol defines, for example, REGISTER, INVITE, ACK, CANCEL, BYE, OPTIONS, NOTIFY, PUBLISH, SUBSCRIBE, Messages such as signaling (INFO), which can be carried and transmitted using the UDP protocol or other message protocols, and each message carries a request or response message.

FIG. 1 shows a flow of implementing streaming media data playback control by using a SIP protocol according to an embodiment of the present invention, which is described in detail as follows:

The playback terminal sends a session connection SIP message to the streaming media server to request to establish a session connection. After receiving the session connection SIP message sent by the playback terminal, the streaming media server returns a response message to the playback terminal to respond.

As an embodiment of the present invention, the playback terminal can establish a session connection with the streaming server by using the INVITE message in the existing SIP protocol. The playback terminal converts the user's streaming media data play request into an INVITE message, and transmits the data to the streaming media server where the streaming media data is located.

An example of a typical INVITE message is as follows: INVITE sip:cam3@a.com SIP/2.0

Via: SIP/2.0/UDP192.168.4.124:5060;branch=z9hG4bK-b2230f3bb435fd61b2 98ad85b4de8637

Via: SIP/2.0/UDP 192.168.4.117: 1121 ;branch=z9hG4bK-1170813591a5testl To: <sip:cam3@a.com>;tag=27186

From: <sip:testl @a.com>;tag=15718;contrast=add

Call-ID: eeae6897a7272b9e4828c4036ac33482

CSeq: 2 INFO

Call-Info: /movies/test.mp4

Contact: <sip:testl @a.com>

Max-Forwards: 69

Content-Length: 0

If the INVITE message is processed normally in the streaming server, the response message indicates that the request is successful, and includes Session Description Protocol (SDP) description information of the streaming media data requested by the playback terminal. From the description information, the playback terminal can know the related information of the requested streaming media data. If an exception occurs when the INVITE message is processed by the streaming server, the streaming server returns a response message indicating that the request failed to the playback terminal.

An example of a response message corresponding to the above INVITE message is as follows:

SIP/2.0 200 OK

Via: SIP/2.0/UDP 192.168.4.117: 1121; branch=z9hG4bK-1170813591a5testl

To: <sip:cam3@a.com>;tag=27186

From: <sip:testl @a.com>;tag=15718;contrast=add

Call-ID: eeae6897a7272b9e4828c4036ac33482

CSeq: 2 INFO

Call-Info: /movies/test.mp4

Contact: <sip:testl @a.com>

Max-Forwards: 69

Content- Type: application/sdp

Content-Length: 151 V=0

o=alice 2890844526 2890844526 IN IP4 client.atlanta.example.com

s=- c=IN IP4 192.0.2.101

t=0 0

m=audio 49172 RTP/AVP 0

a=rtpmap:0 PCMU/8000

The above response message is a message indicating that the request is successful, indicating that the INVITE message is processed normally in the streaming server. In the message, Content-Length: 151 is the SDP description of the requested streaming media data.

2. The playback terminal sends a streaming media playback control SIP message to the streaming media server, and carries the streaming media data playback control information. After receiving the message, the streaming media server returns a response message to the playback terminal.

As an embodiment of the present invention, the INFO message in the existing SIP protocol is extended, and the streaming media data playing control information is carried, and of course, other messages in the existing SIP protocol may be extended, or a new SIP message may be configured. .

The streaming data playing control information may specifically include the following parameters:

Streaming data stream playback control word: used to identify streaming media data playback, pause or stop; streaming media data stream playback range: defined by the playback start time and end time of the streaming media data stream, or by streaming media data stream Instantly identifying the broadcast of the streaming media data stream;

Streaming data stream advance and retreat rate control word: Used to identify the playback rate of the streaming media data stream, using a non-zero value identifier. When the value is a positive number, it indicates that the streaming server is requested to fast play the streaming media data stream at a double speed of the value; when the value is a negative number, it indicates that the streaming server is requested to fast playback of the streaming media data stream at a multiple speed of the value. ;

Track identification: The playback track number that needs to be selected for the playback terminal, used to identify the track data selected for playback. A value of 0 indicates that the playback terminal requests the streaming server to send only the video signal;

Video track identification: The video terminal is requested to control the video signal for the playback terminal, and is used to identify the video data for selection and playback. A value of 0 indicates that the playback terminal requests the streaming server to transmit only the audio signal.

An example of a typical INFO message is as follows:

INFO sip:cam3@a.com SIP/2.0 Via: SIP/2.0/UDP192.168.4.124:5060;branch=z9hG4bK-b2230f3bb435fd61b2 98ad85b4de8637

From: <sip:testl @a.com>;tag=15718;contrast=add

Call-ID: eeae6897a7272b9e4828c4036ac33482

CSeq: 2 INFO

Contact: <sip:testl @a.com>

Max-Forwards: 69

Content-Length: xxx

[message]

In the above INFO message, the message body can be described by an extensible markup language (XML) or other text language. Taking XML as an example, the message body description example is as follows: <?xml version="1.0"?>

</ Control>

In the above message body, the parameter Method is a streaming data stream playback control word, and its value can be Play, Pause, or Stop. When the value of the parameter Method is Pause or Stop, the other parameters in the message body are invalid.

The parameter Range is a playback range of the streaming media data stream, and may be defined by the playback start time and the end time of the streaming media data stream, or the playback time of the streaming media data stream is used as the playback start time of the streaming media data stream, for example, the message body. Medium, npt=123-3400.34 means to start playing from the 123rd second of the streaming data stream, the end of the 3403.34 second, or when the Range value is clock=20070820T175412Z, it means the recording time from the streaming data stream August 20, 2007 Started at 17:54:12 Put it.

The parameter Scale is a streaming media data flow advance and retreat rate control word, which is a non-zero number. When the value is a positive number, it indicates that the streaming server is requested to play the streaming data stream at a double speed of the value; when the value is negative Indicates that the streaming server is requested to fast playback of the streaming media stream at a multiple speed of the value. For example, in the message body, 300 indicates that the streaming server is requested to fast forward the streaming data stream by 300 times of the normal playback speed.

The parameter AudioTrackID is the track identifier, which is the playback track number that the playback terminal needs to select. Specifically, a value of 0 indicates that the playback terminal requests the streaming server to transmit only the video signal, and the value of 1 indicates that the playback terminal requests the streaming server to simultaneously transmit the video signal and the audio signal.

The parameter VideoTrackID is the video track identifier that requests the playback terminal to control the video signal. In particular, a value of 0 indicates that the playback terminal requests the streaming server to only transmit audio signals. In the above message body, the value is 1, indicating that the playback terminal requests the streaming server to simultaneously transmit the video signal and the audio signal.

The streaming media server receives the streaming media playback control SIP message, extracts the streaming media playback control information, and controls the playback of the streaming media accordingly. If the streaming media control SIP message is processed normally in the streaming server, the streaming server indicates success in the response message; if the streaming media control SIP message is processed in the streaming server, an exception occurs, the streaming server responds The message indicates an error.

3. The streaming media server sends a streaming media playback indication SIP message to the playback terminal, and carries the streaming media playback indication information. After receiving the streaming media playback indication SIP message, the playback terminal returns a response message to the streaming media server.

As an embodiment of the present invention, the NOTIFY message in the existing SIP protocol is extended, and the streaming media data playing indication information is carried, and of course, other messages in the existing SIP protocol may be extended, or a new SIP message may be configured. .

The streaming media data playback indication information includes a streaming media data stream advance and retreat position control word parameter, which is used to instruct the playback terminal to process the current streaming media data stream to the end position or rewind to the start position.

Take the NOTIFY message described in XML as an example. The message body is described as follows:

NOTIFY sip:cam3@a.com SIP/2.0 Via: SIP/2.0/UDP192.168.4.124:5060;branch=z9hG4bK-b2230f3bb435fd61b2 98ad85b4de8637

Via: SIP/2.0/UDP 192.168.4.117:1121 ;branch=z9hG4bK-1170813591a5testl To: <sip:cam3 @a.com>;tag=27186

From: <sip:testl @a.com>;tag=15718;contrast=add

Call-ID: eeae6897a7272b9e4828c4036ac33482

CSeq: 2 NOTIFY

Contact: <sip:testl @a.com>

Max-Forwards: 69

Content-Length: xxx

<?xml version="1.0"?>

</ Notico

In the above message, the following part of Content-Length: xxx is the message body described by XML,

The streaming media data playback indication information part carried in the NOTIFY message.

The parameter Locate is a streaming media data flow advance and retreat position control word, which is used to indicate that the playback terminal processes the current streaming data stream when it fast forwards to the end position or rewinds to the start position. In the embodiment of the present invention, when the streaming media stream fast forwards to the end position, the streaming media server sends a NOTIFY message with a parameter Locate value of EOS (end tag) to the playing terminal, and notifies the playing terminal to perform corresponding processing; When the streaming media data rewinds to the starting position, the media server sends a NOTIFY message with the parameter Locate value to the BOS (starting tag) to the playing terminal, and notifies the playing terminal to perform corresponding processing.

After receiving the streaming media playback instruction SIP message, the playback terminal extracts the streaming media playback indication information, and performs corresponding processing on the playback of the streaming media data. If the streaming media playback indicates that the SIP message is normally processed in the playback terminal, the playback terminal indicates success in the response message; if the streaming media playback indicates that the SIP message is processed in the playback terminal, an abnormality occurs, the playback terminal indicates an error in the response message.

4. The playing terminal periodically sends a heartbeat message to the sending streaming server to maintain a session connection with the streaming server.

In an embodiment of the present invention, after the session connection is established, the playing terminal periodically sends The NOTIFY message is sent to the streaming server as a heartbeat message, requesting to maintain the session connection until the BYE message is sent to terminate the session.

5. After the streaming media is played, the playback terminal sends a session termination SIP message to the streaming media server to terminate the session.

In the embodiment of the present invention, the playback terminal sends a BYE message to the streaming media server to terminate the session. After receiving the BYE message, the streaming media server returns a response message to the playback terminal.

As a preferred implementation manner of the embodiment of the present invention, all messages between the playback terminal and the streaming media server are carried by the UDP protocol, and the streaming media server does not need to maintain many long links, and can support more concurrent on-demand users, thereby greatly Reduced operating costs.

FIG. 2 shows the structure of a playback terminal according to an embodiment of the present invention. For the convenience of description, only parts related to the embodiment of the present invention are shown.

The session connection unit 21 sends a session connection SIP message to the streaming server, and establishes a SIP session connection channel with the streaming server. The play control message sending unit 22 sends a streaming media play control SIP message to the streaming media server through the SIP session connection channel established by the streaming media server, where the streaming media play control SIP message carries the streaming media play control information. The data playback unit 23 receives and plays the multimedia data stream transmitted by the streaming media server.

As an embodiment of the present invention, the streaming media playback control SIP message may be an extended INFO message, and the message body includes streaming media playback control information, and the streaming media playback control information includes corresponding media playback control parameters, and the specific format of the message. And the content is as shown above, and will not be described again.

In the embodiment of the present invention, the play indication message receiving unit 24 receives the streaming media play indication SIP message returned by the streaming media server, and extracts the streaming media play indication information carried by the streaming media play instruction SIP message.

FIG. 3 shows the structure of a streaming media server according to an embodiment of the present invention. For the convenience of description, only parts related to the embodiment of the present invention are shown.

The session connection unit 31 receives the session connection SIP message sent by the playback terminal, and establishes a SIP session connection channel with the playback terminal. The play control message receiving unit 32 receives the streaming media data play control SIP message sent by the play terminal through the SIP session connection channel, and extracts the streaming media data play control information carried in the message. The playback control unit 33 transmits the multimedia data stream to the playback terminal based on the streaming media data playback control information. As an embodiment of the present invention, the play indication message sending unit 34 sends a streaming media data play instruction SIP message to the play terminal, and carries the streaming media data play indication information. The streaming media data playback indication information includes a streaming media data stream advance and retreat position control word parameter for indicating that the current streaming media data stream is fast forwarded to the end position or rewinded to the start position. The streaming media playback indicates that the SIP message can be an extended NOTIFY message, and the streaming media playback control information includes corresponding media playback control parameters. The specific format and content of the message are as shown above, and are not described again.

As a preferred embodiment, in the embodiment of the present invention, the streaming media data stream is carried by the UDP protocol. In the embodiment of the present invention, the SIP terminal-enabled play terminal and the streaming media server do not need to re-transplant a new protocol, and only need to perform the INFO message and the NOTIFY message body in the play terminal and the streaming media server with the SIP protocol stack. By expanding, the streaming data stream can be fast forwarded and rewinded, paused, stopped, selected for playing range, only playing audio, playing only streaming media data, etc., enriching the playback control mode and enhancing the playback control function. At the same time, since all control messages between the playback terminal and the streaming server are carried by the UDP protocol, the streaming server can support more playback terminals in parallel.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. Within the scope.

Claims

Rights request

A streaming media data playing control method, the method comprising the steps of: sending a session connection session initiation protocol SIP message to a streaming media server, and establishing a SIP session connection channel with the streaming media server;

The streaming media control control SIP message is sent to the streaming media server through the SIP session connection channel, and the streaming media playback control information is carried.

2. The streaming media data playing control method according to claim 1, wherein the streaming media playback control SIP message is an extended signaling message, and the message body of the signaling message includes streaming media playback control. information.

The streaming media data playing control method according to claim 1 or 2, wherein the streaming media playing control information comprises one of the following parameters or any combination thereof:

The streaming media data stream playing control word is used to identify the streaming media data playing, pausing or stopping; the streaming media data stream playing range is used to identify the playing start time and ending time of the streaming media data stream;

a streaming media data flow advance and retreat rate control word, used to identify a playing rate of the streaming media data stream; a track identifier, used to identify the track data selected for playing;

Video track identifier, used to identify the video data selected for playback.

4. The streaming media data playback control method according to claim 1, wherein the method further comprises the following steps:

Receiving a streaming media playback indication SIP message returned by the streaming media server;

And extracting, by the streaming media, the streaming media playback indication information carried by the SIP message.

A streaming media data playing terminal, wherein the terminal comprises:

a session connection unit, configured to send a session connection session initialization protocol SIP message to the streaming media server, and establish a SIP session connection channel with the streaming media server;

a data playing unit, configured to receive and play a multimedia data stream transmitted by the streaming media server.

The streaming media data playing terminal according to claim 5, wherein the streaming media playback control SIP message is an extended signaling message, and the message body of the signaling message includes streaming media. Play control information.

The streaming media data playing terminal according to claim 5 or 6, wherein the streaming media playing control information comprises one of the following parameters or any combination thereof:

Video track identifier, used to identify the video data selected for playback.

8. The streaming media data playing terminal of claim 5, wherein the terminal further comprises:

The play indication message receiving unit is configured to receive a streaming media play indication SIP message returned by the streaming media server, and extract the streaming media play indication information carried by the streaming media play indication SIP message.

A streaming media data playing method, the method comprising the steps of: receiving a session connection session initiation protocol SIP message sent by a playback terminal, establishing with a playback terminal

SIP session connection channel;

10. The streaming media data playing method according to claim 9, wherein the method further comprises the following steps:

The streaming media data playback indication SIP message is sent to the playing terminal, and the streaming media data playing indication information is carried.

The streaming media data playing method according to claim 9, wherein the streaming media playback instruction SIP message is an extended notification message, and the message body of the notification message includes streaming media playback indication information.

The streaming media data playing method according to claim 10 or 11, wherein the streaming media playback indication information includes a streaming media data stream advance and retreat position control word parameter, configured to indicate that the current streaming media data stream is fast. Processed when you reach the end position or rewind to the start position.

The streaming media data playing method according to claim 9, wherein the streaming media data stream is carried by a User Datagram Protocol (UDP) protocol.

14. A streaming media data playing device, configured in a streaming media server, wherein the device comprises:

a session connection unit, configured to receive a session connection session initiation protocol SIP message sent by the play terminal, and establish a SIP session connection channel with the play terminal;

The streaming media data playing device of claim 14, wherein the server further comprises:

The play indication message sending unit is configured to send a streaming media data play indication SIP message to the play terminal, and carry the streaming media data play indication information.

The streaming media data playing device according to claim 15, wherein the streaming media playback instruction SIP message is an extended notification message, and the message body of the notification message includes streaming media playback indication information.

The streaming media data playing device according to claim 15 or 16, wherein the streaming media playback indication information includes a streaming media data stream advance and retreat position control word parameter, configured to indicate that the current streaming media data stream is fast. Processed when you reach the end position or rewind to the start position.

The streaming media data playing device according to claim 14, wherein the streaming media data stream is carried by a User Datagram Protocol (UDP) protocol.