JP4868606B2 - Streaming transmission control method - Google Patents

Description

The present invention relates to streaming transmission control how.

  In recent years, in order to provide a ubiquitous environment, an FMC (Fixed-Mobile Convergence) environment in which a fixed communication environment and a mobile communication environment are mixed is provided. Under the FMC environment, terminals with various processing capabilities coexist and communicate with each other. In some cases, it may be preferable for the user who owns the terminal to switch to a session based on a service suitable for the place by moving freely inside or outside the house.

  2. Description of the Related Art Conventionally, there is a technique that can switch a session established using SIP (Session Initiation Protocol) between terminals (see, for example, Patent Document 1). According to this technology, for example, when switching terminals in a home, a session established between terminals can be switched while maintaining a running application by using a session management server arranged in the global network. .

As for sessions based on services in the prior art, for example, in the case of a VOD (Video On Demand) service, there are the following two sessions.
(1) Control session for controlling reproduction (or stoppage) of streaming data, such as an RTSP (Real-time Streaming Protocol) session (2) Streaming data is transmitted, such as an RTP (Real Time Protocol) session Data transmission session

  RTSP is a protocol that uses TCP / IP (Transmission Control Protocol / Internet Protocol) to reproduce streaming data such as audio and moving images in real time. RTP is a protocol for transmitting data such as voice and moving images in real time using UDP (User Datagram Protocol). In the case of UDP, retransmission control for packet loss, transmission delay time guarantee control, and the like are not executed.

RTSP, IETF RFC2326, Real Time Streaming Protocol SIP, IETF RFC3261, Session InitiationProtocol JP 2006-237815 A

  For the VOD service, the RTSP session and the RTP session are managed by SIP. At this time, it is also conceivable to switch one of the RTSP session and the RTP session using the technique described in Patent Document 1. If this can be realized, streaming data transmission control using an RTSP session and streaming data reception and reproduction using an RTP session can be executed by different terminals. For example, a mobile phone can control playback of streaming data using an RTSP session, and a television can receive and play streaming data using an RTP session.

  However, even if the second terminal can establish an RTP session with the streaming distribution server, the first terminal that has established the RTSP session cannot know the IP address and port number of the second terminal.

  In addition, when a different terminal establishes a session for the VOD service, there is also a problem that it leads to a DOS (Denial of Service) attack in which an RTP packet is transmitted to an attack target terminal.

Therefore, according to the present invention, intended to provide to the first terminal for controlling transmission of streaming data, the streaming transmission control how that can switch the second terminal to receive and reproduce streaming data and And

According to the present invention, there is provided a streaming transmission control method in a system in which a plurality of terminals establish a session via a session control server,
When the first terminal establishes the first session for transmitting the streaming data transmission control message to the streaming distribution server,
A first step in which a first terminal transmits a session transition notification message for establishing a second session for transmitting streaming data from the streaming distribution server to the second terminal, to the session control server;
A second step in which the session control server sends a session establishment request message to the second terminal and sends a session update notification message to the streaming delivery server to establish the second session;
A third step in which the session control server transmits a session information notification message including the session information of the second session to the first terminal;
A first step of transmitting a session setting notification message describing the address of the second terminal included in the session information to the streaming distribution server;
The first terminal transmits a transmission control message to the streaming distribution server using the first session, the streaming distribution server transmits the streaming data to the second terminal using the second session, and the second terminal The terminal plays while receiving the streaming data.

According to another embodiment of the streaming transmission control method of the present invention,
The first session is a transmission control session based on RTSP,
The second session is also preferably a data transmission session based on RTP.

According to another embodiment of the streaming transmission control method of the present invention,
The session control server is a SIP server,
The session transition notification message is a REFER message, and the Request-URI of the REFER message describes the address of the second terminal,
The session establishment request message is an INVITE message,
The session update notification message is an UPDATE or (re-) INVITE message,
The session information notification message is preferably a NOTIFY message.

According to another embodiment of the streaming transmission control method of the present invention,
The session setting notification message is a SETUP message based on RTSP. In the transport header of the SETUP message, the IP address of the second terminal is described in the destination parameter, and the port number of the second terminal is described in the client_port parameter. It is also preferable.

According to another embodiment of the streaming transmission control method of the present invention, for the second step,
The session control server sends an inquiry request message to the second terminal,
The second terminal transmits an inquiry response message including session information indicating the processing capability of the second terminal to the session control server,
The session control server determines whether or not the second session can be established for the second terminal. When it is determined that the second session can be established, a session establishment request message for establishing the second session is sent to the second terminal. It is also preferable to transmit to the other terminal.

According to another embodiment of the streaming transmission control method of the present invention,
The inquiry request message is a SIP OPTION message.
The inquiry response message is also preferably a SIP 200OK message.

According to another embodiment of the streaming transmission control method of the present invention,
Prior to the first step, it is also preferable that the first terminal transmits a pause message to the streaming distribution server and pauses the transmission of streaming data.

According to the streaming transmission control how the present invention, the first terminal for controlling transmission of streaming data, it is possible to switch the second terminal to receive and reproduce streaming data and.

  Hereinafter, the best mode for carrying out the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a system configuration diagram according to the present invention.

  According to the system of FIG. 1, a plurality of terminals 2 possessed by a user can connect to the Internet 4 and exchange a SIP signaling message with a session control server (SIP server 1). The terminal 2 is a SIP compatible terminal (terminal having a SIP UE (SIP User End) function). According to FIG. 1, the user has a mobile phone as the first terminal and installs a television in the house as the second terminal.

  A streaming distribution server 3 is connected to the Internet 4 and distributes streaming data in response to a request from the terminal 2 (On Demand). Streaming is a method for transferring and playing multimedia files such as audio and moving images. The receiving terminal plays while receiving streaming data. Of course, the media format is not limited to audio + video, but may be images, texts, and the like. The streaming distribution server 3 according to the present invention has a SIP-compatible server function, and in the case of a VOD service, a VOD SIP UE (Video On Demand SIP UE) function. Thereby, the streaming distribution server 3 can exchange the SIP signaling message with the SIP server 1.

  The terminal 2 can establish, switch and disconnect an RTP session and an RTSP (Real-time Streaming Protocol) session with the streaming delivery server 3 using the SIP server 1. In the case of the VOD service, the terminal 2 has a VOD client function and reproduces while receiving streaming data transmitted from the streaming distribution server 3 using RTP. In addition, the terminal 2 executes streaming data transmission control with respect to the streaming delivery server 3 using RTSP. Examples of transmission control include establishment (SETUP), start (PLAY), interruption (PAUSE), and termination (TREADOWN). That is, transmission of streaming data of the RTP session is controlled using the RTSP session.

  The SIP server 1 can establish, switch, and disconnect an RTP session and an RTSP session between the terminal 2 and the streaming delivery server 3 based on the SIP signaling message from the terminal 2. According to the present invention, the first terminal controls streaming transmission to the streaming distribution server 3, and the second terminal reproduces the streaming data while receiving the streaming data.

  FIG. 2 is a first sequence diagram in the present invention.

  According to the sequence of FIG. 2, the first terminal controls streaming transmission using an RTSP session, and the second terminal plays while receiving streaming data using an RTP session. Regarding the SIP server 1, S200 described below can be executed by an existing SIP server function. The sequence that characterizes the present invention is in S201 and subsequent steps.

(S200) First, the first terminal transmits an INVITE message to the SIP server 1 in order to establish an RTSP session for controlling transmission of streaming. In the INVITE message, the SDP (Session Description Protocol) of the RTSP session is described. The SDP includes information on a protocol that handles media information (see, for example, RFC4566 based on IETF). “Media information” is information such as format, port, and protocol for each medium.

In this INVITE message, for example, the following SDP of the RTSP session is described.
v = 0 (protocol version)
o =-<user name><sessionID> IN IP4 <IP address>
(Source and session identifier)
s = SDP Seminar (session name)
c = IN IP4 <IP address> (session information)
t = 2873397496 2873404696 (session active time)
m = data <port number> TCP rtsp (media information)
a = active (media attribute)

  In response to this, the SIP server 1 transmits this INVITE message to the streaming distribution server 3. In response to this, the streaming delivery server 3 returns a 100 Trying message notifying the reception of the INVITE message to the first terminal via the SIP server 1. Next, the streaming distribution server 3 transmits a 200OK message in response to the establishment of the RTSP session to the first terminal via the SIP server 1. On the other hand, the first terminal returns an ACK message notifying the reception of the 200OK message to the streaming distribution server 3 via the SIP server 1. As a result, an RTSP session is established between the first terminal and the streaming distribution server 3.

  When the streaming distribution server 3 includes a presence server function, the streaming distribution server 3 periodically transmits a PUBLISH message for updating the presence information of the server 3 to the SIP server 1. At this time, the first terminal may transmit a SUBSCRIBE message (subscription request) for requesting status notification to the SIP server 1. In response to this, the SIP server 1 returns a NOTIFY message for notifying the status to the first terminal. Thereby, the first terminal can know the presence information of the streaming distribution server 3.

  The first terminal transmits an RTSP DESCRIBE message to the streaming distribution server 3. In response to this, the streaming distribution server 3 returns a 200OK message including the SDP to the first terminal. Thereby, the first terminal can acquire the SDP of the streaming distribution server 3.

In this 200OK message, for example, the following SDP of the RTSP session is described.
v = 0 (protocol version)
o =-<user name><sessionID> IN IP4 <IP address>
(Source and session identifier)
s = SDP Seminar (session name)
c = IN IP4 <IP address> (session information)
t = 2873397496 2873404696 (session active time)
m = video <port number> RTP / AVP 96 97 109 (media information)
a = rtpmap: <payload type><encodingname> / <sampling rate>
(Media attribute)

(S201) Here, it is assumed that the user wants to play while controlling streaming transmission at the first terminal and receiving streaming data at the second terminal. At this time, the first terminal transmits to the SIP server 1 a REFER message (session transition notification message) for establishing an RTP session for transmitting streaming data from the streaming distribution server 3 to the second terminal. The REFER message includes the SDP received in S200.

  Regarding the REFER message, the Request URI describes the address (SIP URI) of the second terminal, and Refer-To describes the streaming URI of the switching information included in the body part.

(S202) The SIP server 1 that has received the REFER message can also send an OPTION message (inquiry request message) to the second terminal. In response to this, the second terminal returns a 200 OK message including the SDP to the SIP server 1 itself. Thereby, the SIP server 1 can know the media that can be reproduced by the second terminal. The SIP server 1 does not execute the following sequence when the session requested by the first terminal cannot be established by the second terminal.

(S203) The SIP server 1 transmits an INVITE message (session establishment request) to the second terminal in order to establish an RTP session between the second terminal and the streaming distribution server 3. The INVITE message includes the SDP of the received REFER message. On the other hand, the second terminal returns a 100 Trying message notifying the reception of the INVITE message to the SIP server 1. Next, the second terminal transmits a 200 OK message in response to the establishment of the RTP session to the SIP server 1. In response to this, the SIP server 1 returns an ACK message notifying the reception of the 200OK message to the second terminal.

(S204) Furthermore, the SIP server 1 transmits an UPDATE message (session update notification message) to the streaming distribution server 3 (may be a (re-) INVITE message). The UPDATE message updates session capability information. In response to this, the streaming delivery server 3 transmits a 200 OK message in response to the update of the RTP session to the SIP server 1. As a result, an RTP session is established between the second terminal and the streaming distribution server 3.

(S205) The SIP server 1 transmits a NOTIFY message (session information notification message) to the first terminal. The NOTIFY message includes session information of an RTP session between the second terminal and the streaming distribution server 3. Specifically, at least necessary information in the session information is an IP address and a port number in the second terminal. Then, the first terminal returns a 200 OK message to the SIP server 1.

(S206) The first terminal transmits a SETUP message (session setting notification message) to the streaming delivery server 3. The SETUP message includes the IP address and port number of the second terminal to which streaming data is to be transmitted using the RTP session. In the transport header of the SETUP message, the IP address of the second terminal is described in the destination parameter, and the port number of the second terminal is described in the client_port parameter. Then, the streaming delivery server 3 returns a 200OK message to the first terminal.

(S207) The first terminal transmits a “PLAY” message for starting streaming transmission to the streaming delivery server 3 using the RTSP session. On the other hand, the streaming delivery server 3 returns a 200OK message to the first terminal using the RTSP session and transmits the streaming data to the second terminal using the RTP session.

(S208) The second terminal plays the streaming data while receiving it from the streaming distribution server 3. Thereafter, control of streaming transmission, for example, interruption, resumption, and termination are all instructed by a message transmitted from the first terminal.

  Accordingly, the first terminal transmits a transmission control message to the streaming distribution server 3 using the RTSP session, the streaming distribution server 3 transmits the streaming data to the second terminal using the RTP session, and the second terminal Terminal can receive the streaming data while receiving it.

  FIG. 3 is a second sequence diagram in the present invention.

  In the sequence of FIG. 3, the reception and playback of streaming data at the first terminal is switched to the second terminal, and the transmission control of the streaming is maintained by the first terminal.

(S300) First, the first terminal establishes an RTSP session and an RTP session with the streaming distribution server 3. Then, the first terminal controls streaming transmission using the RTSP session, and reproduces the streaming data while receiving the streaming data using the RTP session. The sequence of S300 is obtained by executing the sequence of S200 of FIG. 2 not only on the RTSP session but also on the RTP session.

  Thereafter, the first terminal transmits a PAUSE message (temporary stop) to the streaming distribution server 3, and temporarily stops transmission of the streaming data. In response to this, the streaming delivery server 3 returns a 200OK message including the streaming stop time to the first terminal. Thereafter, the first terminal may transmit a TEARDOWN message to the streaming delivery server 3 to instruct the end of streaming transmission.

(S301 to S303) The same sequence as S201 to S203 in FIG.

(S304) The SIP server 1 transmits an UPDATE message (session update notification message) for the RTSP session and the RTP session to the streaming delivery server 3 (may be a ((re-) INVITE message)). The streaming delivery server 3 transmits a 200OK message in response to the update of the RTP session and the RTSP session to the SIP server 1. Further, the SIP server 1 transmits an UPDATE message for the RTSP session to the first terminal. On the other hand, the first terminal transmits a 200OK message in response to the update of the RTSP session to the SIP server 1. Thereby, an RTP session is established between the second terminal and the streaming distribution server 3. The first terminal and the streaming distribution server 3 In between, RTSP session is updated.

(S305 to S308) This sequence is the same as S205 to S208 in FIG. Note that the first terminal can also include the stop time included in the 200OK message, which is a response to the PAUSE message, in the PLAY message. The streaming distribution server 3 starts transmitting streaming data from the stop time to the second terminal.

  FIG. 4 is a functional configuration diagram of the SIP server in the present invention.

  According to FIG. 4, the SIP server 1 includes a SIP server basic function unit 100, a session transition notification receiving unit 101, a data transmission session establishing unit 102, a session information notification transmitting unit 103, an inquiry unit 104, a determination Part 105. The SIP server basic function unit 100 realizes the operation of an existing SIP server. These functional components can be realized by executing a program that causes a computer (processor) mounted on the server to function.

  The session transition notification receiving unit 101 receives a REFER message (session transition notification message) for establishing an RTP session between the streaming distribution server 3 and the second terminal from the first terminal. The inquiry unit 104 is notified that the REFER message has been received.

  The inquiry unit 104 transmits an OPTION message (inquiry request message) to the second terminal. In response to this, the inquiry unit 104 receives a 200OK message including the SDP of the second terminal. The SDP is notified to the determination unit 105.

  The determination unit 105 determines whether or not an RTP session can be established for the second terminal. For example, if the streaming data is video media and the second terminal is a terminal that cannot reproduce the video media, it is determined that the RTP session cannot be established. When it is determined that establishment is possible, the fact is notified to the data transmission session establishment unit 102.

  The data transmission session establishment unit 102 transmits an INVITE message (session establishment request message) to the second terminal and transmits an UPDATE message (session update notification message) to the streaming delivery server 3.

  Session information notification transmission section 103 transmits a NOTIFY message (session information notification message) including session information of the second session to the first terminal. This session information includes the IP address and port number of the second terminal. As a result, the first terminal can know the IP address and port number of the second terminal, and can control the transmission of streaming to the second terminal.

  Accordingly, the first terminal transmits a transmission control message to the streaming distribution server 3 using the RTSP session, the streaming distribution server 3 transmits the streaming data to the second terminal using the RTP session, and the second terminal Terminal can be operated to play while receiving the streaming data.

  According to FIG. 4, the streaming distribution server 3 includes a SIP user function unit 301 and a streaming server function unit 302. These functional components can be realized by executing a streaming distribution program that causes a computer mounted on the server to function.

  The SIP user function unit 301 exchanges SIP signaling with the SIP server 1. Therefore, the SIP user function unit 301 holds information on a session established with the terminal.

  The streaming server function unit 302 transmits streaming data to a plurality of terminals via an RTP session in response to a transmission control message received via an RTSP session. Here, when the streaming server function unit 302 receives the SETUP message (session setting notification message) from the first terminal via the RTSP session, the streaming server function unit 302 transmits the RTP to the SIP user function unit 301 with the second terminal. Whether the session is established and the address (IP address or SIP URI) and port number of the second terminal match the address and port number of the second terminal in the session information included in the SETUP message Confirm. Here, if both addresses match, a 200 OK message for the SETUP message is returned to the first terminal.

As described above in detail, according to the streaming transmission control how the present invention, the first terminal for controlling transmission of streaming data, switching the second terminal to receive and reproduce streaming data and Can do.

  ADVANTAGE OF THE INVENTION According to this invention, the terminal which controls transmission of streaming and the terminal which reproduces | regenerates while receiving streaming data can be freely changed according to a user's usage condition. For example, it is assumed that playback is performed outdoors while controlling streaming transmission and receiving streaming data using a mobile phone. At this time, when the user who owns the mobile phone returns home, the user can switch the television set in the home to play while receiving the streaming data. At that time, the transmission of streaming can be continuously controlled using the mobile phone.

  In the various embodiments of the present invention described above, various changes, modifications, and omissions in the scope of the technical idea and the viewpoint of the present invention can be easily made by those skilled in the art. The above description is merely an example, and is not intended to be restrictive. The invention is limited only as defined in the following claims and the equivalents thereto.

It is a system configuration diagram in the present invention. It is a 1st sequence diagram in this invention. It is a 2nd sequence diagram in this invention. It is a function block diagram of the SIP server in this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 SIP server 100 SIP server basic function part 101 Session transition notification receiving part 102 Data transmission session establishment part 103 Session information notification transmission part 104 Inquiry part 105 Determination part 2 Terminal 3 Streaming delivery server 4 Internet

Claims (7)

A streaming transmission control method in a system in which a plurality of terminals establish a session via a session control server,
When the first terminal establishes the first session for transmitting the streaming data transmission control message to the streaming distribution server,
A first step in which a first terminal transmits a session transition notification message for establishing a second session for transmitting streaming data from a streaming distribution server to a second terminal, to the session control server;
A second step in which the session control server sends a session establishment request message to the second terminal and sends a session update notification message to the streaming distribution server to establish a second session;
A third step in which the session control server transmits a session information notification message including session information of a second session to the first terminal;
A first step in which the first terminal transmits a session setting notification message describing the address of the second terminal included in the session information to the streaming distribution server;
The first terminal transmits a transmission control message to the streaming distribution server using the first session, the streaming distribution server transmits the streaming data to the second terminal using the second session, and the second terminal A streaming transmission control method, wherein a terminal plays while receiving the streaming data. The first session is a transmission control session based on RTSP (Real-time Streaming Protocol),
2. The streaming transmission control method according to claim 1, wherein the second session is a data transmission session based on RTP (Real-time Transport Protocol). The session control server is a SIP (Session Initiation Protocol) server,
The session transition notification message is a REFER message, and the Request-URI of the REFER message describes the address of the second terminal,
The session establishment request message is an INVITE message,
The session update notification message is an UPDATE or (re-) INVITE message,
3. The streaming transmission control method according to claim 1, wherein the session information notification message is a NOTIFY message.   The session setting notification message is a SETUP message based on RTSP. In the transport header of the SETUP message, the IP address of the second terminal is described in the destination parameter, and the port number of the second terminal is described in the client_port parameter. The streaming transmission control method according to claim 1, wherein the streaming transmission control method is performed. For the second step,
The session control server sends an inquiry request message to the second terminal;
The second terminal transmits an inquiry response message including session information indicating the processing capability of the second terminal to the session control server;
The session control server determines whether or not a second session can be established with respect to the second terminal. When it is determined that the second session can be established, a session establishment request message for establishing the second session is received. The streaming transmission control method according to claim 1, wherein transmission is performed to two terminals. The inquiry request message is a SIP OPTION message,
The streaming transmission control method according to claim 1, wherein the inquiry response message is a SIP 200 OK message.   Before the first step, the first terminal transmits a pause message to the streaming distribution server and pauses the transmission of streaming data, according to any one of claims 1 to 6. The streaming transmission control method described.

Images