JP5239756B2 - Media synchronization method for video sharing - Google Patents

Description

  The present invention relates to a media synchronization method at the time of video sharing, and in particular, video sharing services in which video providing services are advanced by grouping user terminals that receive video streaming services and sharing contents provided by the user terminals within the group. It is preferable to use it as a media synchronization method.

  The streaming distribution service is a service that distributes data as stream data so that the data can be reproduced while being downloaded, and there are two types of forms: a unicast method and a multicast method.

  In the unicast method, a user terminal such as a set top box (STB) is connected to the distribution server on a one-to-one basis, and the user can perform trick play (pause / play / rewind / fast-forward / In general, it is possible to perform operations such as resumption and frame advance.

  The multicast method can be viewed by a plurality of users, but is mainly a broadcast-type distribution service and generally cannot perform a streaming operation from the user.

  The current video distribution service is only for individuals such as movie distribution service or for a large number of people such as news distribution, and there will be demand for services that share video within a specific group in the future. is assumed.

FIG. 5 is a configuration diagram of unicast distribution and multicast distribution in a conventional video distribution service via the Internet. In the figure, a user A (4 ₁ ) is connected to a distribution server 1 arranged for a unicast distribution server via the Internet 3 and is connected to a real-time transport layer protocol (RTP). The movie distribution service can be received using a real-time streaming protocol (RTSP) communication protocol. According to this unicast distribution mode, trick play (pause, playback, rewind, fast forward, restart, frame advance, etc.) by streaming operation is possible.

On the other hand, the user B (4 ₂ ) and the user C (4 ₃ ) are connected to the distribution server 2 arranged for the multicast distribution server via the Internet 3 and are connected to the real-time transport layer protocol (RTP: Real- A movie distribution service can be received using a communication protocol such as a time transport protocol (RTSP) or a real-time streaming protocol (RTSP). However, in this multicast distribution mode, trick play (pause, playback, rewind, fast forward, restart, frame advance, etc.) by streaming operation is impossible.

As prior literature, distribution data that creates a shared relationship with various data constituting content and facilitates secondary processing of the data is generated, and this is easily distributed by a single communication means There is known a content distribution system which can be used. (For example, see Patent Document 1)
JP 2006-165878 A

  However, in the prior art (Patent Document 1), content data including audio data, character data, and the like included in moving image data is compressed into MPPEG (MPEG: Moving Picture Experts Group) format. It is an invention that assumes a case where secondary processing such as correction is performed on a part, and is not related to a service that allows a plurality of people to perform streaming operations of distribution video.

  It is an object of the present invention to provide a media synchronization method and apparatus at the time of video sharing for the demand for services for sharing video within a specific group.

A first invention for solving the above problem is a media synchronization method at the time of video sharing for providing a distribution service by a streaming operation of a distribution medium to a plurality of user terminals constituting a group, wherein the user terminal a step of registering in advance the terminal data to the application server, the steps to register to the distribution server by a Web operation of the distribution media application servers to provide from within the group the user terminal, group meetings from any of the user terminals started the form of services, and, before for the Sharing, ABS distribution server to the media server, the steps of unicast the distribution medium in accordance with the streaming operation by real-time streaming protocol, the media server in the group to all user terminals the for A step of performing synchronous distribution of communication media, a step of notifying a distribution server of a trick play instruction from a user terminal in the group via the media server in the middle of a conversation, and a step of the distribution server performing the trick play control. Contains.

  According to the first aspect of the invention, it is possible to provide a synchronization sharing service for distribution media that enables trick play operations of all user terminals in the group.

  According to a second invention, in the media synchronization control method for video sharing according to the first invention, a session initialization protocol between the user terminal and the application server in cooperation with the application server and the session initialization protocol server. Control session by.

  According to the second invention, the application server can associate the hypertext transfer protocol (HTTP) and the call control protocol (SIP) session by WEB screen login, and group the call control protocol (SIP) sessions. Can do.

  According to a third aspect of the present invention, in the media synchronization method at the time of video sharing according to the first aspect, the media server stores the video media registered in the distribution server in cooperation with the distribution server in each user terminal in the group. To control distribution.

  According to the third aspect of the invention, the media server can terminate media from the user terminal and combine and distribute the media.

  According to a fourth invention, in the media synchronization method at the time of video sharing described in the first invention, the application server cooperates with the distribution server to transfer the media transferred by the user terminal to the distribution server.

  According to the fourth aspect of the invention, the distribution server can store the media transferred from the user terminal via the application server in the database.

  According to a fifth aspect of the present invention, in the media synchronization method for video sharing according to claim 1, the media server receives a real-time streaming protocol transmitted from each grouped user terminal as an application medium, and The real-time streaming protocol is transferred to the access address of the distribution server after matching control between the user terminals, and trick play distribution control of distribution media transmitted from the distribution server is performed.

  According to the fifth invention, it is possible to perform trick play (pause, playback, fast forward, rewind, resume, frame advance, etc.) of the distribution media.

  As described above, according to the media synchronization method and apparatus for video sharing according to the present invention, it is expected that the security can be enhanced by performing streaming distribution only for the users who participate in the group, and the trick play operation of all users in the group can be performed. It is possible to receive an advanced distribution service (distributed media synchronization sharing service).

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a network configuration diagram (part 1) of media synchronization control during video sharing according to an embodiment of the present invention. In the figure, streaming synchronization is shared within the group of user A, user B, and user C, and all group members can perform streaming operations.

  An application server 7 and a media server 8 installed as the grouping-compatible device 6 include a real-time transport layer protocol (RTP) that is a communication protocol between the user A, the user B, and the user C, and Data is exchanged with each other using a real-time streaming protocol (RTSP). The media server 8 also exchanges data with the unicast distribution server 1 using the real-time transport layer protocol (RTP) and the real-time streaming protocol (RTSP).

The SIP server (SIP: Session Initiation Protocol) 5 is responsible for managing sessions between the user terminals of the users A, B, and C and the application server 7, and has no concept of grouping.
The application server 7 can group sessions with individual user terminals of the user A, the user B, and the user C, and can issue a media distribution instruction in cooperation with the media server 8. In addition, a WEB screen function is provided to users A, B, and C, and a group meeting holding function and a function of uploading user-owned content to a distribution server are implemented.

  The media server 8 terminates the real-time transport layer protocol (RTP) and the real-time streaming protocol (RTSP) from the user terminals of the user A, the user B, and the user C, and the RTP from the unicast distribution server 1. And RTSP also terminates. In addition, the media control function implements a sound and video mixing function.

  The unicast distribution server 1 manages the distribution video uploaded from the user, and starts distribution by a real-time streaming protocol (RTSP). In addition, according to the streaming operation from the media server 8 by the real-time streaming protocol (RTSP), a function for distributing the uploaded distribution video and a function for distributing the video are implemented.

FIG. 2 is a network configuration diagram (part 2) for media synchronization control during video sharing according to an embodiment of the present invention.
-Between application server and call control protocol (SIP) server, and between application server and user terminal In application server 7, association of hypertext transfer protocol (HTTP) and call control protocol (SIP) session by web screen login In addition, the call control protocol (SIP) session is grouped by creating a group by operating the Web screen.

Hypertext Transfer Protocol (HTTP) is a protocol used to transfer hypertext markup language (HTML) files between a Web server and a browser. A session is executed between two systems. It shows from the start to the end of the logical connection of communication.
(2) Between Media Server and User Terminal The media server 8 terminates the media from the user terminal, and combines and distributes the media. Real-time streaming protocol (RTSP) also terminates as media.
(3) Between Distribution Server and Media Server Distribution server 1 performs real-time streaming protocol (RTSP) connection and unicast distribution only to media server 8.

  The media server 8 matches the real time streaming protocol (RTSP) from the user and transmits the real time streaming protocol (RTSP) to the distribution server. The media server 8 combines and distributes media from the distribution server 1 to user terminals.

  FIG. 3 is a sequence diagram (part 1) of intra-group media distribution control according to the embodiment of the present invention. The procedure for controlling intra-group media distribution will be described with reference to FIGS. 1 and 2 according to FIG.

  S1. The call control protocol resource identifier (SIP-URI: Session Initiation Protocol-Uniform resource identifier) of the user A terminal / user B terminal is registered in the application server 7 by the WEB screen operation of the application server 7. The allocation server 7 holds the terminal SIP-URI. Note that who is allowed to register, such as the user himself / herself or a maintenance operator, differs depending on the service. The call control protocol resource identifier (SIP-URI) is one method for designating a partner in the call control protocol (SIP), which is application layer signaling for starting, changing, and completing a group of communications.

  S2. User A transfers the user-owned media content to the application server 7 by the hypertext transfer protocol (HTTP) by operating the Web screen of the application server 7. The application server 7 transfers the transferred content to the distribution server 1. The distribution server 1 converts the transferred content into a codec that can be distributed, and stores the converted content in the distribution server 1. In addition, the distribution server 1 notifies the application server 7 of an access address to the stored content. The application server 7 stores the notified access address in the application server 7.

  S3. Hold a group meeting. The hosting method is: (1) incoming user terminal call by in-network call by Web screen operation of application server 7, (2) application server 7 call by user A Web client call by Web screen operation of application server 7, (3 The sequence of incoming calls from the user terminal via the SIP server 5 / application server 7 by calling from the user terminal is not limited.

  The application server 7 transmits a group start request to the media server 8 when the group is held, and the media server 8 supplements the group resource. The application server 7 also receives the media reception IP address of the user terminal described in the SDP (Session Description Protocol) description in the “INVITE” message or “200 OK” message of the call control protocol (SIP) received from the user terminal. The port number is notified by a connection request to the media server, and the media server 8 stores the IP address and port number received from the application server 7, opens a port for transmission to the user A terminal, and captures the user's resources. To do.

  Note that media transmitted from the user terminal is terminated at the media server 8 in SIP negotiation (an act of determining the reception address, port number, codec, etc. of the media used on the calling side and called side).

  When a group is created, a start request is made. The media server 8 knows that the terminal A and the terminal B are busy.

  S4. If you want to share the content registered by the user A on the distribution server during the group meeting with the users who are participating in the group, “You registered interesting content! Look together. ], The content registered by the Web screen operation of the application server 7 is designated. The application server 7 notifies the media server 8 of the content access address of the stored registered content. The media server 8 stores the notified content access address. The application server 7 also notifies the user terminal of the content access address.

  S5. The user A terminal transmits a “DESCRIBE” message to the media server 8 in order to start content distribution from the distribution server 1. In response to the reception of the “DESCRIBE” message from the user, the media server 8 transmits a “DESCRIBE” message to the content access address notified from the application server 7 in S4. The distribution server 1 sets detailed information in the “200 OK” message for the received “DESCRIBE” message, and returns a response to the media server. The media server transmits the “200 OK” message received from the distribution server to the user A terminal. The user A terminal designates the content from the received response message and transmits a “SETUP” message to the media server. The media server 8 transmits the received “SETUP” message to the distribution server 1. The distribution server 1 prepares for content distribution from the received “SETUP” message, and transmits a “200 OK” message to the media server 8. The media server 8 transmits the received “200 OK” message to the user A terminal. The user A terminal transmits a “PLAY” message to the media server 8 in order to start content distribution, the media server 8 transmits a “PLAY” message to the distribution server, and the distribution server 1 sets “200 OK”. Is transmitted to the media server 8 to start distribution. The media server 8 transmits the “200 OK” message from the distribution server 1 to the user A terminal.

  S6. The media server 8 receives the media distributed from the distribution server 1 and distributes the distribution media to the user terminals of all participants in the group. This realizes synchronous distribution of distribution media to all users in the group. Further, when distributing the media in the media server 8, the media used in the group meeting and the media distributed from the distribution server 1 are combined if necessary.

  S7. User A wants to perform trick play (pause, play, rewind, fast forward, resume, frame advance, etc.) for the content being distributed (such as “Sometimes stop here. It ’s funny.” The message “PHASE” or “PLAY” is transmitted to the media server 8. The media server 8 transmits a “PHASE” or “PLAY” message to the distribution server 1. The distribution server 1 performs trick play control corresponding to the message on the distribution content by the received RTSP message, and transmits a “200 OK” message to the media server 8. The media server 8 transmits a “200 OK” message to the user A terminal.

  FIG. 4 is a sequence diagram (part 2) of intra-group media distribution control according to the embodiment of the present invention. The procedure for controlling intra-group media distribution will be described below with reference to FIG.

  S8. When the user B who has not registered the content wants to perform trick play, “I want to operate. The content access address is notified to the user B terminal by designating the content distributed by the Web screen operation of the application server 7. The user B terminal transmits a “SETUP” message to the media server 8. In response to the received “SETUP” message, the media server 8 transmits a “200 OK” message to the user B terminal.

  S9. The user A terminal transmits a “PHASE” or “PLAY” message to the media server 8 in order to perform trick play. When the media server 8 does not request a plurality of requests to the distribution server 1 at the same time, RTSP “matches the requests of the user A and the user B and makes the distribution server 1 appear to one person and there is no request. Only the “PHASE” or “PLAY” message is transmitted to the distribution server 1. The distribution server 1 performs a trick corresponding to the message (video pause, rewind, playback, fast forward, etc.) on the distribution content by the received RTSP message. Play control is performed, and a “200 OK” message is transmitted to the media server 8. The media server 8 transmits a “200 OK” message to the user B terminal.

  Thereafter, the trick play operation can be performed until the media server 8 receives a “TEARDOWN” message from the end of distribution from all the participating users in the group or until all users in the group disconnect.

  S10. When a user who is participating in a group finishes distribution, “I'm getting tired. ] Transmits a “TEARDOWN” message to the media server 8. When the media server 8 receives a “TEARDOWN” message from all users who have performed “SETUP” in the group, the media server 8 transmits a “TEARDOWN” message to the distribution server 1 to request distribution termination. The distribution server 1 performs distribution end processing by the “TEARDOWN” message from the media server 8 and transmits a “200 OK” message to the media server 8.

  S11. When releasing a voice call “It's already time! See you tomorrow. ”The user terminal leaves the group meeting by transmitting BYE. The call control protocol (SIP) server transfers the “BYE” message to the application server 7, and the application server 7 transmits a disconnection request to the media server 8. The media server 8 closes the port for transmission to the user terminal and releases the user's resources. The application server 7 transmits a group end notification to the media server 8 in response to a disconnection request from all users in the group, and the media server 8 releases the group resources.

The following additional notes are further disclosed with respect to the embodiment including the above examples.
(Appendix 1)
A media synchronization method at the time of video sharing that provides a service by streaming operation of a distributed video to a plurality of user terminals constituting a group,
Pre-registering each terminal data of the user terminal in an application server;
Registering the content to be provided in the group from the user terminal to the distribution server by web operation of the application server;
Starting a group conference type service from any of the user terminals, and transmitting the content from the distribution server to a media server;
The media server performs synchronous distribution of distribution media to all terminals in the group;
A trick play instruction from the user terminal in the group in the middle of the conversation, notifying the distribution server via the media server;
The distribution server performs the trick play control;
A media synchronization method for video sharing, comprising:
(Appendix 2)
In the media synchronization method for video sharing described in Appendix 1,
A media synchronization method at the time of video sharing, characterized in that the application server and the session initialization protocol server cooperate to perform session control using a session initialization protocol.
(Appendix 3)
In the media synchronization method for video sharing described in Appendix 2,
A media synchronization method at the time of video sharing, characterized in that a group meeting is started by participation of a plurality of user terminals and grouping control of participants is performed.
(Appendix 4)
In the media synchronization method for video sharing described in Appendix 1,
A media synchronization method during video sharing, wherein the media server receives media from the user terminal in cooperation with the application server and controls media distribution within a group.
(Appendix 5)
In the media synchronization method for video sharing described in Appendix 1,
A media synchronization method at the time of video sharing, wherein the user terminal transfers media that the user terminal wants to share within a group to the application server by a hypertext transfer protocol.
(Appendix 6)
In the media synchronization method for video sharing described in Appendix 1,
The application server, in cooperation with the distribution server, transfers the media transferred by the user terminal to the distribution server.
(Appendix 7)
In the media synchronization method for video sharing described in Appendix 6,
The distribution server converts the media transferred from the application server into a media codec that can be distributed, stores the media in a database, and simultaneously notifies the application server of the access address of the content. Method.
(Appendix 8)
In the media synchronization method for video sharing described in Appendix 1,
The application server instructs the distribution of the registered media to all user terminals in the group by a web screen operation by the user terminal that performed media registration;
Notifying the media server of access address information notified from the distribution server;
The media server starts unicast delivery by a real-time streaming protocol to the access address notified from the application server;
The media server receives the registered media distributed from the distribution server, and synthesizes and distributes the media to all the grouped users.
(Appendix 9)
In the media synchronization method for video sharing described in Appendix 8,
The media server receives a real-time streaming protocol transmitted from each grouped user terminal as an application medium, and sends the received real-time streaming protocol to the access address of the distribution server after matching control between the user terminals. A media synchronization method at the time of video sharing, wherein trick play distribution control is performed for distribution media that are transferred and transmitted from the distribution server.

  According to the present invention, a trick play (pause, playback, rewind, fast forward, frame advance, etc.) instruction of video distribution media can be performed by operating all user terminals in the group while having conversations with user terminals in a specific group. Therefore, it can be used in a media synchronization method at the time of video sharing that provides a synchronized sharing service for distribution media.

It is a network block diagram (the 1) of the media synchronous control at the time of video sharing in one Embodiment of this invention. It is a network block diagram (the 2) of the media synchronous control at the time of video sharing in one Embodiment of this invention. It is a sequence diagram (the 1) of the media distribution control in a group in one Embodiment of this invention. It is a sequence diagram (the 2) of the media distribution control in a group in one Embodiment of this invention. It is a connection block diagram of the unicast and multicast in the video delivery service via the conventional internet.

Explanation of symbols

1 Distribution server (Unicast distribution)
2 Distribution server (multicast distribution)
3 Internet 4 ₁ , 4 ₂ , 4 ₃ User A, User B, User C
5 Session Initiation Protocol Server (SIPS)
6 Device for grouping 7 Application server (AS)
8 Media server

Claims (5)

A media synchronization method at the time of video sharing that provides a distribution service by streaming operation of distribution media to a plurality of user terminals constituting a group,
Pre-registering each terminal data of the user terminal in an application server;
A step to register the distribution server by a Web operation of the distribution media application servers to provide from within the group the user terminal,
Any of the started the user terminal from the group meeting style services, and, for ago Sharing, ABS distribution server to the media server, the steps of unicast the distribution medium in accordance with the streaming operation by real-time streaming protocol,
A step of the media server to synchronize dispensing of the distribution media for all user terminals in the group,
A trick play instruction from the user terminal in the group in the middle of the conversation, notifying the distribution server via the media server;
The distribution server performs the trick play control;
A media synchronization method for video sharing, comprising: The media synchronization method for video sharing according to claim 1,
A media synchronization method at the time of video sharing, characterized in that the application server and the session initialization protocol server cooperate to perform session control using a session initialization protocol. The media synchronization method for video sharing according to claim 1,
A media synchronization method at the time of video sharing, wherein the media server controls distribution of video media registered in the distribution server to each user terminal in a group in cooperation with the distribution server. The media synchronization method for video sharing according to claim 1,
The application server, in cooperation with the distribution server, transfers the media transferred by the user terminal to the distribution server. The media synchronization method for video sharing according to claim 1,
The media server receives a real-time streaming protocol transmitted from each grouped user terminal as an application medium, and sends the received real-time streaming protocol to the access address of the distribution server after matching control between the user terminals. A media synchronization method at the time of video sharing, wherein trick play distribution control is performed for distribution media that are transferred and transmitted from the distribution server.

Images