WO2012134150A2

WO2012134150A2 - Method and system for providing multimedia content sharing service while conducting communication service

Info

Publication number: WO2012134150A2
Application number: PCT/KR2012/002228
Authority: WO
Inventors: 이길수
Original assignee: (주)티아이스퀘어
Priority date: 2011-03-29
Filing date: 2012-03-27
Publication date: 2012-10-04
Also published as: WO2012134150A3

Abstract

The present invention relates to a system and a method for providing a service for providing multimedia content, such as music and movies, to a client terminal while conducting a communication service based on an Internet protocol, such as text chatting, voice calling, video calling, video chatting, so that users on both sides can simultaneously use the multimedia content. The method for providing a multimedia content sharing service is for providing the multimedia content sharing service, by a service provision system for providing a communication service between a first terminal and a second terminal, to the first terminal and the second terminal while conducting the communication service, and comprises: a first step of receiving from the first terminal a request signal for the multimedia content sharing service with the second terminal; a second step of forming a session for transmitting the multimedia content between the first terminal and the second terminal, according to the multimedia content sharing request signal; a third step of receiving a multimedia content data, which corresponds to the multimedia content that is transmitted from the first terminal, and transmitting same to the second terminal; a fourth step of receiving from the first terminal a play indication signal for indicating the playing of the multimedia content and transmitting same to the second terminal; and a fifth step of receiving from the second terminal a reply signal to the play indication signal and transmitting same to the first terminal, wherein the first terminal and the second terminal plays the multimedia content based on the play indication signal.

Description

Method and system for providing multimedia content sharing service during communication service

The present invention relates to a method and system for providing a multimedia content sharing service while performing a communication service, and more particularly, to perform a communication service such as a text chat, a voice call, a video call, a voice chat, a video chat, etc. based on an Internet protocol. The present invention relates to a service providing system and a method for smoothly providing multimedia contents such as music, movies, and e-books to a client terminal.

Recently, with the development of Internet technology, portable communication terminals equipped with network connection functions based on Internet protocols such as smart phones, tablet personal computers, and smart TVs are rapidly spreading, and various communication services using these portable communication terminals are variously developed. It is becoming.

The portable communication terminal uses a wireless LAN such as Wi-Fi (WiFi) instead of using the existing 2G (3G) or 3G (3G) mobile communication network, voice or chat during voice calls, voice chat, text chat, messaging services It is configured to use various types of communication services such as video call, video chat, etc. The communication service using the WLAN is widely used in that the user does not have to pay a separate fee. Recently, the so-called mVoIP (Mobile Voice over IP) service, which provides a voice call service based on the Internet Protocol (Internet Protocol, IP), has also increased significantly.

In line with this trend, users can use multimedia content such as music, movies, and e-books together with various types of communication services such as voice calls, voice chats, text chats, voice or video messages, video calls, and video chats based on IP. There is a demand for a method that can be conveniently and smoothly provided to a user.

The present invention has been made in view of the above, and while performing various types of communication services such as voice call, chat during voice call, text chat, video call, video chat, music, movie, e-book, etc. It is an object of the present invention to provide a service providing method and system that enables users to easily share the same multimedia contents.

The present invention selects a music, a movie, an e-book or various video on demand (VOD), or chats from a menu provided by an application of the user's smart terminal while the real-time communication service between the smart terminals is desired, or chatting. Another object of the present invention is to provide a service providing method and system for allowing a communication service user to simultaneously listen to or view corresponding multimedia content that is automatically provided based on a specific keyword inputted therein.

The present invention provides a gift that can present the corresponding multimedia contents to the other party by selecting the music, VOD or movie information currently being played by the service subscriber while simultaneously using the multimedia contents in real time while performing the communication service between smart terminals. It is another object of the present invention to provide a service providing system and a method having a 'purchasing / purchasing function' that can store a corresponding content on its own terminal by selecting a purchase.

The present invention is a micro payment interworking function using the phone number of the mobile communication terminal to pay for gifts or purchases of the multimedia content while simultaneously listening to or watching multimedia content in real time while performing a communication service between smart terminals and existing music. / VOD or movie site or clouding system (Clouding System) linked to streaming or download service or payment service linked to services such as music downloads, or through an open market or virtual store, such as an app store online Another object is to provide a service providing system and method that can provide a payment function.

The present invention provides a service interworking function through an application mounted on a smart terminal, so that multimedia content sharing can be performed smoothly between the interworking between the smart terminal and the legacy legacy 2G / 3G network based communication service. Another object is to provide a service providing system and method capable of providing a service.

In order to solve the above problems, the present invention provides a multimedia service when performing a communication service, the multimedia content in at least one of the calling terminal and the called terminal during the communication service between the calling terminal and the called terminal; Selecting what to play; Playing the selected multimedia content and synthesizing it with voice or video data and transmitting the synthesized multimedia content to the counterpart terminal; It provides a method for providing a multimedia service when performing a communication service comprising the step of playing the received composite data at the other terminal.

According to another aspect of the present invention, in the method for providing a multimedia service when performing a communication service, at least one of the calling terminal and the called terminal selects the multimedia content to be transmitted to the counterpart terminal during the performing of the communication service between the calling terminal and the called terminal. Making; Establishing a transmission session for transmitting the selected multimedia content to a counterpart terminal; Transmitting multimedia content data to a counterpart terminal through the transmission session; It provides a method for providing a multimedia service when performing a communication service comprising the step of playing the received multimedia content data in the other terminal.

In this case, the multimedia terminal may be configured to provide a menu for transmitting, playing, streaming, purchasing, and presenting the multimedia content by selecting a menu of the calling terminal or the called terminal.

In a method of providing a multimedia content sharing service according to an aspect of the present invention, a multimedia content sharing service is provided to a first terminal and a second terminal during a communication service in a service providing system that provides a communication service between a first terminal and a second terminal. A method of providing, comprising: a first step of receiving a multimedia content sharing request signal with a second terminal from a first terminal during a communication service; A second step of establishing a session for transmitting multimedia content between the first terminal and the second terminal according to the multimedia content sharing request signal; A third step of receiving multimedia content data corresponding to the multimedia content transmitted from the first terminal and transmitting the received multimedia content data to the second terminal; A fourth step of receiving a reproduction instruction signal instructing reproduction of the multimedia content from the first terminal and transmitting the reproduction instruction signal to the second terminal; And a fifth step of receiving a response signal to the reproduction instruction signal from the second terminal and transmitting the response signal to the first terminal. Here, the first terminal and the second terminal reproduce the multimedia content based on the reproduction instruction signal.

In one embodiment, the multimedia content sharing request signal is generated when the multimedia content included in the menu screen provided by the interface of the communication service of the first terminal is selected in the first terminal.

In one embodiment, the multimedia content sharing request signal is generated when the first terminal selects the multimedia content to be searched based on the text data input from the first terminal during the communication service.

In one embodiment, the playback indication signal includes time information to start playback of the multimedia content. Here, the first terminal and the second terminal respectively play the multimedia content at the time corresponding to the time information.

In one embodiment, the second terminal starts playback of the multimedia content in response to the reception of the playback instruction signal in a fourth step, and the first terminal in response to the reception of a response signal to the playback instruction signal in a fifth step. Start playback.

In one embodiment, the service providing method further includes a sixth step of receiving a multimedia content reproduction control signal from the first terminal side and transmitting the received multimedia control signal to the second terminal after the fifth step. Here, the second terminal performs control related to the reproduction of the multimedia content based on the multimedia content reproduction control signal.

In one embodiment, the multimedia content playback control signal includes a control signal for at least one of playing, stopping, repeating playback, moving forward, moving backward, and adjusting the volume of the multimedia content.

In an embodiment, the third step includes receiving a Message Session Relay Protocol (MSRP) SEND message carrying multimedia content data from the first terminal and transmitting the message to the second terminal.

In an embodiment, the fourth step includes transmitting a Session Initiation Protocol (SIP) message containing an execution command for the multimedia content data to the second terminal.

The multimedia content sharing service providing system according to an aspect of the present invention provides a communication service between a first terminal and a second terminal, and provides a service for providing a multimedia content sharing service to a first terminal and a second terminal during a communication service. A system, comprising: receiving a multimedia content sharing request signal from a first terminal side with a second terminal during a communication service and forming a session for transmitting multimedia content between the first terminal and the second terminal according to the multimedia content sharing request signal; Signal processing server; And a multimedia content relay server configured to receive multimedia content data corresponding to the multimedia content transmitted from the first terminal and transmit the received multimedia content data to the second terminal. Here, the signal processing server receives a reproduction instruction signal instructing reproduction of the multimedia content from the first terminal and transmits the reproduction instruction signal to the second terminal, and receives a response signal confirming that the reproduction instruction signal is received from the second terminal. The first terminal and the second terminal play the multimedia content based on the playback instruction signal.

In a method of providing a multimedia content sharing service according to another aspect of the present invention, in a service providing system for providing a communication service between a first terminal and a second terminal, the multimedia content is transmitted to the first terminal and the second terminal during a communication service. A method of providing a sharing service, the method comprising: a first step of receiving a multimedia content sharing request signal with a second terminal from a first terminal during a communication service; A second step of transmitting a signal confirming whether or not the multimedia content is shared to the second terminal according to the multimedia content sharing request signal, receiving a response signal, and transmitting the received response signal to the first terminal; A third step of receiving identification information of a multimedia content and a content sharing information transmission request signal from a first terminal; Extracting and transmitting the multimedia content connection information corresponding to the content identification information to the second terminal; And a fifth step of transmitting the multimedia content in a streaming manner to the connected first terminal and the second terminal based on the multimedia content connection information.

In one embodiment, the multimedia content sharing request signal includes a request message for querying the second terminal whether to receive the streaming method of the multimedia content.

In one embodiment, the method for providing a multimedia content sharing service, after the fifth step, receives a presenting request signal for requesting to transmit multimedia content from at least one of the first terminal and the second terminal to the other party or a third party. The method may further include transmitting the multimedia content to the counterpart or a third party according to the payment of at least one of the first terminal and the second terminal.

In one embodiment, the method for providing a multimedia content sharing service, after the fifth step, receives a download request signal for downloading the multimedia content to its own terminal from at least one of the first terminal and the second terminal, and the first terminal And transmitting the multimedia content to the corresponding terminal according to at least one payment of the second terminal.

In one embodiment, the method for providing a multimedia content sharing service, after the fifth step, receiving the multimedia content reproduction control signal from any one of the first terminal and the second terminal and transmits to the other of the first terminal and the second terminal. It further includes six steps. Herein, the other of the first terminal and the second terminal performs control related to the reproduction of the multimedia content based on the multimedia content reproduction control signal.

A system for providing a multimedia content sharing service according to another aspect of the present invention provides a communication service between a first terminal and a second terminal, and provides a multimedia content sharing service to a first terminal and a second terminal during a communication service. A system for providing a multimedia content sharing request signal with a second terminal from a first terminal side while performing a communication service, and transmits a signal to confirm whether to share multimedia content with a second terminal and receives a response signal thereto. A signal processing server transmitting to the first terminal and receiving the identification information of the multimedia content and the multimedia content reproduction request signal from the first terminal; A content management server extracting multimedia content data corresponding to the identification information according to a request of a signal processing server; And a streaming server for transmitting the multimedia content data received from the content management server to the first terminal and the second terminal in a streaming manner at the request of the signal processing server.

According to another aspect of the present invention, there is provided a method for providing a multimedia content sharing service, comprising: a first terminal and a second terminal during a communication service between a first terminal and a second terminal through a service providing system providing a communication service including a real-time text chat or a video chat; A method of providing multimedia content in at least one user terminal of a second terminal, the method comprising: a first method of automatically detecting a preset keyword among messages transmitted and received through a text chat or a video chat in a user terminal during a communication service; step; A second step of automatically extracting multimedia content data corresponding to a keyword in real time; And a third step of transmitting, in real time, video data in which the multimedia content data and the text chat or video chat signal are synthesized or overlaid to the counterpart terminal of the text chat or video chat.

According to another aspect of the present invention, there is provided a method for providing a multimedia content sharing service, comprising: a first terminal and a second terminal during a communication service between a first terminal and a second terminal through a service providing system providing a communication service including a real-time text chat or a video chat; A method of providing multimedia content in at least one user terminal of a second terminal, the method comprising: a first method of automatically detecting a preset keyword among messages transmitted and received through a text chat or a video chat in a user terminal during a communication service; step; Transmitting a text chat or video chat signal and a keyword to a counterpart terminal of the text chat or video chat in real time; And extracting multimedia content data corresponding to the keyword from the counterpart terminal and outputting video data obtained by synthesizing the extracted multimedia content data with a text chat or video chat signal on the screen.

According to another aspect of the present invention, there is provided a method for providing a multimedia content sharing service, comprising: a first terminal and a second terminal during a communication service between a first terminal and a second terminal through a service providing system providing a communication service including a real-time text chat or a video chat; A method of providing multimedia content in at least one user terminal of a second terminal, the method comprising: a first step of executing a specific sound source or a video on demand (VOD) file in a user terminal while performing a communication service; A second step of synthesizing the audio data of the sound source or the VOD file in the first step and the user voice data input through the microphone of the user terminal; And a third step of transmitting the synthesized voice signal to the counterpart terminal of the communication service. Here, the user terminal synthesizes audio data of a sound source or a VOD file with voice data received from the counterpart terminal and outputs the synthesized voice signal received from the user terminal to the speaker.

According to the present invention, while performing various types of communication services such as voice call, voice chat, that is, voice chat, text chat, voice or video message transmission, video call, video chat, etc. It is possible to provide a service providing method and a system in which multimedia contents can be easily used simultaneously by all users of a communication service.

For example, a subscriber (customer) who subscribes to the service of the present invention during a real-time text chat, chat during a voice call, or a video chat service between smart terminals is provided through a menu provided by a predetermined application mounted on his or her terminal. , The specific keywords entered during the chat (for example, the name of the singer, song title or composer for a song, the book name or author for a book, and the name of the movie, the name of a hero, or the name of a director for movie-related information). By selecting a music (MP3, etc.), a movie, a book (eBook), or various VODs to be listened to, the other party and the corresponding multimedia contents can be simultaneously listened to or watched together or viewed.

In addition, according to the present invention, when performing the real-time communication service between the smart terminals, the user of the communication service to the other party to play by clicking or touching the music, VOD or movie information currently playing while listening to music or VOD together The content can be presented to the user, and at least a receiving user can provide a service for storing the corresponding content in his terminal by selecting the purchase of the music, VOD, or movie. In particular, by providing a service that can be presented to third parties, it is possible to induce a linking business with other businesses of various forms.

In addition, according to the present invention, a micro-payment service using a mobile phone number for the payment service of the corresponding content during the real-time simultaneous listening or watching of the predetermined multimedia content during the text chat, voice chat or video chat between smart terminals , Payment service through interlocking with existing music, VOD or movie sites, clouding system, streaming or music upload / download, and online payment through open market or virtual store. It can provide, thereby extending the object of the monetization service for multimedia content.

In addition, according to the present invention, when performing a communication service between a smart terminal and a legacy legacy 2G / 3G network-based terminal by providing an interworking service function that connects the application of the calling smart terminal and the customer of the legacy legacy network communication between different networks When performing the service, it is possible to provide a real-time multimedia content sharing service.

1 is a schematic conceptual diagram illustrating a multimedia content sharing service providing system when performing a communication service according to an embodiment of the present invention.

FIG. 2 is a schematic block diagram of an embodiment of a configuration employable in the multimedia content sharing service providing system of FIG. 1.

3 is a flowchart illustrating a service procedure of a method for providing a multimedia content sharing service that can be employed in the multimedia content sharing service providing system of FIG. 2.

FIG. 4 is a diagram for describing a process of listening and transmitting a music file selected by a user terminal in real time during a video chat between the user terminals of FIG. 1.

FIG. 5 is a diagram illustrating a process of playing and transmitting a VOD file selected by a user terminal in real time during a video chat between the user terminals of FIG. 1.

FIG. 6 is a schematic block diagram of another embodiment of a configuration employable in the multimedia content sharing service providing system of FIG. 1.

7 is a flowchart illustrating a service procedure of a method for providing a multimedia content sharing service that may be employed in the system for providing a multimedia content sharing service of FIG. 6.

FIG. 8 is a schematic block diagram of another embodiment of a configuration employable in the multimedia content sharing service providing system of FIG. 1.

9 is a conceptual diagram of an embodiment of an interworking process of a client terminal employable in a system and method according to an embodiment of the present invention.

10 is a conceptual diagram of a presenting additional service procedure employable in a system and method according to an embodiment of the present invention.

11 is a conceptual diagram of a download additional service procedure employable in a system and method according to an embodiment of the present invention.

12 is a conceptual diagram illustrating another embodiment of a multimedia sharing service employable in a system and method according to an embodiment of the present invention.

FIG. 13 is a conceptual diagram illustrating another embodiment of a multimedia sharing service employable in a system and method according to an embodiment of the present invention. FIG.

EMBODIMENT OF THE INVENTION Hereinafter, the Example by this invention is described with reference to an accompanying drawing.

Referring to FIG. 1, a multimedia content sharing service providing system 100 (hereinafter, simply referred to as a service providing system) may share multimedia content during a communication service to users who are connected to a network and using a communication service. Service to ensure that

The communication service may be at least one of a voice call, a voice chat, a text chat, a video call, a video chat, and a message transmission.

Multimedia content includes music, movies, e-books and the like in the form of all audio or video data that can be transmitted over a network.

The sharing of multimedia content is provided by a method of synthesizing the multimedia content to at least one calling terminal and at least one called terminal and transmitting the same to a counterpart, file transmission method, or streaming transmission method. Refers to listening, watching or viewing the content substantially simultaneously.

The network includes any network capable of performing a call or communication function, such as a network for wired or wireless voice communication, a network for wired or wireless video telephony, an Internet Protocol (IP) based communication network, or the Internet. Such a network may include a wireless communication network, a data network, or a satellite network, and the wireless communication network may include, for example, a body area network (BAN), a personal area network (PAN), a local area network (LAN), and a metropolitan area (MAN) according to a transmission distance thereof. Network, wide area network (WAN), and the like.

At least two

user terminals

11 and 15 coupled to different networks or homogeneous networks are connected to the network, and each user terminal may be a calling party or a called party terminal. The

user terminals

11 and 15 may be voice phones for voice calls, video phones for video calls, or smart terminals such as smart phones, tablet PCs, and smart TVs for data communication. In the case of a smart terminal, a wireless LAN processing unit for data communication in an indoor environment, a cellular based WAN processing unit for voice call or data transmission and reception, a wireless communication processing unit for receiving GPS signals for location information confirmation, etc. It can be configured to be mounted.

According to the service providing system 100 of the present embodiment, at least two user terminals on a network perform communication services without having to terminate the communication service or perform a separate application program (for example, a file transfer program). On the way, the user of the calling party or the called terminal generates a multimedia content sharing service request signal through a menu of an application that provides a communication service, so that the user of the calling terminal and the called terminal can use the selected multimedia content at the same time.

For example, if a son who is having a video call with his father selects multimedia contents corresponding to a song he wants to sing with his father, the service providing system transfers the corresponding song file stored in his son's terminal to his father's terminal. By transmitting or transmitting multimedia content data about the song to the smart terminal of the son and the smart terminal of the father, the son and the father can make a video call with each other and listen to the song synthesized in the background on the video call data. Can be.

In another example, a daughter studying with an e-book calls her mother to ask for specific contents of the e-book, connects a voice or video call, and selects a multimedia content sharing menu provided by a certain application of his terminal. , The service providing system receives the e-book from the daughter's terminal and transmits the e-book to the mother's terminal, or from the service providing system side, Active Server Page (ASP), XML (eXtended Markup Language), Flash, HTTP ( By providing the multimedia content, which is a document in the form of a web page created by HyperText Transfer Protocol, to the terminal of the daughter and mother in real time, the daughter and mother can watch the same e-book together and make a call. In this case, the application may provide most of the terminal screen of the daughter and mother to the e-book display area and one portion of the screen to the display area of the video call screen or the display area of the application providing menu.

Here, the application refers to a mobile application, which is a module that operates at the topmost application layer in terms of the architecture of the terminal or network. In other words, the mobile application is a module that directly controls the activation / deactivation of the user from the user's perspective and provides functions such as call, information acquisition, and entertainment. The multimedia content sharing service of the present embodiment may be provided or function as an entity capable of charging a user. In the present embodiment, the application is one that provides all of the communication service, the multimedia content sharing service, and additional services of the multimedia content sharing service to the user terminal or at least one of the multimedia content sharing service and the additional service to the user terminal or It may be implemented as a plurality of applications. These applications are interworked with the service providing system through the network, so that the user can easily use the services provided by the service providing system, and the type or type of the terminal and the type or version of the operating system mounted on the terminal. Various forms and configurations can be implemented depending on the type of development language.

Referring to FIG. 2, the service providing system 100a includes a signal processing server 131 and a multimedia content relay server 132a.

The signal processing server 131 identifies a scenario in which a user terminal to perform a communication service through a network is a subscriber or a customer of a multimedia content sharing service and provides a multimedia content sharing service according to a service request signal from the user terminal. To perform.

For example, the signal processing server 131 may receive a multimedia content sharing request signal from a calling party or a called party terminal while performing a communication service, and establish a session for transmitting multimedia content data between the corresponding terminals according to the signal. have.

The multimedia content relay server 132a transmits a multimedia file corresponding to the corresponding content through a corresponding file transfer session formed by the signal processing server 131 so that a plurality of terminals may simultaneously share the multimedia content while performing a communication service. Transmits to the other user terminal.

The service providing system 100a according to the present exemplary embodiment may include a registration server (RS) for subscriber registration or authentication for a multimedia content sharing service when performing a communication service between a first terminal and a second terminal. .

3 is a flowchart illustrating a service procedure of an embodiment of a method for providing a multimedia content sharing service that may be employed in the multimedia content sharing service providing system of FIG. 2.

As shown in FIG. 3, the method for providing a multimedia content sharing service is received from at least one of user terminals performing a communication service in a service providing system including a signal processing server 131 and a multimedia content relay server 132a. In response to the multimedia content sharing request signal, a file transfer session is formed between user terminals so that the corresponding content can be shared.

In this embodiment, the service providing system includes a signaling server (SS) as the signal processing server 131 and a relay server as the multimedia content relay server 132a. The relay server may include an MSRP server 135. Message Session Relay Protocol (MSRP) is a rich communication suite (RCS) content that applies to the use of the Internet Protocol Multimedia Subsystem (IMS), which provides mobile telephony services. Features include instant messaging (IM), a file transfer that transfers files over a computer network or the Internet, and Image Share, which supports sharing images among users while on a mobile phone. Or for operation.

The procedure of the method for providing a multimedia content sharing service according to the present embodiment will be described in more detail as follows.

First, an IP-based multimedia service session established between the first terminal 15 and the second terminal 13 allows users to select one of voice call, voice mail, instant messaging, video call, video chat, or a combination thereof. During the communication service (S310), the user of the first terminal 15, like the user of the second terminal 13 through the predetermined application mounted on the terminal to listen to or watch the sound source or video file (File) In operation S321, a file transmission for the selected file is selected in operation S323.

According to the user's selection, the application of the first terminal 15 requests the service providing system to share the multimedia content and invites the second terminal 13 to the multimedia content sharing service to the SS 131 of the service providing system. It transmits (S325). The multimedia content sharing request signal is, for example, when the user selects a specific multimedia content on a menu screen provided by the interface of the communication service of the first terminal 15, the Message Session Relay Protocol (MSRP) session information is SDP ( Session Description Protocol) may be generated in the form of an INVITE message added to the SS (131). The SS 131 transfers the INVITE message received from the first terminal 15 to the second terminal 13 (S327). The SS 131 transmits a response message 100 Trying indicating that it is attempting to connect to the second terminal 13 to the first terminal 15 (S329). This response message is for preventing the first terminal 15 from retransmitting the INVITE message in the case of network delay.

When the MSRP session information is accepted at the second terminal 13, the SS 131 receives a response message 200 OK including the MSRP session information of the second terminal 13 from the second terminal 13 ( S331). The SS 131 forwards the 200 OK message received from the second terminal 13 to the first terminal 15 (S333).

The SS 131 receives an ACK message from the first terminal 15 (S335). According to the ACK message, the MSRP server 135 connected to the SS 131 is connected to the first terminal 15. The SS 131 transmits an ACK message from the first terminal 15 to the second terminal 13 (S337). When the ACK message is transmitted to the second terminal 13, the MSRP server 135 is connected to the second terminal 13. Through the above-described process, a file transfer session is established between the first terminal 15 and the second terminal 13 via the MSRP server 135 (S340).

According to the user's file transfer menu selection, the first terminal 15 loads multimedia content data such as a sound source or a video file in an MSRP SEND message and transmits the multimedia content data to the second terminal 13 (S351). When the MSRP SEND message is normally received, the MSRP server 135 transmits a 200 OK message to the first terminal 15 to inform the success of receiving the message (S353).

The MSRP server 135 transmits an MSRP SEND message to the second terminal 13 (S355). When the MSRP SEND message is normally transmitted to the second terminal 13, the MSRP server 135 receives a 200 OK message indicating that the corresponding message is normally transmitted from the second terminal 13 (S357).

The MSRP server 135 receives an MSRP REPORT message indicating whether the multimedia content data included in the MSRP SEND message has been normally received or failed from the second terminal 13 (S359). If the second terminal 13 has normally received the multimedia content data, the MSRP server 135 transmits a file transfer result, for example, an MSRP REPORT message indicating the file transfer success to the first terminal 15 (S361). On the other hand, the application of the first terminal 15 confirms the file transfer result through the MSRP REPORT message received from the MSRP server 135 (S363), and if the check result is a file transfer failure, and checks whether or not to re-send to the user (S365) ). Here, when the user selects retransmission, the application of the first terminal 15 returns to immediately before the step S351 to retransmit the pre-selected sound source or video file. On the other hand, if the user does not select retransmission, the application terminates the multimedia content sharing service procedure while performing the communication service.

As a result of checking in step S363, if the file transfer is successful, the SS 131 receives a playback instruction signal from the first terminal 15 (S367). The reproduction instruction signal may be implemented in a SIP MESSAGE form in which a play command defined by a predetermined standard is displayed in a content field. The SS 131 transmits the reproduction instruction signal received from the first terminal 15 to the second terminal 13 (S369). The SS 131 receives a 200 OK message indicating that an execution command has been received from the second terminal 13 (S371), and receives a 200 OK message indicating that the execution command has been received from the second terminal 13 (the first terminal (S371). 15) (S373). Here, the SIP message or the play instruction signal on which the execution command is carried may include time information on a time to start playing the multimedia content. This time information enables the first terminal 15 and the second terminal 13 to start playing the corresponding content at substantially the same time. Of course, in another aspect applicable to this embodiment, the time to start the playback of the content is to confirm the reception of the SIP message containing the execution command or to confirm the reception of the response signal to the SIP message containing the execution command It can be a point in time.

Through the above-described process, the multimedia file previously selected in the first terminal 15 is reproduced (S375), and the multimedia file received from the first terminal 15 is also reproduced in the second terminal 13 (S377).

After the above-described process, the SS 131 may receive a file transmission and file reproduction result from the first terminal 15 (S379). The file transmission and reproduction result may be transmitted in a SIP MESSAGE form in which a report command defined by a predetermined standard is displayed in a content field. In this case, the SS 131 stores a record of a file transmission and reproduction result report received from the first terminal 15 and sends a 200 OK message to the first terminal 15 indicating that a report message has been received. Can transmit

When the file playback is finished, the application of the first terminal 15 confirms to the user whether or not to repeat the playback of the file (S383), and if the user selects to repeat the playback, the process returns to immediately before the step (S367) and the step ( S367) The following process can be performed again. On the other hand, if the user does not select to repeat the playback or select the end as a result of the check in the step (S383), the application of the first terminal 15 sends a second SIP BYE message for the file transfer session through the SS 131 The second terminal 13 releases the file transfer session and transmits a 200 OK message to the first terminal 15 through the SS 131 to transmit the file transfer session with the first terminal 15. By terminating, the multimedia content sharing service scenario is terminated during the communication service. If the first terminal 15 terminates the use of the multimedia content sharing service or a predetermined time elapses, the application of the second terminal 13 automatically deletes the multimedia content data temporarily stored in the second terminal 13. It can be operated to (S385).

4 and 5 illustrate a voice synthesis or a music file or VOD file selected by a customer during a video chat between smart terminals using an IP network in an application of the user terminal (hereinafter simply referred to as an 'app'). It shows a method for transmitting to the other party through the image synthesis method. According to the present embodiment, the multimedia content is mixed and synthesized in an application (app) of each smart terminal, and then transmitted to the terminal of the other party. After extracting a specific text keyword from a character sent or received in each terminal, the keyword is generated. Rather than searching for and executing the corresponding content, the sending terminal application (app) mixes voice or video (Video) data and transmits it to the counterpart. In addition, the meta data of the sound source file or the information of the selected file may be delivered to the counterpart in order to use the present function or the storing or downloading function of the counterpart.

4 is a block diagram of a client terminal for explaining a process of providing a music file service employable in the method of FIG. 2.

Referring to FIG. 4, a music file selected by at least one user terminal among video chats between user terminals may be synthesized with a user's own voice to listen in real time or transmit to a counterpart. That is, when a predetermined music file is selected from the calling party or the called user terminal during video chat between the user terminals connected to the multimedia service providing system according to the present embodiment, the corresponding user terminal is synthesized through an audio mixing method. The synthesized music file may be transmitted to the counterpart terminal in real time while playing the music file.

Such a user terminal can be, for example, at least one Real-time Protocol (RTP) communication interface, at least one jitter buffer, at least one decoder, at least one encoder, and at least one The main body 210 having a mixer may be provided. The user terminal may include a display 231 and a speaker 235 for outputting received video and / or audio data, a camera 233 for capturing an external image, and a microphone for receiving external audio information. (Microphone, 237) and the like can be provided.

Referring to the music listening and transmission process during the video chat in the user terminal according to the present embodiment in more detail, first, a specific sound source (Music, 250) is executed in the user terminal (S1). Here, the sound source 250 includes a song file, audio files such as background music, sound effects, and the like.

When the sound source 250 is executed and the voice data of the user to be transmitted to the counterpart during the video call is input through the microphone 237 (S2), the application of the user terminal transmits the sound source 250 and the user voice data to the mixer (Mixer). (S3), and delivers the synthesized voice to the other party in the video chat (S4). The application synthesizes the voice data received from the sound source 250 and the counterpart terminal through the receiving side mixer (S5), and outputs the synthesized voice through the speaker 235 (S6).

According to this embodiment, the service providing system establishes a file transfer session between a user terminal and a counterpart terminal, relays message transmission and reception between both terminals, and supports real-time transmission and reception of a sound source to be listened to simultaneously by all video chat participants. Allows you to listen to multimedia content in real time at the same time during a video chat.

FIG. 5 is a block diagram illustrating a user terminal for explaining a VOD file service providing process employable in the method of FIG. 2.

Referring to FIG. 5, a VOD file selected by at least one user terminal among video chats between the calling party and the called party user terminals may be reproduced in real time or transmitted to a counterpart terminal. That is, when a user of the calling party or the called party smart terminal selects a predetermined video on demand (VOD) file during the video chat between the smart terminals, the user voice and / or the other party's voice and the VOD voice are synthesized in the smart terminal. Participants in the video chat can watch the VOD file together during the video chat by transmitting the synthesized audio signal and the VOD video to the other terminal while playing the VOD video with one voice signal. A receiving end (RECV) and a transmitting end (SEND) of the user terminal are connected to a multimedia service providing system through a network.

In more detail the process of playing and transmitting the VOD file during the video chat in the user terminal according to the present embodiment, first through the application mounted on the user terminal, the user executes the VOD file 260 to be viewed simultaneously with the other party of the video chat (S1).

When the VOD file 260 is executed and the user's voice data to be transmitted to the other party during the video call is input through the microphone 237 (S2), the application of the user terminal transmits the user's voice and the VOD voice to the transmitting side mixer (Mixer). Synthesize (S3), transmit the synthesized audio signal to the counterpart in the video chat (S4), transmit the VOD image of the VOD file 260 to the counterpart terminal (S5), and the application is The other party's voice and the VOD voice are synthesized through the receiving mixer (S6), the synthesized voice is output through the speaker 235 (S7), and the video and the VOD image received from the other party's terminal are displayed on the display 231. The synthesized image is synthesized through the receiving mixer (S8), and the synthesized image is reproduced through the display device 231 of the user terminal (S9).

According to the present embodiment, the service providing system establishes a video call session between a user terminal and a counterpart terminal, and supports both real-time transmission and reception of a VOD file to which both video chat participants simultaneously listen to and receive messages between both terminals. Allows you to listen to multimedia content in real time at the same time during a video chat.

Referring to FIG. 6, the service providing system 100b includes a signal processing server 131 and a multimedia content relay server 132b. The multimedia content relay server 132b includes a content management server (CMS) 123 and a streaming server (STS: streaming server) 125.

The signal processing server 131 performs a signal processing operation to transmit multimedia content data to corresponding terminals in a streaming manner based on the multimedia content sharing request signal received from the first terminal or the second terminal during the communication service. In the present embodiment, the multimedia content sharing request signal includes a multimedia content reception agreement request signal received from the first terminal 15.

For example, the signal processing server 131 processes the multimedia content reception agreement request signal of the first terminal 15 and the multimedia content reception agreement response signal of the second terminal 17, and streams the first terminal 15. In response to the request signal, the streaming server 125 requests streaming transmission of multimedia content data.

The content management server 123 stores multimedia content data corresponding to the content identifier included in the streaming request signal from the signal processing server 131. The multimedia content data may be supplied from an external content provider.

The streaming server 125 transmits the multimedia content data received from the content management server 123 to the first terminal 15 and the second terminal 17 in a streaming manner at the request of the signal processing server 131.

The service providing system 100b according to the present embodiment may include an MSRP server to provide an instant messaging service as a communication service between the first terminal 15 and the second terminal 17.

As shown in FIG. 7, the method for providing a multimedia content sharing service includes a user terminal that performs a communication service in a service providing system including a signal processing server 131, a content management server 123, and a streaming server 125. The multimedia content is provided in a streaming manner according to the multimedia content sharing request signal received from at least one, so that users can share the corresponding content.

In this embodiment, the service providing system includes an SS 131 as a signal processing server and a content management server 123 and a streaming server 125 as a multimedia content relay server 132b.

The user of the first terminal 15 and the user of the second terminal 17 are in the text chat or video chat (S710). Here, the application of the present embodiment for providing a communication service screen for text or video chat to the first terminal 15 or the second terminal 17 may include a text input window and a music menu to be used for the multimedia content sharing service on the communication service screen. , VOD (Video On Demand) menu, and music / VOD control menu.

In a text or video chat state, a user may recognize a specific keyword among texts of a user input into a chat window through an application mounted on the first terminal 15 or a music / VOD menu displayed on a screen of the first terminal 15. Recognizing a user selection (S721), and recognizing a user input for file transmission in a streaming manner (S723), the first terminal 15 queries the second terminal 17 whether to accept the streaming reception. The content receiving agreement query request message is transmitted to the SS 131 (S725).

The SS 131 transmits a content reception agreement query request message to the second terminal 17 to inquire whether the second terminal 17 agrees to the streaming reception (S727). Here, the content reception agreement query request message may correspond to the multimedia content sharing request signal. If the second terminal 17 agrees to receive the streaming of the multimedia content (S729), the SS 131 receives a content reception agreement query response message including the decision whether to agree with the second terminal 17 (S731). In operation S733, the second terminal 17 transmits a decision on whether to agree with the second terminal 17 to the first terminal 15. FIG. The first terminal 15 confirms whether or not the second terminal 17 receives the content of the streaming method and proceeds with the following procedure if the user agrees to the content, and terminates the procedure if the user does not agree (S740).

According to the agreement of the second terminal 17, the first terminal 15 transmits a content inquiry request message to the SS 131 (S751). The content retrieval request message is for retrieving content information by using a content identifier (Content ID). The content information includes codec information and streaming connection information about the content. The content identifier refers to a series of numbers, letters, symbols, or a combination thereof used to identify the multimedia content selected by the user of the first terminal 15. The content identifier is preferably set to recognize the same multimedia content in the first terminal 15, the second terminal 17 and the service providing system.

The SS 131 transmits a content inquiry request signal for requesting content information to the CMS 123 according to a request of the first terminal 15 (S753). The CMS 123 transmits a content inquiry response message to the SS 131 (S755). The content inquiry response message includes codec information and streaming connection information of the multimedia content queried by the SS 131. The SS 131 transmits a content inquiry response message to the first terminal 15 (S757).

The first terminal 15 receiving the content inquiry response message transmits the content sharing information transmission request message to the SS 131 (S761). The content sharing information transmission request message is for delivering content information received by the streaming method to the second terminal 17, and the content information received by the streaming method includes codec information and streaming connection information of the corresponding content. The SS 131 transmits the content sharing information including the content information to the second terminal 17 (S763).

The second terminal 17 receiving the content information transmits a content sharing information reception notification message to the SS 131 (S765). The SS 131 transmits a content sharing information reception notification message indicating that the second terminal 17 has received the content information to the first terminal 15 (S767).

The second terminal 17 accesses the STS 125 using the content streaming connection information in the content information (S769). The first terminal 15 also accesses the STS 125 using the content streaming connection information in the content information (S771). Through this connection, a streaming session is connected between the first terminal 15 and the STS 125 and between the STS 125 and the second terminal 17.

When the streaming session is connected, the STS 125 starts to transmit the multimedia content to the first terminal 15 in a streaming manner (S775), and at the same time, the multimedia content to the second terminal 17 at the same time. Start transmission in a streaming manner (S777). In this case, the first terminal 15 and the second terminal 17 output a video signal and an audio signal streamed from the STS 125. Multimedia content data corresponding to the content information may be provided from the CMS 123 to the STS 125.

When the streaming transmission for the multimedia content is completed, the STS 125 terminates the streaming session connection with the first terminal 15 and the second terminal 17 (S781, S783). When the streaming session is terminated, the first terminal 15 or the second terminal 17 performs a video call by outputting video and audio from the counterpart terminal in the case of a video chat.

The application of the first terminal 15 may determine whether to repeat playback of the multimedia content to the user of the first terminal 15 according to the termination of the streaming session connection (S785). According to the user's selection of repeating playback or ending playback, the application of the first terminal 15 may return to step S761 to repeat the following content sharing procedure or terminate the present service procedure.

Referring to FIG. 8, the multimedia content sharing service providing system 100c includes a media gateway server (MGW) 110, a web application server 121, a content management server (CMS). , 123), Streaming Server (STS: Streaming Server, 125), Database System (DBS: DatabaseBase, 127), Operations Management Server (OMS: Operation administration and Management Server, 129), SIP Signaling Server (SS: SIP Signaling Server 131, a registration server (RS: Registration Server) 133, a Message Session Relay Protocol (MSRP) server 135, and a billing server (BS: Billing Server, 137). Servers in charge of each function in the service providing system 100c refer to components or modules that perform functions corresponding thereto, and they may be combined with each other to constitute at least one device.

The Media Gateway (MGW) 110 is a network between different telephony networks such as a public switched telephone network (PSTN), a signaling system No 7 (SS7), a wireless access network of 2G / 2.5G / 3G, or a private branch exchange (PBX). This refers to a transmission device or service for converting a digital media stream, and enables multimedia communication through a next generation network based on multiple transmission protocols such as Asynchronous Transfer Mode (ATM) or Internet protocol. That is, the MGW 110 supports voice call matching with a CDMA network or video call matching with a WCDMA network, converts signaling in a legacy network and call signaling supported by the SS 131, and time division multiplexing (TDM). Media conversion in division multiplexing and Real-Time Protocol (RTP) media in applications of

user terminals

11, 13, 15, and 17 are relayed.

According to the service providing system 100c having the MGW 110 of the present embodiment, the voice telephone terminal 11 and the smartphone 15 connected to the 2G or 2.5G network or the video telephone terminal 13 and the smartphone ( 15) Connect a communication service such as text chat or voice call, and share multimedia contents such as music and movies while the communication service is being performed.

WAS (Web Application Server) 121 handles web business logic.

The CMS (Contents Management Server) 123 stores and manages various multimedia contents such as a sound source, an ebook, a music video (VoD), and a movie. Such content may be provided from an external content provider (CP). In addition, the CMS 123 may be used for portal sites of external networks such as Daum (www.daum.net), an open market such as a mobile app store, or a clouding system. It provides a platform and performs interworking with content providers, portal sites, open markets, and cloud systems. Here, the mobile app store is SK Telecom's T-Store, Apple's iPhone App Store, Nokia's Nokia Ovi Store, Android Market, BlackBerry App World. ), And the like.

The streaming server 125 transmits the content selected by the subscriber or the customer to the user terminal in a streaming manner. The STS 125 transmits content such as music, an e-book or a VOD selected by the customer in a streaming manner to the user terminal in real time in association with the CMS 123.

The DBS (DataBase System) 127 manages a database (DataBase) for voice and video call statistics information, service statistics information, and service management statistics information.

OA & M Server (OA & M Server: 129) is a component for operating and managing the service providing system (100c), the system configuration management, statistical processing management, failure of the service providing system (100c) It performs functions such as process management and operation management.

The SIP (SIP Signaling Server) 131 processes SIP signaling (Session Initiation Protocol Signaling) based on the IMS network and performs an S-Proxy (SIP Proxy) function for controlling a SIP session request to an external network. In addition, the SS 131 processes management, statistics, and call detail records (CDRs) for SIP calls that are routed from the IMS network, and the SIP calls are handled by an integrated services digital network user part (ISP) call scenario management guide. Performs a call routing function to an application server (AS: Application Server, not shown). In this embodiment, the application server can be seen as included in the MGW (110). Here, the IMS network refers to a set of nodes or an architectural framework for providing an IP multimedia service, and includes a call session control function (CSCF), a home subscriber server (HSS), And an application server, and transmits information about a user terminal on which a predetermined IP multimedia service is set to a corresponding service provider.

RS (Registration Server, 133) is in charge of the subscriber's phone book list management, subscriber status management, subscriber authentication management, and interworking with the IMS network based on the SIP protocol.

The Message Session Relay Protocol (MSRP) server 135 is responsible for the transmission of instant messages, and is responsible for managing the transmission sessions of binary files for music, images, videos, and the like, and for reliable file transfer. MSRP server 135 may be referred to as an MSRP Switch server.

The billing server (BS) 137 performs a billing settlement function when billing a multimedia content sharing service for a customer and interworking with another platform in the service providing system 100c.

In addition, the service providing system 100c may interwork with an existing legacy system. The legacy system may include a CCS 141, a billing system 143, an SMSC / MMSC 145, and a wired / wireless portal 147. Include. Here, the CCS (Customer Care System) 141 is a customer database of the service provider, and is a device for processing functions such as subscriber authentication, phone authentication, that is, authentication according to the type of phone. The billing system 143 is a device in which a service provider processes a customer's billing, or processes a customer's charge / deductor and balance inquiry function for a prepaid customer. SMSC (Short Message Service Center, 145) is a short message processing device for sending a short message received from the user terminal or additional service device to the other terminal, MMSC (Multimedia Message Service Center) is a multimedia message subscriber terminal or additional service A multimedia message processing device for sending from a device to a called terminal. The wired / wireless portal 147 is a portal system provided by a mobile communication customer for a wired or wireless Internet service provided by a corresponding mobile service provider and provides the Internet service to a subscriber who has subscribed to a predetermined service.

In addition, the service providing system 100c may be connected to an external open platform 151, an external platform 153, a content provider 155, or the like through the Internet. Here, the open platform 151 refers to a platform for the

smart terminals

15 and 17 to download various programs and contents or receive streaming services, such as an App Store, T-Store, Olleh Market, and the like. The platform 153 is a platform that can use music, e-books (eBook, etc.) and movies as a portal operator platform or a clouding system platform operated and serviced by content. The content provider CP 155 is a content provider that can upload various contents to the service providing system 100c.

The user terminal coupled to the service providing system 100c of the present embodiment and a corresponding network will be described in more detail as follows.

The voice telephone terminal 11 is a user terminal for voice and data communication through a 2G or 2.5G network. The video telephone terminal 13 refers to a user terminal for voice, video / video and data communication in a WCDMA network. The

smart terminals

15 and 17 are used for voice, video / video, and data communication in the Internet, WiFi network 50, or WCDMA Packet Switched (PS) network, and have a wireless Internet function. Refers to a user terminal equipped with an integrated application for transmitting and receiving text / text messages, voice and video messages, and voice / video calls in a network. Such

smart terminals

15 and 17 include so-called smartphones, tablet PCs, iPads and the like.

The 2G / 2.5G or CDMA (GSM) network 20 is connected to a mobile switching center (MSC) 21 and an external network, which is a mobile operator's switch that can route and process voice calls using a CDMA (GSM) user terminal. It interworks with the service providing system 100c through a PGS (Protocol Gateway Service) server 23 which plays a role of a gateway of the internal network.

The WCDMA network 30 may route and process voice and video calls using a WCDMA terminal, and may include a Serving General Packet Radio Services (SGSN) Support Node (SGSN) and a Gateway GPRS Support Node (GGSN) 37 It is responsible for the interworking (interworking) between the user terminal of the WCDMA packet switched network and the user terminal of the external network. In addition, the WCDMA network 30 is connected to the WMSC (WCDMA MSC, 31) and the PGS server 33, which are exchangers capable of routing and processing voice and video calls to WCDMA user terminals such as the video telephone 13. Interwork with the service providing system (100c) through.

The Internet 50 refers to the global system of interconnected computer networks using a series of communication protocols, commonly known as Transmission Control Protocol / Internet Protocol (TCP / IP) or User Datagram Protocol / Internet Protocol (UDP). . The user terminal may access the Internet 50 through a wireless LAN method such as WiFi. In addition, the Internet 50 is connected to the service providing system 100c through a SBC (Session Border Controller) 52. SBC 52 is a component that conforms to industry standards provided by SIP networks, and is coupled to the Internet 50 to handle NAT (Network Address Translation) Traversal that may occur between SIPs of interconnected computer networks.

According to the service providing system 100c of the present embodiment, a multimedia content sharing service can be provided through an application of a user terminal while performing a communication service. In addition, during the execution of the communication service, the user performing the corresponding communication service may share the multimedia content in real time according to the multimedia content sharing request signal of the user terminal.

9 is a conceptual diagram illustrating an embodiment of an interworking process of a user terminal employable in a service providing system and method according to an exemplary embodiment of the present invention.

Referring to FIG. 9, the user terminal 310 may correspond to a counterpart of a video chat in a predetermined manner according to a video chat option or a multimedia content sharing service option set by a user during a video chat, for example, as shown in FIG. 3. And share multimedia content. Here, the user terminal 310 is equipped with an application that supports the multimedia content sharing service during the video chat and provides the service screen.

Looking at the operation of the application in the user terminal according to the present embodiment in more detail.

First, the application provides a multimedia content sharing menu displayed on a portion of the video chat screen and the video chat screen on the display of the user terminal 310. The multimedia content sharing menu may include an icon (music menu) through which a user can select music in a video chat state, an input interface (hereinafter, referred to as a chat window) for inputting text or text for chatting. On the screen of the user terminal 310, the user may select a music menu displayed on the screen or input a predetermined keyword in a chat window while performing a communication service.

When the user activates the chat window (S1), the keypad is displayed on the screen (312). When the user inputs text related to a song such as a singer's name or composer on the keypad, for example, "Do you like tonight?" (S2), the character recognition engine installed in the application of the user terminal may enter a specific keyword such as chat text. Recognizing the song title included 'two nights', the application requests a sharing service for the corresponding sound source file to the service providing system according to the user executing selection of the corresponding sound source displayed on the screen (S3).

On the other hand, when the user selects the music menu (S4), the sound source list is displayed on the user terminal (314). If a desired sound source, for example, 'two nights' is selected by the user (S5), the application requests the multimedia content sharing service to the service providing system according to the execution selection of the corresponding sound source from the user (S6).

According to the step S3 or S6, the service providing system receives a multimedia content sharing request signal from an application of the user terminal 310. Here, the multimedia content sharing request signal is a signal for requesting the service providing system to transmit the multimedia data file corresponding to the multimedia content stored in the user terminal to the counterpart terminal based on the keyword recognized by the character recognition engine, or the character recognition engine. Corresponding to a signal for requesting the service providing system for streaming transmission of the multimedia content corresponding to the identifier while transmitting the identifier of the multimedia content stored in the user terminal to the service providing system corresponding to the keyword recognized by. The multimedia content sharing request signal may be generated in the form of an INVITE message in which a message session relay protocol (MSRP) session information is added to a session description protocol (SDP) in the user terminal 310 and transmitted to a signal processing server in a service providing system. .

In addition, the service providing system transmits the multimedia file of the user terminal to the counterpart terminal through a file transfer session formed between the terminals of the user performing a communication service according to the multimedia content sharing request signal, or the multimedia content sharing request signal and streaming. In response to the request signal, a multimedia file, for example, a music file, corresponding to the identifier of the multimedia content is transmitted to both user terminals in a streaming manner (S7).

When a predetermined sound source is transmitted from the user terminal 310 to the counterpart terminal or the corresponding sound source is streamed to the user terminal 310 and the counterpart terminal in a streaming method in a service providing system, the users performing the communication service perform a communication service. The same music can be listened to together (S8).

In addition to the above-described service procedure, the service providing system and method of the present embodiment may have various additional service procedures. For example, an application mounted on a user terminal or a service providing system connected to the user terminal may present the multimedia content such as music currently playing on the user terminal to a counterpart or a third party through the present function. In addition, at least one of the users who are performing the communication service may directly purchase the contents through a function such as setting or downloading the contents as their own. In addition, in an application or a service providing system of a user terminal, pause, replay, and stop of a corresponding content in a terminal of a user and / or a counterpart of a multimedia content such as music executed in both terminals. Control functions such as

FIG. 10 is a conceptual diagram of a presenting additional service procedure while performing a multimedia content sharing service employable in a service providing system and method according to an exemplary embodiment of the present invention.

Referring to FIG. 10, when the users of the calling user terminal 310 and the called user terminal 330 have a video chat with each other, for example, simultaneously listening to music selected by the user of the calling terminal 310, the calling party A user of the terminal 310 may present a corresponding sound source to the other party by selecting a gift menu button provided by an application mounted on his terminal (hereinafter, referred to as a first app).

Referring to the presenting additional service procedure according to the present embodiment in more detail, for example, a music file held by the user of the calling terminal 310 in the video chat state S1 to the user of the called terminal 330 is a music file. The user of the calling terminal 310 selects a present menu in the first app in a state of requesting sharing of the music and simultaneously listening to the corresponding music in the background (S2) (S3).

Here, the first app may transmit the information request signal for the corresponding sound source to the service providing system 100c and receive the corresponding sound source information from the service providing system 100c according to the user's gift selection menu. After receiving the corresponding sound source information from the service providing system 100c, the first app may check the sound source information output on the screen of the calling terminal 310 and select a confirmation menu (S5). This process may be omitted when sound source information exists in the calling terminal 310. The service providing system 100c may use the SS 131, the RS 133, the MSRP server 135, the BS 137, the STS 125, the CMS 123, etc. of FIG. 8 to provide additional services of this embodiment. It may be provided.

When the user of the calling terminal 310 selects the 'confirmation' menu of presenting on the screen (S5), the first app works in conjunction with the service providing system 100c connected through the network to the calling user terminal 310. The balance is inquired and requests payment of the corresponding sound source (S6). This payment process may be omitted if the sound source is free.

As the user of the calling terminal 310 requests payment, the service providing system 100c notifies the user of the called terminal 330 that the user of the calling terminal 310 wants to present a sound source. When the message is transmitted and the user of the called terminal 330 confirms the download, the user can allow the download of the corresponding sound source by the called terminal 330 (S7). When the download of the sound source is completed in the called terminal 330, the service providing system 100c may receive a download complete message from the called terminal 330 (S8).

When the sound source download to the called party terminal 330 is completed, the service providing system 100c transmits a present completion message to the calling party terminal 310 (S9). In addition, the service providing system 100c processes the billing payment for the calling terminal 310 through linkage with the first app (S10).

In the present exemplary embodiment, the case where the function of the present additional service is selected by the calling terminal 310 is described as an example. However, when the multimedia content sharing service of the streaming method is being used, the presenting terminal 330 also presents the present invention. Naturally, additional service functions can be used.

11 is a schematic conceptual diagram of a download additional service procedure employable in a system and method according to an embodiment of the present invention.

Referring to FIG. 11, when the users of the calling terminal 310 and the called terminal 330 are video chatting with each other, for example, simultaneously listening to music selected by the user of the calling terminal 310, the called terminal ( The user of 330 selects a download menu button provided by an application (hereinafter, referred to as a second app) mounted on his terminal, and downloads and stores the corresponding sound source to his terminal.

Referring to the download additional service procedure according to the present embodiment in more detail, first, a user of the calling terminal 310 during a video chat (S1) sends a predetermined music file to a chat counterpart, which is a user of the called terminal 330. The user of the called terminal 330 selects a download menu displayed on the screen provided by the second app in the state S2 of requesting sharing of the music and simultaneously listening to the corresponding music in the background (S3).

If there is corresponding sound source information in the called terminal 330, the second app may display the sound source information on the screen of its terminal. On the other hand, if there is no corresponding sound source information in the called terminal 330, the second app may be provided by requesting the sound source information from the service providing system (100c) (S4). The user of the called terminal 330 checks the sound source information displayed on the screen.

When the user of the called terminal 330 selects the 'confirmation' menu for the download additional service (S5), the second app interoperates with the service providing system 100c and inquires the balance of the called terminal 330. , The payment request of the sound source (S6). This payment process may be omitted if the sound source is free. When the payment is completed, the service providing apparatus 100c provides a sound source download to the called terminal 330 (S7).

When the download is completed, the service providing device 100c receives the download completion message from the called terminal 330 (S8), and processes the billing payment for the corresponding sound source in association with the second app of the called terminal 330. (S9).

As shown in FIG. 12, in the service providing system according to the present embodiment, when the first terminal 310 and the second terminal 330 are simultaneously listening to music in a video chat state S1 (S2), A service for sharing the music reproduction environment between the terminal 310 and the second terminal 330. That is, the user of the first terminal 310 corresponding to the host side uses the music / VOD control menu in the application mounted on the terminal to the second terminal 330 corresponding to the remote side. Service can be performed to control the corresponding content of the.

For example, the user of the first terminal 310 adjusts the volume of the corresponding music file by selecting a voice or volume menu in his terminal (S3). According to the volume adjustment of the user of the first terminal 310, the first app transmits the adjusted volume value to the second terminal 330 through the service providing system (S4). Here, the volume adjusting method may be a method of adjusting the volume of the corresponding content according to the adjusted volume level of the first terminal 310 and transmitting it to the second terminal 330 in the case of streaming transmission. In addition, in the case of a file transmission form, the volume value of the corresponding sound source may be transmitted to the second terminal 330 in a message form through a service providing system.

The application of the second terminal 330 adjusts and plays the volume of the music in accordance with the volume level received from the first terminal 310 (S5). Here, the application of the second terminal 330 immediately executes when receiving the streaming sound source, and when receiving a message about the volume value, adjusts the volume of the sound source according to the received volume value and executes the corresponding music. .

The additional service of the present embodiment is a service when the multimedia file is reproduced in the first terminal (S375) and substantially simultaneously with the multimedia file received from the first terminal in the second terminal (S377). The providing system may be applied to receive the multimedia content reproduction control signal from the first terminal 310 and transmit the multimedia content reproduction control signal to the second terminal 330. In addition, the additional service of the present embodiment may be applied during the performance of steps S775 and S777 of the service procedure of FIG. 7.

Here, the control interface for generating the multimedia content reproduction control signal may be implemented to be activated when at least one menu among the menus provided by the application of the first terminal 310 is selected. The control interface may include a player, a VOD player, and the like.

The multimedia content reproduction control signal includes an execution control signal, a sound control signal, and the like, and the execution control signal includes control signals for play, stop, repeat play, move forward, move backward, and the like, and the sound control signal includes a sound level. It may include a control signal such as a loud, a small, a mute for adjusting.

For example, the multimedia content playback control signal may include a music / VOD control menu (hereinafter referred to simply as a music control menu), and the music control menu may be on / off, stop, pause. ), Operation control menus such as Replay, fast forward (RWD), rewind (REW), and repeat play, and status display menus such as the total play time and progress time displayed on the screen together with these operation control menus. can do.

According to the above configuration, the application of the second terminal 330 in accordance with the multimedia content playback control signal received from the first terminal 310 is to automatically perform the control associated with the playback of the multimedia content currently playing.

In the present exemplary embodiment, the first terminal 310 adjusts the volume for the simultaneous listening music. For example, the second terminal 330 may adjust the volume for the corresponding music. In the present embodiment, the first terminal 310 may be a calling party or a called user terminal.

Referring to FIG. 13, the method for providing a multimedia sharing service according to the present embodiment is another embodiment of a remote control method for multimedia content, in which a first terminal 310 and a second terminal 330 simultaneously listen to music during a video chat. , The user can control the volume or the corresponding content (Stop / Pause / Replay / FWD / REW), repeat playback, etc. in each user terminal by using the music / VOD control menu in the application mounted in each terminal. It can be adjusted by selecting the operation control menu and the status display menu to view the play time and progress time.

For example, in the video chat state S1, when the user of the first terminal 310 and the user of the second terminal 330 are simultaneously listening to music in the background (S2), the user of the first terminal 310. Selects a music control menu displayed on the screen of the terminal for the corresponding content (S3) and adjusts items such as volume, voice on / off, etc. to a desired value (S4). And, similarly to the case of the first terminal 310, the user of the second terminal 330 also selects the music control menu for the music content (S3), Volume (Volume), Voice On / Off (Voice On / Off) ), Or stop / pause / replay / FWD / REW, repeat play, etc. to a desired value (S5).

Here, the service providing system may transmit information about the music control menu set or changed by either first user to the other party, whereby the other second user refers to the music control menu of the second user. It is possible to directly control the settings of the music content.

According to the present exemplary embodiment, the playback environment of the corresponding shared content may be adjusted according to a value directly adjusted by each terminal through an application mounted on the calling party and the called party terminals, rather than a host-remote control method. By controlling, the corresponding content can be shared according to the personality or taste of the shared content, thereby improving user convenience.

The technical features of the present invention according to the above embodiments are schematically shown as follows.

First, a customer who subscribes to the service while using a communication service such as a real-time text chat or a video chat, selects a music, VOD, or movie such as an MP3 file from a menu provided by a predetermined application mounted on his or her user terminal and contacts the other party. Corresponding multimedia content menu is automatically displayed for a specific character that is simultaneously listened to or watched or input in real time, and the user can listen to or watch the corresponding content together with the other by selecting a desired music or movie.

Second, while listening to, viewing or viewing music, VOD, or e-books at the same time when performing a communication service, the user presents to the other party or a third party by clicking or touching the currently playing content on his or her terminal. Or, it can be downloaded to your terminal and purchased. The use of such gifts or purchasing functions can be useful for business alliances, such as generating revenue with content providers or other industries. For example, while performing a communication service, a user of a calling party or a called party terminal may present a sound source being played to a counterpart who does not own the corresponding content, and the counterpart may directly purchase the corresponding content.

Third, the payment service for the gift or purchase of the corresponding content may be easily provided through an application interworking with the service providing system while using the real-time simultaneous listening or viewing of the multimedia content when performing the communication service. The payment service is a micro payment service using a mobile phone number, a streaming service through interworking with an existing music or movie site, a clouding system, or a payment service through interlocking services such as music upload / download, a portal site or an open market. It may include an online payment service through interworking.

Fourth, when performing a communication service between a smart terminal and a terminal connected to an existing legacy network, a seamless or seamless multimedia content sharing service may be provided regardless of a network to which user terminals are connected.

Fifth, when a user selects a specific menu in an application that is mounted on the user terminal and provides a corresponding communication service screen during a real-time text chat, voice call, or video chat, the user generates a specific keyword in the chat window provided by the application or provided by the application. When the user is inputted, the user who is performing the communication service may simultaneously listen to or watch the multimedia content such as background music, VOD, or movie, which is generated correspondingly.

Sixth, by providing the multimedia content control interface to at least one of the users using the multimedia content sharing service when performing the communication service, it is possible to easily adjust the playback environment of the content, thereby to conveniently use the multimedia content sharing service can do.

In the above, the present invention has been described with reference to preferred embodiments, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains have various modifications and variations from this description. It will be possible. Therefore, the present invention should be construed with reference to the overall description of the appended claims and drawings, and all equivalent or equivalent modifications thereof will belong to the scope of the present invention.

Claims

In the service providing system for providing a communication service between the first terminal and the second terminal, a method for providing a multimedia content sharing service to the first terminal and the second terminal during the communication service,

A first step of receiving a multimedia content sharing request signal with the second terminal from the first terminal while performing a communication service;

A second step of establishing a session for transmitting multimedia content between the first terminal and the second terminal according to the multimedia content sharing request signal;

A third step of receiving multimedia content data corresponding to the multimedia content transmitted from the first terminal and transmitting the received multimedia content data to the second terminal;

A fourth step of receiving a play instruction signal indicating playback of multimedia content from the first terminal and transmitting the play instruction signal to the second terminal; And

A fifth step of receiving a response signal to the reproduction instruction signal from the second terminal and transmitting the response signal to the first terminal;

Including,

And the first terminal and the second terminal play the multimedia content on the basis of the playback instruction signal.
The method of claim 1,

In the first step, the multimedia content sharing request signal is generated when the multimedia content included in the menu screen provided by the interface of the communication service of the first terminal is selected in the first terminal. How to provide shared services.
The method of claim 1,

In the first step, the multimedia content sharing request signal is generated when the first terminal selects the multimedia content to be searched based on text data input from the first terminal during the communication service. How to provide multimedia content sharing service.
The method of claim 1,

The reproduction instruction signal includes time information to start playback of the multimedia content, and the first terminal and the second terminal simultaneously play the multimedia content at a time corresponding to the time information, respectively. How to provide shared services.
The method of claim 1,

The second terminal starts playback of the multimedia content in response to receiving the playback instruction signal in the fourth step, and the first terminal responds to the reception of a response signal to the playback instruction signal in the fifth step. Method for providing a multimedia content sharing service, characterized in that to start playing the multimedia content.
The method of claim 1,

After the fifth step,

And receiving a multimedia content reproduction control signal from the first terminal side and transmitting the received multimedia signal to a second terminal.

And the second terminal performs control related to the reproduction of the multimedia content based on the multimedia content reproduction control signal.
The method of claim 6,

The multimedia content reproduction control signal is a multimedia content sharing service providing method, characterized in that the control signal for at least one of the reproduction, stop, repeat playback, forward movement, backward movement, volume control of the multimedia content.
The method of claim 1,

The third step includes receiving a message session relay protocol (MSRP) SEND message containing the multimedia content data from the first terminal and transmitting to the second terminal.
The method of claim 8,

The fourth step includes transmitting a Session Initiation Protocol (SIP) message containing an execution command for the multimedia content data to a second terminal.
A service providing system providing a communication service between a first terminal and a second terminal and providing a multimedia content sharing service to a first terminal and a second terminal during a communication service.

Receiving a multimedia content sharing request signal with the second terminal from the first terminal side while performing a communication service, and forms a session for transmitting multimedia content between the first terminal and the second terminal according to the multimedia content sharing request signal. A signal processing server; And

A multimedia content relay server for receiving multimedia content data corresponding to the multimedia content transmitted from the first terminal and transmitting the received multimedia content data to the second terminal.

Including,

The signal processing server receives a playback instruction signal for instructing playback of multimedia content from the first terminal, transmits the playback instruction signal to the second terminal, and receives a response signal confirming that the playback instruction signal has been received from the second terminal. Transmit to the first terminal,

And the first terminal and the second terminal play the multimedia content on the basis of the playback instruction signal.
In the service providing system for providing a communication service between the first terminal and the second terminal, a method of providing a multimedia content sharing service to the first terminal and the second terminal during the communication service,

A first step of receiving a multimedia content sharing request signal with a second terminal from a first terminal while performing a communication service;

A second step of transmitting a signal for confirming whether or not the multimedia content is shared to the second terminal according to the multimedia content sharing request signal, receiving a response signal, and transmitting the response signal to the first terminal;

A third step of receiving identification information of a multimedia content and a content sharing information transmission request signal from the first terminal;

A fourth step of extracting and transmitting multimedia content connection information corresponding to the content identification information to the second terminal; And

A fifth step of transmitting multimedia content to the first terminal and the second terminal connected based on the multimedia content connection information in a streaming manner;

Multimedia content sharing service providing method comprising a.
The method of claim 11,

In the first step, the multimedia content sharing request signal is generated when the multimedia content included in the menu screen provided by the interface of the communication service of the first terminal is selected in the first terminal. How to provide shared services.
The method of claim 11,

In the first step, the multimedia content sharing request signal is generated when the first terminal selects the multimedia content to be searched based on text data input from the first terminal during the communication service. How to provide multimedia content sharing service.
The method of claim 11,

The multimedia content sharing request signal in the first step, the multimedia content sharing service providing method characterized in that it comprises a request message for inquiring whether the streaming method of the multimedia content to the second terminal.
The method of claim 11,

After the fifth step,

Receiving a presenting request signal for requesting the transmission of the multimedia content to the other party or a third party from at least one of the first terminal and the second terminal, and to the payment of at least one of the first terminal and the second terminal And transmitting the multimedia content to a counterpart or a third party.
The method of claim 11,

After the fifth step,

Receive a download request signal for downloading the multimedia content to its own terminal from at least one of the first terminal and the second terminal, and according to the payment of at least one of the first terminal and the second terminal Method of providing a multimedia content sharing service, characterized in that it further comprises the step of transmitting to the terminal.
The method of claim 11,

After the fifth step,

Receiving a multimedia content reproduction control signal from one of the first terminal and the second terminal and transmitting the multimedia content reproduction control signal to the other of the first terminal and the second terminal;

And the other one of the first terminal and the second terminal performs control related to the reproduction of the multimedia content based on the multimedia content reproduction control signal.
The method of claim 17,

The multimedia content reproduction control signal is a multimedia content sharing service providing method, characterized in that the control signal for at least one of the reproduction, stop, repeat playback, forward movement, backward movement, volume control of the multimedia content.
A service providing system providing a communication service between a first terminal and a second terminal and providing a multimedia content sharing service to a first terminal and a second terminal during a communication service.

Upon receiving the multimedia content sharing request signal with the second terminal from the first terminal during the communication service, a signal for confirming whether or not the multimedia content is shared is transmitted to the second terminal, and a response signal is received for the second terminal. A signal processing server transmitting to the first terminal and receiving identification information of the multimedia content and a multimedia content reproduction request signal from the first terminal;

A content management server extracting multimedia content data corresponding to the identification information according to a request of the signal processing server; And

And a streaming server for transmitting the multimedia content data received from the content management server to the first terminal and the second terminal in a streaming manner in response to a request of the signal processing server.
Provides multimedia content in at least one user terminal of the first terminal and the second terminal during the communication service between the first terminal and the second terminal through a service providing system providing a communication service including a real-time text chat or video chat In the method,

A first step of automatically detecting a preset keyword among messages transmitted and received through a text chat or a video chat in a user terminal while performing a communication service;

A second step of automatically extracting multimedia content data corresponding to the keyword in real time; And

A third step of transmitting, in real time, video data obtained by synthesizing or overlaying the multimedia content data with the text chat or video chat signal to a counterpart terminal of the text chat or video chat;

Multimedia content sharing service providing method comprising a.
Provides multimedia content in at least one user terminal of the first terminal and the second terminal during the communication service between the first terminal and the second terminal through a service providing system providing a communication service including a real-time text chat or video chat In the method,

A first step of automatically detecting a preset keyword among messages transmitted and received through a text chat or a video chat in a user terminal while performing a communication service;

A second step of transmitting the text chat or video chat signal and the keyword to a counterpart terminal of the text chat or video chat in real time; And

A third step of extracting multimedia content data corresponding to the keyword from the counterpart terminal and outputting video data obtained by synthesizing the extracted multimedia content data and the text chat or video chat signal on a screen;

Multimedia content sharing service providing method comprising a.
Provides multimedia content in at least one user terminal of the first terminal and the second terminal during the communication service between the first terminal and the second terminal through a service providing system providing a communication service including a real-time text chat or video chat In the method,

A first step of executing a specific sound source or VOD file in a user terminal while performing a communication service;

A second step of synthesizing audio data of a sound source or a VOD file in the first step with user voice data input through a microphone of the user terminal; And

A third step of transmitting the synthesized voice signal to a counterpart terminal of the communication service;

Including,

The user terminal synthesizes audio data of the sound source or VOD file with voice data received from the counterpart terminal and outputs the synthesized voice signal received from the user terminal to the speaker. Method of providing a multimedia content sharing service.