WO2013002478A1

WO2013002478A1 - Method and system for providing multimedia content during a communication service

Info

Publication number: WO2013002478A1
Application number: PCT/KR2012/002639
Authority: WO
Inventors: 이길수; 김채활
Original assignee: (주)티아이스퀘어
Priority date: 2011-06-28
Filing date: 2012-04-06
Publication date: 2013-01-03

Abstract

The present invention relates to a method and system for automatically providing multimedia content in real time during a communication service. More particularly, the present invention relates to a method and system for providing multimedia content, in which, when a text keyword is inputted during an Internet protocol-based communication service such as text chatting, voice chatting, and video chatting, the system of the present invention automatically and in real time detects multimedia content corresponding to the keyword, and transmits the detected multimedia content to a user terminal together with a communication service signal, and therefore, feelings and emotions of the user or another user are efficiently expressed in real time. The method for providing said service comprises: a first step of automatically detecting a preset keyword in a message transceived through a messaging service in either a first or a second terminal during a communication service including the messaging service; a second step of automatically and in real time extracting multimedia content data corresponding to the keyword in the terminal that detects the keyword; and a third step of synthesizing or overlaying the multimedia content data with the communication service signal in the terminal that detects the keyword in order to display same on a user interface of the terminal itself.

Description

Method and system for providing multimedia contents during communication service

The present invention relates to a method and system for providing multimedia content during a communication service, and more particularly, to performing a communication service such as a text chat, a text chat during a voice call, a text chat during a video call, or the like based on an Internet protocol. The present invention relates to a method and system for effectively providing multimedia content that can express feelings, emotions, and the like to a user terminal of one or the other party together with a communication service signal.

Recently, with the development of the Internet technology, portable communication terminals having a network connection function based on Internet protocols such as smart phones and tablet personal computers are rapidly spreading, and various communication services using such portable communication terminals have been researched and developed in various ways.

These portable communication terminals use various types of wireless communication such as voice calls, chats, messages, video calls, and video chats using a wireless LAN such as Wi-Fi instead of using a second generation (2G) or third generation (3G) mobile communication network. It is configured to use communication service. The communication service using the WLAN is widely used in that the user does not have to pay a separate fee. Recently, so-called mVoIP services, which provide voice call services based on the Internet Protocol (Internet Protocol, IP), have also increased significantly.

According to this trend, it is possible to easily provide users with multimedia contents that can convey personality or feeling with various types of communication services such as text chat, text chat, message, and video chat during IP-based voice call. A solution is required.

An object of the present invention is to display in real time on the user interface of the terminal or the other terminal of the multimedia content that can express the personality of the user during the communication service such as text chat, text chat during voice calls, text chat during video calls It is to provide a service providing method and system.

In addition, the present invention provides a service providing method and system for seamlessly delivering multimedia content that can express a user's personality to a counterpart regardless of a network used by a called terminal.

In order to solve the above problems, the present invention provides a video call using a smart terminal or a smart device, the call for the video call to the destination terminal by the video call application by driving the video call application in the calling terminal Transmitting a connection request signal to a service providing system through an internet network or a packet switch network; Performing a video call using a smart terminal or smart device comprising the step of establishing a video call call between the calling terminal and the called terminal by the service providing system establishes a video call call with the called terminal through the video call network by the call connection request signal Provide a method.

According to another aspect of the present invention, in a method for performing a video call using a smart terminal or a smart device, a call connection request signal for a video call to a called terminal by the video call application is driven by the video call application by driving the video call application on the calling terminal. Transmitting to a service providing system through a network or a packet switch network; The video connection call is established between the calling terminal and the called terminal by the service providing system setting up a video call with the called terminal through the Internet network or the packet switching network by the call connection request signal. Provides a method of conducting a call.

Here, the service providing system may be configured to transmit and receive text data input from the calling terminal or the called terminal.

In addition, the service providing system may be configured to analyze text data and synthesize corresponding multimedia content data in an image channel and transmit the same.

According to another aspect of the present invention, at least one of the first terminal and the second terminal during the communication service between the first terminal and the second terminal through a service providing system for providing a communication service including a messaging service. In the providing method, during the communication service including the messaging service, at least one of the first terminal and the second terminal to automatically detect in real time the keyword set in advance in the device of the present invention from among the messages transmitted and received through the messaging service; step; A second step of automatically extracting multimedia content data corresponding to the keyword in real time from the terminal which detected the keyword; And a third step of synthesizing or overlaying the multimedia content data with a signal of the communication service in the terminal detecting the keyword and displaying the multimedia content data on the user interface of the terminal. .

In one embodiment, the second step is to receive a search request for the multimedia content from at least one terminal that has detected the keyword in the service providing system, to search the multimedia content data corresponding to the multimedia content to detect the keyword Transmitting to at least one terminal.

In one embodiment, the method for providing multimedia content (hereinafter, referred to as a service providing method) during a communication service is a Uniform Resource Identifier (URI) request message for a messaging service server that delivers an instant message from a first terminal before a first step. Receive a message including an authentication header field including an authentication key from the first terminal, and generate a response message including a URI of the messaging service server according to the authentication result of the first terminal. Transmitting to the first terminal; Sends a messaging service invitation message containing the URI of the first terminal to the second terminal, receives a URI request message of the messaging service server from the second terminal, sends an authentication request message to the second terminal, and sends an authentication key from the second terminal Receiving a message including an authentication header field including a message and transmitting a response message including a URI of a message service server to a second terminal according to an authentication result of the second terminal; And transmitting the URI of the second terminal to the first terminal according to the participation of the messaging service of the second terminal. Here, the service providing system handles the transmission and reception of a text message between the first terminal and the second terminal.

In one embodiment, a communication service including a messaging service includes a service for transmitting and receiving a text message during a video call, or a service for transmitting and receiving a text message during a voice call.

In one embodiment, the multimedia content includes emoticons, flashcons, avatars, and the like.

According to another aspect of the present invention, at least one of the first terminal and the second terminal during the communication service between the first terminal and the second terminal through a service providing system for providing a communication service including a messaging service. In the providing method, during a voice or video call and a chat service including a voice or video call service and a text chat service, a keyword previously set in the apparatus of the present invention is used in real time among text messages transmitted and received through the text chat service in a first terminal. A first step of automatically detecting; A second step of automatically extracting multimedia content data corresponding to a keyword in real time from a first terminal; And outputting or transmitting the multimedia content data from the first terminal so that the multimedia content is displayed on at least one of a user interface of the first terminal and a user interface of the second terminal that perform a voice or video call and chat service. Provides a method of providing multimedia content during the execution of an included communication service.

In an embodiment, the third step includes the step of transmitting the multimedia content data to the second terminal by combining or overlaying the multimedia content data with the audio signal, the video signal, or a combination thereof of the video call chat service.

In an embodiment, the third step may include a message including an execution command requesting the first terminal to synthesize or overlay the multimedia content data with an audio signal, a video signal, or a combination thereof of the video call chat service. And transmitting to the second terminal together.

In one embodiment, the service providing method, receiving the invitation message of the video call chat service for the second terminal from the first terminal before the first step, confirming the subscriber information for the second terminal, the result of confirming the subscriber information The method may further include transmitting an invitation message of the video call chat service to the second terminal, and establishing a video call path between the first terminal and the second terminal according to the response of the second terminal.

In one embodiment, the method of providing a service further includes establishing a messaging service connection for transmitting and receiving a text message between the first terminal and the second terminal before the first step and after establishing the video call path. .

According to another aspect of the present invention, a method for providing multimedia content to at least one of a first terminal and a second terminal in a service providing system for providing a communication service including a messaging service between a first terminal and a second terminal. A first step of detecting, in real time and automatically, a keyword set in advance by a device of the present invention in a message transmitted and received through a messaging service while performing a communication service including a messaging service; A second step of automatically extracting multimedia content data corresponding to a keyword in real time; And a third step of transmitting the multimedia content data to at least one of the first terminal and the second terminal through a chat channel or a video channel established for a messaging service. . Here, at least one of the user interface of the first terminal and the user interface of the second terminal displays an audio signal, a video signal, or a combination signal thereof of a communication service in which multimedia content data is synthesized or overlaid.

In one embodiment, the third step is a step of synthesizing or overlaying the multimedia content data on the audio signal, the video signal, or a combination signal of the communication service in the service providing system and transmitting to at least one of the first terminal and the second terminal. It includes.

In one embodiment, the third step comprises the execution of a message along with the multimedia content data, the message containing the execution instruction instructing the service providing system to synthesize or overlay the multimedia content data on the audio signal, the video signal, or a combination thereof of the communication service. And transmitting to at least one of the first terminal and the second terminal.

In one embodiment, the service providing method, prior to the first step through the media gateway in the service providing system to establish a video call path between the first terminal located in the Internet or packet switched network and the second terminal located in the circuit switched network. step; And establishing a messaging service connection for transmitting and receiving a text message between the first terminal and the second terminal.

According to another embodiment of the present invention, in the system for providing multimedia content to at least one of the first terminal and the second terminal while providing a communication service including a messaging service between the first terminal and the second terminal A signal processing server that processes messages transmitted and received between the first terminal and the second terminal to establish a messaging service connection in a communication service; And a messaging service server that processes a text message transmitted and received in a messaging service between the first terminal and the second terminal. Herein, at least one of the first terminal and the second terminal detects a keyword by itself, extracts multimedia content data corresponding to the keyword, and extracts the audio signal, a video signal, or a combination signal thereof of a communication service. The multimedia content data is synthesized or overlaid and displayed on the user interface of the own terminal.

According to another aspect of the present invention, a system for providing multimedia content to at least one of the first terminal and the second terminal while providing a communication service including a messaging service between the first terminal and the second terminal, voice or A signal processing server that processes messages transmitted and received between the first terminal and the second terminal to establish a messaging service connection in a communication service including a video call service and a text chat service; And a messaging service server that processes a text message transmitted and received in a messaging service between the first terminal and the second terminal. Here, the first terminal displays the multimedia content data on the user interface in a state where the multimedia content data is superimposed or synthesized on the audio signal, the video signal, or a combination signal thereof of the communication service while the communication service is performed, and the second terminal performs the communication service. The multimedia content data received from the first terminal is displayed on the user interface in a state of being superimposed or synthesized with an audio signal, a video signal, or a combination signal of the communication service. In this embodiment, the terminal transmitting the multimedia content to the counterpart may be switched from the first terminal to the second terminal.

According to still another aspect of the present invention, a system for providing multimedia content to at least one of a first terminal and a second terminal while providing a communication service including a messaging service between a first terminal and a second terminal, wherein: A signal processing server processing a message transmitted and received between the first terminal and the second terminal to establish a communication service connection including a service; A multimedia gateway interworking with a signal processing server and processing signals transmitted and received between a first terminal located on the Internet or a packet switched network and a second terminal located on a circuit switched network; And a messaging service server interworking with a signal processing server and a multimedia gateway and processing an instant message transmitted and received in a messaging service between a first terminal and a second terminal.

Here, the multimedia gateway detects a predetermined keyword among text messages transmitted and received between the first terminal and the second terminal, extracts multimedia content data corresponding to the detected keyword in real time, and extracts the extracted multimedia content data of the communication service. The audio signal, the video signal, or a combination signal thereof is transmitted in real time to at least one of the first terminal and the second terminal. At least one of the first terminal and the second terminal on the user interface in the state of overlaying or synthesizing the multimedia content data received from the service providing system with the audio signal, the video signal, or a combination signal thereof of the communication service while performing the communication service. Display.

In one embodiment, the multimedia gateway transmits the multimedia content data to at least one of the first terminal and the second terminal by combining or combining the multimedia content data with an audio signal, a video signal, or a combination signal thereof.

According to the present invention, multimedia contents reflecting the personality or feeling of the user through text analysis during communication services such as text chat, voice call, video call, video chat, etc. are output to the user's own terminal, the counterpart terminal, or both. can do.

In addition, unlike in the conventional case where E1 trunk and signaling must pass through a separate server on a network for character analysis and content synthesis, multimedia contents such as emoticons, flashcons, and avatars are directly communicated from a user terminal. By transmitting to the counterpart terminal in real time during the service, it is possible to effectively transmit its feelings or feelings to the counterpart.

In addition, it is possible to seamlessly provide multimedia contents in real time to user terminals in a fun and energetic manner while performing a communication service between different networks, such as a connection between the Internet or a packet switched network and a circuit switched network.

1 is a view for explaining a multimedia content providing system (hereinafter, referred to as a service providing system) while performing a communication service according to an embodiment of the present invention.

FIG. 2 is a flowchart illustrating an embodiment of a method for providing multimedia content (hereinafter, referred to as a service providing method) while performing a communication service employable in the service providing system of FIG. 1.

FIG. 3 is a flowchart of yet another embodiment of a service providing method employable in the service providing system of FIG. 1.

4 is a schematic block diagram illustrating a configuration and operation principle of a user terminal employable in the service providing system and method of the present invention.

5 is a schematic block diagram illustrating another configuration and principle of operation of a user terminal employable in the service providing system and method of the present invention.

FIG. 6 is a diagram illustrating a system configuration of another embodiment which may be employed in the service providing system of FIG. 1.

7 is a flowchart of an embodiment of a service providing method employable in the service providing system of FIG. 6.

8 is a conceptual diagram illustrating a process of displaying multimedia content on a user interface while performing a communication service through a service providing system or method according to an exemplary embodiment of the present invention.

9 is a diagram illustrating a login function on a user interface for performing a communication service in a service providing system or method according to an exemplary embodiment of the present invention.

FIG. 10 is a service for automatically detecting a character input during a text chat during a video call and outputting a corresponding content on a terminal screen as a communication service in a service providing system or method according to an exemplary embodiment of the present invention. Plus ") is a view showing a user interface screen.

11 is a schematic diagram illustrating a procedure for updating a multimedia content and a keyword as a communication service in a content management system in a terminal in a service providing system or method according to an embodiment of the present invention.

First, the overall outline and features of the present invention are summarized as follows.

The present invention provides a text conversation between a smart terminal or a smart device using an application and a system of the present device over Wi-Fi or Wideband Code Division Multiple Access (WCDMA) and Long Term Evolution (LTE) Packet Switched Network (LTE), It extracts various multimedia contents (eg emoticons, flash cones, avatar cones, etc.) in real time for specific text keywords during text chat during voice call and video call, and transmits them to the other party's terminal to express their feelings and feelings. Effective delivery is the main feature.

For example, if a smart terminal or smart device user launches an app and then selects a contact to select a text chat, voice call, voice chat, or video chat feature, the called party is on a Wi-Fi network, a WCDMA packet-switched network, When the called party uses the WCDMA video feature phone instead of the smart phone, the present invention attempts to process the call accordingly and requests the other party to call the call, and the call processing is completed so that the text chatting channel between the calling terminal and the called terminal is completed. When a voice call or a video call is established, text from an originating or called terminal can be recognized and the corresponding multimedia content can be delivered in both directions. In addition, the present invention performs character analysis on the input text through the character analysis engine existing in the calling terminal, or through the character analysis engine provided by the service providing system or the server, search for the registered content and search the retrieved image or video Can be synthesized and transmitted to the calling and called terminals.

The service provided by the present invention is schematically shown as follows.

The present invention provides a seamless communication between a caller on a Wi-Fi or WCDMA or LTE packet network and a called party on a Wi-Fi network, LTE or WCDMA Packet Switched Network, or WCDMA Circuit Switched Network, regardless of the network where the called party is located. It is possible to provide a service that delivers a multimedia content of one's emotion, feeling, or content that one wants to express to a counterpart among seamless video call services.

The present invention may provide a service that delivers information on a product or a prize of an event / promotion target to a counterpart through a multimedia content when an event or promotion is intended for a specific customer of a smart terminal or a device.

The present invention is a two-way multimedia that allows a smart terminal or device to send a multimedia content containing a feeling or emotion to the caller in response to the multimedia content received from the other party during a text chat, voice call, or video chat in response to the caller Content delivery service can be provided.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a system configuration diagram illustrating a multimedia content providing system (hereinafter, referred to as a service providing system) while performing a communication service according to an embodiment of the present invention.

Referring to FIG. 1, a multimedia content providing system (100, hereinafter, simply referred to as a 'service providing system') during a communication service is a multimedia containing a user's feelings or emotions connected to a network to perform a communication service. Make the content available together.

The communication service may be at least one of a text chat, a chat during a voice call, a chat during a video call, and a message transmission. Multimedia content includes emoticons, flashcons, avatars, and the like. An emoticon refers to an image or video created by combining letters, symbols, and numbers from an input device, such as a computer keyboard, to express emotions or intentions, and a flashcon replaces a specific word or keyword, which can be displayed on the user interface. A video refers to an avatar, and an avatar refers to an image or video depicting the computer user himself.

The network includes any network capable of performing a call or communication function, such as a mobile communication network for voice call, a mobile communication network for video call, an internet protocol (IP) or long term evolution (LTE) based data communication network, or the Internet. do. Such a network may include a mobile communication network, a data network or a satellite network, and the mobile communication network may include, for example, a body area network (BAN), a personal area network (PAN), a local area network (LAN), and a metropolitan area (MAN) according to a transmission distance thereof. Network, wide area network (WAN), and the like.

At least two

user terminals

10 and 20 coupled to different networks or homogeneous networks are connected to the network, and each user terminal may be a calling party or a called party terminal. The

user terminals

10 and 20 may be a voice terminal for a voice call, a video phone for a video call, or a smart terminal or a smart device such as a smart phone or a tablet PC or a smart TV for data communication. In the case of a smart terminal, a wireless LAN processing unit for data communication in an indoor environment, a cellular based WAN processing unit for voice call or data transmission and reception, a wireless communication processing unit for receiving GPS signals for location information confirmation, etc. It can be configured to be mounted.

The service providing system 100 according to the present embodiment includes a Signal Processing Server (SS) for processing Session Intiation Protocol (SIP), a Registration Server (133), and a Message Session Relay Protocol (MSRP). ) A server 135.

The SS 131 processes SIP Initiation Protocol Signaling (SIP) signaling based on an IMS network, and performs an S-Proxy (SIP Proxy) function for controlling a SIP session request to an external network. In addition, the SS 131 processes management, statistics, and call detail records (CDRs) for SIP calls that are routed from an IP multimedia subsystem (IMS) network, and the SIP calls are integrated services digital network user part. Call routing to an application server (AS) (not shown) that processes according to call scenario management guidelines. Here, the IMS network refers to a set of nodes or an architectural framework for providing an IP multimedia service, and includes a call session control function (CSCF), a home subscriber server (HSS), And an application server, and transmits information about a user terminal on which a predetermined IP-based multimedia service is set to a corresponding service provider.

RS 133 is in charge of subscriber's phone book list management, subscriber status management, subscriber authentication management, and interworking with IMS network based on SIP protocol.

The MSRP server 135 is responsible for the transmission of instant messages, and is responsible for managing transmission sessions of binary files for music, images, videos, and the like, and for reliable file transfer. MSRP server 135 may be referred to as an MSRP Switch server.

According to the service providing system 100 of the present embodiment, at least two user terminals on a network are provided through a chat window provided by a communication service application (hereinafter, also referred to as an "app") while performing a communication service based on IP. By inputting a predetermined keyword, the user of the calling terminal and the called terminal can simultaneously use the multimedia content corresponding to the keyword and expressing the personality or feeling of the user during the communication service.

For example, when User A, who is in an IP-based voice call with a friend, activates a messaging service provided by an app and inputs a preset keyword, the first app and user's terminal operating in User A's terminal Each of the operating second apps searches for multimedia content corresponding to the corresponding keyword, extracts multimedia content data corresponding to the searched multimedia content, and displays the multimedia content data previously extracted on the display screen or the user interface of at least a portion of the display screen. Output or play. In this case, the first app and the second app may search for and extract multimedia content data stored in the user terminal.

Here, the application refers to a mobile application, which is a module that operates at the topmost application layer in terms of the architecture of the terminal or network. In other words, the mobile application is a module that directly controls the activation / deactivation of the user from the user's perspective and provides functions such as call, information acquisition, and entertainment. The multimedia content providing service of the present embodiment can be provided and function as an entity capable of charging a user. In the present embodiment, the application may be implemented as one or a plurality of applications that provide at least one of a communication service and a multimedia content providing service to the user terminal. The application is interworked with a service providing system through a network and provides a user interface for a corresponding service. The type and type of a terminal, the type or version of an operating system mounted on the terminal, a type of a development language, etc. It can be implemented in various forms.

Referring to FIG. 2, the service providing method of the present embodiment is a multimedia that expresses personality or feeling of at least one of user terminals while performing a communication service through a service providing system that provides a communication service including a messaging service. Allow content to be displayed on the user interface.

Here, the signal processing server includes an SS 131, and the multimedia content providing server includes an MSRP server 135. The SS 131 may interwork with the RS 133 that manages registration information, status information, and the like of the service subscriber. In the MSRP server 135, the Message Session Relay Protocol (MSRP) is a Rich Communication Suite (RCS) that applies to the use of the Internet Protocol Multimedia Subsystem (IMS) for providing mobile telephony services. Transfer of content, especially instant messaging (IM), a form of real-time direct text-based communication, File transfer to transfer files over a computer network or the Internet, and support for sharing images among users during mobile phones. It may be used for a function or an operation such as an image share.

The procedure of the method for providing a multimedia content transmission service during a text chat according to the present embodiment will be described in more detail as follows.

The first terminal 10 transmits an MSRP authentication (AUTH) message to the MSRP server 135 to obtain an MSRP Uniform Resource Identifier (URI) of the MSRP server 135 for message transmission (S211). The MSRP server 135 transmits an MSRP 401 Unauthorized response message to the first terminal 10 to inform that authentication is required (S213).

The first terminal 10 transmits the authentication header field including the authentication key to the MSRP AUTH message to the MSRP server 135 (S215). The MSRP server 135 performs authentication by checking the Authorization header field values. If the authentication succeeds, the MSRP server 135 loads the MSRP URI to be used in the MSRP 200 OK response message to the first terminal 10 when the first terminal 10 transmits the message. It transmits (S217).

The first terminal 10 transmits an INVITE message including its own MSRP URI and the MSRP URI of the MSRP server 135 to the Session Description Protocol (SDP) via the SS 135 to the called party's second terminal 20. (S219, S221). The SS 131 may transmit a 100 Trying message to inquire the location of the first terminal 10 and notify the first terminal 10 of the call connection attempt (S223). Here, the SS 131 may transmit the INVITE message received from the first terminal 10 to the searched position of the second terminal 20.

The second terminal 20 receives the INVITE message from the first terminal 10 side, stores the MSRP URI of the first terminal 10, and MSRP to the MSRP server 135 to obtain the MSRP URI of the MSRP server 135. The AUTH message is transmitted (S225). The MSRP server 135 transmits an MSRP 401 Unauthorized response message to the second terminal 20 to inform that authentication is required (S227).

The second terminal 20 transmits the Authorization header field including the authentication key to the MSRP AUTH message to the MSRP server 135 (S229). The MSRP server 135 checks the Authorization header field values and performs authentication. If the authentication is successful, the MSRP server 135 loads the MSRP URI to be used in the MSRP 200 OK response message to the second terminal 20 when the second terminal 20 transmits the message. It transmits (S231).

The second terminal 20 notifies the user that a chat connection request has been received and transmits a 180 ringing message to the SS 131 (S233). The SS 131 transmits a 180 ringing message to the first terminal 10 to inform that the second terminal 20 is waiting for a response (S235).

When the user of the second terminal 20 joins the chat by selecting participation, the second terminal 20 displays a 200 OK message in which the MSRP URI of the first terminal 10 and the MSRP URI of the MSRP server 135 are loaded on the SDP. Is transmitted to the SS 131 (S237). The SS 131 transmits a 200 OK message to the first terminal 10 to inform that the second terminal 20 participated in the chat (S239). Here, the first terminal 10 obtains the MSRP URI of the second terminal 20 from the SDP in the 200 OK message.

The first terminal 10 notifies that the chat connection is completed by transmitting an ACK message to the SS 131 (S241). The SS 131 transmits an ACK message to the second terminal 20 to inform that the chat connection is completed (S243).

By the above-described process, the first terminal 10 and the second terminal 20 are connected to the MSRP server 135 of the service providing system and are in a chat state capable of transmitting and receiving instant messages using the MSRP URI of the other party ( S250). The connection between each terminal and the MSRP server 135 is maintained until the SIP BYE message is transmitted to or received from the other party.

In the chat state, the user of the first terminal 10 inputs text through the chat window of the first app (S261). For example, text such as "I want to eat pizza" may be entered. The first terminal 10 transmits the text message including the input text to the MSRP server 135 (SEND, S263). The MSRP server 135 transmits the text message received from the first terminal 10 to the second terminal 20 (S265). In response, the second terminal 20 transmits a 200 OK message to the MSRP server 135 (S267). The MSRP server 135 transmits a 200 OK message to the first terminal 10 (S269).

The first app of the first terminal 10 and the second app of the second terminal 20 check whether the multimedia content output option is activated during option setting of the communication service (S271, S281). If the corresponding option is activated, the first app of the first terminal 10 and the second app of the second terminal 20 detect a preset keyword among messages input or transmitted or received while performing a messaging service. For example, "pizza" is detected as a keyword in "I want to eat pizza" (S273, S283). Each of the first terminal 10 and the second terminal 20 extracts multimedia content data corresponding to the corresponding keyword, for example, multimedia content data related to the keyword "pizza" (S277 and S287). If extracted content exists in at least one of the first terminal 10 and the second terminal 20, the URL or the content of the corresponding content may be delivered to the counterpart (S275 and S285). In addition, although each terminal normally extracts the corresponding content by detecting a keyword, at least one of the first terminal 10 and the second terminal 20 selectively extracts the extracted content to the other party through the MSRP server according to the optional option. Can be transmitted (S275, 285). The first terminal 10 and the second terminal 20 output or play multimedia content data through at least a portion of a screen and a speaker on a user interface in a chat state (S279 and S289).

The steps S263 to S269 and the steps S271 to S279 and S281 to S289 may be repeatedly performed. In addition, the service providing method according to the present embodiment also applies to a specific keyword in a text message input from the second terminal 20 similarly to providing multimedia content with respect to a specific keyword in the text message generated in the first terminal 10. Multimedia content can be provided.

According to the present embodiment, multimedia contents such as a personalized emoticon, a flashcon, an avatar, etc., corresponding to a specific keyword in both terminals during a messaging service of a first terminal and a second terminal through a service providing system and an app mounted on each terminal are provided. Can be used together, thereby increasing the utilization of the communication service.

This embodiment shows a method of providing multimedia content during a communication service such as a video call and a chat service between smart terminals located in the Internet or a packet switched network.

Referring to FIG. 3, when a user of the first terminal 10, which is a smart terminal, drives a first app for a video call (S310), and selects a called party in the Internet or a packet switched network to make a video call (S312), The originating first terminal 10 transmits an INVITE message to the SS 131 and requests a call (S314).

The SS 131 confirms the current position of the second terminal 20 through a location query of the called-party second terminal 20 with the RS 133. The SS 131 requests a call in the INVITE message to the second terminal (S316). The second terminal 20 executes a ring in the terminal itself and transmits a 180 response message to the SS 131 (S318). The SS 131 transmits a 180 ringing message to the first terminal 10 (S320). When receiving the 180 ringing message, the first terminal 10 executes a ring back tone (RBT) to the caller (S322).

When the called person presses the call button, the second terminal 20 transmits a 200 OK message to the SS 131 (S324). The SS 131 transmits a 200 OK message to the first terminal 10 (S326). The first terminal 10 transmits an ACK message indicating that the 200 OK message has been received to the SS 131 (S328). The SS 131 transmits an ACK message to the second terminal 20 (S330).

By the above-described process, a video call path is established between the first terminal 10 and the second terminal 20, and voice and video call between both ends are possible (S340).

In order to establish a chat connection after opening a video call, the first terminal 10 establishes a connection for chatting with the MSRP server 135 (S350). In addition, the second terminal also establishes a connection for chatting with the MSRP server 135 (S355). The chat connection setting of the first terminal 10 or the second terminal 20 may be similar to the procedure of S211 to S243 of FIG. 2.

During the video chat, the user of the first terminal 10 inputs text through a chat window provided by the first app (S361). The text message including the input text is transmitted from the first terminal 10 to the MSRP server 135 (S363). The MSRP server 135 transmits the text message received from the first terminal 10 to the second terminal 20 (S365). In response, the second terminal 20 transmits a 200 OK message to the MSRP server 135 (S367). The MSRP server 135 transmits a 200 OK message to the first terminal 10 (S369).

If the multimedia content output option setting for a specific keyword is activated or turned on in the setting of the first app of the first terminal 10 (S371), the first app detects a preset keyword among text messages input or received. In operation S375, the multimedia content corresponding to the detected keyword is searched to extract a multimedia content data file in the form of a flash or a video corresponding to the multimedia content (S375). In addition, the extracted content is output to at least one of the first terminal 10 and the second terminal 20 (S376). Here, the first terminal 10 plays the extracted content according to the option setting (S377) such as the terminal itself output or synthetic transmission only (S378) or the terminal itself (S378) while the chat call path (345) ) May be transmitted to the second terminal 20. When the multimedia content is transmitted to the second terminal 20, the first terminal 10 synthesizes the content into a video chat signal and transmits the content to the second terminal 20 or requests to synthesize or overlay the content on the video chat signal. The message containing the command may be transmitted to the second terminal 20.

If the multimedia content output option setting for a specific keyword is activated or turned on in the option setting of the second app mounted in the second terminal 20 (S381), the second app may be connected to the video chat signal from the first terminal 10. The synthesized multimedia content data transmitted through the video call path 340 or the chat call path 345 is output to the second terminal 20. Meanwhile, when receiving a message including an execution command for synthesizing or overlaying the corresponding multimedia content with a video chat signal, the second app detects a preset keyword among the text messages received through the chat channel 345, and detects the detected keyword. The multimedia content may be searched for a keyword to extract multimedia content data in the form of a flash or a video corresponding to the multimedia content, and output the extracted content to the second terminal 20 itself. That is, the second terminal 20 receives and outputs image data in a form synthesized or overlaid on an audio signal, a video signal, or a combination signal thereof for outputting multimedia content data, or outputs an audio signal for video chatting. Receives a message containing an execution command for synthesizing or superimposing the multimedia content data on the video signal, or a combination signal thereof, and receives the video chat signal synthesized or overlayed with the multimedia content data according to the execution command previously received by the terminal itself. You can print

The video call and chat session is maintained until the BYE message is transmitted and received between the first terminal 10 and the second terminal 20. In addition, in the present embodiment, the above-described steps S363 to S369 and steps S371 to S383 may be repeatedly executed according to a text input including a specific keyword from the first or second terminal.

4 is a schematic block diagram illustrating a configuration and operation principle of a user terminal employable in a service providing system and method according to an embodiment of the present invention.

Referring to FIG. 4, the user terminal 10 includes a smart terminal connected to a cellular network or a data network such as GSM, UMTS, WCDMA, TD-SCDMA, LTE, or a video phone connected to a cellular network, and is mounted on the terminal. App and a predetermined user interface provided by the app. The user interface may have a chat window. The user terminal 10 outputs a chat text input unit 11, a content information receiver 12, a content search unit 13, and a content output unit so that multimedia contents can be utilized while performing a messaging service such as text chat, voice chat, or video chat. A unit 14 and a character analysis engine 15 are provided.

When text to be included in the text message for chatting is input to the user terminal, the chat text input unit 11 transmits the input text to the text analysis engine 15. The character analysis engine 15 supplies the multimedia content data corresponding to a specific keyword in the text input from the chat character input unit 110 according to the character receiving process 16 to the database 18 of the character analysis engine according to the character processing process 17. ), The table including the character analysis information is searched for, and the retrieved content identifier (ID) is transmitted to the content information receiver 12. The content information receiver 12 transmits the content identifier received from the text analysis engine 15 to the content search unit 13. The content retrieval unit 13 retrieves a table including the content information from the database 18 of the character analysis engine based on the content identifier. When the multimedia content data for the specific keyword is found, the content searching unit 13 transmits the found multimedia content data to the content output unit 14. The multimedia content data from the content output unit 14 is displayed on the user terminal through at least some screens and speakers on the user interface of the user terminal during the chat.

The smart terminal 10 is applicable to the first terminal, the second terminal, or both mentioned in the service providing system and method according to the above-described embodiment. The specific function and text analysis engine of the smart terminal 10 is preferably implemented by a predetermined video call app such as "Video Chat Plus" app.

5 is a schematic block diagram illustrating another configuration and operation principle of a user terminal employable in the service providing method of the present invention.

Referring to FIG. 5, when a text message including a preset keyword is transmitted or received from a calling party or a called party smart terminal during a video call or video chat between smart terminals, each smart terminal 10a searches for multimedia content. After synthesizing the retrieved multimedia content file into a video call signal or a video chat signal, the synthesized signal may be output to the smart terminal of the other party while outputting the synthesized signal to the smart terminal 10a. Here, the receiving end (RECV) and the transmitting end (SEND) of the source and destination smart terminals are connected to the service providing system through the network.

In this embodiment, the smart terminal 10a includes at least one Real-time Protocol (RTP) communication interface, at least one jitter buffer, at least one decoder, at least one encoder, and It may be provided with a main body 21 including at least one mixer (Mixer). In addition, the smart terminal (10a) is a display (22a), a database in which the multimedia content is displayed or synthesized or superimposed with the audio signal, video signal, or a combination signal of the video call signal or the video chat signal, and a multimedia content file Or a storage unit 23, a speaker 24 for outputting an audio signal of a video call or video chat signal synthesized with an audio signal of multimedia content, a camera for photographing an external image, and an external camera. A microphone 25 to which an audio signal is input may be provided.

Here, the service providing system maintains a communication path for communication services such as text chat, video call, or video chat between the calling party and the called party smart terminals, and according to a preset keyword in the text message during the communication service. The multimedia content generated in at least one of the calling party and the called party terminals is transmitted to the other party terminal. The called party smart terminal displays or outputs an image or video file received from the calling party terminal on the user interface of the communication service in the same manner as the alternate video or in an overlay method.

Meanwhile, the service providing system or method according to the present embodiment not only provides a corresponding service between the Internet / packet switching network and the Internet / packet switching network, but also the Internet / WiFi, WCDMA Packet Switched (PS) network, and WCDMA Circuit Switched (CS) network. Of course, the user of the first and second terminals may be implemented to share multimedia content during a text chat, video call, or video chat.

For example, when a first terminal located in a WiFi / WCDMA PS network chats while making a video call through a call connection with a second terminal located in a WCDMA CS network, the first terminal according to a preset text and chat option The specific keyword of the text inputted at is detected in the service providing system, and multimedia content corresponding to the detected keyword is processed in the service providing system similarly to the case of FIG. 5, and then, to the first terminal and the second terminal through the chat channel. And the first and second terminals share the corresponding contents in real time during the chat.

Referring to FIG. 6, the multimedia content providing system 100a may include a media gateway (MGW) 110, a content management server (CMS) 123, an operation management server (OMS), 129, a SIP signaling server (SS) 131, a registration server (RS) 133, and a message session relay protocol (MSRP) server 135. Servers in charge of each function in the service providing system 100a refer to components or modules that perform corresponding functions, and they may be combined with each other to constitute at least one device.

The service providing system 100a according to the present embodiment includes a text chat, a video call, or a video between a first terminal and a second terminal connected to different networks such as the Internet or WiFi, a WCDMA packet switched network, and a WCDMA circuit switched network. The user of the first and the second terminal may be implemented to share the multimedia content during the chat.

In one aspect, the service providing system 100a is connected to a session border controller (SBC), which is a server for providing calls over a network address translation (NAT), performs SIP processing through the SS 131, By managing the service for the smartphone subscriber through 133, the multimedia content is provided during the communication service between the smart terminals.

For example, when the first terminal 10, which is a smart terminal, makes a SIP call by pressing a phone number of the called terminal and a corresponding service button through an application, the service providing system 100a may receive a first call that is a smart terminal for the received SIP call. Based on the identifier (ID) of the second terminal 10a, IP information of the second terminal 10a is found through the RS 133, and a video call is made to the second terminal 10a based on the IP information, and the MGW ( A video call path is established between them through 110, and a chat call path is established between them through the MSRP server 135, and then a corresponding service is provided through the opened video chat path. In this case, the calling party or the called party

smart terminal

10, 10a registers or changes its status in the RS 133 using the SIP Subscribe message, and its status in the RS 133 using the SIP Notify message. Change State changes include busy, end of call, and the like. In addition, the originating first terminal 10 sends a message by inserting text or dual-tone multi-frequency (DTMF) into the body of the SIP INFO message, and the SS 131 sends the body of the SIP INFO message. .245 Can be relayed in UserInputIndication.

In another aspect, the service providing system 100a includes an image between a first terminal 10a connected to the Internet via Wi-Fi and a second terminal 20 which is a general video terminal connected to a mobile communication network. Provide call-related services. In this case, in the service providing system 100a, when the first terminal 10a runs the application and selects the telephone number of the called second terminal 20 and the corresponding video call additional service item in the application, the Wi-Fi and the Internet are selected. Is connected to the MGW 110 in the service providing system, the MGW 110 makes a call to the second terminal 20 through the WMSC 31 for the received SIP call, and the second terminal 20 makes a call. In response, a video call path is generated via the MGW 110, and thereby provides a corresponding service between the first terminal 10a and the second terminal 20.

In another aspect, the service providing system 100a uses the telephone number and the video call button of the called-party second terminal 10 located in the circuit-switching network on the Internet or the packet-switched network. When pressing to make an ISUP call, the service providing system 100a finds IP address information of the second terminal 10 through the RS 133 with respect to the received ISUP call, and based on the found IP address information, the second terminal 10. ) Make a video call in the form of a SIP incoming call, and provide the corresponding service through the video call path formed through the MGW 110.

In another aspect, the service providing system 110a provides a messaging service, such as a text transfer service, or a communication service including such a messaging service, between a first terminal and a second terminal, and the first terminal and the first terminal while performing a messaging service. According to a text message including a specific keyword transmitted from at least one of the two terminals, multimedia content corresponding to the specific keyword is provided to the first terminal and the second terminal.

Each component of the service providing system 100a of this embodiment will be described in more detail as follows.

The Media Gateway 110 (MGW) is a line-based access network of different telephony networks such as a public switched telephone network (PSTN), a signaling system No 7 (SS7), a 2G / 2.5G / 3G, or a private branch exchange (PBX). It refers to a transmission device or a service that converts a digital media stream between them, and enables multimedia communication through a next-generation network based on multiple transmission protocols such as Asynchronous Transfer Mode (ATM) or Internet protocol. That is, the MGW 110 supports voice call matching with a CDMA network or video call matching with a WCDMA network, converts signaling in a legacy network and call signaling supported by the SS 131, and time division multiplexing (TDM). Media conversion in division multiplexing and Real-Time Protocol (RTP) media in applications of

user terminals

10, 10a, 20, and 22 are provided and relayed. In the present embodiment, the MGW 110 is an application server (AS) that handles call setup between heterogeneous networks, and the like, and a media transcoding server (MTS) that handles media transmission and reception between homogeneous or heterogeneous networks. Server), an application plus server (APS: Application Plus Server) that handles interworking with an external carrier, and the like.

According to the service providing system 100a having the MGW 110 of the present embodiment, the video telephone terminal 20 connected between the voice telephone terminal 22 connected to the 2G or 2.5G network and the smartphone 10 or connected to the 3G network And communication service such as text chat, video call, video chat, etc. between the smart phone 10 and the user interface of both terminals to the multimedia content corresponding to the specific keyword in accordance with the transmission and reception of the text message containing the specific keyword during the communication service Can be output on

Referring back to FIG. 6, a CMS (Contents Management Server) 123 stores and manages multimedia content such as emoticons, flashcons, and avatars. Such content may be provided from an external content provider (CP) designed for the device and service of the present invention.

OA & M Server (OA & M Server: 129) is a component for operating and managing the service providing system 100a, and includes voice and video call statistics information, service statistics information, service management statistics information, and configuration management (System). Configuration Management), statistics processing management, fault management management, operation management, etc.

The SIP (SIP Signaling Server) 131 processes SIP signaling (Session Initiation Protocol Signaling) based on the IMS network and performs an S-Proxy (SIP Proxy) function for controlling a SIP session request to an external network. In addition, the SS 131 processes management, statistics, and call detail records (CDRs) for SIP calls that are routed from the IMS network, and the SIP calls are handled by an integrated services digital network user part (ISP) call scenario management guide. According to the call routing function to the MGW (110).

Here, the IMS network refers to a set of nodes or an architectural framework for providing IP multimedia services, and includes a call session control function (CSCF), a home subscriber server (HSS), And an application server (AS) and the like, and transmit information about a user terminal on which a predetermined IP multimedia service is set to a corresponding service provider.

RS (Registration Server, 133) is in charge of the subscriber's phone book list management, subscriber status management, subscriber authentication management, and interworking with the IMS network based on the SIP protocol.

The Message Session Relay Protocol (MSRP) server 135 is responsible for the transmission of instant messages, and is responsible for managing the transmission sessions of binary files for music, images, videos, and the like, and for reliable file transfer. MSRP server 135 may be referred to as an MSRP Switch server.

The user terminal coupled to the service providing system 100a of the present embodiment and a corresponding network will be described in more detail as follows.

The voice telephone terminal 22 is a user terminal for voice and data communication via a 2G or 2.5G network 32. The video telephone terminal 20 is a user terminal for voice, video, or data communication through the WCDMA network or the 3G network 30. The

smart terminals

10 and 10a are for voice, video / video and data communication in the Internet 50 including the WiFi, the WCDMA PS network or the LTE network, and have a wireless Internet function. (Text) Refers to a user terminal equipped with an integrated application for sending and receiving messages, sending and receiving voice or video messages, and making voice and video calls. Such

smart terminals

10, 10a include a so-called smartphone, tablet PC, iPad, and the like.

The 2G / 2.5G or CDMA (GSM) network 32 includes an external network and a mobile switching center (MSC) 34, which is a mobile operator's switch that can route and process voice calls using a CDMA (GSM) user terminal. It interworks with the service providing system 100a through a PX (PCX Gateway System) 36, which plays a role of a gateway of the internal network.

The WCDMA network 30 may route and process voice and video calls using a WCDMA terminal, and may include a Serving General Packet Radio Services (SGSN) Support Node (SGSN) and a Gateway GPRS Support Node (GGSN) 37 It is in charge of interworking between the user terminal of the WCDMA packet switched network and the user terminal of the external network. In addition, the WCDMA network 30 is a WMSC (WCDMA MSC, 31) and PGS server 33, which is an exchange that can route and process voice and video calls to WCDMA user terminals, such as the video telephone terminal 20. It is connected to the service providing system 100a through.

The Internet 50 refers to a global system of interconnected computer networks that uses a series of communication protocols known as Transmission Control Protocol / Internet Protocol (TCP / IP). The user terminal may access the Internet 50 through a wireless LAN method such as WiFi. In addition, the Internet 50 is connected to the service providing system 100a through the SBC (Session Border Controller) 52. SBC 52 is a component that conforms to industry standards provided by SIP networks and is coupled to the Internet 50 to handle NAT traversal that may occur between SIPs of interconnected computer networks.

According to the service providing system 100a of the present embodiment, the user interface of both terminals recognizes the input or the transmission or reception of a text message including a specific keyword through the application of the user terminal during the execution of the communication service, and corresponds to the recognized keyword. It can be displayed on. In addition, regardless of the network where the calling terminal and the called terminal are located, while providing a communication service between the calling terminal and the called terminal, the corresponding multimedia content is displayed on the user interface of the calling terminal and the called terminal according to a keyword set during the communication service. Service as possible.

Referring to FIG. 7, the service providing method of the present embodiment is a service in the case of a video call between the called party's second terminal 20 and the calling party's first terminal 10 not using the app provided by the present invention. The system provides a video call between the first terminal 10 and the second terminal 20 through interworking with the Internet or packet switching network where the first terminal 10 is located and the legacy WCDMA network where the second terminal 20 is located. And establish a video chat call and provide multimedia content during the video chat.

In more detail, the first terminal 10, which is the calling party's smart terminal, drives an app provided by the service providing system for the video call (S702), and the non-subscribed caller who wants to attempt the video call. If it is selected (S704), the first terminal 10 requests the call to the SS 131 in the INVITE message (S710).

The SS 131 transfers a call request message to the MGW 110 (S712). The MGW 110 requests a video call to the WMSC 31 of the 3G network through an initial address message (IAM) (S714). The WMSC 31 requests a call setup from the second terminal 20 which is the called party's video terminal (S716). The second terminal 20 executes a ring and transmits an ALERT message to the WMSC 31 (S718). The WMSC 31 transmits an address complete message (ACM) to the MGW 110 (S720). In addition, the WMSC 31 transmits a Call Progress (CPG) message to the MGW 110 (S722). The MGW 110 transmits to the SS 131 an ALERT message that the second terminal 20 is currently in a ringing state (S724). The SS 131 transmits a 183 Progress message to the first terminal 10 (S726).

Meanwhile, the SS 131 transmits a 183 message for early media to the first terminal 10 in step S726, and then sends a media negotiation request message from the first terminal 10 to the first terminal 10. Received, and transmitted to the MGS (110) may be a video call path between the WMSC (31) and the first terminal 10 through the negotiation between the MGW (110) and the WMSC (31). Such a video call may be used to transmit a ring back tone set by the called party from the WMSC 31 and to receive a ring back tone from the first terminal 10.

When the second terminal 20 responds to the incoming call, the Answer message from the second terminal 20 is transferred to the WMSC 31 (S730). The WMSC 31 sends an Answer Message (ANM) signal to the MGW 110 (S732). Negotiation between the MGW 110 and the second terminal 20 proceeds (S734). The MGW 110 transmits an Answer signal to the SS 131 (S736), and the SS 131 transmits a 200 OK message to the first terminal 10 (S738). In response, the first terminal 10 transmits an ACK message to the SS 131 (S740). The SS 131 transmits an Answer ACK to the MGW 110 (S742). Through the above-described process, a video call path between the first terminal 10 and the second terminal 20 is established and a video call is made.

If a user of the first terminal 10 inputs text through a chat window provided by the first app during a video call, the first terminal 10 stores the text in an INFO message and then sends the text to the SS 131. Deliver the message (S750). The SS 131 transfers the text message received from the first terminal 10 to the MGW 110 (S752). The MGW 110 converts the text message received from the SS 131 into an H.245 UII (UII) message and transmits it to the WMSC 31 (S754). The WMSC 31 transmits the H.245 UII message to the second terminal 20 (S756). The second terminal 20 may display the corresponding text message.

While transmitting the text message, the MGW 110 analyzes the text message, searches for the presence of a specific keyword, and extracts multimedia content corresponding to the specific keyword (S760). The MGW 110 synthesizes or overlays the extracted content (S762). Synthesis or superposition of the content may be performed by a media transcoding server or the like coupled to the MGW 110 or provided in the MGW 110 at the request of the MGW 110.

The MGW 110 transmits to the SS 131 that the INFO message is normally transmitted while synthesizing or overlapping the multimedia content corresponding to the specific keyword with the video chat signal (S764). The SS 131 transmits a success 200 OK message to the first terminal 10 (S766).

Through the above-described process, the MGW 110 is a multimedia content for a specific keyword so that a synthesized or superimposed image or video for a certain time is displayed on the user interface of the first terminal 10 and the second terminal 20 during a video chat. do.

As shown in FIG. 8, the

user terminals

10 and 10a use the app of the present invention to display their corresponding contents in real time with respect to a specific character or keyword input by the user during a video chat between the user terminals. You can play in various forms on the smart terminal screen.

For example, if the text input during the video chat inputs, “How about a shochu after work today?”, The preset keyword is automatically detected from the text string input from the app of the present invention mounted on the user terminal, and the corresponding content. Can be extracted and played simultaneously on the user interface of the user terminal.

More specifically, the calling first terminal 10 and the called second terminal 10a are in a video chat state (S1). When the first terminal 10 inputs a specific character for chatting, for example, if the other party inputs the text “How about a shochu after work today?”, The text is transmitted through the service providing system of the present invention. It transmits to the terminal 10a (S2).

The first terminal 10 detects a specific character keyword, such as "shochu or shochu", which is set in advance in the sentence input through the first app mounted (S3). The first terminal 10 searches for and extracts content corresponding to a specific keyword from the content database DB of the first app (S4 and S5). The first terminal 10 executes the corresponding content through the first app (S6). In this case, the first terminal 10 outputs the corresponding content on a user interface such as a screen or a speaker. Then, the multimedia content for a specific keyword executed for a predetermined time in the first terminal 10 disappears, and the first terminal 10 maintains the video chat mode (S7).

Similarly to the case of the first terminal 10, the second terminal 10a is a specific character keyword set in advance in the sentence received from the first terminal 10 via the mounted second app, such as "shochu or shochu drink. "Is detected (S13). The second terminal 10a searches for and extracts content corresponding to a specific keyword from the content database of the second app (S14 and S15). The second terminal 10a executes the corresponding content through the second app (S16). At this time, the second terminal 10a outputs the corresponding content on a user interface such as a screen or a speaker. In addition, the multimedia content for a specific keyword executed for a predetermined time in the second terminal 10a disappears, and the second terminal 10a maintains a video chat mode (S17).

9 is a diagram illustrating a subscription and login procedure on a user interface for performing a communication service in a service providing system or method according to an exemplary embodiment of the present invention.

The user terminal 10 implementing the service providing method of the present embodiment is an application that can provide multimedia contents while performing a communication service, and an app for a video call and a chat service (hereinafter, referred to as "video chat plus"). Mount it. Video Chat Plus app is to use the IP-based communication service, and performs authentication for the user through a subscription and authentication method provided by the registration server (RS). The subscription only needs to be performed once, and after the subscriber authentication, the user can receive user profile information and buddy list information from the registration server, receive a list of phone numbers stored in the smart terminal, and then have the authority for additional services. .

More specifically, as shown in FIG. 9, a user who wants to use the service of the present invention first searches for an app of the present invention using an app store or an open market on the Internet (910).

After searching for the app, the user downloads the selected app to his smart terminal (S920). The user who downloaded the app executes the app of the present invention and communicates with the authentication server (RS) of the device of the present invention to perform a service authentication procedure (930).

If the user is the first service user of the service, the user inputs his / her phone number, requests an authentication number for the entered phone number, and completes the service subscription of the present invention by inputting the authentication number received from the RS. And additional options such as login and password can be entered. The subscription procedure can be performed only once when using the initial service, and after that, only the service authentication function can be performed.

When the user authentication is completed, the user performs the app to access the service of the present invention (940). When the service connection is completed, the app synchronizes with the device of the present invention to perform address book synchronization (950). Here, the app receives a friend list information or buddy list information, online and offline status information, etc. subscribed to the service of the present invention from the authentication server when the service is connected to the screen or list of phone numbers stored in the smart terminal You can read and print it on the screen. In addition, the app may output a menu for using the service of the present invention, for example, a text chat, a voice call, a voice chat, a video call, or a video chat on the screen. The menu may have the form of an icon.

FIG. 10 is a diagram illustrating a user interface screen for performing a video chat plus as a communication service in a service providing system or method according to an exemplary embodiment of the present invention.

In the present embodiment, the login subscriber may select a called party from a buddy list provided by the service providing system of the present invention, request a video call or a video chat, and set various options during the video call or a video chat.

More specifically, as shown in FIG. 10, the user executes an app to use the service of the present invention (1010). When the app is executed, the user selects a called party and a video call or video chat menu (1020). In response to a call connection request for a video call or a video chat, the service providing system performs a call processing procedure for a video call or a video chat between the caller and the called party.

In the video call or

video chat state

1031, 1032 between the caller and the called party, the caller performs a chat activation by touching the chat window 1042 to chat with the called party (1040). The caller enters text in the chat window through the activated keypad (1050). For example, the text is "Would you like some coffee?" At this time, the input text is output to the caller's terminal. In addition, the text input from the caller's terminal is transmitted to the called party and output to the called party's terminal screen (1060). Here, the first app mounted on the caller's terminal and the second app mounted on the called party's terminal search for the content databases 1052 and 1062 in each terminal, and the text entered by the caller and / or the text received by the called party. Search if a particular keyword contained within exists in the keyword database.

That is, when a specific keyword "coffee" in the text inputted by the sender exists in the content database 1052 of the caller, the first app extracts the corresponding content and outputs the corresponding content to the terminal screen. Similarly, when a specific keyword "coffee" among the texts received by the called party is in his or her content database 1062, the second app extracts the corresponding content and outputs the corresponding content to the terminal screen (1060).

Referring to FIG. 11, in the present embodiment, the external content provider CP registers the keyword and the content with the CMS (see 123 of FIG. 6) through the keyword and the content providing screen provided by the service providing system. The smart terminal or the device 1110 checks the updated keyword and content in conjunction with the CMS 123 after starting the app and downloads the corresponding content. The sender or called party stores the keyword and the content linked with the CMS 123 in a database DB within his or her user terminal. Thereafter, when the user inputs text, the user may search for the keyword stored in the terminal, extract the pre-stored content, and transmit information or content about the corresponding content to the counterpart.

In addition, when a user registers a keyword and content in a content provider while using a text chat or a video chat service after starting the video chat app provided by the present invention, the CMS 123 registers when the current user is registered. Information about the content update is transmitted to the smart terminal or the device 1120 in the established state. When the app receives a notification of a content update from the CMS 123, the app downloads a keyword and content in association with the CMS 123 and stores information and content in a local storage area of the terminal. Thereafter, when the updated keyword is input from the user terminal, the app may perform text analysis, extract the content, and then transmit information or content about the corresponding content to the opposite terminal.

According to the embodiments described above, the present invention has the following effects.

While video calls are available in most WCDMA terminals, some currently provided smart terminals or smart devices do not support video calls as a basic function. In addition, some smart terminals or devices support video calls, but only video calls between the same model and the same operating system (OS) are provided. The method and system for providing a service according to the present invention is designed to be provided as a portable structure to all smart terminals or devices and various operating systems (OS) from the structural design stage, and corresponding applications (hereinafter, also referred to as "apps"). If you download it and perform normal membership and logon, it can be applied in various OS. Therefore, according to the present invention, users can use a seamless service and a user interface for the service regardless of the type or OS of the called terminal.

In addition, according to the present invention, it is possible to perform the video chat plus function in the smart terminal or device. In other words, in the case of the video call app of the existing smart terminal or device, since only a simple chat function is additionally provided in addition to the video call, users cannot feel the fun other than the video call, so the time for using the video call is not long and the use of the corresponding service and I can't find what I need. Smart video chat plus service according to the present invention is a space that can express the user's own personality through the chat function, the text analysis engine included in the present invention, the content extraction and the image transmission function of the content to these users Provide. For example, as soon as the user inputs the text "I love you", the character analysis engine provided by the user terminal analyzes and searches the text "I love you", retrieves the "Heart" image, and delivers the image to the other terminal in real time. While performing a communication service, his / her personality, emotions, and feelings can be effectively expressed in real time with multimedia contents corresponding to specific keywords.

In addition, the present invention can provide a service that is independent of the destination network. The smart video chat plus app of the present embodiment enables high-definition (HD) video calls on iPhones and Androids when the app is downloaded and normal membership registration and logon are performed. It can provide seamless services and user interfaces for services wherever they are.

The present invention as described above has the following technical features.

First, it provides management and login authentication functions for smartphone app subscribers. Second, it provides a smartphone app that provides video call, video chat plus, call list, buddy list management. Third, it provides call processing and media transmission / reception function from WiFi / WCDMA PS network to WiFi / WCDMA PS network. Fourth, it provides call processing and media transmission / reception function from WiFi / WCDMA PS network to WCDMA CS network. Fifth, it provides a text analysis and search function of the chat text entered from the smartphone. Sixth, the present invention provides a function of synthesizing an image or a video from a smartphone with an existing video call signal. Seventh, the present invention provides a function of transmitting multimedia content in real time by transmitting an image or a video from a smartphone without combining with an existing video and overlaying each terminal. Eighth, it provides a function to convert chat text standards between smartphones and video calls in WCDMA CS networks. Ninth, it provides an analysis and retrieval function for chat text transmitted between smartphone and video call of WCDMA CS network. Tenth, it provides a function of synthesizing and transmitting an image or a video corresponding to a chat text transmitted between a smartphone and a video phone of a WCDMA CS network with an existing video.

In the above, the present invention has been described with reference to preferred embodiments, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains have various modifications and variations from this description. It will be possible. Therefore, the present invention should be construed with reference to the overall description of the appended claims and drawings, and all equivalent or equivalent modifications thereof will belong to the scope of the present invention.

Claims

A method of providing multimedia content in at least one of a first terminal and a second terminal during a communication service between a first terminal and a second terminal through a service providing system providing a communication service including a messaging service,

A first step of automatically detecting a preset keyword among messages transmitted and received through the messaging service in at least one of the first terminal and the second terminal during a communication service including a messaging service;

A second step of automatically extracting multimedia content data corresponding to the keyword from the terminal detecting the keyword in real time; And

A third step of synthesizing or overlaying the multimedia content data on a signal of the communication service in a terminal detecting the keyword and displaying the multimedia content data on a user interface of the terminal in real time;

Method of providing multimedia content during communication service comprising a.
The method of claim 1,

In the second step, the service providing system receives a search request for the multimedia content from at least one terminal that detects the keyword, and searches for the multimedia content data corresponding to the multimedia content to detect the keyword. Method for providing multimedia content during the communication service comprising the step of transmitting to.
The method of claim 1,

Before the first step,

An authentication header field including a Uniform Resource Identifier (URI) request message for a messaging service server that delivers an instant message from the first terminal, a authentication request message sent to the first terminal, and an authentication key from the first terminal. Receiving a message including a message and transmitting a response message including a URI of the messaging service server to the first terminal according to an authentication result of the first terminal;

Transmitting a messaging service invitation message including a URI of the first terminal to the second terminal, receiving a URI request message of a messaging service server from the second terminal, transmitting an authentication request message to the second terminal, Receiving a message including an authentication header field including an authentication key from a second terminal, and transmitting a response message including a URI of the message service server to the second terminal according to an authentication result of the second terminal; And

Transmitting the URI of the second terminal to the first terminal according to the participation of the messaging service of the second terminal;

More,

The service providing system is a multimedia content providing method during a communication service, characterized in that for processing the transmission and reception of a text message between the first terminal and the second terminal.
The method of claim 1,

The communication service including the messaging service may include a service for transmitting and receiving a text message during a voice call, or a service for transmitting and receiving a text message during a video call.
The method of claim 1,

The multimedia content providing method of the multimedia content during the communication service including the emoticon, flashcon, and avatar.
In the method for providing multimedia content in at least one of the first terminal and the second terminal during the communication service between the first terminal and the second terminal through a service providing system for providing a communication service including a messaging service,

A first step of automatically detecting a preset keyword among text messages transmitted and received through the text chat service in a first terminal during a voice or video call and chat service including a voice or video call service and a text chat service;

A second step of automatically extracting multimedia content data corresponding to the keyword in real time from the first terminal; And

Output or transmit the multimedia content data from the first terminal so that the multimedia content is displayed on at least one of a user interface of the first terminal and a user interface of the second terminal that performs the voice or video call and chat service. Third step to do

Method of providing multimedia content during communication service comprising a.
The method of claim 6,

The third step may include transmitting, to the second terminal, the multimedia content data synthesized or overlapped with an audio signal, a video signal, or a combination signal thereof of the video call chat service in the first terminal. How to provide multimedia content while running.
The method of claim 6,

The third step may include a message including an execution command requesting the first terminal to synthesize or overlap the multimedia content data with an audio signal, a video signal, or a combination signal of the video call chat service. The multimedia content providing method during the communication service comprising the step of transmitting to the second terminal together.
The method of claim 6,

Before the first step,

Receive an invitation message of the video call chat service for the second terminal from the first terminal, confirm the subscriber information for the second terminal, and invite the video call chat service to the second terminal according to the subscriber information And transmitting a message and establishing a video call path between the first terminal and the second terminal according to the response of the second terminal.
The method of claim 9,

Before the first step and after the opening of the video call path,

And establishing a messaging service connection for transmitting and receiving a text message between the first terminal and the second terminal.
A method of providing multimedia content to at least one of a first terminal and a second terminal in a service providing system providing a communication service including a messaging service between a first terminal and a second terminal,

A first step of automatically detecting a preset keyword among messages transmitted and received through the messaging service while performing a communication service including a messaging service;

A second step of automatically extracting multimedia content data corresponding to the keyword in real time; And

A third step of transmitting multimedia content data to at least one of the first terminal and the second terminal through a chat call path or a video call path established for the messaging service;

Including,

At least one of the user interface of the first terminal and the user interface of the second terminal is characterized in that the audio signal, video signal, or a combination signal of the communication service synthesized or superimposed on the multimedia content data is displayed. Method of providing multimedia content during communication service.
The method of claim 11,

In the third step, in the service providing system, the multimedia content data is synthesized or superimposed on an audio signal, a video signal, or a combination signal of the communication service and transmitted to at least one of the first terminal and the second terminal. Method of providing multimedia content during the communication service comprising the step.
The method of claim 11,

The third step may include a message including an execution command for instructing the service providing system to synthesize or superimpose the multimedia content data on an audio signal, a video signal, or a combination signal of the communication service together with the multimedia content data. Method of providing multimedia content during a communication service comprising the step of transmitting to at least one of the first terminal and the second terminal.
The method of claim 11,

Before the first step,

Establishing a video call path between the first terminal located in the Internet or the packet switched network and the second terminal located in the circuit switched network through a media gateway in the service providing system; And

And establishing a messaging service connection for transmitting and receiving a text message between the first terminal and the second terminal.
A system for providing multimedia content to at least one of a first terminal and a second terminal while providing a communication service including a messaging service between a first terminal and a second terminal,

A signal processing server for processing an invitation message and a response message transmitted and received between the first terminal and the second terminal to establish a messaging service connection in a communication service; And

Messaging service server for processing text messages transmitted and received in the messaging service between the first terminal and the second terminal.

Including,

At least one of the first terminal and the second terminal detects the keyword by itself, extracts multimedia content data corresponding to the keyword, and outputs an audio signal, a video signal, or a combination signal of the communication service. And synthesizing or superimposing the extracted multimedia content data on a user interface of the terminal to display the extracted multimedia content data.
A system for providing multimedia content to at least one of a first terminal and a second terminal while providing a communication service including a messaging service between a first terminal and a second terminal,

A signal processing server that processes messages transmitted and received between the first terminal and the second terminal to establish a messaging service connection in a communication service including a voice or video call service and a text chat service;

A messaging service server that processes a text message transmitted and received in the messaging service between the first terminal and the second terminal; And

Multimedia content providing server for transmitting the multimedia content data to the second terminal along with an audio signal, a video signal, or a combination signal of the communication service received from the first terminal.

Including,

The first terminal displays the multimedia content data on the user interface in a state of overlapping or combining the multimedia content data with the audio signal, the video signal, or a combination signal thereof of the communication service while performing the communication service,

The second terminal displays the multimedia content data received from the first terminal while performing a communication service on a user interface in a state of being superimposed or synthesized with an audio signal, a video signal, or a combination signal of the communication service. Multimedia content providing system while performing a communication service.
A system for providing multimedia content to at least one of a first terminal and a second terminal while providing a communication service including a messaging service between a first terminal and a second terminal,

A signal processing server for processing messages transmitted and received between the first terminal and the second terminal to establish a communication service connection including a messaging service;

A multimedia gateway interworking with the signal processing server and processing signals transmitted and received between a first terminal located on the Internet or a packet switched network and a second terminal located on a circuit switched network; And

A messaging service server interworking with the signal processing server and the multimedia gateway and processing instant messages transmitted and received in the messaging service between the first terminal and the second terminal.

Including,

The multimedia gateway detects a predetermined keyword among text messages transmitted and received between the first terminal and the second terminal, and extracts multimedia content data corresponding to the detected keyword. Provide system.
The method of claim 17,

The multimedia gateway transmits the multimedia content data to at least one of the first terminal and the second terminal by combining or combining the multimedia content data with an audio signal, a video signal, or a combination signal of the communication service. Multimedia content providing system while performing.