KR100863416B1 - System and method for providing P2P based audio and video communication service, method for providing, method for communicating, recoding medium thereof - Google Patents

Abstract

The present invention relates to a P2P-based video call service providing system, a providing method, a communication method, and a recording medium recording the same. The present invention comprises the steps of: (a) receiving from the IPTV service system an EPG including data broadcasting data transmitted in a multicasting manner, and a video call channel to a user terminal; (b) sending the video call service request message to the IP binder via the return pass server system; (c) receiving IP address information and a port number of a caller list from the IP binder (IP binding); (d) establishing a connection of the video call session by the session manager when the video call client selects the IP address and the port number of the called party selected by the caller registered in the caller list; (e) providing a peer-to-peer (P2P) based video / voice call between the calling party and the called party after establishing a video call session connection; And (f) after completing the call, disconnecting the session set up for video call between the calling party and the called party. Accordingly, IPTV viewers access the IP binder using a video call client after PIN authentication, and then use 1: 1 video / audio while the mobile terminal user and the IPTV viewer are moving by using the IP address and port number using the TV2TV, PDA2TV or TV2PDA method. Provide currency.

IPTV, TV2TV, Phone2TV, PDA2TV, Wibro2TV, P2P Video Call

Description

P2P based video call service providing system, method, communication method and recording medium recording the same {System and method for providing P2P based audio and video communication service, method for providing, method for communicating, recoding medium

1 is a block diagram of an IPTV headend system for implementing the present invention.

Figure 2a is a block diagram of a TV2TV, PDA2TV video call service between the mobile terminal and the IP set-top box according to the first embodiment of the present invention.

Figure 2b is a block diagram of a TV2TV, PDA2TV video call service between the mobile terminal and the IP set-top box according to a second embodiment of the present invention.

3 is a diagram illustrating an IP binder for P2P-based video call.

4 illustrates a protocol stack of a video call client of a portable terminal and an IP set-top box.

5 is a diagram illustrating a P2P based video call service method using a mobile call and a video call client of an IP set-top box.

6 is a flowchart illustrating a P2P based video call service providing method in an IPTV service system according to an exemplary embodiment of the present invention.

7 is a flowchart illustrating a P2P based video call method in an IP set-top box of a subscriber according to an embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

100: baseband system 110: compression multiplexing system

120: IP binder 130: back office system

140: subscriber management system 150: monitoring system

160: media management system (MOC) 170: network switch system

191: EPG system 192: data broadcasting system

193: Return Pass Server System 200: Premium Network

210: Internet network 201: Multicast router

211: unicast-enabled router 220: subscriber switch

230: subscriber concentrator 300: TV

310: IP Set Top Box

The present invention relates to a P2P-based video call service providing system, and in particular, a TV2TV method or a PDA2TV using an IP address and a port number by accessing an IP binder (IP Binder) using a video call client after PIN authentication through IPTV. The present invention relates to a P2P based video call service providing system, a providing method, a communication method, and a recording medium recording the same, which provides a P2P based ubiquitous video / voice call service between a mobile terminal and a digital TV using a TV2PDA scheme.

In general, Internet Protocol Television (IPTV) is a type of digital convergence that combines broadcasting and communication with a broadcast program provider or a broadcast signal received from a terrestrial, cable, or satellite. In addition, a TV receiver (TV) connected to an IP Set Top Box (STB) provides Internet Contents On Demand (ICOD) services such as TV Internet content and video content (T-VOD) through an IP network. to provide.

The main components of the IPTV service system include the IPTV Headend system, the IP backbone network, the IP backbone, the access network (e.g. xDSL, HFC, FTTC, FTTH structure), and subscriber terminals (IP STB, TV). do.

 The IPTV service is a broadband broadband service that provides two-way TV content in the form of convergence of communication and broadcasting according to the digital convergence of the program provider (PP) and the content provider (CP) of the Internet market. Provides Internet multimedia contents including broadcast video, audio, and packet data to a TV connected to an IP set-top box (STB) through an internet network, and is interactive by using a two-way communication channel through a return path server. Provide IPTV service.

TV (TV) terminal connected to IP set-top box (STB) equipped with middleware protocol for IPTV service is a convergence service in the era of digital convergence (VoIP), high-speed Internet (Internet), and IPTV service (broadcasting). Triple Play Service (TPS), which includes IPTV), and SD / HD-level ICOD (Internet Contents) through a next-generation network that requires broadband bandwidth from IPTV headend systems to premium services. On Demand) to receive broadcast and Internet content.

In order to use terrestrial IPTV, a TV program connected to an IP set-top box (STB) connected to an Internet line connected to a high-speed Internet network, and a program desired by an electronic program guide (EPG) using a remote control or a key input of the TV. After selecting the user authentication, and provides a variety of Internet content, such as watching movies, dramas, news, sports broadcasts, TV-content Internet information search, T-VoD movies.

However, in the related art, IPTV viewers did not provide a video call function while looking at the other party's face while moving with a portable terminal user such as a personal digital assistant (PDA), a portable Internet terminal, or a mobile communication terminal.

The present invention has been proposed to solve the problems of the prior art, IP address and port number by accessing the IP binder (IP Binder) using a video call client installed in the IP set-top box connected to the digital TV after PIN authentication in IPTV P2P to provide 1: 1 video / voice call function with IPTV viewers by providing P2P based ubiquitous video call service between mobile terminal and digital TV while moving to TV2TV or PDA2TV or TV2PDA or WiBro2TV or TV2WiBro The purpose of the present invention is to provide a video call service providing system, a providing method, a communication method, and a recording medium recording the same.

In order to achieve the object of the present invention, the present invention provides a P2P-based video call service providing system, EPG providing system for providing an electronic program guide (EPG) including a video call channel to the user terminal; Receive member registration information for P2P-based video call service from the video call client of the user terminal and store it as a DB. When receiving a video call request message from the user terminal, IP address information of the caller list registered in response to this, an IP binder (IP Binder) for providing port number information; A data broadcasting system (DM) for receiving periodically updated information from a data agent (DA) of a content provider, the data broadcasting system for generating data broadcasting data and PSI / SI information provided from the content provider; A compression multiplexing system for multiplexing the data broadcasting data and PSI / SI information, and then outputting the multiplexed stream into IP packets; A network switch system for transmitting an IP packetized signal and an electronic program guide (EPG) received from the compression multiplexing system to a plurality of user terminals through an IP network in a multicast manner; And a return pass (RP) server system connected to the user terminal through the IP network through a return channel, recording a log of the accessing user terminal, and transmitting and receiving a video call authentication request message in a unicasting manner.

The P2P-based video call service providing system according to the present invention receives an authentication request message for use of a video call service from a user's terminal through a return pass server system and an authentication ticket in response to the authentication request message. And a personalization authentication server for transmitting a ticket to a user terminal through the return path server system, and transmitting subscriber information about the issued ticket to the IP binder.

P2P-based video call service providing system according to the present invention is characterized in that it further comprises a subscriber management system for subscription and termination for IPTV video call service, member information management.

P2P-based video call service providing system according to the present invention is characterized in that it further comprises a back office system for processing billing for the use of IPTV video call service for each subscriber.

The user terminal is a TV with an IP set-top box, an IP set-top box connected to the user's TV, a computer, a notebook, and a portable terminal.

The portable terminal includes a mobile communication terminal, a personal digital assistant (PDA), and a portable Internet (WiBro) terminal, and the video call client program is installed.

In order to achieve another object of the present invention, the present invention provides a method for providing a P2P-based video call service, comprising: (a) a data manager that periodically updates information of a data broadcasting system (DBS) from a data agent (DA) of a content provider; Receiving in (DM); (b) the data broadcasting system generating data for data broadcasting using information provided from a content provider; (c) after the compression multiplexing system multiplexes the data broadcasting data and the PSI / SI information, IP packetizing the multiplexed stream; (d) generating an EPG including a video call channel by an electronic program guide (EPG) providing system; (e) the network system transmitting the received IP packetized transport stream and the EPG to the plurality of user terminals in a multicasting manner via the IP network; (f) receiving a video call service request message through a return pass server system from a user terminal; And (g) transmitting, by the IP binder, to the video call client of the user terminal transmitting IP address information and port number information of the callable party list to the corresponding user terminal to provide a P2P based video call after user authentication. .

delete

P2P-based video call service providing method according to the invention, characterized in that it further comprises a subscriber management step of managing the subscription and termination, the member information for the IPTV service.

The P2P based video call service providing method according to the present invention further includes the step of processing the billing for the use of P2P based IPTV video call service for each subscriber.

In the user authentication in the step (g), when the personalization authentication server receives an authentication request message for a video call from the user terminal through the return pass server system and the authentication is confirmed, an authentication ticket is sent through the return pass server system. And transmit the subscriber information on the ticket issued from the personalization authentication server to the IP binder.

The user authentication in step (g) is characterized in that the IP binder provides authentication for a P2P based video call service by an authentication module.

In order to achieve another object of the present invention, the present invention provides a P2P-based video call service communication method, comprising: (a) an EPG including data broadcasting data and a video call channel transmitted in a multicasting manner from an IPTV service system; Receiving by the user terminal; (b) sending the video call service request message to the IP binder via the return pass server system; (c) receiving IP address information and a port number of a caller list from the IP binder (IP binding); (d) establishing a connection of the video call session by the session manager when the video call client selects the IP address and the port number of the called party selected by the caller registered in the caller list; (e) providing a peer-to-peer (P2P) based video / voice call between the calling party and the called party after establishing a video call session connection; And (f) after completing the call, disconnecting the session set up for video call between the calling party and the called party.

The P2P based video call service communication method according to the present invention further includes the step of transmitting, by the video call client installed in the user terminal, member information for using the IPTV video call service to the subscriber management system.

P2P-based video call service communication method according to the present invention, when receiving the billing information from the IPTV service system, the payment method for the P2P-based video call, credit card payment, bank transfer payment, mobile phone bill payment or telecommunication company communication It is characterized in that the payment using any one of the payment method.

After step (b), (g) transmitting an authentication request message including a personal ID number (PIN) input from a video call client and location information of the set-top box to the personalization authentication server; (h) if the authentication of the video call service is confirmed, further comprising receiving an authentication ticket from the personalization authentication server through the return pass server system.

The location information of the user terminal is characterized by including a set-top box ID (SAID), subscriber information.

In order to achieve another object of the present invention, the present invention provides a computer or an IP set-top box or a mobile terminal, comprising: (a) an EPG including data broadcasting data and a video call channel transmitted in a multicasting manner from an IPTV service system; A function of receiving a user terminal; (b) sending a video call service request message to an IP binder via a return pass server system; (c) a function of receiving IP address information and port number of a caller list from the IP binder (IP binding); (d) establishing a connection of the video call session by the session manager when the video call client selects the IP address and the port number of the called party selected by the caller registered in the caller list; (e) providing a peer-to-peer (P2P) based video / voice call between the calling party and the called party after establishing a video call session connection; And (f) a record readable by a computer, an IP set-top box (STB), or a mobile terminal that has recorded a program for realizing a function of releasing a session established for a video call between the calling party and the called party after the call is completed. Media.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an IPTV headend system for implementing the present invention.

The IPTV service system includes a baseband system 100, a compression multiplexing system 110, a back office system 130, a subscriber management system 140, a monitoring system 150, a media management system (MOC) (Media Operation Core) 160. ), Network switch system 170, EPG system 191, data broadcast system 192, return path (RP) server system 193, and IP binder (IP Binder) 120.

The IPTV service system is an IPTV headend system for transmitting data for data broadcasting for video calls, and an EPG including a video call channel, an IP network for providing a unicasting or multicast routing protocol to an IP network, and a subscriber network (e.g., Ethernet, xDSL, HFC, FTTC, FTTH), and a user terminal including a TV connected to the IP set-top box (STB) 310.

The subscriber network may be composed of any one of Ethernet, xDSL (ADSL, VDSL), Hybrid Fiber Coaxial Ca (HFC), Fiber To The Curb (FTTC), and Fiber To The Home (FTTH) structures.

The user terminal includes a TV in which an IP set-top box is embedded, an IP set-top box connected to the user's TV, a computer, a notebook, or a portable terminal.

The mobile terminal may use any one of a mobile communication terminal, a personal portable terminal (Phone, PDA, etc.) equipped with a wireless LAN card or a CDMA modem, a handheld PC, a tablet PC, or a WiBro terminal. The video call client program is installed.

The IP set-top box (IP STB) 310 and the mobile terminal are each assigned an IPv4 address or an IPv6 address, and includes a virtual machine (JVM, GVM, etc.) capable of communicating with heterogeneous mobile terminals having different hardware and operating systems, It uses various multi-codecs such as MPEG-2, MPEG-4, H.264, WMV, and other A / V codecs for video / voice call between caller and called party.

The baseband system 100 receives an MPEG-2 broadcast signal from an external program provider (PP), or an analog broadcast signal from terrestrial waves, and converts the received source broadcast signal into a SDI (Serial Digital Interface) signal. Synchronize frames, distribute broadcast video and audio signals from multiple broadcast channels (e.g. 100 channels) via routine switchers, subtitle generators (CG) and automatic program controllers (APC) ) Inserts at least one of an advertisement, a logo, or a subtitle into the broadcast video and audio signal (signal editing and processing) and transmits the same to the compression multiplexing system 110.

The SDI (Serial Digital Interface) signal is a digital signal standard having a transmission rate of 270 Mbps, and a composite digital video and four channels of digital audio signals are mixed.

The baseband system 100 is basically a tuner (Tuner) for receiving an analog broadcast signal to a broadcast signal such as a program provider (PP), terrestrial wave, such as DS-3 optical end station, Yagi antenna, Integrated Receiver Decoder (IRD), A signal divider such as a frame synchronizer for converting and correcting the received source signal into an SDI signal and synchronizing frames, and an A / V router that connects / concentrates all broadcast signal channels for operational management; And a subtitle generator (CG) to edit and process the signal by inserting an advertisement, a logo, and a subtitle into the SDI signal.

Multiplexing PSI / SI information including data broadcasting data and video call channel for video call generated by the data encoder and PSI / SI generator of the compression multiplexing system 110 ( After the multiplexing, the IP premium network 200 through a gigabit dedicated line in the IP multicasting method through the network switch system 170 together with the EPG to the IP packetized IP packetized TS (Transport Stream) broadcast signal Send it out.

The EPG providing system 191 provides an electronic program guide (EPG) including a video call channel to the user terminal.

In the IPTV video call service menu, the Electronic Program Guide provides the user with a video call function that is easy and convenient for viewers, and can be selected from Box List EPG, Text EPG, Mosaic EPG, Mini EPG, or Navigator EPG. It can be serviced using one electronic program guide (EPG).

The data broadcasting system 192 authors, verifies, organizes, and transmits data for data broadcasting, and uses an object carousel for a P2P based video call from a data call service data agent (DA) of a content provider (CP). A data manager (DM) receives OC: Object Carousel, and generates data broadcasting data and PSI / SI information for video call.

The data broadcasting system (DBS) 192 may include a data agent manager for managing data encoding and a program specific information / service information (PSI / SI) for generating program specific information / service information (PSI / SI). A PSI / SI Generator, a Data Server / Data Encoder for encoding the data broadcast data, a Multiplexer Manager for managing IP multiplexing, and a scheduler UI ).

The data broadcasting system (DBS) 192 may include data broadcasting data and a video call channel for a video call generated by a data server / data encoder and a PSI / SI generator for data provided from an authoring tool. It is multiplexed by the IP Multiplexer together with the / SI information, and IP packets are transmitted to the user terminal.

When using the IPv4 multicasting, the network switch system 170 multicasts the IP packetized transport stream along with an EPG based on a Class D IP multicast address, and transmits a plurality of IPs through the IP premium network 200. The subscriber station transmits to the IP set-top box 310.

In addition, IP multicasting may use IPv4 multicasting or IPv6 multicasting techniques.

In one embodiment, when the network switch system 170 uses IPv4 multicasting, the IPv4 multicast address is 224.0.0.1 to 239.255.255.255, which is different for each broadcast channel (eg, 100 channels). Use an address. In one embodiment, when using IPv4 multicasting, SBS uses 237.1.1.1 multicast address, KBS uses 237.1.1.2 multicast address, and YTN uses 237.1.1.3 multicast address as broadcast channel. do.

IP multicast routing protocols used in the L3 switch of the IP premium network 200 include Distance Vector Multicast Routing Protocol (DVMRP), Multicast Extensions to OSPF (MOSPF), Core Based Tree (CBT), and Protocol Independent Multicast (PIM-SM). Multicast routing protocols of either -Sparse Mode) or Protocol Independent Multicast-Dense Mode (PIM-DM) can be used.

Layer 3 network equipment including each router, metro switch (L3 switch), N-Topia switch (L3 switch), and subscriber switch (L3 switch) 220 of the IP network backbone network / access network / subscriber network is PIM-SM Multi. The cast routing protocol is used, and the user terminal (IP STB) and the subscriber concentrator 230 use IGMP and IGMP Snooping protocols, respectively.

The Internet Group Management Protocol (IGMP) is used between an IP set-top box terminal requesting broadcast channel selection / release and a Layer 3 network device (eg, subscriber switch 220) that accepts the request.

The IGMP Snooping protocol is a Layer 2 device (eg subscriber aggregation) located between an IP set-top box 310 terminal of a subscriber requesting channel selection / release and a Layer 3 network device (eg subscriber switch 220) accepting the request. As a protocol driven by the device 230, the Layer 2 equipment (subscriber concentrator 230) on which the IGMP Snooping protocol is driven recognizes an IGMP transmission / reception message between the IP STB terminal and the Layer 3 network equipment, and makes a channel request. The channel information is transmitted only to the IP set-top box 310.

In one embodiment, when all routers of the IP premium network 200 are installed with a PIM-SM multicast routing protocol daemon, the subscriber's IP set-top box 310 joins the subscriber switch by IGMP joining the multicast group. 220 receives PSI / SI information including the data broadcasting data for the video call or the video call channel together with the EPG by IP multicasting.

The core router (RP: Rendezvous Point, rendezvous point) of the IP premium network 200 manages a PIM Join list and a PIM Prune list for each of a plurality of broadcast channels (eg, 100).

Since the broadcast channel is a multicast group, the rendezvous point RP of the IP premium network 200 manages a join list and a prune list for each multicast group (broadcast channel).

In addition, the IPTV system uses static join to the subscriber switch to reduce the IPTV channel zapping time.

The static join method used to reduce the zapping time of the broadcast channel in the subscriber's IP set-top box 310 is as if the subscriber's IP set-top box 310 is joined to all groups (channels) in router 3 (subscriber switch 220). In the same way, Join is requested to the upper L3 network equipment (Router 3, 2, 1) (Subscriber Switch, N-topia Switch, Metro Switch, Rendezvous View Point). As a result, traffic of all broadcast channels (eg, 100 channels) is downloaded to the subscriber switch (router 3) 220, and the subscriber switch (router 3) 220 receives all the groups (all broadcast channels). In order to keep up, it periodically sends Join messages to higher L3 network devices (Ntopia Switch, Metro Switch, Rendezvous View). Subscriber switches use static joins to maintain a large number of groups (broadcast channels) on an ongoing basis.

Regardless of whether or not the subscriber's IP set-top box (STB) joins the actual group (channel), it always joins the group (channel) in routers (L3 network equipment), and in subscriber switch (router 3) 220 like IPTV, This is useful if you always need to be ready to receive an IPTV broadcast channel.

Also, if the subscriber set-top box (STB) leaves group 1 (changes to another broadcast channel), the rendezvous point (RP) and router 1, even if the IGMP group leave message for group 1 withdrawal from the set-top box (STB) 2,3 (Metro Switch, Ntopia Switch, Subscriber Switch) always maintain Join in all multicast groups (all broadcast channels) regardless of the subscriber's IP Set Top Box (STB) 's IGMP Leave message. Therefore, a large amount of channel traffic of all broadcast channels (eg, 100 channels) of the IPTV headend system reaches the subscriber switch (router 3) 220.

Since the subscriber switch 220 has downloaded the traffic of all broadcast channels, the broadcast channel zapping time is reduced from the IP set-top box 310 of the subscriber and data broadcasting data for the video call of the corresponding channel according to the requested IGMP Join message. And PSI / SI information including a video call channel.

IP set-top boxes 310 of a plurality of subscribers are connected to the subscriber switch 220 according to an IGMP Join / Leave message to select / release an IPTV service broadcast channel to receive an IPTV broadcast service.

The back office system 130 is a provisioning system and provides a billing processing function for the use of IPTV video call service for each subscriber.

The subscriber management system 140 provides a member subscription and termination and a member information management function for a P2P based IPTV video call service.

The monitoring system 150 is a control system that monitors a transmission failure of an A / V broadcast signal for IPTV broadcasting, a downlink of an IPTV headend system, and a reception failure and subtitle confirmation.

The media management system (MOC) 160 is a system that manages various business process information (program organization information, location information, contract information, product information, etc.) for operating a broadcasting business.

The media management system 160 manages broadcast program organization information, content and media management information, contract information of a program provider (PP) and a content provider (CP), product information, and manages each system in the center of a broadcasting center. It is a coordinator that integrates and manages the information flow through the organic combination of.

 In terms of acquisition, the media management system (MOC) 160 manages contract metadata, manages content metadata related to media and movies, and acquires / manages EPG information, which is broadcast schedule information. Real-time broadcasting and VoD channel formation management, agent management with each subsystem, management of VoD catalog creation and marketing analysis such as settlement of CP / CA and subscriber viewing inclination in terms of product analysis and analysis, In terms of delivery, it provides broadcasting transmission monitoring, video server transmission management and VoD subscriber authentication, transmission result recording / management for settlement with CP / CA, and data synchronization with each subsystem.

The return path (RP) server system 193 processes bidirectional data by a data provider (DP), delivers bills online from subscriber's IP set-top boxes 310, and uses / charges interworking of bidirectional data. Processing, and transmits a personalization authentication process, and an authentication ticket corresponding to the authentication request message related to the video call service from the subscriber's IP set-top box 310, to the subscriber's IP set-top box 310 by unicasting.

3 is a diagram illustrating an IP binder for P2P based video call, wherein the IP binder 120 performs a P2P based video call service from a video call client in an IP set-top box connected to a mobile terminal or a digital TV. Receives the membership registration information for the DB and stores it, when receiving a video call request message from the user terminal provides IP address information and port number information of the pre-registered caller list in response.

One side of the video call client does not pass through the IP binder 120 with the IP address and port number of the user terminal selected from the list of available callers. It establishes connection of IP video call session, provides P2P based video call of caller and called party by sending / receiving video / audio data through RTP / UDP / IP through A / V codec, and preset video call session after call Release it.

2A is a configuration diagram of a TV2TV and PDA2TV video call service between a mobile terminal and an IP set-top box according to a first embodiment of the present invention.

The present invention provides a P2P based video call service between a video call client installed in an IP set-top box connected to a digital TV and a video call client installed in a mobile terminal (Phone, PDA, Pocket-PC, WiBro terminal, etc.), and TV2TV and TV2PDA. The video call service can be provided by any one of methods such as PDA2TV, TV2Phone, Phone2TV, TV2WiBro, and WiBro2TV.

The mobile terminal may use any one of a phone, a PDA (Pocket-PC), a handheld PC, a tablet PC, and a WiBro terminal, and a video call client including an A / V codec is installed. Although the embodiment has described PDA2TV as an example, the video call service of the mobile terminal is not limited thereto.

In addition, a WiBro2TV and TV2WiBro video call service can be provided using a mobile Internet (WiBro) terminal.

In addition, a P2P-based video call is made by connecting to the IP binder 120 using a mobile communication terminal (Phone) or a personal digital assistant (PDA) or a handheld PC or tablet PC or a WiBro terminal equipped with a video call client. The service may be used but is not limited thereto.

In the embodiment, PDA2TV and TV2PDA video call services will be described.

In one embodiment, when the mobile terminal uses a PDA or Pocket-PC equipped with a video call client, the mobile communication network may be connected using a PDA equipped with a CDMA modem so as to be connected to the IP binder 120 through a mobile communication network or a wireless LAN. A wireless LAN access point (AP) is connected to the IP binder 120 by using a PDA equipped with the IP binder 120 or a PDA equipped with a wireless LAN card to use a video call service.

The IP binder 120 may connect to a web client via a WWW server through the Internet, and manage membership registration information, IP address, and port number for a P2P video call service.

The user authentication method for the video call service may use a personalization authentication server as shown in FIG. 2A according to an implementation method, and the IP binder 120 itself when the personalization authentication server is not used as shown in FIG. 2B. It may be implemented to include a membership module, authentication module, billing module.

As an example, the TV2PDA video call service will be described via the personalization authentication server 194 as shown in FIG. 2A.

The data manager (DM) of the data broadcasting system (DBS) 192 is an object carousel (OC) associated with an updated video call transmitted from a video call service data agent (DA). Is received by the data manager (DM), and the data broadcasting system generates data broadcasting data and PSI / SI information for a video call, and transmits the data to the IP set-top box 310 of a plurality of subscribers by multicasting.

The SSO (Single Sign On) client of the IP set-top box 310 of the subscriber transmits the authentication request message for the video call service to the personalization authentication server 194 through the return path server system 193.

The personalization authentication server 194 receives an authentication request message for the video call service from the SSO client of the subscriber's IP set-top box 310 through the return pass server system 193, and if authentication is confirmed, responds thereto. Then, an authentication ticket is transmitted to the SSO client of the IP set-top box 310 of the subscriber through the return pass server system 193, and at the same time, subscriber information about the ticket issued to the IP binder 120 is transmitted. do.

The subscriber information on the issued ticket includes IP address or set-top box ID (SAID) and subscriber information as location information of the subscriber IP set-top box.

The personalization authentication server 194 performs a personalized ID and passwd authentication process using a personal identification number (PIN) account personalized for each household member.

After user authentication, the IP binder 160 receives the video call request message including the location information of the IP set-top box of the subscriber selected by the user through the return pass server system 193, and receives the IP set-top box of the subscriber. The IP address and port number of the callable party list are transmitted to the IP set-top box 310 of the subscriber through the return path server system 193 as location information.

The video call client of the subscriber's IP set-top box 310 passes the IP binder 120 with the IP address and port number of the user terminal selected from the received caller list (IP address information, port number, caller information, etc.). Instead, the video call client of the mobile terminal (e.g., phone, PDA, WiBro terminal, etc.) establishes a TCP / IP video call session connection in a peer-to-peer manner, and sends the video / videos from the A / V codec through RTP / UDP / IP. By sending and receiving voice data, P2P-based video call (video / voice call) is provided between the caller and the called party, and after the call is completed, the preset video call session is released.

2B is a configuration diagram of a TV2TV and PDA2TV video call service between a mobile terminal and an IP set-top box according to a second embodiment of the present invention.

The IP binder 120 may connect to a web client via a WWW server through the Internet, manage member registration information, IP address, and port number for a P2P video call service, and a user authentication method for a video call service. When the personalization authentication server is not used as shown in FIG. 2B according to the implementation method, the IP binder 120 itself includes a membership module, an authentication module, and a charging module.

4 is a diagram illustrating a protocol stack of a video call client of a portable terminal and an IP set-top box.

The IP set-top box 310 or portable terminal connected to the digital TV is equipped with a video call client program including an A / V codec (video / audio codec) such as MPEG-2, MPEG-4, H.264, and WMV. Using video call client, session manager sets up session for video call by IP address and port number. Caller and receiver receive video from camera through video codec, and audio codec from microphone. Voice is compressed through the A / V data through the A / V codec, compressed and restored, and transmitted to the user's terminal through the Internet via RTP / UDP / IP to peer-to-peer (P2P: Peer-to). -Peer) provides video / voice call and terminates the established session after the call is completed.

Referring to FIG. 5, a P2P-based video call service method using a mobile terminal and a video call client of an IP set-top box includes a subscription and IP binding step, a connection establishment step, a video / voice data transmission step, and a disconnection step. do.

The joining and IP binding step is a peer-to-peer (P2P) method for the TV2TV, PDA2TV, and TV2PDA video call service. The IP set-top box connected to the digital TV and the video call client (client1, client2) installed in the mobile terminal are each a member name. Registration information including ID (ID), password, address, social security number, mobile phone number, e-mail address, IP address and port number assigned to the IP binder 120 is registered.

Then, when the IP binder 120 receives the video call request message from the video call clients (client1 and client2), the IP binder 120 provides a caller list including an IP address and a port number.

After joining the member and binding the IP, the connection setting step is performed by selecting a called party's IP address and port number selected by the caller registered in the caller list using the video call client of the IPTV or the mobile terminal in the TV2TV, PDA2TV, or TV2PDA method. A session manager establishes a TCP / IP connection for a 1: 1 video call session by sending and receiving CONNECT REQUEST, ACK, and CONNECT messages according to a 3-way handshake between client2 and client1.

After the video call session is connected, the video and voice data transmission and reception steps are performed by the caller and the receiver receiving the video from the camera through the video codec and the audio from the microphone through the audio codec. The V data is compressed through the A / V codec and transmitted to the called party's user terminal through the RTP / UDP / IP network, and the video / audio compressed by the A / V codec is restored and output to the video call client. Peer-to-Peer (P2P) -based video and voice calls are provided while looking at your face.

After completion of the P2P-based video / voice call of the caller and the called party, the DISCONNECT message is transmitted and received between the video call client to disconnect the preset session of the peer-to-peer (P2P) based video call client.

6 is a flowchart illustrating a P2P based video call service providing method in an IPTV service system according to an exemplary embodiment of the present invention.

The EPG providing system 191 provides an electronic program guide (EPG) including a video call channel to the subscriber station.

The data broadcasting system 192 receives an object carousel (OC) related to a video call periodically updated from the IP binder 120 through the data manager DM (step S10), and performs a video call. Data broadcast data and PSI / SI information are generated (step S11).

delete

The EPG providing system 191 generates an EPG including a video call channel.

The network switch system 170 transmits the received IP packetized transport stream and the EPG to the IP set-top box 310 of the plurality of subscribers by multicasting according to the PIM-SM multicast routing protocol through the IP network (step S13).

The personalization authentication server 194 receives an authentication request message for a video call from the SSO client of the subscriber's IP set-top box 310 through the return pass server system 193 (step S14), and the personalization authentication server 194. ) Confirms the ticket authentication (step S15).

When the ticket authentication for the subscriber's IPTV video call service is confirmed (step S16), the personalization authentication server 194 transmits the authentication ticket to the subscriber's IP set-top box 310 through the return pass server system 193. The subscriber information about the ticket issued from the personalization authentication server 194 is transmitted to the IP binder 120 (step S16).

When the IP binder 120 receives subscriber information from the personalization authentication server 194, and receives the video call service request message from the IP set-top box 310 of the subscriber through the return pass server system, the IP set-top of the corresponding subscriber is received. IP address information and port number information of the callable party list are transmitted to the box 310 to allow a P2P-based video call (step S17).

Thereafter, the charging server processes the monthly charging for using the P2P-based IPTV video call service (step S18). The charging function may be embedded in the IP binder 120 itself as a charging module according to an implementation method, or charged by a back office system of the IPTV service system.

7 is a flowchart illustrating a P2P based video call method in an IP set-top box of a subscriber according to an embodiment of the present invention.

The video call client installed in the IP set-top box of the mobile terminal or the subscriber receives the subscriber member information for using the IPTV video call service and receives the member information for the ID binder and the IP binder 120 or the subscriber management system 140. (Step 20).

EPG including data broadcasting data, PSI / SI information, and video call channel for video call transmitted from IPTV service system to the broadcast channel tuned on TV 300 connected to subscriber IP set-top box 310. Is received (step S21).

The video call client installed in the IP set-top box of the mobile terminal or subscriber selects the video call menu of the Electronic Program Guide (EPG) using the remote control or the wireless keyboard for the IPTV. To transmit the authentication request message including the location information of the set-top box to the personalization authentication server 194 (step S22).

When the user of the video call service is authenticated from the personalization authentication server 194 (step S23), the SSO client of the subscriber IP set-top box 310 passes from the personalization authentication server 194 via the return pass server system 193. An authentication ticket is received (step S24).

When the video call client of the IP set-top box 310 of the mobile terminal or the subscriber transmits a video call service request message to the IP binder through the return pass server system 193, the IP caller 120 receives a list of available callers from the IP binder 120. IP address information and a port number are received (IP binding) (step S25).

In addition, the video call client provides a search function to search for the IP address information and the port number of the called party in the caller list by inputting the person's name through a separate search box.

The video call client uses the TV2TV, PDA2TV, and TV2PDA method to select the called party's IP address and port number selected by the caller registered in the caller list. A TCP / IP connection is established for a 1: 1 video call session by transmitting, receiving, and sending ACK and CONNECT messages (step S26).

After establishing a video call session TCP / IP connection, the caller and the called party receive video from the camera through the video codec and receive audio from the microphone through the audio codec to compress the A / V data by RTP / UDP / Peer-to-Peer (P2P) -based Peer-to-Peer (P2P) -based Peer-to-Peer (P2P) Provide a video / audio call (step S27).

After completion of the video / voice call, a disconnected connection between the peer-to-peer (P2P) based video call client is disconnected by transmitting and receiving a DISCONNECT message between the calling party and the video call client of the called party (step S28).

Then, if you choose to pay on the video call screen of the IP set-top box to pay the monthly billing information, IPTV video by selecting any payment method of credit card payment, bank transfer payment, mobile phone bill payment, KT communication card payment Complete the payment of the call service.

If you choose to pay by credit card, select your credit card type and enter your credit card information (payment amount, card type, card number, expiration date, social security number, password, installment period information in case of lump sum payment). The credit card payment request message is transmitted from the IPTV client of the IP set-top box 310 to the payment gateway (PG) server of the payment agency.

The PG server of the payment agency transmits a credit card payment request message to a payment server of a credit card company, receives a credit card payment result from the payment server of the credit card company, and receives a credit as an IPTV client of the IP set-top box 310 of the subscriber. The card payment result confirmation request message is transmitted. The IPTV client of the IP set-top box 310 of the subscriber checks the credit card payment result (payment amount, order product, credit card company, authorization number, authorization time) and sends a credit card payment result confirmation message to the PG server of the payment agency. Send to complete payment.

If the bank transfer payment is selected, enter the account transfer information (payment amount, withdrawal bank, account number, account password, social security number, and mobile phone number information to be notified of the payment details) to the payment agency's PG server. Send the transfer payment request message.

The PG server of the payment agency transmits an account transfer payment request message to a payment server of a financial institution, and receives an account transfer payment result from the payment server of the financial institution and receives an account as an IPTV client of the IP set-top box 310 of the subscriber. Send the transfer payment result notification and confirmation request message. The IPTV client of the subscriber's IP set-top box 310 checks the result of the bank transfer payment (payment amount, order product, bank name, authorization number, approval time) and sends a credit card payment result confirmation message to the payment agency's PG server. Send to complete payment.

The authentication method for payment uses a certificate or mobile phone authentication.

If the mobile phone payment is selected, enter the mobile phone information (payment amount, mobile carrier (SKT, KTF, LGT), mobile phone number, social security number, mobile phone number to receive payment details text) to the PG server of the payment agency Of mobile phone information.

The PG server of the payment agency transmits an authentication number transmission request message to the mobile phone of the customer who requested the payment to the server of the mobile communication company, and sends a text message including the authentication number to the mobile phone of the customer who requested the payment from the server of the mobile communication company. send. The customer who requested the payment checks the authentication number included in the text message sent to the mobile phone, inputs the authentication number to the IPTV client, and presses the OK button to confirm and complete the mobile phone payment result from the IPTV client of the IP set-top box 310 of the subscriber. The payment is completed by sending a message to the PG server of the payment agency.

When the KT communication card payment is selected, a phone number payment request message is transmitted to the PG server of the payment agency by inputting phone number information (payment amount, phone number, social security number, mobile phone number to receive payment details text).

The PG server of the payment agency transmits the telephone number payment request message of the customer who requested the payment to the payment server of the telecommunication company (KT), and the telephone number payment confirmation message from the payment server of the telecommunication company to the IPTV client of the subscriber IP set-top box. Send it. The customer who requested the payment checks the authentication number included in the text message sent to the mobile phone, inputs the authentication number to the IPTV client, and presses the OK button, and the PG server of the payment agency from the IPTV client of the IP set-top box 310 of the subscriber. Complete the payment by sending a phone number payment result confirmation and completion message to.

The method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form.

As described above, although described with reference to a preferred embodiment of the present invention, those skilled in the art various modifications of the present invention without departing from the spirit and scope of the invention described in the claims below Or it may be modified.

As described above, the system and method for providing a P2P-based video call service according to the present invention, by using the video call client installed in the IP set-top box connected to the digital TV after PIN authentication through IPTV to the IP binder (IP Binder) P2P-based ubiquitous video call service between a mobile terminal (Phone, PDA, WiBro terminal) and a digital TV connected to a set-top box while moving to TV2TV or PDA2TV or TV2PDA or WiBro2TV or TV2WiBro using IP address and port number By providing a 1 to 1 video / voice call function with the IPTV viewer is effective.

Claims (18)

P2P based video call service providing system, An EPG providing system for providing an electronic program guide (EPG) including a video call channel to a user terminal; Receive member registration information for P2P-based video call service from the video call client of the user terminal and store it as a DB. When receiving a video call request message from the user terminal, IP address information of the caller list registered in response to this, an IP binder (IP Binder) for providing port number information; A data broadcasting system (DM) for receiving periodically updated information from a data agent (DA) of a content provider, the data broadcasting system for generating data broadcasting data and PSI / SI information provided from the content provider; A compression multiplexing system for multiplexing the data broadcasting data with PSI / SI information and then outputting the multiplexed stream into IP packets; A network switch system for transmitting an IP packetized signal and an electronic program guide (EPG) received from the compression multiplexing system to a plurality of user terminals through an IP network in a multicast manner; And A return path (RP) server system connected to the user terminal through the IP network through a return channel, for recording a log of the accessing user terminal and transmitting and receiving a video call authentication request message in a unicasting manner; P2P-based video call service providing system comprising a. The method according to claim 1, Receiving an authentication request message for using a video call service from the user's terminal through a return pass (RP) server system, and receiving an authentication ticket in response to the authentication request message through the return pass (RP) server system. And a personalization authentication server for transmitting subscriber information about the issued ticket to the IP binder. The method according to claim 1, P2P-based video call service providing system further comprises a subscriber management system for subscription and termination of IPTV video call service, member information management. The method according to claim 1, P2P-based video call service providing system further comprises a back office system for processing billing for the use of IPTV video call service for each subscriber. The method according to claim 1, The user terminal, P2P-based video call service providing system, characterized in that the TV with an IP set-top box, an IP set-top box connected to the user's TV, a computer, a laptop, and a mobile terminal. The method according to claim 5, The mobile terminal, P2P-based image, characterized in that a video call client program including a mobile communication terminal, a personal digital assistant (PDA), a handheld PC, a tablet PC, a WiBro terminal, and an A / V codec is installed. Call service provision system. P2P-based video call service providing method, (a) receiving, by the data broadcasting system (DBS), a data manager (DM) which is periodically updated from the data agent (DA) of the content provider; (b) the data broadcasting system generating data for data broadcasting using information provided from a content provider; (c) after the compression multiplexing system multiplexes the data broadcasting data and the PSI / SI information, IP packetizing the multiplexed stream; (d) generating an EPG including a video call channel by an electronic program guide (EPG) providing system; (e) the network system transmitting the received IP packetized transport stream and the EPG to the plurality of user terminals in a multicasting manner via the IP network; (f) receiving a video call service request message through a return pass server system from a user terminal; And (g) transmitting, by the IP binder, to the video call client of the user terminal transmitting IP address information and port number information of the caller list to the corresponding user terminal to provide a P2P-based video call after user authentication; P2P-based video call service providing method comprising a. delete The method according to claim 7, P2P-based video call service providing method characterized by further comprising the subscriber management step of managing the subscription and termination, the member information for the IPTV service. The method according to claim 7, P2P-based video call service providing method further comprising the step of processing the billing for the use of P2P-based IPTV video call service for each subscriber. The method according to claim 7, User authentication in step (g), When the personalization authentication server receives an authentication request message for a video call from the user terminal through the return pass server system and authentication is confirmed, the authentication ticket is transmitted to the user terminal through the return pass server system, and the personalization is performed by the IP binder. P2P-based video call service providing method characterized by transmitting the subscriber information about the ticket issued from the authentication server. The method according to claim 7, User authentication in step (g), And the IP binder provides authentication for a P2P based video call service by an authentication module. P2P based video call service communication method, (a) receiving an EPG including data broadcasting data and a video call channel transmitted from the IPTV service system in a multicasting manner, to a user terminal; (b) sending the video call service request message to the IP binder via the return pass server system; (c) receiving IP address information and a port number of a caller list from the IP binder (IP binding); (d) establishing a connection of the video call session by the session manager when the video call client selects the IP address and the port number of the called party selected by the caller registered in the caller list; (e) providing a peer-to-peer (P2P) based video / voice call between the calling party and the called party after establishing a video call session connection; And (f) after completing the call, disconnecting the session established for the video call between the calling party and the called party; P2P-based video call service communication method comprising a. The method according to claim 13, Before step (a) above, And transmitting, by the video call client installed in the user terminal, member information for using the IPTV video call service to the subscriber management system. The method according to claim 13, After the step (f), Receiving the charging information for the use of the video call service from the IPTV service system, any one of a credit card payment, bank transfer payment, mobile phone bill payment or telecommunication company bill payment method as a payment method for P2P-based video call P2P-based video call service communication method further comprising the step of making a payment using. The method according to claim 13, Between step (b) and step (c), (g) transmitting an authentication request message including a personal identification number (PIN) input from the video call client and location information of the user terminal to a personalization authentication server; (h) receiving an authentication ticket from the personalization authentication server through the return pass server system when authentication of the video call service is confirmed; P2P-based video call service communication method further comprising. The method according to claim 16, The location information of the user terminal includes a user terminal ID (SAID), subscriber information, characterized in that the P2P-based video call service communication method. On your computer or IP set-top box or mobile terminal, (a) a function of receiving, by a user terminal, an EPG including data broadcasting data and a video call channel transmitted from the IPTV service system in a multicasting manner; (b) sending a video call service request message to an IP binder via a return pass server system; (c) a function of receiving IP address information and port number of a caller list from the IP binder (IP binding); (d) establishing a connection of the video call session by the session manager when the video call client selects the IP address and the port number of the called party selected by the caller registered in the caller list; (e) providing a peer-to-peer (P2P) based video / voice call between the calling party and the called party after establishing a video call session connection; And (f) after completing the call, disconnecting the session set up for video call between the calling party and the called party; A recording medium that records a program for realizing the problem.

Images