KR101685974B1 - Terminal, communication system and methods for performing broadcast related chatting service thereof - Google Patents

Abstract

The present invention relates to a method and apparatus for identifying at least one counterpart terminal that receives the same broadcast content as a user terminal using broadcast viewing information of a counterpart terminal and is capable of performing a broadcast related conversation service with the identified counterpart terminal And a method for performing a broadcast-related conversation service of the terminal.

Description

TECHNICAL FIELD [0001] The present invention relates to a terminal, a communication system,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a terminal, a communication system, and a broadcasting-related interactive service capable of performing a broadcasting-related conversation service.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

According to the related art, it is possible to output broadcast contents or perform an interactive service using each terminal. Alternatively, even when the broadcasting contents output and the conversation service are simultaneously performed using one terminal, they are performed independently of each other.

However, the above-described prior art does not provide a way to perform the conversation service in relation to the broadcast content currently being received.

Therefore, the user does not satisfy the desire to communicate with the other party who is watching the same broadcast content as the broadcast content currently being viewed by the user in relation to the broadcast content.

An object of the present invention is to provide a communication system capable of performing a broadcast-related conversation service with a counterpart terminal that receives the same broadcast content in a communication system including a plurality of terminals, and a method of performing the broadcast-related conversation service.

It is another object of the present invention to provide a terminal capable of performing a broadcast-related conversation service with a counterpart terminal receiving the same broadcast content in one terminal and a method of performing a broadcast-related conversation service in the terminal.

A terminal related to an embodiment of the present invention for realizing the above-mentioned problem includes a wireless communication unit for receiving first broadcast content and transmitting and receiving broadcast viewing information to and from a second terminal; A control unit that identifies at least one counterpart terminal that is currently receiving the first broadcast content using the received broadcast viewing information and controls an operation of performing a broadcast related conversation service with the identified counterpart terminal; And a display unit displaying at least one of a conversation history and an identification information list of the identified at least one terminal according to the control of the controller when performing the broadcast related conversation service.

Here, the wireless communication unit can transmit and receive data and video signals according to the performance of the broadcast related interactive service with the identified at least one terminal under the control of the controller.

According to another aspect of the present invention, there is provided a communication system including a first terminal and a second terminal, the first terminal including: a first communication unit for transmitting and receiving broadcast viewing information to and from a counterpart terminal; Identifying at least one counterpart terminal that receives the same broadcast content as the currently received broadcast content using the received broadcast viewing information and controlling an operation of performing a broadcast related conversation service with the identified counterpart terminal A first control unit; And a first display unit for displaying a dialog-related screen according to the control of the first control unit when the broadcast-related dialog service is performed, wherein the second terminal, when performing the broadcast-related dialog service, A second user input unit for receiving conversation contents to be included in a message to be transmitted to at least one terminal; A second wireless communication unit for transmitting and receiving a message including the content of the conversation with the identified at least one terminal; And a second controller for controlling operations of the second wireless communication unit and the second user input unit in connection with the execution of the broadcast related interactive service.

According to another aspect of the present invention, there is provided a method of performing a broadcast-related conversation service in a terminal, the method comprising: receiving a first broadcast content; Transmitting and receiving broadcast viewing information to and from a remote terminal; Identifying at least one counterpart terminal currently receiving the first broadcast content using the received broadcast viewing information; Performing a broadcast related conversation service with the identified at least one counterpart terminal; Displaying a conversation related screen including at least one of the conversation history and the identification information list of the identified at least one terminal upon performing the broadcast related conversation service; And transmitting and receiving data and video signals according to the performance of the broadcast related interactive service with the identified at least one terminal.

According to another aspect of the present invention, there is provided a method for performing a broadcast-related conversation service in a communication system, the method comprising: transmitting and receiving broadcast viewing information to and from a first terminal; Identifying, by the first terminal, at least one counterpart terminal that receives the same broadcast content as the currently received broadcast content using the received broadcast viewing information; Displaying the dialog-related screen as the first terminal performs a broadcast related dialog service with the identified at least one counterpart terminal; Receiving a conversation content to be included in a message to be transmitted to the identified at least one terminal as the second terminal performs the broadcast related conversation service; And transmitting, by the second terminal, a message including the input conversation contents to the identified at least one terminal.

Here, the displaying step may display a conversation-related screen including the conversation contents included in the transmitted message.

According to at least one embodiment of the present invention, the terminal, the communication system, and the broadcasting-related interactive service performing method according to the present invention can provide the following effects.

First, in a communication system including a broadcasting terminal and a communication terminal, data according to a broadcasting-related conversation service can be transmitted and received using a communication terminal and a counterpart terminal receiving the same broadcasting contents as the broadcasting contents received through the broadcasting terminal . Therefore, the user can communicate with the other parties who watch the same broadcast content using the communication terminal in relation to the broadcast content being viewed through the broadcast terminal.

Second, it is possible to transmit and receive data according to a broadcast-related conversation service with a counterpart terminal receiving the same broadcast content using one terminal in which both broadcast reception and data communication are performed. Accordingly, the user can not only watch the broadcast content using one terminal, but also can communicate with the other parties watching the same broadcast content.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
FIG. 2A and FIG. 2B are structural diagrams of a communication system in which a broadcast-related conversation service according to the present invention is performed; FIG.
FIG. 2C is a screen configuration diagram of a terminal in which a broadcast-related conversation service according to the present invention is performed; FIG.
3 is a diagram illustrating a connection structure between a server and a plurality of terminals for performing a broadcast-related conversation service according to the present invention;
4 is a flowchart of a method of performing a broadcast-related conversation service according to an embodiment of the present invention.
5A to 5D are diagrams for receiving a command signal of a broadcast-related conversation service using a communication system according to the present invention.
6A and 6B are diagrams illustrating a case where a request signal for performing a broadcast-related conversation service is received using a communication system according to the present invention.
7A to 7C are screen configuration diagrams for outputting a dialog-related screen using the first terminal of the communication system according to the present invention.
8A to 8C are screen configuration diagrams for inputting / outputting conversation contents using the second terminal of the communication system according to the present invention.
FIGS. 9A to 9F are diagrams illustrating a video conversation among broadcast-related conversation services using a communication system according to the present invention. FIG.
10A to 10D are diagrams for transmitting a request message for performing a broadcast-related conversation service to a specific counterpart terminal using a communication system according to the present invention.
11A to 11C are diagrams of a case where a request message for performing a broadcast-related conversation service is received from a specific counterpart terminal using a communication system according to the present invention.
12A to 12C are diagrams for illustrating a dialog-related screen displayed on a first terminal of a communication system using an external display device according to the present invention.
13A and 13B are diagrams for explaining a broadcast-related conversation service using a terminal according to the present invention.
14A and 14B are screen configuration diagrams for outputting a dialog-related screen using a terminal according to the present invention.
15A to 15C are diagrams illustrating a video conversation among broadcast-related conversation services using a terminal according to the present invention.
16A to 16D are diagrams for transmitting a request message for performing a broadcast-related conversation service to a specific counterpart terminal using a terminal according to the present invention.
FIGS. 17A through 17C are diagrams illustrating a case where a request signal for performing a broadcast-related conversation service is received from a specific counterpart terminal using a terminal according to the present invention.
18A to 18D are views for displaying a dialog-related screen using a computer according to the present invention.

Hereinafter, a terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a desktop computer, a digital broadcasting terminal (including a digital TV), a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) Navigation and the like may be included.

1 is a block diagram of a terminal according to an embodiment of the present invention.

The terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, 170, a control unit 180, a power supply unit 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the terminal 100 and the wireless communication system or between the terminal 100 and the network in which the terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (DVF-H) And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the terminal 100 such as the open / close state of the terminal 100, the location of the terminal 100, the presence of the user, the orientation of the mobile terminal, 100 in response to the control signal. For example, when the terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating an output relating to visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, a haptic module 154, 155, and the like.

The display unit 151 displays (outputs) information to be processed by the terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the terminal 100. For example, in the terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The projector module 155 is an element for performing an image project function using the terminal 100 and may be the same as the image displayed on the display unit 151 according to a control signal of the controller 180 At least some of which can display other images on an external screen or wall.

Specifically, the projector module 155 includes a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, a light source And a lens (not shown) for enlarging and outputting the image at a predetermined focal distance to the outside. Further, the projector module 155 may include a device (not shown) capable of mechanically moving the lens or the entire module to adjust the image projection direction.

The projector module 155 can be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module and a DLP (Digital Light Processing) module according to the type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by enlarging and projecting an image generated by reflecting light generated from a light source on a DMD (Digital Micromirror Device) chip.

Preferably, the projector module 155 may be longitudinally provided on a side, front or back side of the terminal 100. It goes without saying that the projector module 155 may be provided at any position of the terminal 100 as required.

The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the usage right of the terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a universal user authentication module A Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

The broadcast content referred to in the present specification may include a broadcast program provided from a broadcast channel or a broadcast channel through a real-time broadcast service or a VOD broadcast service on the Internet.

In addition, the broadcast-related interactive service referred to in the present specification may include a conversation service performed during viewing of the same broadcast content among the terminals viewing the same broadcast content. At this time, the terminals may be equipped with a module or a soft program that is pre-registered in the broadcast-related conversation service management server to perform a broadcast-related conversation service or can perform a broadcast-related conversation service.

In addition, the broadcast-related conversation service management server referred to in the present specification may include a server for managing a broadcast-related conversation service between a plurality of terminals.

According to the present invention, in a communication system including a plurality of terminals, it is possible to use a second terminal or a third terminal that receives the same broadcast content as the broadcast content received and output by the first terminal, It is possible to transmit and receive data according to the performance.

For example, the first terminal may be referred to as a broadcast reception / output terminal, and the second or third terminal may be referred to as a data communication terminal for a broadcast-related conversation service. The first terminal may be a digital TV, the second terminal may be a mobile phone, and the third terminal may be a desktop / notebook computer. Also, the first to third terminals may be pre-registered in the broadcast-related conversation service management server to perform a broadcast-related conversation service, and may install software for performing a broadcast-related conversation service.

Hereinafter, a communication system in which a broadcast-related interactive service according to the present invention is performed will be described in detail with reference to FIGS. 2A and 2B. FIG.

When performing the broadcast-related conversation service, the first terminal 200 can display the screen 210 (described later) according to the execution of the broadcast-related conversation service while outputting the broadcast content.

The second terminal 100 or the third terminal 250 may be connected to the other terminal that receives / outputs the same broadcast content as the broadcast content being output by the first terminal 200 and a broadcast related dialog service (e.g., / Voice conversation / video conversation) can be transmitted / received.

For example, the second terminal 100 or the third terminal 250 may display a screen 220 for receiving a conversation to be included in a message to be transmitted to a counterpart terminal that receives / outputs the same broadcast content .

In Fig. 2B, components included in the first terminal 200 are shown. Components of the first terminal 200 include the same or similar components as those shown in Fig. 1, and reference numerals with -1 appended to the reference numerals of the components shown in Fig. 1 are given. Also, the second terminal 100 may include at least one of the components shown in FIG.

More specifically, the first terminal 200 includes a first communication unit 110-1 in place of the wireless communication unit 110 in FIG. 1, and a communication module 112-1 in place of the mobile communication module 112 And may include an Internet module 113-1 instead of the wireless Internet module 113. [

In addition, according to the present invention, a terminal that receives and outputs broadcast content can perform a conversation service with a counterpart terminal that receives the same broadcast content.

Hereinafter, with reference to FIG. 2C, a detailed description will be made of a terminal in which a broadcast-related interactive service according to the present invention is performed. The terminal shown in FIG. 2C may be any one of the first to third terminals shown in FIG. 2A. For convenience of description, it is assumed that the terminal shown in FIG. 2C may include at least one of the components shown in FIG.

Hereinafter, with reference to FIG. 2C, a detailed description will be made of a terminal in which a broadcast-related interactive service according to the present invention is performed.

When the terminal 100 performs a broadcast-related conversation service with the other terminal while viewing the same broadcast content during reception and output of the broadcast content, the terminal 100 divides the screen into two areas, (To be described later) in accordance with the execution of the broadcast related interactive service in the second area 250. (a)

The terminal 100 displays a virtual keypad 260 (in the case of a front touch screen) to receive a conversation of a message to be transmitted from the user to the counterpart terminal, and the user operates the virtual keypad 260 You can enter the conversation.

FIG. 3 illustrates a connection structure between a server and a plurality of terminals for performing a broadcast-related conversation service according to the present invention.

For convenience of explanation, the first to third terminals 200, 100 and 250 form one communication system, and the first counterpart terminal 320 and the second counterpart terminal 330 are connected to the first terminal 200 are watching the same broadcast content as the broadcast content received and outputted by the user.

In the communication system configured by the first to third terminals 200, 100, and 250, during the reception and output of broadcast content using the first terminal 200, the second or third terminal 100, And can exchange data with the first counterpart terminal 320 or the second counterpart terminal 330 according to the execution of the broadcast related conversation service.

At this time, the data related to the execution of the broadcast-related conversation service can be transmitted and received via the broadcast-related conversation service management server 310. [

For example, the data transmitted and received according to the execution of the broadcast-related conversation service may include a message including text-type conversation contents when performing a text conversation, an audio signal when performing a voice conversation, and a video signal / audio signal when performing a video conversation . Here, the audio signal or the video signal can be transmitted and received in the form contained in the multimedia message.

Hereinafter, a method of performing a broadcast-related interactive service according to the present invention will be described in detail with reference to the accompanying drawings.

First, a method of performing a broadcast-related conversation service using a communication system including a plurality of terminals will be described (see FIGS. 2A and 2B).

4 shows a flowchart of a method of performing a broadcast-related conversation service according to an embodiment of the present invention.

The first and second terminals 200 and 100 mentioned below may be located within a certain distance. The predetermined distance may include a distance enabling short-range wireless communication or a distance capable of controlling a broadcast-related conversation service using the first terminal 200 using the second terminal 100.

As shown in FIG. 4, the first terminal 200 receives the first broadcast content using the first communication unit 110-1 (S410).

For example, the first terminal 200 may include a digital TV. In addition, the first broadcast content can be received using the broadcast receiving module 111-1 or the Internet module 113-1 of the first communication unit 110-1.

The first terminal 200 can output the received first broadcast content through the output unit 150-1.

The first terminal 200 transmits and receives broadcast viewing information to the other terminal (s) using the first communication unit 110-1 (S420).

Here, the other terminal (s) may include the terminal (s) previously registered with the management server 310 to perform a broadcast related conversation service with the first terminal 200.

For example, the management server 310 receives broadcast viewing information from terminals registered to perform a broadcast-related conversation service, and is receiving (or viewing) the same broadcast content as that of the first terminal 200, To the first terminal 200, the broadcast viewing information received from the first terminals 200. [ Of course, the broadcast viewing information received from the first terminal 200 may be transmitted to terminals that are receiving (or viewing) the same broadcast content as the first terminal 200 through the management server 310. [ In addition, the first terminal 200 may receive broadcasting viewing information of all the other-side terminals, regardless of whether the same broadcasting contents are being received.

Here, the broadcast viewing information may include identification information of the terminal and identification information of the broadcast content currently being received (or being watched) using the terminal.

For example, the identification information of the corresponding terminal may include identification information of the terminal (e.g., the first terminal 200) receiving the broadcast content or a terminal (e.g., a second terminal (For example, a telephone number of a mobile phone), and the like of the mobile phone. The identification information of the broadcast content may include identification information (e.g., channel specific number, channel name) of the broadcast channel or identification information (e.g., program specific number, program specific name) of the broadcast program.

As a result of performing the receiving step S420, the first terminal 200 can notify the counterpart terminal (s) that the first terminal 200 is currently receiving (or viewing) the first broadcast content, (Or watching) the other party's terminal (s).

The broadcast viewing information of the first terminal 200 is transmitted from the first terminal 200 to the second terminal 100 and transmitted using the second wireless communication unit 110 of the second terminal 100 It is possible.

The first terminal 200 may perform a broadcast related conversation service under the control of the first controller 180-1 (S430).

First, the first terminal 200 may perform a broadcast-related conversation service at the request of the first terminal 200 user.

The first terminal 200 can perform a broadcast-related conversation service when a command for performing a broadcast-related conversation service is input from the user through the user input unit 130-1.

This will be described in detail with reference to Figs. 5A to 5D.

5A, the first terminal 200 displays a key area 'conversation' 501 for receiving a command signal for executing a broadcast-related conversation service in one area of the output screen of the first broadcast content, When the 'conversation' 501 is selected, the execution command signal of the broadcast-related conversation service can be inputted.

For example, if the first terminal 200 includes a touch screen, the user can directly select the 'conversation' 501 by touching the remote controller or the second terminal 100 of the first terminal 200 Quot; conversation " 501.

5B, the first terminal 200 displays the menu area 502 in one area of the output screen of the first broadcast content, and when the menu area 502 is selected by the user, A list 510 can be displayed (b). When the user selects the menu item 'broadcast-related conversation service' 511 from the menu item list 510, the first terminal 200 can receive a command signal for performing a broadcast-related conversation service.

For example, if the first terminal 200 includes a touch screen, the user can directly select the menu area 502 or the 'broadcast related conversation service' 511, Or the second terminal 100 to select the menu area 502 or the 'broadcast related conversation service' 511.

Referring to FIG. 5C, the first terminal 200 may receive a command for performing a broadcast-related conversation service from the second terminal 100 or the third terminal 250. [

For example, the user operates the second terminal 100 or the third terminal 250 to input a performance command operation of the broadcast-related conversation service, and the second terminal 100 or the third terminal 250 may transmit the broadcast- Related command can be transmitted to the first terminal 200 upon receipt of a command for performing a broadcast-related conversation service from the user.

FIG. 5D shows a process of operating the second terminal 100 to receive a performance command operation of a broadcast-related conversation service.

The second terminal 100 displays a tile (e.g., a widget or an icon) 520 corresponding to a broadcast-related conversation service, and when the tile 520 is selected by the user, And transmit the signal to the first terminal 200.

Next, the first terminal 200 can perform a broadcast-related conversation service at the request of a specific counterpart terminal which receives (or watches) the first broadcast content being received (or being watched) by itself .

When the first terminal 200 receives a request signal for performing a broadcast-related conversation service through the first communication unit 110-1, the first terminal 200 can perform a broadcast-related conversation service.

Meanwhile, the execution request signal of the broadcast-related interactive service may be received through the second wireless communication unit 110 of the second terminal 100 and then transmitted to the first terminal 200. [

This will be described in detail with reference to Figs. 6A and 6B.

Referring to FIG. 6A, when the first terminal 200 receives a request signal for performing a broadcast-related conversation service from a specific counterpart terminal Jane, the first terminal 200 displays a message informing the user of the execution of the broadcast- , &Quot; Conversation Service-Jane ", and " Cancel ".

For example, when 'conversation service - all' is selected, the first terminal 200 can perform a broadcast related conversation service with all counterpart terminals receiving the first broadcast content. Alternatively, when the 'conversation service-Jane' is selected, the first terminal 200 may perform a broadcast-related conversation service only with a specific counterpart terminal (Jane), or may perform a broadcast related conversation service with all counterpart terminals receiving the first broadcast content Data that is transmitted to and received from a specific counterpart terminal (jane) may not be included in the conversation history (described later). Alternatively, the first terminal 200 may not perform the broadcast-related conversation service when 'cancel' is selected.

6B, when the first terminal 200 receives a request signal for performing a broadcast-related conversation service from a specific counterpart terminal Jane, the first terminal 200 displays a message informing the user of the execution of the broadcast- Rejection '.

For example, when 'accept' is selected, the first terminal 200 performs a broadcast-related conversation service with all of the other party's terminals that receive the first broadcast content, and when 'reject' is selected, It may not be performed.

Referring back to FIG. 4, when the first terminal 200 performs a broadcast-related conversation service, the first terminal 200 controls the first terminal 200-1 using the broadcast viewing information received in the receiving step S420, under the control of the first controller 180-1 At least one counterpart terminal that receives 1 broadcast content is identified (S440).

Here, the identified at least one counterpart terminal may be in a state of receiving and outputting the first broadcast content or in a state of watching the first broadcast content.

If the broadcast viewing information received in the receiving step S420 is provided only from the other party's terminal that receives the first broadcast content, the first controller 180-1 transmits all of the other party's terminals providing broadcast viewing information to the first broadcast content As the receiving terminal.

Alternatively, when the broadcast viewing information received in the receiving step S420 is provided from all of the counterpart terminals, the first control unit 180-1 determines whether broadcast viewing information received from the counterpart terminal It is possible to extract the audience information and identify the other party terminal that has provided the extracted broadcast viewing information as the other party terminal that receives the first broadcast content.

The first terminal 200 displays a conversation related screen for at least one counterpart terminal identified in the identifying step S440 under the control of the first controller 180-1 when performing the broadcast related conversation service (S450).

Here, the conversation related screen may include at least one of the conversation history and the identification information list of the at least one counterpart terminal identified above.

In particular, the conversation history may include conversation content included in a message received via the broadcast-related conversation service from the identified at least one counterpart terminal. For example, the conversation history may arrange the conversation contents in the order of reception time of the corresponding messages, or may include the conversation contents included in the most recently received messages from the at least one counterpart terminal identified.

Further, the identification information list may include identification information of each of the identified at least one counterpart terminal. For example, the identification information may include a name, a screen name, a unique number (for example, a telephone number, etc.), a photograph, and the like set in the counterpart terminal.

The dialog-related screen displayed in the display step S450 may be provided directly from the management server 310 or may include information provided from the management server 310 (for example, broadcast viewing information for the identified at least one counterpart terminal , Conversation history, identification information, and the like).

On the other hand, if the dialog-related screen is directly provided by the management server 310, the first terminal 200 may not perform the identifying step S440. This is because the dialog-related screen includes only the conversation history or identification information list for the other party terminal (s) receiving the same broadcast content as that of the first terminal 200.

Also, when the first terminal 200 is provided with the conversation history or identification information for all the counterpart terminals previously registered to perform the broadcast-related conversation service with the first terminal 200 from the management server 310, the first controller 180- 1 extracts only the conversation history or identification information for the counterpart terminal identified in the identifying step S440 among the conversation history or the identification information for all the counterpart terminals and outputs the extracted conversation history or identification information to the extracted conversation history or the extracted identification information Related display screen including the constructed identification information list can be displayed.

When the other terminal receiving the same broadcast content as the first terminal 200 is added, identification information of the added terminal is added to the identification information list. In the conversation history, The contents of the conversation included in the received message may be included.

Hereinafter, the display step S450 will be described in detail with reference to Figs. 7A to 7C.

Referring to FIG. 7A, the first terminal 200 can simultaneously display an output screen of a first broadcast content (hereinafter referred to as a first broadcast output screen) and a dialogue related screen 210 .

For example, the first terminal 200 can divide the entire display area into a plurality of areas, and display the first broadcast output screen in the first area and the dialog-related screen in the second area, respectively. Alternatively, the first terminal 200 can display a first broadcast output screen in the entire display area, and can display a picture in picture (Picture In Picture) technique, an overlay technique, a pop-up technique A dialogue-related screen can be displayed.

Also, the first terminal 200 may receive a screen size adjustment signal from a user and adjust the size of the first broadcast output screen or the dialog-related screen so as to correspond to the input screen size adjustment signal.

7B is a view showing the dialogue-related screen 210 in detail. Particularly, FIG. 7B shows the identification information list 710, and FIG. 7B shows the conversation history 731. FIG.

7B, the dialogue-related screen 210 includes an identification information list 710 composed of identification information of each of the counterpart terminals receiving the same broadcast content as the first terminal 200, Bar (720).

For example, the identification information may include a name set on the terminal, a screen name, and the like. The command bar 720 may include an end command area 721, a switch command area 722, a video talk command area 723, and an environment setting command area 724.

7B, the dialogue-related screen 210 includes a conversation history 210 consisting of conversation contents contained in the most recently received messages from the counterpart terminals receiving the same broadcast content as the first terminal 200, An input area 732 of a new conversation content, and a command bar 720. [

7B, when the switching command area 722 is selected in FIG. 7B, the dialog-related screen shown in FIG. 7B is displayed. When the switching command area 722 is displayed in FIG. The user can display the dialog-related screen shown in Fig. 7B (a).

7B or 7B, when the end area 721 is selected, the display of the conversation-related screen or the execution of the broadcast-related conversation service is stopped, and when the video conversation area 723 is selected, Can be performed.

7C, the first terminal 200 displays a conversation-related screen including the identification information list 710, and displays the same content as the first terminal 200 on the identification information list 710 It is possible to identify and display whether or not the current broadcast related conversation service is performed for each of the terminals. Of course, it is also possible to identify whether the current broadcast-related conversation service is performed on the conversation history.

For example, [on] is further displayed in the identification information of the counterpart terminal performing the current broadcast-related conversation service on the identification information list 710, and [off] ] Can be further displayed.

Although not shown in the drawing, in order to identify whether the current broadcast-related conversation service is performed or not, a color, a font, a font size, etc. may be used, or an image / icon may be used.

4, the second terminal 100 performs a broadcasting related conversation service through the second wireless communication unit 110 under the control of the second controller 180 when performing the broadcasting related conversation service (S430) And transmits / receives the data to / from the identified at least one counterpart terminal (S460).

The data in the transmission / reception step (S460) can be transmitted / received via the management server 310. [

The data in the transmission / reception step S460 includes a message including a text type conversation content in the case of a text conversation, a voice signal in the case of a voice conversation, a voice signal in the case of a video conversation, A video signal may be included. On the other hand, even if the video conversation is not performed, the second terminal 100 can transmit / receive a video signal to / from the identified at least one counterpart terminal in the transmission / reception step S460.

In addition, the data transmitted and received in the transmitting and receiving step S460 can be input through the second terminal 100. [ At this time, the second controller 180 may control the data input process.

For example, in the case of a text conversation, the conversation contents may be input using the keypad included in the second terminal 100 (or a virtual keypad in the case of the front touch screen) (an example of the second user input unit 130) . Alternatively, in the case of a voice conversation, the voice signal may be input using the second microphone 122 included in the second terminal 100. [ Alternatively, in the case of a video conversation, the audio signal is input using the second microphone 122 included in the second terminal 100, and the video signal is input to the second camera 121 included in the second terminal 100 .

The data transmitted and received in the transmission and reception step S460 may be input through the first terminal 200 and the data input through the first terminal 200 may be transmitted to the second terminal 100 for transmission .

In addition, in the case of text chatting, conversation contents included in the message transmitted / received in the transmission / reception step (S460) can be displayed and included in the conversation history. In the case of video conversation, an image corresponding to the video signal transmitted / received in the transmission / reception step S460 may be displayed in one area on the screen through the first display unit 151-1 of the first terminal 200. [

Hereinafter, a process of performing a text conversation will be described with reference to FIGS. 8A to 8C.

8A and 8B, the second terminal 100 includes an input for receiving a conversation content to be included in a message to be transmitted to a counterpart terminal that receives the same broadcast content (hereinafter, the same broadcast content) as that of the first terminal 200 The screen 220 can be displayed.

8A, the input screen 220 includes a recent conversation content area 801 for displaying the conversation contents included in the message most recently transmitted from the terminals receiving the same broadcast content to the management server 310, A content input area 802, and a transmission command area 803.

When the transmission command area 803 is selected after inputting the conversation contents via the conversation contents input area 802, the second terminal 100 transmits a message including the entered conversation contents to the management server 310, The conversation contents included in the transmitted message may be included in the conversation history displayed on each of the terminals receiving the same broadcast content.

8B, when the message transmitted by the second terminal 100 is the most recently transmitted message to the management server 310, in the recent conversation content area 801 of the second terminal 100, The conversation contents included in the message transmitted by the terminal 100 can be displayed.

8C, the conversation contents 731-1 included in the message transmitted by the second terminal 100 in relation to FIG. 8B are included in the conversation history, and conversations included in the most recently transmitted message Content can be placed at the bottom of the conversation history or can be identified (e.g., dark border, color, box size, etc.).

Hereinafter, a process of performing a video conversation will be described with reference to FIGS. 9A to 9F. 9A to 9F can be applied to a case of transmitting and receiving a video signal to and from a counterpart terminal receiving the same broadcast content even when video conversation is not being performed.

The first terminal 200 may receive the same broadcast content (hereinafter the same broadcast content) from the first terminal 200 using the first communication unit 110-1, (Hereinafter referred to as a " counterpart video signal "). At this time, each counterpart video signal can be received via the management server 310.

The second terminal 100 transmits a video signal (hereinafter referred to as a user video signal) input through the camera of the first terminal 200 or the second terminal 100 to the management server 310, As shown in Fig.

Referring to FIG. 9A, the first terminal 200 can perform a video conversation when the video conversation area 723 of the command bar 720 is selected by the user. For example, the video conversation area 723 may be selected by direct touch, or may be selected by operation of the remote controller or the second terminal 100. [

The first terminal 200 can display an image corresponding to the received counterpart video signal and the transmitted user video signal using the first display unit 151-1.

9B, the first terminal 200 displays a user image 901 corresponding to the user video signal, a first counterpart image 902 corresponding to the first counterpart video signal, a second counterpart 902 corresponding to the first counterpart video signal, And display the second counterpart image 903 corresponding to the counterpart video signal.

Furthermore, the first terminal 200 can identify (CAMOFF) the counterpart terminal (camera) on which the camera (or webcam) is disabled on the conversation history 731.

 The first terminal 200 can determine the degree of motion of an object included in a video signal (including a counterpart video signal and a user video signal) using the first controller 180-1.

The first terminal 200 can identify and display the corresponding image using the first display unit 151-1 according to the control of the first controller 180-1 have.

For example, the degree of motion may be determined based on the motion of the object, the number of motion of the object, and the intensity of the voice signal synchronized with the video signal.

9C and 9D, the size of the image 903 is increased to a certain level or more (FIG. 9C) or the size of the image 903 is increased as the number of motions increases, (Fig. 9D).

Also, although not shown in the drawings, for the identification display of the image, the corresponding image may be blinked or displayed using a different color from other images.

Referring to FIG. 9E, the first terminal 200 can allow the user to select whether or not to transmit the camera activation request signal to the partner terminal (the base station) in which the camera is inactivated. When the transmission (Yes) is selected in Fig. 9E, the second terminal 100 can transmit the camera activation request signal to the other terminal (not shown). Accordingly, the other party terminal (base station) can activate the camera for video conversation upon receiving the camera activation request signal.

Referring to FIG. 9F, the first terminal 200 can receive a camera activation request signal from a specific counterpart terminal when the camera for performing video conversation is inactivated. The first terminal 200 may activate a camera for performing a video conversation when ON is selected by the user.

According to the present invention, the first user input unit 130-1 of the first terminal 200 selects a specific counterpart terminal using the dialog-related screen, and the wireless communication unit 110 of the second terminal 100, Related service with the selected specific counterpart terminal under the control of the second control unit 180. [

This will be described in detail with reference to Figs. 10A to 10D.

10A, the first terminal 200 can select a specific counterpart terminal (Jane) from the user by using the identification information list (a) or the conversation history (b).

Referring to FIG. 10B, the first terminal 200 determines whether to perform a text conversation (Text) with a specific counterpart terminal (Jane) selected in FIG. 10A, a video conversation / text conversation To display a pop-up window 1010 that allows the user to select the desired pop-up window.

Referring to FIG. 10C, when the video / text is selected in FIG. 10B, the second terminal 100 transmits the video signal and the textual conversation contents according to the video / text conversation performed with the specific counterpart terminal (Jane) You can send and receive messages that contain.

At this time, the video signal and the conversation contents transmitted / received between the second terminal 100 and the specific counterpart terminal (Jane) 1020 are not displayed on the remaining terminals except for the first terminal 200 and the specific counterpart terminal 1020 . For example, conversation contents between the second terminal 100 and a specific counterpart terminal (Jane) 1020 may not be included in the conversation history.

In addition, according to FIG. 10D, the first terminal 200 can transmit a broadcast-related interactive service execution request signal to a specific counterpart terminal that is receiving the same broadcast content but does not currently perform a broadcast-related conversation service.

According to the present invention, the first terminal 200 can receive the conversation request signal from the specific counterpart terminal using the first communication unit 110-1 during the execution of the broadcast-related conversation service. At this time, the specific counterpart terminal may be one of the counterpart terminals receiving the same broadcast content as the first terminal 200.

This will be described in detail with reference to Figs. 11A to 11C.

Referring to FIG. 11A, the first terminal 200 receives a broadcast message from a specific counterpart terminal (not counted) receiving the same broadcast content (one of the counterpart terminals included in the conversation history or the identification information list) Request signal. The first terminal 200 may allow the user to select one of 'delete', 'individual', and 'image' together with a message informing that the conversation request signal is received.

Referring to FIG. 11B, when 'Personal' is selected in FIG. 11A, the second terminal 100 can send and receive a message according to the text conversation performed with the specific counterpart terminal (the number of the counterpart) 1110. At this time, the conversation contents included in the transmitted / received message may not be included in the conversation history displayed on the other terminal except for the first and second terminals 200 and 100 and the specific counterpart terminal 1110. [

Referring to FIG. 11C, the second terminal 100 can transmit and receive a video signal according to a video conversation performed with a specific counterpart terminal (not counted) 1110 when 'video' is selected in FIG. 11A. At this time, the image corresponding to the transmitted / received video signal may not be displayed on the other terminal except for the first and second terminals 200 and 100 and the specific counterpart terminal 1110.

According to the present invention, the first terminal 200 can display the dialog-related screen displayed using the first display unit 151-1, using the external display device, under the control of the first control unit 180-1 Can be displayed.

This will be described in detail with reference to Figs. 12A to 12C. For convenience of explanation, it is assumed that a video conversation / text conversation is being performed, and the third terminal 250 can be used as an external display apparatus. The external display device is an auxiliary display device of the first terminal 200 and may be previously registered in the management server 310 as an external device that receives and displays the dialog related screen from the first terminal 200, Software for performing a broadcast-related conversation service can be mounted.

12A, when the first terminal 200 displays the counterpart images 1101 to 1103 and the dialog-related screen 210 according to the execution of the video conversation / text conversation, Input can be received.

Here, the moving display command signal may be input by operating the remote controller of the first terminal 200 or the second terminal 100. [

12B, the first terminal 200 displays only the broadcast output screen, and the third terminal 250 (i.e., the third terminal 250) displays only the broadcast output image as the counterpart images 1101 to 1103 and the dialogue screen 210 are moved to the third terminal 250. [ Can display the partner images 1101 to 1103 and the dialogue-related screen 210. [

Referring to FIG. 12C, when the third terminal 250 receives the partner image and the dialog-related screen while displaying the web page according to the Internet connection, the third terminal 250 displays the web page, the partner images 1101 to 1103, 210 can be displayed together.

Next, a method of performing a broadcast-related conversation service using one terminal will be described (see FIG. 2B).

4 shows a flowchart of a method of performing a broadcast-related conversation service according to an embodiment of the present invention. For convenience of description, it is assumed that the terminal described below may include at least one of the components shown in FIG.

As shown in FIG. 4, the terminal 100 receives the first broadcast content using the wireless communication unit 110 (S410).

For example, when the first broadcast content is received through the broadcasting network, the broadcast receiving module 111 may receive the first broadcast content using the Internet module 113 when the first broadcast content is received through the Internet have.

The terminal 100 can output the received first broadcast content through the output unit 150 under the control of the control unit 180. [

The terminal 100 transmits / receives broadcast viewing information to / from the other terminal (s) using the wireless communication unit 110 (S420).

Here, the counterpart terminal (s) may include the terminal (s) previously registered in the management server 310 to perform a broadcast-related conversation service with the terminal 100. [

For example, the management server 310 receives broadcast viewing information from terminals registered to perform a broadcast-related conversation service and receives the same broadcast content (hereinafter, the same broadcast content) as the terminal 100 Or viewing the broadcast viewing information received from the terminals. Of course, the broadcast viewing information received from the terminal 100 may be transmitted to the terminals that are receiving (or viewing) the same broadcast content through the management server 310. [ In addition, the terminal 100 may receive broadcasting viewing information of all the other-side terminals, regardless of whether the same broadcasting contents are being received.

Here, the broadcast viewing information may include identification information of the terminal and identification information of the broadcast content currently being received (or being watched) using the terminal.

The terminal 100 may perform a broadcast related conversation service under the control of the controller 180 (S430).

The terminal 100 may perform a broadcast related conversation service at the request of the terminal user or may perform a broadcast related conversation service when receiving a request signal for performing a broadcast related conversation service from the outside through the wireless communication unit 110 .

This will be described in detail with reference to Figs. 13A and 13B.

Referring to FIG. 13A, the terminal 100 displays a key region 'dialog' 1301 for receiving an execution command signal of the broadcast-related conversation service in one area of the output screen of the first broadcast content, 1301 " is selected, an execution command signal of a broadcast-related conversation service can be input.

Meanwhile, although not shown in the drawings, the execution command signal can be received by using a key or a menu item for receiving the execution command signal of the broadcast-related conversation service.

Referring to FIG. 13B, when receiving an execution request signal for a broadcast-related conversation service from a specific counterpart terminal (Jane) receiving the same broadcast content, the terminal 100 displays a message informing the user of the broadcast- - Full, '' Dialogue service-Jane ', or' Cancel '.

For example, when the 'conversation service-all' is selected, the terminal 100 can perform a broadcast-related conversation service with all counterpart terminals receiving the same broadcast content. Alternatively, when the 'conversation service-Jane' is selected, the terminal 100 performs a broadcast-related conversation service only with a specific counterpart terminal (Jane) or performs a broadcast-related conversation service with all counterpart terminals receiving the same broadcast content However, data transmitted to and received from a specific counterpart terminal (Jane) may not be included in the conversation history. Alternatively, the terminal 100 may not perform the broadcast-related conversation service when 'cancel' is selected.

4, the terminal 100 receives the first broadcast content using the broadcast viewing information received in the receiving step (S420) under the control of the controller 180 when performing the broadcast related conversation service At least one counterpart terminal is identified (S440).

Here, the identified at least one counterpart terminal may be in a state of receiving and outputting the first broadcast content or in a state of watching the first broadcast content.

In operation S450, the terminal 100 displays a conversation-related screen for at least one counterpart terminal identified in the identifying step S440 under the control of the controller 180 when performing a broadcast-related conversation service.

Here, the conversation related screen may include at least one of the conversation history and the identification information list of the at least one counterpart terminal identified above.

The dialog-related screen displayed in the display step S450 may be provided directly from the management server 310 or may include information provided from the management server 310 (for example, broadcast viewing information for the identified at least one counterpart terminal , Conversation history, identification information, and the like).

Meanwhile, when the terminal 100 is provided with the conversation history or the identification information for all the counterpart terminals previously registered to perform the broadcast-related conversation service with the terminal 100, the control unit 180 controls the all Extracts only the conversation history or identification information for the counterpart terminal identified in the identification step S440 among the conversation history or identification information for the counterpart terminals and includes the extracted conversation history or the identification information list composed of the extracted identification information A dialog-related screen can be displayed.

In the display step S450, the terminal 100 can display the output screen of the first broadcast content and the dialog-related screen together.

Further, when the other party terminal receiving the same broadcast content is added, identification information or conversation contents of the added counterpart terminal may be included in the identification information list or conversation history.

A detailed description of the dialog-related screen will be made with reference to Figs. 7A to 7C described above.

The terminal 100 transmits data related to the execution of the broadcast related interactive service through the wireless communication unit 110 to the identified at least one counterpart terminal 100 in accordance with the control of the controller 180 (S460).

In addition, the terminal 100 can transmit and receive a video signal with the identified at least one counterpart terminal in the transmitting and receiving step S460. This is not limited to the case of performing video conversation.

The data in the transmission / reception step (S460) can be transmitted / received via the management server 310. [

The data in the transmission / reception step (S460) may include, for example, a message including a text type conversation content in the case of text conversation, a voice signal in the case of voice conversation, Signal may be included.

In addition, in the case of text chatting, conversation contents included in the message transmitted / received in the transmission / reception step (S460) can be displayed and included in the conversation history. In the case of video conversation, an image corresponding to the video signal transmitted / received in the transmission / reception step S460 may be displayed in one area of the screen through the display unit 151 of the terminal 100. [

Hereinafter, a process of performing a text conversation will be described with reference to FIGS. 14A and 14B.

14A, the terminal 100 can display the output screen of the first broadcast content and the dialogue-related screen 1420 together with the execution of the broadcast-related dialogue service. For convenience of explanation, it is assumed that a conversation history is displayed on the conversation-related screen 1420. [

14B, the terminal 100 displays the dialog history 1431 and the dialogue content input area 1432 on the dialogue-related screen 1420, and when the dialogue content input area 1432 is selected, And display the virtual keypad 1440 for reception.

For example, the virtual keypad 1440 can be displayed in an overlay format on the output screen of the first broadcast content.

Accordingly, the user can input the conversation contents using the virtual keypad 1440, and the entered conversation contents can be displayed in the conversation contents input area 1432. [ When a transmission command signal of the input conversation content is inputted, a message including the input conversation content is transmitted to the management server 310, and the conversation contents of the transmitted message may be displayed in the conversation history .

Hereinafter, a process of performing a video conversation will be described with reference to FIGS. 15A to 15C. 15A to 15C can be applied to the case of transmitting / receiving a video signal to / from the identified at least one counterpart terminal even when the video conversation is not performed.

When performing video communication, the terminal 100 receives each video signal (hereinafter referred to as a counterpart video signal) from the counterpart terminals receiving the same broadcast content using the wireless communication unit 110. [ At this time, each counterpart video signal can be received via the management server 310.

The terminal 100 may transmit a video signal (hereinafter referred to as a user video signal) input through the camera 121 to the management server 310 when video conversation is performed.

15A, the terminal 100 can display an image corresponding to each of the received counterpart video signal and the transmitted user video signal using the display unit 151. FIG.

Further, the terminal 100 can identify (CAMOFF) the counterpart terminal (the nominal) with which the camera (or webcam) is disabled on the conversation history.

 The terminal 100 can determine the degree of motion of an object included in a video signal (including a counterpart video signal and a user video signal) using the control unit 180. [

The terminal 100 can identify and display the image corresponding to the determined degree of motion under the control of the controller 180. [

For example, the degree of motion may be determined based on the motion of the object, the number of motion of the object, and the intensity of the voice signal synchronized with the video signal.

15B and 15C, the size of the image 1503 is increased to a certain level or more (FIG. 15B) or the size of the image 1503 is increased as the number of motions increases, the strength of the synchronized voice signal increases, (Fig. 15C).

On the other hand, although not shown in the drawing, the terminal 100 can transmit a camera activation request signal to a counterpart terminal (camera) in which the camera is deactivated, so that the camera of the counterpart terminal (base station) can be activated.

According to the present invention, the user input unit 130 selects a specific opponent terminal using the dialog-related screen, and the radio communication unit 110 transmits the broadcast-related conversation with the selected specific opponent terminal under the control of the controller 180 Service can be performed.

This will be described in detail with reference to Figs. 16A to 16D.

According to FIG. 16A, the terminal 100 can select a specific counterpart terminal (not shown) 1601 by using the conversation history from the user.

16B, the terminal 100 allows the user to perform a text conversation (Text) with a specific counterpart terminal (base) selected in FIG. 16A, a video conversation / text conversation And a pop-up window 1610 for selecting the display.

Referring to FIG. 16C, when the video / text is selected in FIG. 16B, the terminal 100 transmits / receives a message including a video signal and a textual conversation content according to a specific conversation terminal / can do.

At this time, the video signal and the conversation contents transmitted and received between the terminal 100 and the specific counterpart terminal (nominal) may not be displayed in the terminals other than the terminal 100 and the specific counterpart terminal (nominal).

In addition, according to FIG. 16D, the terminal 100 can transmit a performance request signal of a broadcast-related conversation service to a specific counterpart terminal (not shown) that is receiving the same broadcast content but does not currently perform a broadcast-related conversation service.

According to the present invention, the terminal 100 can receive the conversation request signal from the specific counterpart terminal using the wireless communication unit 110 during the execution of the broadcast-related conversation service. At this time, the specific counterpart terminal may be one of the counterpart terminals receiving the same broadcast content as the terminal 100.

This will be described in detail with reference to Figs. 17A to 17C.

Referring to FIG. 17A, the terminal 100 can receive a conversation request signal from a specific counterpart terminal (unexecuted) which is receiving the same broadcast content during the execution of the broadcast-related conversation service. In addition, the terminal 100 may allow the user to select one of 'delete', 'individual', and 'image' together with a phrase informing reception of the conversation request signal.

Referring to FIG. 17B, when 'Personal' is selected in FIG. 17A, the terminal 100 can send and receive a message according to a specific conversation terminal and a specific conversation terminal (not counted). At this time, the conversation contents included in the transmitted and received messages are displayed only in the terminal 100 and the specific counterpart terminals (1422), and may not be included in the entire shared conversation history (1421).

Referring to FIG. 17C, when 'video' is selected in FIG. 17A, the terminal 100 can transmit and receive a video signal according to a video conversation performed with a specific counterpart terminal (not counted). At this time, the image corresponding to the transmitted / received video signal can be displayed only in the terminal 100 and a specific counterpart terminal (not yet counted).

According to the present invention, the terminal 100 may display a dialog-related screen displayed using the display unit 151 using an external display device under the control of the control unit 180 (Figs. 12A to 12C Reference).

According to the present invention, a broadcast-related interactive service can be performed by a notebook computer alone, and a specific embodiment in which the service is performed by a notebook computer will be described.

This will be described with reference to Figs. 18A to 18D. For convenience of explanation, the description will be made only when the first terminal 200 is a digital TV and the third terminal 250 is a notebook computer.

18A, when receiving the menu icon display command signal from the user in the web page display state according to the web connection, the notebook computer 250 displays the icon 1810 of the broadcast related dialog service while maintaining the web page display state Can be displayed.

18B, the icon 1810 is displayed with a preview screen 1801 of broadcast contents (hereinafter referred to as recent broadcast contents) currently provided in the broadcast channel most recently used through the notebook computer 250 or the digital TV 200, (5) 1802 receiving the broadcast content, and the number of the other party terminals (3) 1803 performing the broadcast-related conversation service among the counterpart terminals currently receiving the broadcast content can be displayed. In addition, an area (dialogue) 1804 for receiving an instruction to perform conversation with the counterpart terminal performing the broadcast-related conversation service, and an area (conversation + broadcast) 1805 for receiving a command for outputting the latest broadcast content and performing conversation are displayed .

18C, when the dialog 1804 is selected, the notebook computer 250 performs a broadcast-related conversation service and displays a web page and a dialog-related screen 1820 (including the other party / user image in the case of video conversation) Can be displayed together. At this time, the digital TV 200 can receive and output recently broadcast contents.

18D, when the conversation + broadcast 1805 is selected, the notebook computer 250 performs a broadcast-related conversation service and displays an output screen of the latest broadcast content and a dialog-related screen 1820 together .

In addition, according to an embodiment of the present invention, the above-described broadcast-related interactive service execution method can be implemented as a code readable by a processor on a medium on which a program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The above-described terminal, communication system, and broadcasting-related interactive service performing method of the present invention are not limited to the configuration and method of the above-described embodiments, but the embodiments can be implemented by various implementations All or some of the examples may be selectively combined.

100: terminal, second terminal
200: first terminal
250: Third terminal
310: Broadcast-related conversation service management server
210: Dialog related screen

Claims (26)

A wireless communication unit that receives the first broadcast content and transmits and receives broadcast viewing information to the other terminal;
A control unit that identifies at least one counterpart terminal that is currently receiving the first broadcast content using the received broadcast viewing information and controls an operation of performing a broadcast related conversation service with the identified counterpart terminal; And
And a display unit for displaying a conversation related screen including at least one of a conversation history and an identification information list of the identified at least one terminal under the control of the controller when performing the broadcast related conversation service,
Wherein the control unit controls the wireless communication unit to transmit and receive data and video signals according to performance of the broadcast related interactive service to the identified at least one terminal and to display an image corresponding to the video signals transmitted and received,
Determines the degree of motion of an object included in the video signal received from each of the identified counterpart terminals, and controls to identify and display an image corresponding to each of the received video signals corresponding to the determined degree of motion terminal. The method according to claim 1,
And identification information of the other party terminal and identification information of the broadcast content currently being watched by each of the at least one counterpart terminals previously registered to perform the broadcast-related conversation service with the terminal. delete The method according to claim 1,
The wireless communication unit includes:
Receiving an execution request signal of the broadcast-related conversation service from outside,
Wherein,
And performs the identification operation of the counterpart terminal and the control operation of the broadcast related conversation service upon receiving the execution request signal. The display device according to claim 1,
And displays the output screen of the received first broadcast content and the dialog-related screen together under the control of the control unit. delete The method according to claim 1,
Further comprising a user input unit for selecting a specific counterpart terminal using at least one of the conversation history and the identification information list,
The wireless communication unit includes:
And performs a broadcast-related conversation service with the selected specific counterpart terminal under the control of the controller. 8. The method of claim 7,
Wherein the conversation contents included in the message transmitted and received between the terminal and the selected specific counterpart terminal are not included. The method according to claim 1,
Wherein,
Related screen to be displayed using an external display device,
The external display device includes:
Wherein the terminal is registered as a secondary display device of the terminal to receive and display a dialog-related screen from the terminal. The display device according to claim 1,
Wherein the terminal identifies whether or not to perform the current broadcast related conversation service for each of the identified at least one counterpart terminal using at least one of the conversation history and the identification information list under the control of the controller. The wireless communication system according to claim 1,
And transmits a request signal of the broadcast-related conversation service to a specific counterpart terminal that is not currently performing a broadcast-related conversation service among the at least one counterpart terminal identified under the control of the controller. delete delete delete delete delete delete delete delete delete Receiving first broadcast content;
Transmitting and receiving broadcast viewing information to and from a remote terminal;
Identifying at least one counterpart terminal currently receiving the first broadcast content using the received broadcast viewing information;
Performing a broadcast related conversation service with the identified at least one counterpart terminal;
Displaying a conversation related screen including at least one of the conversation history and the identification information list of the identified at least one terminal upon performing the broadcast related conversation service;
Transmitting and receiving data and video signals according to performance of the broadcast related interactive service with the identified at least one counterpart terminal;
Determining a degree of motion of an object included in the video signal received from the at least one counterpart terminal; And
And identifying and displaying an image corresponding to each of the received video signals corresponding to the determined degree of motion. delete delete delete delete delete

Images