KR101772075B1 - Chatting meth using broadcasting channel synchronization in tv and mobile terminal - Google Patents

Abstract

The present invention relates to a method of chatting through broadcast channel synchronization in a TV and a mobile terminal, in which at least one user is invited to chat while viewing a TV, and when a message is input, a speech balloon pops up in a chat area on the TV screen, The message is directly mapped to the image, so that the user who receives the message can easily recognize the user, thereby emphasizing the scene and making the user entertained. Accordingly, the present invention has an effect that an optimum chat environment can be implemented by interlocking the TV and the mobile terminal to show the conversation contents most effectively on the TV and text input through the mobile terminal.

Description

TECHNICAL FIELD [0001] The present invention relates to a chatting method using broadcast channels in a TV and a mobile terminal,

The present invention relates to a chatting method using broadcast channel synchronization capable of performing chatting through a TV screen through channel synchronization during TV watching.

The mobile terminal may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some mobile terminals include additional functions to execute games, and some other mobile terminals are also implemented as multimedia devices. Moreover, recent mobile terminals can receive a broadcast or multicast signal to view a video or television program.

Efforts are continuing to support and enhance the functions of the mobile terminal. Such efforts include not only changes and improvements in structural components that form the mobile terminal, but also improvements in software or hardware. Among them, the touch function of the mobile terminal allows a user who is unfamiliar with the button / key input to conveniently perform the operation of the terminal by using the touch screen. In recent years, not only simple input but also user interface (UI) Is becoming an important function of Accordingly, as the touch function is applied to a mobile terminal in various forms, development of a user interface (UI) corresponding thereto is further demanded.

In addition, recent TVs are not only simply watching broadcast programs, but also developing various multimedia software with various functions such as selection of favorite channels, storage, and various other functions.

Accordingly, if a variety of UIs that can be performed between the TV or the TV and the mobile terminal during the TV watching are developed and provided, the user can enjoy watching TV more. For example, if a user invites friends through a TV or a mobile terminal while watching a specific broadcast program and shares opinions while viewing the same broadcast program or supports a specific athlete in the case of a sports event, the satisfaction of the broadcast viewing may be further increased.

It is an object of the present invention to provide a method of chatting while watching a broadcast of the same channel in synchronization with another person on a TV channel.

It is another object of the present invention to provide various user interfaces that are useful when chatting by sharing a TV channel.

In order to accomplish the above object, there is provided a method of chatting through broadcast channel synchronization, the method comprising: executing a chat application while viewing a broadcast program; When the user to be invited is selected in the chat application, automatically transmitting an invitation message to the users; Displaying an image box of a user in response to the invitation on a predetermined chat area of a broadcast screen; And displaying the chat contents on the chat area by inputting text through the mobile terminal while viewing the broadcast program.

When the chat application is executed, the TV and the mobile terminal are connected to each other by the DLNA function.

The broadcast program and the chat application are selectively executed on a TV or a mobile terminal.

The invitation message includes a message indicating whether the invitation is accepted or not, and a channel number and name currently being watched.

The chat area may automatically disappear or be forcibly hidden if chat contents are not input for a predetermined time, and an image box including the image and name of the user is displayed in the chat area in the order of invitation.

The image box changes to a semi-transparent state when chat contents are not input for a predetermined time.

When the invited user's TV is in the off state, the TV is automatically turned on and then synchronized with the same channel. When the invited user watches the TV, the chat program is automatically changed.

When the chat application is executed in the TV, the text input through the mobile terminal is provided to the message input window according to the input request of the TV, and the text input is performed in the corresponding message input window.

The chat content is displayed in a chat area on the chat area, and the shape and size of the chat area are optimized for the length of the text.

The size of the image box is enlarged when chat contents are input. When the gesture is inputted using the remote control unit of the mobile terminal or the TV, the image box continuously changes for a predetermined time.

In order to accomplish the above object, a mobile terminal according to an embodiment of the present invention includes a display unit for displaying a message input window and an invitation list; A wireless communication unit for transmitting an invitation message to invited users; And a control unit for automatically connecting to the TV when the chat program is executed while watching TV, performing a chat with the invited users through the message input window, and displaying the chat content on a predetermined chat area of the TV screen.

When the user to be invited is selected from the invitation list, the control unit automatically transmits an invitation message to the user, and displays the image box of the user corresponding to the invitation on the chat area of the TV screen.

When the chat application is executed, the TV and the mobile terminal are connected to each other by the DLNA function.

The invitation message includes a message indicating whether the invitation is accepted or not, and a channel number and name currently being watched.

The control unit switches the screen to the message input window when the invitation message is transmitted, and displays the image box including the user's image and name in the order of the invitation in the chat area of the TV screen.

The chat area automatically disappears if no chat content is input for a predetermined time, and the image box changes to a semi-transparent state when chat content is not input for a predetermined time.

In response to the invitation, the invited users access the chat window after executing the same chat program. If the invited user's TV is in the off state, the invited users automatically turn on the TV and synchronize with the same channel, When you run the chat program in the presence of the channel will automatically change.

When the chat application is executed in the TV, the text input through the mobile terminal is performed in the message input window according to the input request of the TV.

The control unit displays chat contents in a chat area in the form of speech balloons, and the form and size of the speech balloons are displayed optimally for the text length.

The size of the image box is enlarged when chat contents are input. When the gesture is input using the mobile terminal, the image box continuously changes for a predetermined time.

In the TV and mobile terminal according to the above-described embodiments, at least one or more users are invited to chat while viewing a TV, and when a message is received, popping up a speech balloon prompts an immediate response, It is possible to easily identify the user who has received the message by directly mapping it with the image, thereby emphasizing the scene and giving the user a lot of fun.

In addition, the present invention minimizes the viewing window screen during chatting by displaying the chatting contents using a variable space while minimizing the viewing screen when performing chatting while watching TV.

In addition, the present invention can optimize the chat environment by efficiently interlocking the TV with the mobile terminal, displaying the conversation contents most effectively on the TV, and text input through the mobile terminal.

In addition, the present invention has the effect of reflecting a natural emotion in a chat by giving motion to a photo image displayed in a chat area by a gesture (an operation of shaking the RCU or a mobile terminal).

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
2 is a block diagram of a wireless communication system in which a mobile terminal may operate in accordance with an embodiment of the present invention.
FIG. 3 illustrates an example of a home screen for activating a chat program using Netcast during TV viewing in an embodiment of the present invention; FIG.
4 is a diagram illustrating an example of a chat screen according to an embodiment of the present invention.
5 is a view showing an example of transmitting an invitation message when Crowd Surfing is executed on a TV.
6A to 6C are views illustrating an example of transmitting an invitation message when Crowd Surfing is executed in a mobile terminal.
7 is a diagram illustrating an example of performing SMS notification and setting of invitation partners when Crowd Surfing is executed in a mobile terminal.
8 shows an example in which users invited by an SMS message participate in a chat;
9A and 9B are views showing an example of a TV screen including a chat area in the embodiment of the present invention.
10 is a diagram illustrating an example of requesting text input from a TV to a mobile terminal when Crowd Surfing is executed on a TV.
11 is a diagram showing a change of an image box and a speech balloon when chatting.
12 is a view showing an example of a screen display when a chat hiding item is selected during chatting;
13 shows an example of adjusting the size of the chat area according to the broadcast status.
14A and 14B illustrate an example in which a user's emotion is reflected in a chat.
15 is another example of displaying a stored chat message.
16 is a flowchart illustrating a method of chatting using broadcast channel synchronization in a TV and a mobile terminal according to an embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, it should be noted that the above-mentioned "module" and "part"

The terminal may be implemented in various forms. For example, the terminal described in this specification may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) And fixed terminals such as a digital TV, a desktop computer, and the like. In the following description, it is assumed that the terminal is a mobile terminal. However, it will be readily apparent to those skilled in the art that the configuration according to the following description may be applied to the fixed terminal, except for components specifically configured for mobile use.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. 1 shows a mobile terminal having various components. However, not all illustrated components are required. A mobile terminal may be implemented by more components than the illustrated components, or a mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more components that allow wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network on which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and the wireless Internet module 113 can be built in or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the position information module 115 is a Global Position System (GPS) module. According to the present technology, the GPS module calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain three-dimensional current position information according to latitude, longitude, and altitude It can be calculated accurately. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module can calculate speed information by continuously calculating the current position in real time.

An audio / video (A / V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display module 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display module 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. Also, it is responsible for a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. This will be discussed later in connection with touch screens.

The sensing unit 140 includes a geomagnetic sensor for calculating the direction of movement when the user moves, a gyro sensor for calculating the direction of rotation, and an acceleration sensor for calculating the moving distance by multiplying the stride of the user by one step .

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, Video input / output (I / O) ports, earphone ports, and the like.

Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) ), A Universal Subscriber Identity Module (" USIM "), and the like. In addition, an apparatus having an identification module (hereinafter referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device.

The interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display module 151, an audio output module 152, and an alarm unit 153.

The display module 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. If the mobile terminal 100 is in the video communication mode or the photographing mode, the captured image and / or the received image or UI and GUI are displayed.

Meanwhile, as described above, when the display module 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display module 151 can be used as an input device in addition to the output device. The display module 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). Some of these displays can be configured to be transparent so that they can be viewed from outside. This may be referred to as a transparent display. A typical example of the transparent display is a transparent organic light emitting diode (TOLED) or the like. In addition, there may be two or more display modules 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may be provided with an external display module (not shown) and an internal display module (not shown) at the same time. The touch screen may be configured to detect not only the touch input position and area but also the touch input pressure.

The audio output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for informing occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When a call signal is received or a message is received, the alarm unit 153 can output a vibration to notify it. Alternatively, when the key signal is input, the alarm unit 153 can output the vibration by the feedback to the key signal input. The user can recognize the occurrence of an event through the vibration output as described above. Of course, a signal for notifying the occurrence of an event may also be output through the display module 151 or the sound output module 152. [

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input / output data (e.g., a phone book, a message, a still image, . In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- And an optical disc. Also, the mobile terminal 100 may operate a web storage for performing a storage function of the memory 160 on the Internet.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 as a battery, and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

In the foregoing, the mobile terminal related to the present invention has been described in terms of components according to functions. Hereinafter, the mobile terminal related to the present invention will be further described with reference to FIGS. 2 and 3 in view of the components according to the outline. Hereinafter, for simplicity of explanation, a slider type mobile terminal will be described as an example among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, and the like. Therefore, the present invention is not limited to the slider type mobile terminal but can be applied to all types of mobile terminals including the above-mentioned type.

The terminal 100 shown in Fig. 1 is configured to be operable in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system .

Hereinafter, a communication system capable of operating a terminal according to the present invention will be described with reference to FIG.

The communication system may use different air interfaces and / or physical layers. For example, wireless interfaces that can be used by communication systems include, but are not limited to, Frequency Division Multiple Access ('FDMA'), Time Division Multiple Access ('TDMA'), Code Division Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM) . Hereinafter, for the sake of convenience of description, the description will be limited to CDMA. However, the present invention is applicable to all communication systems including CDMA wireless communication systems.

2, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275 , And a mobile switching center ('MSC') 280. MSC 280 is configured to be coupled to a Public Switched Telephone Network (" PSTN ") 290, and is also configured to be coupled to BSCs 275. BSCs 275 may be coupled in pairs with BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may comprise at least one sector, and each sector may comprise an omnidirectional antenna or an antenna pointing to a particular direction of radial from BS 270. [ In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments and each of the plurality of frequency assignments has a specific spectrum (e.g., 1.25 MHz, 5 MHz, etc.).

The intersection of sector and frequency assignment may be referred to as a CDMA channel. BS 270 may be referred to as a Base Station Transceiver Subsystem (BTSs). In this case, the word "base station" may be referred to as a combination of one BSC 275 and at least one BS 270. [ The base station may also indicate a "cell site ". Alternatively, each of the plurality of sectors for a particular BS 270 may be referred to as a plurality of cell sites.

2, a broadcasting transmitter (BT) 295 transmits a broadcasting signal to the terminals 100 operating in the system. The broadcast receiving module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 2 illustrates several Global Positioning System ('GPS') satellites 300. The satellites 300 help to locate at least one of the plurality of terminals 100. Although two satellites are shown in FIG. 2, useful location information may be obtained by two or more satellites. The location information module 115 shown in FIG. 1 cooperates with satellites 300 to obtain desired location information. Here, you can track your location using all of the technologies that can track your location, as well as your GPS tracking technology. Also, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

Among the typical operations of a wireless communication system, the BS 270 receives a reverse link signal from the various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by the particular base station 270 is processed by the particular base station 270. The data resulting from the processing is transmitted to the connected BSC 275. The BSC 275 provides call resource allocation and mobility management functions, including the organization of soft handoffs between the base stations 270. The BSC 275 also transmits the received data to the MSC 280 and the MSC 280 provides additional transmission services for connection with the PSTN 290. [ Similarly, the PSTN 290 connects to the MSC 280, the MSC 280 connects to the BSCs 275, and the BSCs 275 communicate with the BSs 270 ).

The present invention proposes that at least one user can perform a chat while watching a broadcast of the same channel in synchronization with another person on a TV channel.

That is, the present invention proposes a method of performing a chat through the DLNA device while watching TV through information sharing between a TV and a DLNA (Digital Living Network Alliance), and displaying the chat message on a TV screen. The DLNA includes SMS, IM and SNS through a mobile terminal. In addition, the chat program can be executed on a TV or a mobile terminal when performing a chat during a broadcast.

For example, when a chat program (Crowd Surfing) is executed on a mobile terminal, the mobile terminal can be automatically connected to a TV. When a chat program is first executed on a TV, the mobile terminal requests input necessary for chatting.

Access to chat program (Access)

FIG. 3 shows an example of a home screen for activating a chat program using Netcast during TV viewing in an embodiment of the present invention.

As shown in FIG. 3, when a user enters a home screen using Netcast while watching a specific sports game, a plurality of broadcast programs composed of an application name and a representative icon are displayed on the screen. Among them, when the user focuses on the chat program (Crowd Surfing) (in proximity), its size is displayed larger than other applications.

When the user selects the chat program, various execution items are displayed in the key help area (key help area) 50 at the lower end of the screen as shown in FIG. The execution item includes, for example, Invitation, Setting, Hide Chat, and EXIT items. The keyhelp area 50 is also used for a predetermined time (for example, 10 seconds ) Disappears when there is no input, and is displayed again when there is an input of a remote control unit (RCU). FIG. 4 shows an example of a chat screen according to an embodiment of the present invention.

The invitation icon is an icon for a user to invite while watching TV, and the setting icon is an icon for setting various information about a partner to be invited, and the chat icon is an icon for chatting with invited users. The termination icon is an icon for executing the termination of the chat program (Crowd Surfing). When the termination key is selected, a message asking whether the crowd surfing is ended is displayed.

Invitation

With crowd surfing running, "Invitation" is performed by selecting an invitation icon (or invitation key). Crowd surfing can be performed on a mobile terminal or TV. Hereinafter, the invitation and the chatting operation when Crowd Surfing is executed in the TV or mobile terminal will be described in detail.

FIG. 5 shows an example of transmitting an invitation message when Crowd Surfing is executed on a TV.

As shown in FIG. 5, after the crowd surfing is performed on the TV, when the user selects the invitation icon on the initial screen of crow surfing, a list 51 of friends to be invited is displayed on the screen. The invitation list 51 is a list obtained from the server. Only limited persons are displayed in the invitation list 51, and if there are more lists, a clue is displayed on the right (or left).

In the invitation list 51, the user searches the list by moving the focus at the first check box (initial focus position) using the left and right direction keys of the remote control unit (RCU).

If a focus is placed on a photograph or a check box of a desired user during the search, the user to be invited is designated by pressing an OK button. When the user setting to be invited is completed, the user moves the focus to the OK button by using the down direction key, and then selects the OK button by using the RCU. The number of users to be invited is limited to a maximum of 6-7 persons in order to correct a minimum viewing situation.

If the OK button is selected, the control unit (not shown) of the TV transmits an SMS message to the mobile terminal of the selected invitee and displays a message indicating that the transmission of the SMS message is completed on the TV screen as a pop-up Display. The pop-up 52 disappears automatically when the 'OK key' is selected or there is no key input for a predetermined time (about 3 seconds).

6A to 6C show an example of transmitting an invitation message when Crowd Surfing is executed in the mobile terminal.

When a user executes Crowd Surfing using the mobile terminal while watching TV, the mobile terminal is automatically connected to the TV by the DLNA function. 6A and 6B, the control unit 180 displays an invitation list for selecting a user to be invited on the screen, selects a user to be selected by the user from the invitation list, A pop-up asking whether to send the message is displayed.

When the user selects transmission of the SMS message, the SMS message is transmitted to the selected user and a chat window is displayed on the screen as shown in FIG. 6C. At this time, if the invited user accepts the invitation, the image box of the user who accepted the invitation is displayed on the TV screen in the form of a thumbnail.

In particular, when Crowd Surfing is executed in the mobile terminal, the user can set the SMS notification and the invitee (friend) through the setting item in the initial screen (Fig. 6A) as shown in Fig. When the user turns on the SMS notification, the user can receive an invitation from a friend when offline, and if a specific invitation status is selected, detailed information on the SMS is displayed.

FIG. 7 shows an example of performing an SMS notification and a setting for a invitee when performing Crowd Surfing in a mobile terminal, and FIG. 8 is an example in which users invited by an SMS message participate in a chat.

When an SMS message is received from the TV or the mobile terminal, the control unit 180 of the invited user, along with a TV channel name (for example, 'Channel 12, Sports of the Day') in a predetermined pop- A notification message (SMS notification) indicating that the current chat is requested is displayed. That is, it provides a menu to join the chat.

In addition, the control unit may provide a message to the user to select whether to set the viewing device to the TV or the mobile terminal when the chat request is received.

If the user selects to participate in the message and selects viewing on the TV, the control unit 180 stores the received SMS message in the inbox and performs a crowd surfing and displays a chat window. At this time, if the TV is off, it is automatically turned on and then synchronized with the TV channel ('Channel 12, Sports of Today') displayed in the SMS message. If the TV is in the ON state and the other channel is being watched, the corresponding channel is automatically changed to the channel 12 ('Today's Sports').

In addition, if the TV can not be found after the Crowd Surfing is performed, a pop-up message accompanied by a message saying that the TV can not be found is provided so that the user can select whether to continue the Crowd Surfing without the TV or to terminate the Crowd Surfing . If the user continues Crowd Surfing without V, only the mobile terminal can chat.

Accordingly, when the users who have received the SMS message respond to the invitation, the images and names of the users who have accepted the invitation are displayed on the TV screen of the inviting user, so that chat can be performed while watching the same channel 12 do.

In the present invention, when chatting while watching TV, the viewing screen and the current conversation contents are displayed most effectively through the TV, and operations, text input, and emoticon input are basically performed through the mobile terminal.

Chatting

9A and 9B show an example of a TV screen including a chat area in the embodiment of the present invention. FIG. 9A is a chat screen when Crowd Surfing is executed on a TV, and FIG. 9B is a chat screen when Crowd Surfing is executed on a mobile terminal. The two screens are basically the same except that the setting items are displayed at the bottom. That is, since the TV is controlled through the RCU and the mobile terminal is controlled through the menu setting, as shown in FIG. 9A, when performing Crowd Surfing on the TV, a setting item should be displayed at the lower part of the screen.

As shown in FIGS. 9A and 9B, when the invited users respond to the invitation, the image box of the user responding to the invitation is displayed in the form of a thumbnail in the chat area 53 on the right side of the TV screen. At the top of this screen, the first invited user is displayed, and below that, the invited users are displayed.

The display order of the image boxes is displayed in the order of the invitation. In each image box, a user (friend) participating in the chat displays an image (photo) and a name.

When a specific user sends a message, the size of the image box of the user becomes large. In the case where the conversation does not proceed for a certain period of time (for example, one minute), each image box becomes translucent.

FIG. 10 shows an example of requesting text input from a TV to a mobile terminal when Crowd Surfing is executed on a TV.

As described above, in the case where the crowd surfing is executed in the mobile terminal, if the user responds to the invitation after transmitting the SMS message, the text can be directly input in the chat window as shown in FIG. 6C. However, when Crowd Surfing is executed on the TV, the mobile terminal requests text input, and the mobile terminal provides an input window according to the text input request.

In the present invention, text input is basically performed in the mobile terminal.

9A and 9B), each user can input a character using the mobile terminal. At this time, the input of the text in the mobile terminal is performed according to the message input request of the TV.

When the user requests a message (or text) input to the mobile terminal using the RCU, the controller 180 of the mobile terminal displays a message on the pop-up message that the message is requested from the TV. When the user confirms the message, the controller 180 displays the chat message list, and when the user selects the message input, the message creation window is displayed.

Therefore, a user who transmits a chat message creates and sends a desired message in the message creation window, and the transmitted message is displayed in a chat mode on a chat screen.

Fig. 11 shows the change of the image box and the speech balloon during chatting.

As shown in FIG. 11, the size of the image box in which the message is received in the chat screen increases while maintaining the interval between the image boxes.

Then, the received message is displayed on the left side of the image box (so as not to invade another image box) in a speech balloon shape. The shape and size of the speech bubble are optimized for the length of the text, and if the text input occurs within 5 seconds, the content is updated and if there is no input for 5 seconds, it disappears automatically.

As with the SMS, the input is limited to 80 characters (including spaces), and up to 20 characters can be displayed on one line. Also, if the color of the balloon is basically set to white, the most recently received message is set to yellow. The shape, shape and color of the speech balloon may be arbitrarily set by the user.

FIG. 12 shows a screen display in the case where the chat hide item is selected during chatting in the embodiment of the present invention.

In the present invention, the hide chat function is divided into automatic hide and forced hide. The automatic hide is to hide the key help area 50 and the chat area 52 automatically when the chat screen does not change for 5 minutes. In addition, forced hide means that a hide chat item is selected in the key help area 50 or a forced hide function is set using the right arrow key (▶).

That is, as shown in FIG. 12, when the 'hide chat' item is selected by the RCU, the key help area 50 and the chat area 52 are hidden and the chat hide function is set on the right side of the screen The screen display (left arrow key) appears.

If the auto hide feature is enabled, it returns to the original chat screen when a new message is created. On the other hand, when the forcible hiding function is set, the display button is selected by using the RCU or the hidden key help area 50 and the chat area 52 are displayed by using the left key. Particularly, when a new message is generated in the forced hide state, the screen display (left direction key) is blinked to notify the user that a new message has been generated.

The present invention can reflect a user's emotion during a chat in a chat window. That is, when Crowd Surfing is executed on the TV, the size and shape of the image box can be changed by shaking the RCU. If Crowd Surfing is executed on the mobile terminal, the size and shape of the image box are changed by shaking the mobile terminal can do.

FIG. 13 shows an example of adjusting the size of the chat area according to the broadcast status.

If the broadcast condition is not good during a chat, chatting may be more important than watching the broadcast itself. Accordingly, when the reception sensitivity of the broadcast signal falls below a predetermined level or the error rate (bit error rate, block error rate, etc.) becomes a predetermined value or less, the size of the chat area 53 is automatically increased, It can be widely used as a screen. When the broadcast state is good, the chat area 53 is displayed in its original size so that a chat can be performed while watching a broadcast channel.

14A and 14B show an example in which a user's emotion is reflected in a chat.

14A shows an emoticon 54 set in the image box displayed in the chat area 53 instead of the image of the user. The setting of the emoticon 54 can be set in the 'imoticon item'. 14B shows an example in which a gesture of a user, that is, an image box displayed in the chat area 53 when the mobile terminal or the RCU is shaken is shaken together with a sound effect.

At this time, the degree to which the image box changes is user-configurable, and the user can select whether the gesture of one person is reflected only in one image box or in the entire image box. You can also set whether multiple gestures will be reflected in the entire image box.

Save chat content

When chatting is performed while watching the TV, the contents of each chat are stored in the memory 160 of the mobile terminal. The stored contents can be stored for each program or stored in chronological order. At this time, the contents of the message can be stored together with the captured specific broadcast scene, and the streaming reproduction can be performed on the scene captured together with the chat contents in the future.

15 is another example of displaying a stored chat message.

As shown in FIG. 15, the chat message is displayed on the current side of the screen in the form of a bar graph as much as the number of persons performing the chat, and the captured screen (chat screen) is displayed on the screen. At the top of the bar graph, an icon or name for identifying the user is displayed, and a chat content (message) is displayed below the bar graph. When a particular bar graph is selected, the user's full chat message is displayed.

16 is a flowchart illustrating a method of chatting using broadcast channel synchronization in a TV and a mobile terminal according to an embodiment of the present invention.

As shown in FIG. 16, the user executes an application (Crowd Surfing) using a TV or a mobile terminal while watching a TV (channel 12, today's sports) of a specific channel, and selects a user to be invited , S11).

When a user to be invited is selected, an invitation message (SMS message) is transmitted to the users (S12), and the received message is displayed on the mobile terminal of the invited user.

When the user who receives the invitation message receives the invitation, Crowd Surfing is executed and directly connected to the chat window, and the channel of the TV is automatically changed to the channel 12 and the sports channel so that the channel synchronization is performed.

Also, if the user who has received the invitation message responds to the invitation, the names and pictures of the users (friends) to chat in the chat area are displayed. Accordingly, the caller and the receiver simultaneously perform the chat while watching the same broadcast through the channel synchronization (S14).

The chat contents are transmitted through a chat window of the mobile terminal. Since the TV or the mobile terminal is connected by the DLNA function, the input contents are displayed on the chat screen of the TV in the form of speech balloon (S14). In addition, for quick input, the present invention can use emoticons, and emotions can be expressed using a gesture that shakes the mobile phone.

For example, suppose that a user a is watching Kim's figure skating performance through Channel 12's '2010 World Figure Skating Championships'. A user who wants to chat with friends with excitement after seeing the good performance of Kim Yu-na plays Crowd Surfing using TV or mobile terminal, and invites friends (user b ~ user e) who want to chat send. The invitation character includes a message asking whether to accept the invitation and a channel number.

Of the friends (users b to e) who have received the invitation letter, the friends (users b to c) who are watching TV are all synchronized with the same channel (channel 12) d ~ user e) will automatically connect to channel 12 that user a requested to chat after the TV power is turned on automatically. At this time, Crowd Surfing is automatically executed on the TVs of the users b to e, and the names of the users a to e and the images of the pictures to be chatted are displayed in the chat area of the TV screen.

Accordingly, the users a through e all enter the message through the chat window of the mobile terminal while viewing the act of Kim Yu-na through the channel 12, and the input message is displayed on the chat screen of the TV. If Kim Jin-ja has won the gold medal afterwards, he / she is excited and shakes his / her mobile terminal and shakes the image of user a ~ user e displayed in the chat area of the TV screen.

Thus, the present invention provides a natural interface that reflects experiences during watching TV with people. In other words, when a message is received, the speech bubble pops up to induce an immediate response. In addition, the message is directly mapped to the image, so that the user who receives the message can be easily recognized, and the dialogue scene can be recognized by the continuous screen change in which the speech balloon and various display items disappear and are generated. And can be fun to the user.

 In addition, the present invention displays chat contents using a variable space while minimizing a viewing screen when chatting while watching TV. That is, since the verbal abundance is generated in accordance with the length of the text, there is no need to conserve space in consideration of the long text. Particularly, when there is no message, since the chat area temporarily disappears, the screen area is minimized by the chat area.

In addition, the present invention can reflect a natural emotion in a chat by giving movement to a photographic image displayed in a chat area by a gesture, for example, an operation of shaking the RCU or the mobile terminal.

According to an embodiment of the present invention, the above-described method can be implemented as a computer-readable code on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Further, the computer may include a control unit of the terminal.

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

110: wireless communication unit 111: broadcast receiving module
112: mobile communication module 113; Wireless Internet Module
140; Sensing unit 150: output unit
151: display unit 160: memory
180:

Claims (22)

Executing a chat application while watching a broadcast program through a TV;
Transmitting an invitation message to the users automatically when a user to be invited is selected in the chat application;
Displaying a plurality of image boxes in a thumbnail form representing a plurality of users responding to the invitation in a predetermined chat area on a broadcast screen; And
Performing a chat by inputting text through a mobile terminal while viewing a broadcast program through the TV, and displaying the chat content on a chat area of a broadcast screen,
If the chat content is not input for a preset time, the chat area is hidden on the broadcast screen and then displayed again when a new chat content is input.
The size is automatically enlarged when the reception sensitivity of the broadcast program drops below a predetermined level or when the error rate becomes a predetermined value or less,
And displaying a screen display indicating that the chat area is hidden on one side of the broadcast screen when the chat area is hidden according to the chat hide function. The method of claim 1, wherein when the chat application is executed
And the TV and the mobile terminal are connected to each other by the DLNA function. The method of claim 1, wherein the broadcast program and the chat application
The method of claim 1, wherein the at least one of the at least one of the at least one of the at least two of the at least one of the at least two of the at least one of the at least one of the at least one of the plurality of users. The method of claim 1,
A message indicating whether to accept the invitation, and a channel number and name currently being viewed. delete The method of claim 1,
And an image box including an image and a name of the user is displayed in the chat area in the order of the invitation. How to chat. 7. The apparatus of claim 6, wherein the image box
And when the chat content is not input for a predetermined time, the content is changed to a semi-transparent state. delete The method as claimed in claim 1, wherein, when the invited user's broadcast program is in an off state, the broadcast program is automatically turned on and then synchronized with the same channel, And changing a channel of the broadcast channel. The method of claim 1, wherein the text input via the mobile terminal
Wherein when the chat application is executed on a TV, the chat application is provided as a message input window according to a request for inputting a TV, and text is entered in the corresponding message input window. delete 2. The apparatus of claim 1, wherein the image box
The size and the size of the chats are varied for a predetermined time according to the gesture inputted through the remote control unit of the mobile terminal or the TV. Way. A display unit for displaying a message input window and a list of invitation lists;
A wireless communication unit for transmitting an invitation message to invited users; And
When the chat application is executed during the TV viewing, automatically connects to the TV, displays the image box of the invited user selected in the invitation list on the chat area of the TV screen, And a controller for displaying the chat contents in the chat area when the chat is performed,
The control unit
(a) hiding the chat area on one side of the broadcast screen according to the chat hide function, displaying a screen display indicating that the chat area is hidden,
(b) if the chat content is not input for a preset time, the chat area is displayed on the broadcast screen and displayed again when new chat content is input,
(c) automatically enlarges the size of the chat area when the reception sensitivity of the broadcast program falls below a predetermined level or the error rate becomes less than a predetermined value. delete 14. The method of claim 13, wherein when the chat application is executed
Wherein the TV and the mobile terminal are connected to each other by a DLNA function. 14. The method of claim 13,
A message indicating whether to accept the invitation, and a channel number and name currently being viewed. 14. The apparatus of claim 13, wherein the control unit
When the invitation message is transmitted, switches the screen to the message input window immediately, and displays an image box including the user's image and name in the order of the invitation in the chat area on the TV screen. delete 14. The method of claim 13, wherein, in response to the invitation, invited users access the chat window after executing the same chat application, and automatically turn on the TV when the invited user's TV is off, And when the chat application is executed while watching the TV, the channel is automatically changed. delete 14. The apparatus of claim 13, wherein the control unit
Wherein the display unit displays chat contents in a balloon form in a chat area, and the shape and size of the balloon are displayed corresponding to the length of the text. 14. The system of claim 13, wherein the image box
Wherein the size of the chat content is increased according to the length of the chat content when the chat content is input, and the size and shape are changed for a predetermined time according to the gesture inputted through the remote control unit of the mobile terminal or the TV.

Images