KR20120025929A - Terminal and contents sharing method for terminal - Google Patents

Abstract

PURPOSE: A terminal and a terminal content sharing method thereof are provided to control an image or sound of content outputted through a connected external terminal by the control of the terminal. CONSTITUTION: A control unit connects an external terminal by a communication unit(S101). The control unit checks the size of display are of the external terminal(S102). The control unit sets at least two display areas, which is a second display area(S103). The control unit transmits information on the second display area to the external terminal(S104). The control unit controls that a specific content is displayed on the second display area of the external terminal.

Description

Terminal and contents sharing method for terminal

The present invention relates to a terminal and a content sharing method of the terminal.

Recently, an N screen play service that seamlessly displays the same content on multiple screens by connecting terminals such as a television, a personal computer, and a mobile phone through a network has been an issue. In addition, in order to support the N screen play service, it is contemplated to improve the structural part and / or software part of the terminal.

In addition, another object of the present invention is to provide a terminal and a content sharing method of the terminal for controlling the video or sound source of the content output to the external terminal.

Content sharing method of a terminal according to an embodiment of the present invention comprises the steps of forming a network with an external terminal; Selecting a content to be reproduced by the external terminal and a reproduction mode related to a sound source or an image output when the content is reproduced; And transmitting the content information according to the selected content reproduction scheme to the external terminal through the network such that the content is reproduced according to the reproduction scheme selected by the external terminal.

In addition, the terminal according to an embodiment of the present invention comprises a communication unit for forming a network with an external terminal; And a reproduction mode related to a content to be reproduced in the external terminal and a sound source or a video output when the content is reproduced, and to reproduce the content according to the reproduction scheme selected in the external terminal. It includes a control unit for transmitting the content information according to the external terminal through the communication unit.

According to an embodiment of the present invention, the image or the volume of the content output through the external terminal connected to the terminal can be adjusted under the control of the terminal.

1 is a structural diagram showing a service network according to embodiments of the present invention.
2 is a block diagram of a mobile terminal according to one embodiment of the present invention;
3A and 3B are perspective views of a mobile terminal or a portable terminal related to the present invention.
4 is a flowchart illustrating a content sharing method of a terminal according to a first embodiment of the present invention.
5A through 5D are diagrams illustrating a first display area and a second display area according to a first embodiment of the present invention.
FIG. 6 is a conceptual diagram illustrating a content sharing method of a terminal in relation to multi-tasking of the terminal according to the first embodiment of the present invention; FIG.
7A and 7B illustrate a method in which a terminal controls a display area of an external terminal in view of a user interface according to the first embodiment of the present invention.
8 is a flowchart illustrating a method of controlling information related to the generated event to be displayed on an external terminal when an event occurs in the terminal according to the first embodiment of the present invention.
9 is a flowchart illustrating a method of controlling information related to the generated event to be displayed on the external terminal when an event occurs in the external terminal according to the first embodiment of the present invention.
10 is a flowchart illustrating a method of controlling a sound source or a video of content shared by an external terminal with an external terminal according to an embodiment of the present invention.
11A to 16 illustrate a method of selecting content to be shared and a reproduction method thereof according to a user input according to a second embodiment of the present invention.

Hereinafter, a mobile terminal according to the present invention will be described in more detail with reference to the accompanying drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

FIG. 1 is a structural diagram illustrating a service network according to embodiments of the present invention and illustrates an N screen play service network.

Referring to FIG. 1, the terminal 100 is connected to one or more external terminals 200 and 300 on which an image display function is implemented through a network, and the external terminal 200 to display contents on the external terminals 200 and 300. The content is shared with the external terminals 200 and 300 by transferring the content to the 300 or by receiving the content from the external terminals 200 and 300 and displaying the content on the screen.

In addition, the terminal 100 may share the content with the external terminal 200 by controlling to deliver the content from the other external terminal 300 to the external terminal 200 so that the content is displayed on the external terminal 200.

Here, the terminal 100 may use various communication methods such as WiFi, direct WiFi, Zigbee, Ultra-wideband, and Bluetooth to communicate with the external terminals 200 and 300. In addition, according to a communication method, the terminal 100 may directly connect with the external terminals 200 and 300 to transmit and receive data, or may transmit and receive data through an access point.

In addition, the terminal 100 and the external terminals 200 and 300 may share content through an internet network. The terminal 100 and the external terminals 200 and 300 may share the same content by connecting to the Internet and receiving and displaying the synchronized content regardless of the location and the device. Accordingly, the terminal 100 controls the external terminal 200 or 300 by directly or via the Internet network so that the external terminal 200, 300 receives and displays the synchronized contents through the Internet. , 300) and the content can be shared.

Here, the terminal 100 and the external terminals 200 and 300 are wireless, such as a wireless local area network (WLAN), a wireless broadband (WiBro), a world interoperability for microwave access (Wimax), and a high speed downlink packet access (HSDPA). Internet technology is available.

2 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the controller 180, and the power supply unit 190 may be included. The components shown in FIG. 2 are not essential, so that a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 may include, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast (DVB-H). Digital broadcast signals can be received using digital broadcasting systems such as Handheld and Integrated Services Digital Broadcast-Terrestrial (ISDB-T). Of course, the broadcast receiving module 111 may be configured to be suitable for not only the above-described digital broadcasting system but also other broadcasting systems.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access and may be embedded or external to the mobile terminal 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for obtaining a location of a mobile terminal, and a representative example thereof is a GPS (Global Position System) module.

Referring to FIG. 2, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed. The sensing unit 140 may include a proximity sensor 141.

The output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. Can be.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays photographed and / or received images, a UI, and a GUI.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). and at least one of a 3D display.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the implementation form of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180, 180. As a result, the controller 180 or 180 may determine which area of the display unit 151 is touched.

Referring to FIG. 2, a proximity sensor 141 may be disposed in an inner region of the mobile terminal surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Proximity sensors have a longer life and higher utilization than touch sensors.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the proximity touch is performed by the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 may also output a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152, so that they 151 and 152 may be classified as part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to vibration, the haptic module 154 may be configured to provide a pin array that vertically moves with respect to the contact skin surface, a jetting force or suction force of air through an injection or inlet port, grazing to the skin surface, contact of an electrode, electrostatic force, and the like. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also may implement the user to feel the haptic effect through a muscle sense such as a finger or an arm. Two or more haptic modules 154 may be provided according to a configuration aspect of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 or 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The memory 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in connection with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the usage rights of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various command signals input from the cradle by a user may be transferred. It may be a passage that is delivered to the terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 or 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180, 180, or may be implemented separately from the controller 180, 180.

The controller 180 or 180 may perform pattern recognition processing for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controllers 180 and 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180, 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code may be stored in the memory 160 and executed by the controller 180 or 180.

3A is a front perspective view of an example of a mobile terminal or a portable terminal according to the present invention.

The disclosed portable terminal 100 has a terminal body in the form of a bar. However, the present invention is not limited thereto and may be applied to various structures such as a slide type, a folder type, a swing type, a swivel type, and two or more bodies are coupled to be relatively movable.

The body includes a casing (casing, housing, cover, etc.) that forms an exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are built in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be further disposed between the front case 101 and the rear case 102.

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the audio output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal body, mainly the front case 101. have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is manipulated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The manipulation units 131 and 132 may also be collectively referred to as manipulating portions, and may be employed in any manner as long as the user operates the tactile manner with a tactile feeling.

Content input by the first or second manipulation units 131 and 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

FIG. 3B is a rear perspective view of the portable terminal shown in FIG. 3A.

Referring to FIG. 3B, a camera 121 ′ may be additionally mounted on the rear of the terminal body, that is, the rear case 102. The camera 121 ′ has a photographing direction substantially opposite to that of the camera 121 (see FIG. 3A), and may be a camera having different pixels from the camera 121.

For example, the camera 121 has a low pixel so that the user's face is photographed and transmitted to the counterpart in case of a video call, and the camera 121 'photographs a general subject and does not transmit it immediately. It is desirable to have a high pixel because there are many. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 are further disposed adjacent to the camera 121 '. The flash 123 shines light toward the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to see his / her own face or the like when photographing (self-photographing) the user using the camera 121 '.

The sound output unit 152 'may be further disposed on the rear surface of the terminal body. The sound output unit 152 ′ may implement a stereo function together with the sound output unit 152 (see FIG. 3A), and may be used to implement a speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. An antenna 116 constituting a part of the broadcast receiving module 111 (refer to FIG. 2) may be installed to be pulled out from the terminal body.

A power supply unit 190 for supplying power to the portable terminal 100 is mounted on the terminal body. The power supply unit 190 may be embedded in the terminal body or may be directly detachable from the outside of the terminal body.

The rear case 102 may be further equipped with a touch pad 135 for sensing a touch. Like the display unit 151, the touch pad 135 may also be configured to have a light transmission type. In this case, if the display unit 151 is configured to output visual information from both sides, the visual information may be recognized through the touch pad 135. The information output on both surfaces may be controlled by the touch pad 135. Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102 as well.

The touch pad 135 operates in association with the display unit 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

1 illustrates a case in which the terminal 100 is a mobile phone and the external terminals 200 and 300 are a television and a laptop computer, for example, but the present invention is not limited thereto. According to the present invention, the terminal 100 includes a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, a television, a desktop computer, and a set-top. It may be implemented as a box (set-top box). In addition, the external terminals 200 and 300 may be implemented as mobile phones, smart phones, digital broadcasting terminals, PDAs, PMPs, navigation systems, desktop computers, set-top boxes, and the like.

Meanwhile, since the structure of the external terminals 200 and 300 illustrated in FIG. 1 is similar to that of the terminal 100 described with reference to FIG. 2, in this document, the external terminals 200-1 and 200-2 are referred to. The description is omitted.

Embodiments disclosed in this document may be implemented in the terminal 100 described with reference to FIGS. 1 to 3B.

Hereinafter, a method of simultaneously displaying a plurality of contents on an external terminal and an operation of the terminal for implementing the same will be described in detail with reference to FIGS. 4 to 9.

4 is a flowchart illustrating a content sharing method of a terminal according to the first embodiment of the present invention. 5A to 9 are diagrams for describing a content sharing method according to a first embodiment of the present invention.

Referring to FIG. 4, the controller 180 or 180 connects to the first external terminal 200-1 through the communication unit 110 (S101).

Thereafter, the controller 180 checks the size of the display area 210 (hereinafter, referred to as a first display area) of the first external terminal (S102). The first display area 210 is an area in which two or more contents can be displayed at the same time. The first display area 210 means all or part of the display area of the first external terminal. When the terminal stores the identified size of the first display area 210 in a memory, and then is connected to the same first external terminal, the controller 180 does not check the size of the first display area 210 again. The size of the first display area 210 stored in may be recalled.

Thereafter, the controller 180 sets at least two display areas (hereinafter, referred to as second display areas) in which different contents are to be simultaneously displayed on the first display area 210 (S103). In detail, the controller 180 may determine the number and size and arrangement of the second display areas according to the number and properties of content to be displayed on the external terminal or the user's selection based on the size of the first display area. Determine.

In operation S103, the controller 180 may set various shapes and numbers of second display areas in the first display area 210. 5A to 5D are diagrams illustrating an example of second display areas set by the controller 180.

For example, referring to FIGS. 5A through 5B, the controller 180 divides the first display area 210 in the horizontal direction (and / or in the vertical direction) according to the number of contents to be displayed. , 223 may be set. The size of each of the second display areas may be set to be the same, or differently set according to the property of the content (for example, a video, a sound source, a web page, a message, a call). In addition, the controller 180 may set or change the size of each second display area according to a user's selection.

For example, referring to FIGS. 5C through 5D, the controller 180 may set some of the second display regions 231, 232, and 233 to overlap each other. Referring to FIG. 5C, one second display area 232 and 233 may be included in another second display area 231. Referring to FIG. 5D, portions 243 of the second display regions 241 and 242 may be set to overlap each other. In the overlapping area 243 in FIGS. 5C and 5D, one content is displayed according to the priority of the content according to the user's selection or the attribute of the displayed content.

Referring back to FIG. 4, the controller 180 transmits information about the second display areas set in step S103 to the external terminal 200 through the communication unit 110, and controls each of the external terminals 200. 2 Control to display the specific content in the display area (S104). The information about the second display areas may include information about the size, arrangement, and content of each of the second display areas.

One of the contents displayed in each of the second display regions may be the contents displayed on the first display region 210. In addition, the content displayed on each of the second display areas may be content delivered from the terminal, content delivered through the Internet network, or content stored in the memory of the external terminals 200 and 300. In addition, the content displayed on the terminal 100 may be delivered to the second display area (eg, from the terminal 100 or from the internet network) to be displayed seamlessly.

Thereafter, the controller 180 may reset the second display areas set in step S103 (S105). When the number of contents to be simultaneously displayed on the external terminal 200 increases or decreases, the controller 180 resets the set second display area according to the number of changed contents. In addition, even when the number of contents is not changed, the attributes of the contents displayed on the external terminal may be changed or may be reset such that the size and / or arrangement of the set second display regions is changed according to a user's selection.

Thereafter, as described in step S104, the controller 180 transmits the information about the second display areas reset in step S105 to the external terminal through the communication unit 110, and the content is further displayed on the external terminal, The displayed content is not displayed or the displayed content is changed (S106).

FIG. 6 is a conceptual diagram illustrating a content sharing method of a terminal in relation to multi-tasking of the terminal according to an embodiment of the present invention.

FIG. 6A is a diagram conceptually showing an application (task or content) being executed simultaneously in a terminal. FIG. 6B illustrates an embodiment of second display areas displayed on the first display area 210 of the external terminal 200. For example, according to a user input, the controller 180 drives an application to display content3 on the display unit. Thereafter, according to a user input using the multitasking key 402 or the like, or when an event occurs, another application is driven to display content2 on the display unit. As such, as contents1, 2, and 3 are sequentially displayed on the terminal (or at the same time), as described with reference to FIG. 4, the contents 1, 2, and 3 are simultaneously displayed on each of the second display regions of the external terminal.

In addition, the controller 180 may control the external terminal 200 to display only content (eg, content1 and 2) related to a specific application selected by the user among applications running in the terminal according to a user input. .

In addition, the controller 180 may determine that content related to an application running in the external terminal 200 (for example, content0) or content related to an application running in the other external terminal 300 (for example, content4) is external. The terminal may be controlled to be displayed or simultaneously displayed on each of the second display areas.

7A and 7B illustrate a method of controlling a display area of an external terminal by a terminal from a user interface perspective.

7A and 7B, as the N-screen related application 401 (hereinafter, N-screen application) is driven, the controller 180 searches for and displays external terminals 200 and 300 that can share content. (See 403 and 404), and connects to one or more devices selected by the user among the searched external terminals 200 and 300. Alternatively, the controller 180 may store information about the external terminal previously connected to the memory as a list and connect the at least one external terminal selected by the user from the list. When connected to an external terminal, the controller 180 can display an icon (eg, 409 of FIG. 7B) of the external terminal in one area (eg, an indicator area) of the display unit.

7B is a diagram illustrating an example of a user interface for a terminal to control a display area of an external terminal.

Referring to FIG. 7B, the controller 180 displays an area 405 indicating the first display area 210 of the external terminal on the display unit 151 of the terminal 100. In the area 405 representing the first display area, the content cont1 currently displayed in the first display area 210 may be synchronized and displayed. As shown in FIG. 7B, when the external terminal 200 displays respective contents in two or more second display areas by the above-described method, the controller 180 may display an area 405 representing the first display area. Each set second display area and the contents (cont1, cont2, cont3) displayed thereon may be displayed. In addition, the controller 180 may adjust the size of the second display area according to user inputs 410 and 411 dragging the boundary of the second display area.

In addition, as shown in FIG. 7B, the controller 180 may display an area displaying icons 406, 407, and 408 of an application (or content) that is being executed at the same time on the display unit 151. An application running at the same time may include an application selected by a user using an multitasking key and an application executed according to an event occurrence. In addition, the terminal 100 may also include an application running on the external terminal 200 or another connected external terminal 300.

In FIG. B, when a touch input of dragging icons 406 and 407 to the area 405 representing the first display area is detected, the controller 180 simultaneously displays additional contents corresponding to the selected icon on the external terminal. In operation S101 to S105, an area 405 indicating the first display area is displayed in the same manner as the display area 210 of the external terminal. On the contrary, when a user input of dragging the second display area displayed on the area 405 representing the first display area to a predetermined area (for example, an area displaying the icons 406, 407, 408, and the like) is detected, The controller 180 controls the content being displayed on the selected second display area to no longer be displayed.

8 is a flowchart illustrating a method of controlling the external terminal to display information related to the generated event when an event occurs in the terminal.

As described above, an event (message reception, call signal reception, etc.) while the terminal 100 is connected to the external terminal 200 (or the terminal 100 shares content with the external terminal 200). Is generated (S201), the controller 180 indicates that an event has occurred through the display unit 151 (and the display unit of the external terminal 200) (S202). At the same time, the controller 180 displays a window for selecting whether to display information of an event occurring in the external terminal 200 on the display unit 151 and waits for a user input (S203). When the user selects to display a message on the external terminal 200, the controller 180 sets or resets the second display area such that event information is additionally displayed on the external terminal 200 according to the above method. The controller transmits the event information to the external terminal 200 (S204). If the user selects not to display a message on the external terminal 200, the controller 180 may display event information through the display unit 151 (S205).

9 is a flowchart illustrating a method of controlling information related to the generated event to be displayed on the external terminal when an event occurs in the external terminal.

As described above, when the terminal 100 is connected to the external terminal 200 (or when the terminal 100 shares content with the external terminal 200), an event occurs in the external terminal 200. In operation S301, the external terminal 200 transmits an event occurrence fact to the terminal 100. The control unit 180 receiving this indicates that an event has occurred through the display unit 151 (and the display unit of the external terminal 200) (S302). At the same time, the controller 180 displays a window for selecting whether to display information of an event occurring in the external terminal 200 on the display unit and waits for a user input (S303). When the user selects to display a message on the external terminal 200, the controller 180 sets or resets the second display area such that event information is additionally displayed on the external terminal 200 according to the above method. The set second display area information and the control signal are transmitted (S304). If the user selects to display a message on the terminal 100 (S305), the controller 180 can receive event-related information from the external terminal 200 and display it on the display unit (S306).

10 to 16 illustrate a method of controlling a sound source or an image of content shared by an external terminal with an external terminal according to an embodiment of the present invention.

10 is a flowchart illustrating a method of controlling a sound source or an image of content shared by an external terminal with an external terminal according to an embodiment of the present invention.

According to the above-described method, the controller 180 connects to the external terminal 200 through the communication unit (S401).

The controller 180 selects content to be delivered to the external terminal 200 according to a user input (S402). When a specific content is displayed through the display unit 151, if a predetermined user input to be described later is input, the displayed content may be selected.

Next, the controller 180 selects a playback mode related to a sound source or an image output when playing the content selected by the external terminal 200 according to a user input in operation S403. Here, the reproduction method refers to a condition or a constraint related to a sound source or an image to be transmitted from the terminal 100 to the external terminal 200 to be output from the external terminal 200. In the playback method, a sound source muting method for outputting only an image but not a sound source, a sound source size adjusting method (for example, a maximum volume transfer method) for adjusting the size of a sound source output with the image, and only a sound source is output The non-image erasing method, the image size adjusting method for adjusting the size of the output image (for example, the method of adjusting the size of the image to fit the size of the entire display area of the external terminal 200) and the like.

Next, the controller 180 transmits the content information according to the selected content reproduction scheme to the external terminal 200 through the communication unit so that the content is reproduced in the external terminal 200 according to the selected reproduction scheme (S404).

Herein, the content information according to the content reproduction method may mean content that is variable according to the selected reproduction method. That is, the controller 180 varies the content according to the selected playback method. For example, the controller 180 may delete sound source data (or extract only image data) of the selected content, amplify the sound source data of the content at a predetermined ratio, or delete image data from the content data according to the selected playback method. Or extract only sound source data) to vary the content. In addition, the controller 180 may check the size of the display area of the external terminal 200 and change the content by enlarging or reducing the image size of the content according to the size of the identified display area.

In addition, the content information according to the content reproduction method may include a content that does not change and a control signal for controlling the external terminal 200 to output the content according to the selected reproduction method.

In addition, when the controller 180 controls the external terminal 200 to output only one of the image or the sound source of the content, the controller 180 does not output the image or sound source from the external terminal 200 through the terminal 100. You can continue to print In this case, the controller 180 may control the content output from the external terminal 200 and the terminal 100 to synchronize with each other.

In addition, during the playback of content according to the playback method selected by the external terminal 200, according to the method described in steps S403 and S404, the controller 180 selects another playback method and transmits content information according to the changed playback method. By doing this, the reproduction method can be changed.

11A to 16 are diagrams for describing a method of selecting content to be shared and a reproduction method thereof according to a user input according to a second embodiment.

When a predetermined user input is detected while playing content to be delivered to the external terminal 200 (for example, touch input or long touch input for dragging a display area where an image of the content is displayed in a predetermined direction, input by menu selection). Etc.), the controller 180 delivers the content being played (or the content selected from the list) to the external terminal 200. In this case, the external terminal 200 may select a reproduction method in which the content is played in accordance with the user input related to the reproduction method described below together with the user input (or without such user input) to deliver the selected content.

11A to 11B are diagrams illustrating a method of selecting a content and a reproduction method thereof using a context menu.

Referring to FIG. 11A, as described above, the controller 180 connects to an external terminal 200 through a communication unit, drives an application for playing content, and displays a content list through the display unit 151. When a content to be delivered to the external terminal 200 is selected from the content list (when a predetermined menu is selected while a sound source or an image is output through the display unit 151 and / or the audio output module 152 by playing the selected content) The controller 180 displays a menu for selecting a playback method through the display unit 151 and waits for a user's touch input. When any one playback method is selected by the user, content information according to the selected playback method is transmitted to the external terminal 200 according to the above-described method.

Referring to FIG. 11B, when a specific content linked is selected while a web page is driven by the terminal 100 to display a web page, the controller 180 receives the linked content in response to a predetermined user input. Transfer to the terminal 200. In this case, the controller 180 displays a menu for selecting a playback method through the display unit 151 and waits for a user's touch input. When any one playback method is selected by the user, content information according to the selected playback method is transmitted to the external terminal 200 according to the above-described method.

12A to 12B are diagrams illustrating a method of selecting a content playback method using a camera or a microphone.

As shown in FIG. 12A, the controller 180 may select a playback method according to information input through the camera 121. For example, when the user touches the content image and drags it to the camera 121, the controller 180 selects a sound source erasing method. To this end, the controller 180 drives the camera 121 and analyzes an image input through the camera 121 to determine whether the camera is covered. For example, the motion, direction, and position of the finger may be analyzed in the input image to determine whether the camera is covered. Alternatively, the amount of light input to the camera may be measured to determine whether the camera is covered.

Meanwhile, as shown in FIG. 12B, the controller 180 may select a reproduction method according to information input through the microphone 122. For example, when the user touches the content image and drags it to the microphone 122, the controller 180 selects an image erasing method. To this end, the controller 180 analyzes the sound source input through the microphone 122 and determines whether the microphone is covered.

13A to 13B illustrate a method of selecting a content playback method using a touch sensor.

The controller 180 analyzes a user's gesture input through the touch sensor and selects a playback method according to the gesture type. For example, as shown in FIGS. 13A and 13B, when the gesture for switching to the left direction is input, the image erasing method is selected. When the gesture for switching to the right direction is input, the sound source erasing method is selected. When the gesture in the upper direction is input without switching to the left or the right direction, the controller 180 can deliver the selected content without selecting a special playback method.

In addition, the controller 180 analyzes the direction of the user's drag input input through the touch screen, selects a sound source cancellation method when the drag direction is toward the camera, and selects an image erasing method when the drag direction is toward the microphone. .

14 is a diagram illustrating a method of selecting a content reproduction method using a camera and a microphone.

The controller 180 analyzes the information input through the camera 121 and / or the microphone 122 and selects a corresponding playback method according to an operation taken by the user and / or a sound made by the user. For example, as shown in FIG. 14, when the user takes an action of bringing a finger to the mouth with a 'shh' sound, the controller 180 analyzes the motion and the sound to determine a sound source cancellation method corresponding to the user's motion. Choose.

15 is a diagram illustrating a method of selecting a content playback method using a volume control key.

Volume control, with or without user input (e.g., a drag input in the upper direction), which causes the terminal 100 to deliver the content being played (selected) to the external terminal 200 while the content is being played on the terminal 100 When the key 132 is input, the controller 180 changes the volume of the content to be delivered in proportion to the input time or the number of the volume control keys. In addition, when the volume control key is input for a predetermined time or more, the controller 180 may select a sound source cancellation method or a maximum volume transmission method according to the direction of the volume control key 132.

16 is a diagram illustrating a method of selecting a content playback method using a motion sensor. The controller 180 identifies a user's motion through a motion sensor and selects a playback method according to the identified user's motion. For example, when the user shakes the terminal 100 left / right, the controller 180 may change the size of the image of the content to match the size of the display area of the external terminal 200. In addition, when the user shakes the terminal 100 up and down, the controller 180 may control to display the original content image in size. In addition, the controller 180 may enlarge or reduce the size of the content image in proportion to the direction, time, frequency, or intensity of shaking the terminal 100. For example, whenever shaking once in the left / right direction, the content displayed on the external terminal 200 is enlarged at a predetermined ratio (for example, 10%), and whenever shaking once in the up / down direction, the external terminal The content displayed on the 200 may be reduced in size at a predetermined rate (for example, 10%).

Further, according to an embodiment of the present invention, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may be implemented in the form of a carrier wave (for example, transmission over the Internet). Include.

The above-described terminal and its content sharing method may not be limitedly applied to the configuration and method of the above-described embodiments, but the embodiments may be selectively modified in whole or in part in various embodiments so that various modifications may be made. It may be configured in combination.

In the above, preferred embodiments of the present invention have been described with reference to the accompanying drawings.

Here, the terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary meanings, but should be construed as meaning and concept consistent with the technical idea of the present invention.

100: mobile terminal
200: first external terminal
300: second external terminal

Claims (22)

Forming a network with an external terminal;
Selecting a content to be reproduced by the external terminal and a reproduction mode related to a sound source or an image output when the content is reproduced; And
And transmitting the content information according to the selected content reproduction scheme to the external terminal through the network so that the content is reproduced according to the reproduction scheme selected by the external terminal. The method of claim 1, wherein the regeneration method is
A method of sharing contents of a terminal, the method comprising: a sound source cancellation method, a sound source size adjustment method, an image cancellation method, or an image size adjustment method. The method of claim 2, wherein the selecting comprises:
Sensing user input;
Selecting a content or a reproduction method corresponding to the user input. The method of claim 3, wherein the user input,
Method of sharing a content of a terminal, characterized in that the voice input through a gesture or a microphone input through a touch sensor, a motion sensor or a camera. The method of claim 2, wherein the transmitting step
If the sound source size control method is selected, the content sharing method of the terminal, characterized in that for transmitting the content information amplified at a predetermined rate the volume of the sound source of the content. The method of claim 2, wherein the transmitting step
If the mute method is selected, the content sharing method of the terminal, characterized in that for transmitting only the video information of the content. The method of claim 6, wherein the content sharing method of the terminal
And outputting a sound source of the content in synchronization with the image displayed on the external terminal. The method of claim 2, wherein the transmitting step
And when the image erasing method is selected, only sound source information of the content is transmitted. The method of claim 8, wherein the content sharing method of the terminal
And outputting an image of the content in synchronization with the sound source output from the external terminal. The method of claim 2, wherein the transmitting step
If the image size adjustment method is selected, the content sharing method of the terminal, characterized in that for transmitting the content information in which the image of the content is enlarged at a predetermined ratio. The method of claim 10, wherein the predetermined ratio is
The content sharing method of the terminal, characterized in that determined according to the image size, the size of the display area of the display unit, the size of the display area of the external terminal or the user input. A communication unit forming a network with an external terminal;
Select a playback mode related to the content to be played on the external terminal and a sound source or video output when the content is played, and play the content according to the playback method selected on the external terminal; And a control unit for transmitting the contents information to the external terminal through the communication unit. The method of claim 12, wherein the regeneration method is
Terminal, characterized in that the sound source cancellation method, the sound source size adjustment method, the image cancellation method or the image size adjustment method. The method of claim 13, wherein the control unit,
And detecting a user input input through a user input unit and selecting a content or a reproduction method corresponding to the user input. The method of claim 14, wherein the user input,
The terminal is a voice input through a predetermined gesture or a microphone input through a touch sensor, a motion sensor or a camera. The method of claim 13, wherein the control unit
When the sound source size control method is selected, the terminal characterized in that for transmitting the content information amplified at a predetermined rate the volume of the sound source of the content. The method of claim 13, wherein the control unit
And when the mute method is selected, only the video information of the content is transmitted. The method of claim 17, wherein the control unit
And outputting a sound source of content through an audio output unit in synchronization with the image displayed on the external terminal. The method of claim 13, wherein the control unit
And when the image erasing method is selected, only sound source information of the content is transmitted. The method of claim 19, wherein the control unit
And outputting an image of content to a display unit in synchronization with a sound source output from the external terminal. The method of claim 13, wherein the control unit
When the image size control method is selected, the terminal characterized in that for transmitting the content information in which the image of the content is enlarged at a predetermined ratio. The method of claim 21, wherein the predetermined ratio is,
And an image size of the content, a size of a display area of the display unit, a size of a display area of the external terminal, or a user input.

Images