KR101688169B1 - Mobile terminal comprising a subdevice - Google Patents

Abstract

The present invention has a sub-device capable of combining and separating, so that the operation and state of the terminal can be controlled remotely.
A mobile terminal according to the present invention includes a sub-device having input / output means and capable of separating or coupling with a terminal, and a demultiplexer for receiving a user input from the sub-device through a predetermined communication path when the sub- And a control unit for controlling the configuration device and the application of the terminal according to the configuration information.

Description

[0001] MOBILE TERMINAL COMPRISING A SUBDEVICE [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a mobile terminal, and more particularly, to a mobile terminal having a sub-device capable of being engaged / disengaged from a terminal main body.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal. As the functions of the terminal are increased, the volume and weight of the terminal are increased. Therefore, there is a problem that the user of a light and small terminal can not be satisfied.

An object of the present invention is to provide a control method of a mobile terminal that controls the operation and state of a terminal when a main device and a sub device are coupled / disconnected.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the present invention will be realized and attained by the structure particularly pointed out in the claims, as well as the following description and the annexed drawings.

According to another aspect of the present invention, there is provided a mobile terminal including a main device including a slot and a recess recessed from the slot, a sub device removably inserted into the groove through the slot, And a control unit for detecting the detachment of the sub apparatus from the main apparatus and controlling the main apparatus based on the control command received by the sub apparatus.

As an example related to the present invention, the control unit may perform different functions when the sub-apparatus is detached and coupled from the main apparatus.

In one embodiment of the present invention, the control unit executes a first function when the sub-apparatus in a state separated from the main apparatus is coupled with the main apparatus, and the control unit controls the sub- And perform a second function when the device is disconnected from the main device.

The present invention has a sub-device capable of combining and separating, so that the operation and state of the terminal can be controlled remotely.

According to the present invention, the operation and state of the terminal can be automatically controlled in accordance with the operation of combining and separating the main apparatus and the sub apparatus.

The sub apparatus according to the present invention can control the constituent devices and applications of the main apparatus through the short-range wireless communication path in a state of being separated from the main apparatus.

The present invention can operate the display by interlocking the two devices in a state where the main device and the sub device are combined.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
FIG. 2A is a front perspective view of a portable terminal according to an embodiment of the present invention; FIG.
FIG. 2B is a rear perspective view of a portable terminal according to an embodiment of the present invention; FIG.
3A and 3B are front views of a portable terminal for explaining an operation state of the portable terminal according to the present invention.
4 is a conceptual diagram for explaining the proximity depth of the proximity sensor;
5 is a conceptual diagram for explaining a control method for a touch operation in a form in which a pair of display units are overlapped.
6A and 6B are conceptual diagrams for explaining a proximity touch recognition area where a proximity signal is detected and a haptic area for generating a tactile effect, respectively.
FIG. 7 is an exemplary diagram illustrating a configuration of a mobile terminal including a main device and a sub device according to the present invention; FIG.
8 is a diagram illustrating an example of a configuration of a sub apparatus that can be coupled to a main apparatus of a mobile terminal according to the present invention.
Figures 9a-9d illustrate various configurations of a sub-device according to the present invention.
FIGS. 10A to 10D are illustrations for explaining a combination of a main apparatus and a sub apparatus according to the present invention. FIG.
11A to 11E are illustrations for explaining a structure and a method for coupling or disconnecting a sub apparatus to a main unit of a folder type according to the present invention.
12A to 12E are illustrations for explaining a structure and a method for joining or separating a sub-device to a slide-type main device according to the present invention.
13A to 13D are illustrations for explaining a structure and a method for coupling or disconnecting a sub device to a main device of a swivel type according to the present invention.
FIGS. 14A to 14D are illustrations for explaining a structure and a method for joining or separating a sub device to a bar type main device according to the present invention; FIG.
15A to 15D are illustrations for explaining a structure and a method for joining or separating a sub apparatus to a watch type main apparatus according to the present invention.
16 is an exemplary view for explaining a structure of a clip type sub apparatus in which the present invention can be easily coupled to all types of main apparatuses.
Figs. 17A and 17B are views showing automatic control of terminal operation (menu display); Fig.
FIG. 18 is an exemplary diagram showing an automatic control of the terminal operation (menu display) of FIG. 17 applied to a swing-type (Swuvel-type) mobile terminal;
19A to 19B are diagrams showing another example of automatic control of the terminal operation (menu display).
20A to 20B are views showing automatic control of terminal operation (keypad control);
21A to 21B are exemplary views showing automatic terminal operation (application control) control;
22 is an exemplary view showing automatic terminal state control;
Figure 23 is another example of automatic terminal state control;
24 is an exemplary view showing automatic power saving control of the terminal.
25 is an exemplary view showing automatic terminal lock control;
26 is an exemplary view of a user setting of control in the joining / separating according to the present invention;
27 is an exemplary diagram for power supply control of the main apparatus 100
28 is an exemplary diagram related to control of a call function of the subordinate apparatus 300;
FIG. 29 is an exemplary view of a multimedia player control; FIG.
FIG. 30 is an exemplary diagram relating to a mouse function control; FIG.
31 is another example of the mouse function control;
32 is an exemplary diagram for controlling a game function;
33A to 33B are exemplary views related to widget execution control;
34 is an exemplary view showing a function interlock control;
35 is another example of the function interlock control.
FIG. 36 is an exemplary diagram for mode switching and intensity control of the main device; FIG.
37 is an exemplary view relating to remote control of photographing functions;
38A to 38B are exemplary views related to emotional mode control of the sub-device;
Figs. 39A to 39E are exemplary views of function control of a clip type sub-device; Fig.
40A to 40B are exemplary views of a method of controlling the main apparatus 100 and the sub apparatus 300 in the coupled state.
41 is another example of a method of controlling the main apparatus 100 and the sub apparatus 300 in the coupled state.
42 is an exemplary view showing power control of a terminal;
43A to 43C are views showing a combination of a non-touch type terminal and a sub apparatus;

In order to achieve the above object, a mobile terminal according to the present invention includes:

A sub-device having input / output means and capable of separating or coupling with the terminal; and a control unit for receiving a user input from the sub-device through a predetermined communication path when the sub-device is separated, And a control unit for controlling the control unit.

According to another aspect of the present invention, there is provided a method of controlling connection and disconnection of a sub-device according to the present invention,

Setting a wireless communication path with the sub apparatus when the connection with the sub apparatus is disconnected; receiving a user input through the communication path; and controlling the configuration apparatus and application of the terminal according to the received user input .

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (DVF-H) And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 is a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the movement of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence of the user, the orientation of the mobile terminal, And senses the current state of the terminal 100 to generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2A is a perspective view of an example of a mobile terminal or a mobile terminal according to the present invention.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

FIG. 2B is a rear perspective view of the portable terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2A), and may be a camera having different pixels from the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the portable terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may also be of a light transmission type like the display unit 151. [ In this case, if the display unit 151 is configured to output time information on both sides, the time information can be recognized through the touch pad 135 as well. The information output on both sides may be all controlled by the touch pad 135. [ Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102 as well.

The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, a related operation of the display unit 151 and the touch pad 135 will be described with reference to FIGS. 3A and 3B.

3A and 3B are front views of a portable terminal for explaining an operation state of the portable terminal according to the present invention.

Various types of time information can be displayed on the display unit 151. [ These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be called a so-called " soft key ".

FIG. 3A shows a touch input to a soft key through a front surface of a terminal body.

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with each other.

For example, an output window 151a and an input window 151b are displayed on the upper and lower portions of the display unit 151, respectively. The output window 151a and the input window 151b are areas allocated for outputting or inputting information, respectively. In the input window 151b, a soft key 151c in which a number for inputting a telephone number or the like is displayed is output. When the soft key 151c is touched, a number corresponding to the touched soft key is displayed on the output window 151a. When the first operation unit 131 is operated, call connection to the telephone number displayed on the output window 151a is attempted.

FIG. 3B shows the input of a touch applied to the soft key through the rear surface of the terminal body. FIG. 3A shows a case where the terminal body is vertically arranged, and FIG. 3B shows a case where the terminal body is arranged horizontally. The display unit 151 may be configured to convert the output screen according to the arrangement direction of the terminal body.

3B shows that the text input mode is activated in the portable terminal. The display unit 151 displays an output window 151a 'and an input window 151b'. In the input window 151b ', a plurality of soft keys 151c' displayed with at least one of letters, symbols, and numbers may be arranged. The soft keys 151c 'may be arranged in the form of a QWERTY key.

When the soft keys 151c 'are touched through the touch pad 135 (see FIG. 2B), characters, numbers, symbols corresponding to the touched soft keys are displayed on the output window 151a'. As described above, the touch input through the touch pad 135 is advantageous in that the soft key 151c 'can not be blocked by the finger when the touch is input, compared with the touch input through the display unit 151. [ In the case where the display unit 151 and the touch pad 135 are formed to be transparent, the fingers located on the rear side of the terminal body can be visually confirmed, thereby enabling a more accurate touch input.

The display unit 151 or the touch pad 135 may be configured to receive a touch input by scrolling, as well as the input method described in the above embodiments. The user can move a cursor or a pointer located on an object displayed on the display unit 151, for example, an icon or the like, by scrolling the display unit 151 or the touch pad 135. [ Further, when the finger is moved on the display portion 151 or the touch pad 135, the path along which the finger moves may be visually displayed on the display portion 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the terminal may be executed in response to a case where the display unit 151 (touch screen) and the touch pad 135 are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the terminal body using the thumb and index finger. The one function may be activation or deactivation of the display unit 151 or the touch pad 135, for example.

The proximity sensor 141 described with reference to Fig. 1 will be described in more detail with reference to Fig.

4 is a conceptual diagram for explaining the proximity depth of the proximity sensor.

As shown in FIG. 4, when a pointer such as a user's finger, a pen, or the like approaches the touch screen, the proximity sensor 141 disposed in or near the touch screen senses the proximity sensor and outputs a proximity signal.

The proximity sensor 141 may be configured to output different proximity signals according to the distance between the proximity-touched pointer and the touch screen (hereinafter referred to as "proximity depth").

In FIG. 4, for example, a cross-section of a touch screen having proximity sensors capable of sensing three proximity depths is illustrated. Of course, proximity sensors that detect less than three or more than four proximity depths are also possible.

Specifically, when the pointer is completely in contact with the touch screen (d0), it is recognized as a contact touch. If the pointer is located on the touch screen at a distance less than the distance d1, it is recognized as a proximity touch of the first proximity depth. If the pointer is located on the touch screen at a distance d1 or less and less than the distance d2, the pointer is recognized as a proximity touch of the second proximity depth. If the pointer is located on the touch screen at a distance d2 or more and less than the distance d3, it is recognized as a proximity touch of the third proximity depth. If the pointer is located at a distance d3 or more on the touch screen, it is recognized that the proximity touch is released.

Accordingly, the controller 180 can recognize the proximity touch as various input signals according to the proximity depth and proximity position of the pointer, and perform various operation control according to the various input signals.

5 is a conceptual diagram for explaining a control method for a touch operation in a form in which a pair of display units 155 and 156 are overlapped.

The terminal shown in this figure is a folder type terminal connected to a main body so that a folder portion is foldable. The first display unit 155 mounted on the folder unit may be of a light transmitting type or a transparent type such as TOLED or the second display unit 156 mounted on the main body may be a form that does not transmit light like an LCD. The first and second display units 155 and 156 may be configured as a touch screen capable of touch input, respectively.

For example, when a touch (a contact touch or a proximity-touch) to the first display unit or the TOLED 155 is detected, the control unit 180 determines whether the touch At least one of the images displayed in the TOLED 155 may be selected or run.

Hereinafter, with respect to the manner in which the information displayed on the other display unit or the LCD 156 is controlled when touching the TOLED 155 exposed to the outside in an overlapped form, a touch, a long touch, a long touch and drag ), And so on.

In the overlapped state (the mobile terminal is in a closed state), the TOLED 155 is arranged to overlap the lower side of the LCD 156. In this state, if a touch such as a long touch (for example, a touch that lasts for 2 seconds to 3 seconds) is detected in a manner different from the touch for controlling the image displayed on the TOLED 155 in advance, ) Causes at least one image of the image list displayed on the LCD 156 to be selected according to the sensed touch input. The result according to the execution of the selected image is displayed on the TOLED 155.

The long touch may also be used to selectively move a desired one of the entities displayed on the LCD 156 to the TOLED 155 (without performing any action thereto). That is, when a user selects one area of the TOLED 155 corresponding to a specific entity of the LCD 156 In the case of a long touch, the control unit 180 moves the corresponding object to the TOLED 155 to be displayed. The entity displayed on the TOLED 155 may also be displayed on the LCD 156 by a predetermined touch input to the TOLED 155, for example, flicking, swirling, and the like. In this figure, the menu No. 2 displayed on the LCD 156 is displayed on the TOLED 155.

If another input, for example, a drag, is detected in addition to the long touch, the control unit 180 is a function related to the image selected by the long touch. For example, a preview screen for the image is displayed on the TOLED 155, As shown in FIG. In this drawing, a case where a preview (male photograph) is performed on the menu No. 2 (image file) is illustrated.

The control unit 180 displays a selection cursor (or a selection bar) of the LCD 156 in the state that the preview screen is being output, while dragging toward another image is further performed on the TOLED 155 while maintaining the long touch And displays the image selected by the selection cursor on a preview screen (female photograph). Thereafter, when the touch (long touch and drag) ends, the controller 180 displays the first image selected by the long touch.

When the slide (the operation of the proximity touch corresponding to the drag) is detected together with the long proximity touch (the proximity touch continuing for at least 2 seconds to 3 seconds) to the TOLED 155 .

When a touch operation other than those described above is detected, the controller 180 can operate in the same manner as a general touch control method.

The control method for the touch operation in the overlapped form can be applied to a terminal having a single display. In addition, the present invention can be applied to a terminal different from a folder type having a dual display.

FIGS. 6A and 6B are views referred to the description of the proximity touch recognition area where the proximity signal is detected and the haptic area where the tactile effect occurs.

6A shows objects such as icons and menu items in a circular form for convenience of explanation. The area of the object displayed on the display unit 151 can be divided into a first area A in the center and a second area B surrounding the center area as shown in FIG. 6A. The first region A and the second region B can be configured to generate tactile effects having different intensities or patterns. For example, when the second region B is touched, a first vibration is output, and when the first region A is touched, a second vibration larger than the first vibration is output.

In the case where the proximity touch recognition area and the haptic area are simultaneously set in the area where the object is displayed, the haptic area where the tactile effect is generated and the proximity touch area where the proximity signal is detected They can be set differently. That is, the haptic area may be set narrower than the proximity touch recognition area, or the haptic area may be set wider than the proximity touch recognition area. For example, in (a) of FIG. 6A, the area including the first area A and the second area B may be a proximity touch recognition area, and the first area A may be set as a haptic area.

(N > 4) as shown in Fig. 6 (a), as shown in Fig. 6 (b) It is also possible to divide into two areas. Each divided region can be configured to generate a tactile effect with different intensities or patterns. Even when the area in which one object is displayed is divided into three or more areas, the haptic area and the proximity touch recognition area can be set differently according to the use environment.

The size of the proximity touch recognition area may be changed depending on the proximity depth to the display unit 151. [ That is, as shown in (a) of FIG. 6, the corresponding proximity touch recognition area may be gradually reduced to 'C', 'B', and 'A' according to the proximity depth to the display unit 151, Or the contiguous touch recognition area corresponding to the proximity depth to the display unit 151 may be gradually increased. In this case as well, the haptic area can be set to a constant size regardless of the proximity depth to the display unit 151, such as the 'H' area shown in FIG. 6B (b).

 In the case of dividing the area in which the object is displayed for the setting of the haptic area or the proximity touch recognition area, in addition to the concentric segmentation as shown in Fig. 6A, segmentation in the horizontal direction or vertical direction, radial segmentation, And various methods such as partitioning can be used.

Hereinafter, embodiments related to a control method that can be implemented in the terminal configured as above will be described with reference to the accompanying drawings. The following embodiments can be used alone or in combination with each other. In addition, the embodiments described below may be used in combination with the above-described user interface (UI).

7 is a diagram illustrating an example of a configuration of a mobile terminal including a main device and a sub device according to the present invention.

As shown, the present invention relates to a mobile terminal including a main device (first device) 100 and at least one sub device (second device) 300a to 300n which can be coupled to or separated from the main device will be. The main device is a concept as compared with a sub device, which means the entire mobile terminal capable of coupling the sub devices. However, in this embodiment, any one of the plurality of bodies, . ≪ / RTI >

The main device (first device) 100 may include all of the components of the mobile terminal described with reference to FIG. 1, and may further include components for mechanically coupling the sub devices (second device) A connection detecting unit 220 for detecting whether or not the sub-device is coupled; and a connection detecting unit 220 for electrically connecting the combined or separated sub-device and the main device to transmit and receive signals or data between the two devices. A connection unit 230 may be additionally provided.

The connection unit 210 may be configured to mechanically connect the main unit and the sub apparatus, and the connection unit 230 is a block for communication between the main apparatus and the sub apparatus, and includes a hardware connection terminal (not shown) Or wirelessly using a wireless system (e.g., Bluetooth, IrDA, or the like).

The coupling detector 220 detects whether the main unit and the sub unit are coupled to or disconnected from each other, thereby automatically changing the main unit and the sub unit to a predetermined operation mode.

The coupling unit 210 can be changed into various structures (or shapes) according to the type of mobile terminal (e.g., bar type, slide type, folder type, swing type, swivel type, watch type, In addition, the main unit of the mobile terminal is not only required to change the appearance of the body, but also to provide an auxiliary member such as a magnet, a spring, or a latch so as to fix the sub-unit to the correct position and then move, As shown in FIG. At this time, the location of each of the components 210 to 230 may be changed according to the type of the mobile terminal.

The sub-apparatus 300 may be configured to have a structure or a shape that can be firmly coupled to the coupling unit 210 of the main apparatus. That is, the coupling unit 410 of the sub apparatus may have a structure (or a shape) corresponding to the coupling unit 210 of the main apparatus. In addition, the structure and shape of each of the components 410 to 430 can be changed suitably to the sub-device. For example, a sub-device may be configured to receive a radio signal transmitted from a main device without using a battery of a large weight and volume, and to use the radio signal as an energy source so that the sub- Can be configured. Therefore, the sub-device can be configured to be flexible or flexible so as to be transparent or warped, and the volume can be reduced since the battery is not included. Alternatively, the battery of the sub-device may be charged using an external power source, or may be configured to charge the battery of the sub-device through the main device while the sub-device is coupled to the main device. In addition, the main device and the sub device may include a power source unit that can charge the battery using solar light.

In addition, the sub-device 300 may include all of the same components as the main device. However, when only the functions dependent on the main device are implemented, only the components suitable for the implementation of the functions may be limitedly provided. Or may have a specific component only in one of the main device or the sub device and remotely control the specific component in the other device. For example, the sub-apparatus may be provided with only a touch pad or a sound output unit without a touch screen. Alternatively, the projector may be provided in the main apparatus, and the projector function may be controlled by controlling the main apparatus remotely from the sub apparatus. Thereby reducing the volume, weight and manufacturing cost of the sub-apparatus. As described above, the sub-device may be used for a remote controller capable of remotely controlling the main device, or may be used for a remote output device capable of outputting information output from the main device at a remote place.

Hereinafter, all of the components of the main device or sub-device are not shown in the drawings, and only the components necessary for the description are selectively shown.

8 is a diagram illustrating an example of a configuration of a sub apparatus that can be coupled to a main apparatus of a mobile terminal according to the present invention. For convenience, the present invention will be described with reference to a bar type mobile terminal, but the present invention can be applied to all types of terminals described above.

When the sub-device 300 is coupled to the main device 100, the sub-device may have a component that is mechanically overlapped (or mechanically overlapped) with the specific components provided in the main device have. For example, the display unit 251 of the sub apparatus may be overlapped with the display unit 151 of the main apparatus. Or the sound output module 252 of the sub apparatus may be configured to overlap with the sound output module 152 of the main apparatus. Or a user input unit (not shown) of the sub apparatus may be configured to overlap the user input unit 130 of the main apparatus.

Even if a specific component of the sub device is overlapped with a specific component of the main device, the characteristics, size, thickness, and the like of the overlapped component do not necessarily have to be the same. For example, the display unit 251 of the sub-apparatus may have a smaller size (for example, one line or two lines) than the display unit 151 of the main apparatus. Or the display unit 251 but may include only a function key or a touch pad.

In addition, the display unit 251 of the sub-apparatus may be configured as a transparent display (Transparent OLED: TOLED). In addition, the display 251 of the sub-device may constitute the touch pad only in a specific area inside (e.g., an area displaying a key, or an area not displaying anything). The main device and the sub device may be configured to display information indicating whether the two devices are connected or disconnected. In order to display the combining / separating information, an indicator may be displayed on the display unit 251 of the sub-apparatus, a backlight may be used for the display unit, or a light-emitting lamp may be separately provided on one side of the sub-apparatus.

Meanwhile, the sub-device 300 can be configured to be coupled to the outside of the main device 100, but can be configured to be inserted into the main device such as a battery or a memory card . In this case, the engaging portion 210 of the main apparatus can have a groove or a slot structure (or a shape) capable of inserting a sub-apparatus on one side. In addition, the apparatus may further include a cover (not shown) to cover the sub-apparatus to prevent undesired separation after the sub-apparatus is coupled.

In addition, the sub-device 300 may be a necklace, a glass, a ring, a card, an earring, a wristwatch, a clip, a pen, an earphone , Or a USB memory stick type. Of course, in this case, the coupling part 210 of the main device can be configured in a structure (or a shape) that can be attached to the inside or the outside of the main device depending on the form of the sub device.

In addition, the main apparatus can detect whether the sub-apparatus 300 is coupled or disconnected using the coupling detection unit 230. Accordingly, when the sub apparatus is coupled to the main apparatus, the main apparatus can automatically change its own operation mode or the operation mode of the sub apparatus.

Also, as the main apparatus and the sub apparatus are coupled or separated, the format of data transmitted from the main apparatus to the sub apparatus can be changed. For example, when the sub apparatuses are combined or separated, the functions of the function keys provided in the sub apparatus are changed to other function keys, the image data is transmitted in a full size, the size of the image data is reduced and transmitted, The distance can be shortened or changed longer, and the quality of audio or video can be varied and transmitted.

9A to 9D are illustrations showing various configurations of a sub apparatus according to the present invention.

As shown in FIG. 9A, the sub-device 300 may have the same components as the main device. However, in consideration of various conditions such as volume and weight, the display unit 251, the control unit 280, and the power supply unit 290 are basically configured. The display unit 251 and the remaining components (e.g., a control unit, a power supply unit, a coupling unit, a coupling detection unit, a connection unit, and an output unit) may be divided into separate bodies 301 and 302. In this case, the display unit 251 may be configured as a transparent touch pad (or a transparent touch screen) considering that the display unit 251 is configured to be superimposed on the display unit 151 of the main unit when the mobile unit is coupled to the main unit 100 have.

9B, the sub-apparatus 300 may include a body 302 and a frame 303 that surrounds the outer periphery of the display unit 251, thereby improving the robustness.

9C, a function key (e.g., a hold function, a telephone transmission / reception function, an MP3 control function, a Bluetooth function, a mouse key function), an input unit (e.g., a microphone and a camera) An output unit (e.g., an acoustic output unit, an earphone connection unit, a beam output unit for projection, and an infrared communication unit). Accordingly, even if the sub apparatus is disconnected from the main apparatus, the sub apparatus alone can control or view the telephone transmission / reception and the multimedia output. By providing the function keys as described above, when a user receives a phone call while listening to music using a sub-device, a certain key can be input immediately to switch to a call state.

In addition, as shown in FIG. 9D, the subdevice may include only the touch pad 305 without including the display unit 251. FIG. At this time, the touch pad 305 may correspond to the area of the display 151 of the main unit one by one, or various function keys 306 may be drawn on the touch pad to be used as a button. Alternatively, a small size display (e.g., one line display, two line display) 307 may be coupled to one side of the touchpad to display simple information (e.g., control status, current status, It is possible.

10A to 10D are illustrations for explaining a combination of a main apparatus and a sub apparatus according to the present invention.

10A is a side cross-sectional view of an example for explaining a coupling method of a main device and a sub device. As shown, a coupling member 510 such as a magnet may be attached to one side of the main device 100 and the sub device 300, respectively, so that they can be easily coupled or separated. Likewise, the main unit may be provided with grooves 520 corresponding to the shape and size of the sub-apparatus, and a magnet may be attached to the grooves. The depth of the groove 520 may vary depending on the design of the main device.

10B is a side cross-sectional view of an example for explaining a coupling method of a main unit and an elastic sub unit. As shown, the sub-device 300 can be configured to have elasticity. The sub-unit having elasticity as described above can be bent to a certain angle. The main unit may include an edge holder 530 at a rim portion to join the elastic sub-unit. That is, the user configures the sub-device so as to bend and fit into the edge holder 530. The edge holder may be formed with a guide groove 531 that can guide the sub-device when it is inserted. After the sub-apparatus is inserted into the edge holder, a fixing member such as a latch (not shown) may be further provided on one side of the main apparatus to prevent the sub-apparatus from falling or moving.

10C is a side cross-sectional view of an example for explaining a method of slot-joining a main apparatus and a sub apparatus. As shown, when the edge holder or slot 540 having the guide groove is provided on the outer side or the inner side of the main device, the sub device can be coupled to the guide groove or the slot 540 by inserting it.

At this time, one side of the main unit may be clogged and a fixing member such as a latch (not shown) may be provided to prevent the sub-unit from being pulled out when the sub-unit is fully pushed to the clogged portion. The latch is configured to be able to hang on one side of the sub-apparatus. Thus, one side of the sub-device can constitute a groove (not shown) of a latchable shape. The method of releasing the latch may be configured such that the sub-apparatus is pushed deeper according to the configuration of the latch or released by pressing a separate latch release key (not shown). Or a spring (not shown) to more easily separate the sub-apparatus.

The sub-apparatus may also be slidably coupled along the edge holder. That is, the sub-apparatus can be slid by a predetermined length unit. In other words, when the sub-device is slid by a certain length and automatically stopped by a stop means (not shown), it is slid back every time the user exerts a force in a desired direction (e.g., a direction for joining or a direction for separating) will be. The stop means may be one or more than two.

10D is an example for explaining a method of coupling a main unit and a sub unit using a hinge. As shown, when the hinge unit 550 or 551 is provided on one side of the main unit or sub-unit, the main unit and the sub-unit can be coupled using the hinge. When the main apparatus and the sub apparatus are coupled using the hinge as described above, the sub apparatus can be folded down as a folder, or can be opened by lifting it up.

The hinge is configured to be detachable and engageable, and to be rotatable within a certain angle after engagement. For example, the user can force the main unit and the sub-unit hinges 550 and 551 in a direction in which they can engage with each other, or separate them by applying force in a detachable direction. After the main apparatus and the sub apparatus are combined, the sub apparatus can be opened or closed like a folder type terminal.

Hereinafter, a description will be given of one example of structures for combining sub apparatuses according to the type of the main apparatus (for example, bar type, slide type, folder type, swing type, swivel type, watch type, etc.) do.

11A to 11E are views for explaining a structure and a method for joining or separating a sub apparatus to a main unit of a folder type according to the present invention.

The folder type main unit is characterized in that a first body 100a having a display unit and a second body 100b having a keypad are coupled using a hinge. In the present embodiment, when the sub-device is assumed to be the third body 300, the third body may be coupled to the first body or the second body in a superimposed manner, or the third body may be coupled to either the first body or the second body One can be substituted and combined. In this embodiment, the second body 100b is not necessarily provided with a keypad, and a display unit, a touch screen, or a touch pad may be disposed in the same manner as the first body 100b.

If the third body 300 is replaced with the second body 100b as shown in FIG. 11A, the third body may act as a folder part folded or unfolded. When the third body 300 is configured as a transparent display, the main device may have a dual display effect. When the third body 300 is configured as a transparent touch pad, the third body may be connected to the first body 100a of the display unit 151, the same effect as the touch screen can be obtained. In order to configure the third body 300 to act as a folder, a hinge unit that connects the first body and the third body is configured to be detachable and attachable.

On the other hand, if the third body is a transparent display (TOLED), transparency can be adjusted depending on whether the third body is superimposed on the first body. For example, when the third body 300 is folded and overlapped on the display unit 151 of the first body 100a, the transparency of the display unit 251 of the third body 300 is adjusted, So that the screen can be seen through. At this time, it is also possible to control so that only a specific area of the display screen of the first body is seen to be transmitted. However, when the third body is separated or unfolded and is not overlapped with the display unit 151 of the first body, it can operate as a double display and display different information.

That is, the third body 300 can operate independently, and when coupled to the main device, it can operate in conjunction with the structure and operation of the main device. For example, when the sub apparatus is coupled to the main apparatus, the display unit 251 of the sub apparatus may operate as either the main display or the sub display. Here, the display unit 151 of the main apparatus may be a TOLED or an LCD.

Meanwhile, the folder type mobile terminal can open / close the third body functioning as a folder part in the vertical direction (up / down direction) or open / close it in the horizontal direction (left / right direction) have. Further, the mobile terminal of the present invention detects the posture (i.e., the rotational direction) of the terminal and rotates and outputs information output to the first body or the third body according to the posture (rotational direction) of the terminal . Alternatively, the information output to the first body or the third body may be alternately output. The above operation can be applied not only to the folder type mobile terminal but also to all other types of mobile terminals.

As described above, the method of replacing the sub-apparatus with the folder unit in the folder-type mobile terminal and combining or separating the sub-apparatus with the main apparatus has been described. Here, the third body may be coupled to any one of the first body and the second body in a state where the first body and the second body are coupled to each other. Hereinafter, for convenience of description, The method will be described.

As shown in FIG. 11B, at least one side of the first body of the main device is provided with a coupling member 510 capable of fixing the sub-device, and a method of pressing the sub-device according to the position of the coupling member 510 Lt; / RTI > For example, a groove or a latch may be formed on one side of the first body of the main device, and then the third body 300 may be coupled using the groove or the latch. Or a third body 300 having a magnet on one side of the first body of the main device and then having a member that can be attached to the magnet. At this time, the first body 100a and the second body 100b can be configured to be folded or unfolded irrespective of the combination or disassembly of the sub-apparatus.

As shown in FIG. 11C, the main body includes an edge holder 530 having a guide groove on at least one side of the first body, and the sub-device is coupled with the guide groove in a slidable manner . At this time, if the sub-device is elastic, the sub-device may be bent and pushed into the edge holder 530 as shown in FIG. 11D. When separating the sub-apparatus from the main apparatus, the sub-apparatus can be pushed up and removed in the opposite direction to the insertion. After the sub-apparatus is coupled as described above, the sub-apparatus may further include fixing means for fixing the sub-apparatus so as not to be detached from the holder.

11E, a hinge unit is additionally provided on at least one side of the first body of the main unit, the second body is coupled using the one side hinge unit, and the hinge units 550 and 551, The third body 300 can be coupled. The positions of the hinges may be changed. When the third body is folded, a coupling member 510 for fixing the folded third body may be further provided. The coupling member 510 may use a member such as the above-described holder or magnet, and may use any one of other known coupling members.

Accordingly, the hinge portions 550 and 551 for coupling the third body should be constructed so as to be capable of being engaged and disengaged. Preferably, the first body and the second body are configured to be folded or unfolded regardless of whether the third body (= subordinate apparatus) is coupled or disconnected as described above.

The structure and the method for combining or separating the sub apparatuses in the folder type mobile terminal have been described above. Hereinafter, a method of combining a sub apparatus with a slide type mobile terminal will be described.

12A to 12E are diagrams for explaining a structure and a method for coupling or separating a sub-device to a slide type main device according to the present invention.

The main feature of the slide type main unit is that the first body 100a having the display unit and sliding is coupled with the second body 100b having the keypad so as to be slid using a guide rail (not shown). In this case, the second body may be composed of a display unit or a touch screen as in the case of the first body.

As described above, in the present embodiment, when the sub-apparatus is assumed to be the third body, the third body 300 may be coupled to the first body 100a or the second body 100b of the main body by being overlapped with each other, 3 body can be replaced by either the first body or the second body. When the sub apparatus is coupled to the main apparatus as described above, the display unit of either apparatus can be used as the main display or the sub display.

As shown in FIG. 12A, when the third body is replaced with either the first body or the second body, the third body may act as a slider that slides. For convenience of explanation, it is assumed that the third body is replaced by the second body. At this time, when the display unit 251 of the third body 300 is composed of a transparent display, the dual display may be overlapped with the display unit 151 of the first body. Of course, even if the display unit is not necessarily configured as a transparent display, when the first body and the third body are combined, an effect of double display that can be displayed on both sides (front and rear) of the mobile terminal may occur.

On the other hand, if the third body is a transparent display, transparency can be controlled depending on whether the first body (= main unit) and the third body (= sub-body) are coupled. On the contrary, when the display unit 151 of the first body is assumed to be a transparent display, the transparency of the display unit 151 may be controlled. For example, when the display unit 251 of the third body (= sub-apparatus) is superimposed on the display unit 151 of the first body (= main apparatus), the display unit of the third body 300 is transparently adjusted 1 can be controlled so that the display screen of the body can be seen through. However, when the third body is separated or slid and is not overlapped with the display unit 151 of the first body, it can operate as a double display and display different information.

At this time, the third body (= sub-apparatus) may be coupled to the same direction (for example, front) as the first body (= main apparatus) . When the third body is coupled with the main body in a direction opposite to that of the main body, the third body may be a transparent touch screen or a transparent touch pad. For example, when the display unit 151 of the first body is touched by the display unit 251 (or the touch pad) of the third body without touching the display unit 151 of the first body, You can do this by selecting an icon.

In addition, when the third body (= sub-apparatus) is combined with the first body (= main apparatus), it slides along a guide rail (not shown) within a certain range, When the force is applied, the third body can be separated from the main device. Therefore, it is preferable that the guide rail for coupling the third body (= sub-device) is configured to be detachable and engageable.

When the first body and the third body are separated as described above, they can operate as a main device and a sub device, respectively. That is, the sub apparatus and the main apparatus may operate in an independent manner, or may operate in such a manner that communication of the sub apparatus and the main apparatus is connected and interlocked. For example, a sub-device may request playback of a specific multimedia file from the main device, receive the multimedia file transmitted from the main device, and output the received multimedia file through an output unit of the sub-device. Alternatively, a call may be made between the main device and the sub device such as an interphone.

Meanwhile, the slide type mobile terminal slides the third body functioning as a slider in the vertical direction (up / down direction) or slides in the horizontal direction (left / right direction) . Therefore, the present invention detects the posture (i.e., the rotational direction) of the mobile terminal to which the main device and the sub device are coupled, and detects the information And can be rotated and output. Alternatively, the information output to the first body or the third body may be alternately output.

As described above, a method of combining the sub-device with the slider portion in the slide type mobile terminal has been described. Also, the third body (= sub-device) may be coupled to any one of the first body and the second body in a state where the first body and the second body are coupled. Hereinafter, a method for coupling to the first body will be described for convenience of explanation.

As shown in FIG. 12B, the slide type mobile terminal includes a coupling member 510 capable of fixing the sub-device to at least one side of the first body, and the sub- In the same manner as described above. For example, a groove or a latch may be formed on one side of the first body of the main device, or a magnet may be attached, and then the third body may be joined using the groove, the latch or the magnet. At this time, the first body and the second body are configured to be slid regardless of whether the third body (sub-apparatus) is coupled or disconnected.

12C, an edge holder or slot 530 having a guide groove on at least one side of the first body of the slide type mobile terminal and a method of pushing the sub-device into the guide groove ). ≪ / RTI > At this time, when the sub-device is elastic, the sub-device 300 may be bent and pushed into the edge holder as shown in FIG. 12D. When the subdevice is separated from the main device (first body), it can be pushed up and removed in the direction opposite to the fitting. After the sub-apparatus is coupled as described above, it may further include fixing means (not shown) for fixing the sub-apparatus so as not to be detached. The fixing means may have various shapes in consideration of the design of the mobile terminal.

12E, a hinge portion 551 is provided on at least one side of the first body of the slide type mobile terminal, and the third body can be coupled using the hinge portion. The position where the hinges 550 and 551 are disposed may be changed. When the third body is folded, a fixing means (not shown) for fixing the folded third body so as not to move is further provided can do. As the fixing means, a member such as the above-described holder or magnet may be used, and any one of other known members may be used. In addition, the hinge unit for coupling the third body should be structured so as to be capable of being engaged and disengaged. The first body and the second body are preferably configured to be slidable regardless of whether the third body 300 is engaged or disengaged.

Meanwhile, although not shown in the drawings, the second body may be coupled in a manner similar to the method of coupling the third body (= sub-device) to the first body. Similarly, when the main unit (the first body in this case) and the sub-unit (the third body) operate in cooperation with each other depending on whether the display unit 251 of the third body is a transparent display or a touch pad, The transparency can be configured to be controlled.

The structure and method for combining or separating sub-devices in the slide-type mobile terminal have been described above. Hereinafter, a method of combining a sub-device with a swivel-type mobile terminal will be described.

13A to 13D are views for explaining a structure and a method of joining or separating sub devices to or from a swivel type main device according to the present invention.

As shown therein, the mobile terminal of the swivel folder type according to the present invention includes a swivel hinge. The swivel hinge operates to rotate or move the folder portion to a specific angle (or position). In the present embodiment, when the folder unit having the display unit 151 is referred to as a first body 100a, the second body 100b coupled with the first body 100a may be a keypad or a touch screen .

In the present embodiment, when the sub-device is assumed to be the third body 300, a third body (= sub-device) may be coupled to the first body or the second body and the third body may be coupled to the first body or the second body 2 body. ≪ / RTI > When the sub-device is coupled to the main device (here, the first body) as described above, the display portion of any one-side device (e.g., sub-device) can be used as the sub-display.

13A, when the third body is replaced with a first body or a second body, the third body may function as a swivel folder portion folded or unfolded. For convenience of explanation, it is assumed that the third body is replaced by the second body.

At this time, when the display unit 251 of the third body (= sub-apparatus) is configured as a transparent display, the dual display may be overlapped with the display unit 151 of the first body. Of course, the display unit may not necessarily be a transparent display but may be an LCD, which is an opaque display. When the first body and the third body are combined with each other using the LCD as the display unit, ≪ / RTI > may occur.

On the other hand, assuming that the third body is a transparent display, when the first body (= main unit) and the third body (= sub-body) are superposed on each other, The transparency of the transparent display can be adjusted. For example, when the display unit 251 of the third body 300 is overlapped with the display unit 151 of the first body 100a, the display unit of the third body 300 is transparently adjusted, So that the screen can be seen through. However, when the third body is separated or unfolded and is not overlapped with the display unit 151 of the first body, it can operate as a double display and display different screens. At this time, the third body (= sub-apparatus) may be overlapped so that the display directions of the two apparatuses are oriented in the same direction (e.g., front side) as the first body (= main apparatus) Rear direction).

Meanwhile, when the third body is coupled with the direction opposite to the direction of the display of the main device, and the third body is composed of a transparent touch screen or a transparent touch pad, a back touch function may be implemented. For example, a specific function icon displayed on the display unit 151 of the first body can be selected and executed by touching the third body without touching the display unit 151 of the first body with a finger.

Accordingly, it is preferable that the swivel hinge for coupling the third body 300 is configured to be detachable and engageable.

When the first body 100a and the third body 300 are separated as described above, they can independently operate as a main unit and a sub unit, respectively. That is, the sub apparatus and the main apparatus can operate in independent manner, and the communication between the sub apparatus and the main apparatus can be operated by being connected to each other and linked. For example, a sub-device may request playback of a specific multimedia file from the main device, receive the multimedia file transmitted from the main device, and output the received multimedia file through an output unit of the sub-device. Alternatively, a call may be made between the main device and the sub device such as an interphone.

Meanwhile, the swivel-type mobile terminal detects the posture (i.e., the rotational direction) of the terminal and rotates the information output to the first body or the third body differently according to the posture (rotational direction) can do. For example, the first body may output the multimedia file in the horizontal direction, and the third body may output the multimedia file in the vertical direction.

A method of combining a sub-device with a swivel-type mobile terminal has been described above. Here, in a state where the first body and the second body are coupled to each other, the third body (= sub-device) may be coupled to any one of the first body and the second body in a similar manner. Hereinafter, a method for coupling to the first body will be described for convenience of explanation. As shown in FIG. 13B, the first body 100a of the swivel type mobile terminal includes a coupling member 510 capable of fixing the sub-device to at least one side thereof, and the sub- So that they can be joined together in a compressed manner. Or an edge holder or slot 530 having a guide groove on at least one side of the first body of the main device as shown in FIG. 13C, and a method of putting the sub device into the guide groove (or slot method) Lt; / RTI > At this time, if the sub-device is elastic, the sub-device may be bent and pushed into the edge holder as shown in FIG. 13D. A method of combining sub-devices in a swivel-type mobile terminal has been described above.

Hereinafter, a structure and a method for combining or separating sub-devices in a bar-type mobile terminal will be described. Hereinafter, a bar type mobile terminal may be combined or separated in a manner similar to the above-described folder type, slide type, or swivel type mobile terminal.

FIGS. 14A to 14D are views for explaining a structure and a method for joining or separating a sub apparatus to a bar type main apparatus according to the present invention. As shown in FIG. 14A, the main unit includes a coupling member 510 capable of fixing a sub-unit to one side of the main unit, and the sub-unit is coupled to the coupling unit 510 in such a manner that the sub- . Or an edge holder or slot 530 having a guide groove on at least one side of the main device as shown in FIG. 14B, and the sub-device can be engaged in a manner (or a slotted manner) have. At this time, if the sub-device is elastic, the sub-device may be bent and pushed into the edge holder as shown in FIG. 14C. Alternatively, as shown in FIG. 14D, a hinge portion 551 may be provided on at least one side of the main device, and the sub device may be coupled using the hinge portion. The positions of the hinges may be changed, and may further include fixing means (not shown) for fixing the sub-unit so that the sub-unit is not moved when the sub-unit is folded. As described above, a method of combining sub-apparatuses in a bar-type mobile terminal has been described. Hereinafter, a method of combining sub-devices in a watch type mobile terminal will be described.

15A to 15D are views for explaining a structure and a method for coupling or disconnecting a sub apparatus to a watch type main apparatus according to the present invention.

15A, in the present embodiment, the watch type mobile terminal includes a first body 100a to which a band unit 100c is connected and a second body 100b including a display unit coupled with the first body. do. The second body may be connected to one side of the first body by a hinge 100d so as to be opened or closed. Hereinafter, the second body may be referred to as a cover, and a display unit may be provided on the first body to form a dual display together with a display unit of the second body.

At least one display unit of the first body 100a or the second body 100b may be formed of a transparent display (TOLED). In addition, each of the display units can operate as a main display or a sub display, and different types of information can be displayed on each display unit as the second body is opened or closed. Further, a touch pad or a transparent touch pad may be attached to at least one of the display units 151 and 251 of the first body or the second body.

Also, in the present embodiment, either the first body or the second body may be operated as a main device or a sub device. For example, the first body may act as a main device and the second body may act as a sub-device. Accordingly, it is preferable that the hinge 100d is configured to couple or separate the first body (= main unit) and the second body (= sub-unit). The hinge portion 100d for coupling the sub-device should be constructed so as to be capable of being engaged and disengaged.

Meanwhile, as with the above-described other types of mobile terminals, the main apparatus and the sub apparatus operate in conjunction with each other. As the two apparatuses are combined or separated, the type and display format of information displayed on each apparatus can be changed.

Hereinafter, a method of superimposing a third body (= sub-apparatus) on either the first body or the second body in a state where the first body and the second body are coupled will be described. For convenience, a method of superposing and joining a sub apparatus to the second body will be described. 15B, a coupling member 510 capable of fixing a sub-device to at least one side of a second body of the main device is provided, and the sub-device is fitted to the position where the coupling member 510 is attached, In the same manner as described above. Alternatively, as shown in FIG. 15C, an edge holder or slot 530 having a guide groove on at least one side of the second body of the main device may be provided, and a sub-device may be inserted into the guide groove ). ≪ / RTI > At this time, if the sub-device is elastic, the sub-device may be bent and pushed into the edge holder as shown in FIG. 15D.

16 is an exemplary view for explaining the structure of a clip type sub apparatus in which the present invention can be easily coupled to all types of main apparatuses.

As described with reference to other drawings, in the present invention, the sub-apparatus functions as a component of the main apparatus when assembled to the main apparatus and electrically connected to the main apparatus remotely And functions as a server terminal and a client terminal, thereby enabling necessary information to be transmitted and received from the main device.

Therefore, it is preferable that the sub apparatus is structured so as to be easy to carry while easily connecting to the main apparatus. In addition, it is preferable that the main device is structured such that the sub-device to be coupled mechanically is not shaken or easily released. For example, as shown in FIG. 16, like the 'C' shaped clip 300, it can be fitted to one side of the terminal when it is coupled to the mobile terminal, Or an attachment part 410 which can be attached to a part of the body such as a head, an ear, an eye, a hand, a foot or a neck. At this time, it is preferable that the coupling portion 410 has elasticity. In other words, the sub-device is not limited to a plate (flat plate) type, but can be configured to have a shape easy to be coupled to the main device, such as 'a' and 'b' shapes.

In this embodiment, the sub apparatus is not intended to be limited to a clip type, and the sub apparatus has a combining section and an output section, and may have various forms or designs. For example, it can be configured as an earphone, an earring, or a necklace. Further, at least two or more sub-apparatuses can be configured to be linked to one main apparatus. That is, it is possible to assign an ID to each of the subdevices, transmit different information to each subdevice, or transmit the same information to all the subdevices at the same time. Further, it is possible to configure the sub-devices to transmit and receive arbitrary information (e.g., voice, video, and message) to each other.

Hereinafter, a control method of a mobile terminal capable of being combined and separated according to the present invention will be described with reference to the drawings.

The control method of the mobile terminal capable of being combined and separated is divided into three steps of 'control method for combining / separating', 'separate method UI', 'combined method UI' Each step is described as follows.

* Control method when combining / separating

The control method of the mobile terminal according to the present invention can be applied to both devices 100 and 300 when the sub device 300 is coupled to or disconnected from the main device 100 of the mobile terminal. And a method for controlling the operation and the status of the display device.

The control method for combining / separating the mobile terminal according to the present invention can be divided into 'automatic operation of terminal operation', 'automatic operation of terminal status',' automatic power saving of terminal power saving ', and automatic control of terminal locking'.

** Automatic control of terminal operation

FIGS. 17A and 17B illustrate examples of automatic terminal control (menu display) control. For convenience of explanation, an example applied to a bar-type mobile terminal will be described.

The controller 180 controls the operation of the main apparatus 100 and the sub apparatus 300 (for example, display) according to the fastening type (vertical or horizontal).

17A, when the main unit 100 and the sub unit 300 are coupled in the longitudinal direction, the controller 180 senses the combination of the main unit 100 and the sub unit 300, Lt; / RTI >

On the other hand, when the combination of the main apparatus 100 and the sub apparatus 300 is fastened in the horizontal direction as shown in FIG. 17B, the control unit 180 displays menu items that are easy to operate in the horizontal display. For example, multimedia menu items such as an image viewer, a broadcast viewing, a camera function, a video player, and the like.

FIG. 18 is an exemplary diagram showing the automatic operation of the terminal operation (menu display) of FIG. 17 applied to a swing-type (Swuvel-type) mobile terminal.

19A to 19B are other examples of automatic control of terminal operation (menu display).

In this embodiment, the control unit 180 controls the operation (e.g., display) of the sub-device 300 differently when the two devices 100 and 300 are coupled to each other.

As shown in FIG. 19A, when coupled with the main device 100, the sub-device 300 performs operations as a touch screen. The control unit 180 receives a touch input of the user from the sub-device 300.

On the other hand, when the sub apparatus 300 is separated from the main apparatus 100 as shown in FIG. 19B, the sub apparatus 300 operates as a keypad or a wireless mouse. The control unit 180 receives the user's touch input through the sub device 300 through a short range wireless communication (e.g., Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA) do.

20A to 20B are exemplary diagrams showing automatic control of a terminal operation (keypad control).

The control unit 180 displays different keypads on the main device 100 according to the fastening type (vertical or horizontal) of the two devices 100 and 300.

20A, when the main device 100 and the sub device 300 are coupled in the longitudinal direction, the controller 180 senses the keypad (e.g., a dome) suitable for the display in the vertical direction, A keypad or the like).

20B, when the main unit 100 and the sub unit 300 are coupled in the horizontal direction as shown in FIG. 20B, the control unit 180 displays a keypad (e.g., a QWERTY keypad Etc.).

21 is an exemplary view showing automatic control of terminal operation (application control).

As in the above embodiments, the control unit 180 executes different applications to the main device 100 according to the vertical and horizontal fastening.

21, when the coupling between the main apparatus 100 and the sub apparatus 300 is coupled in the longitudinal direction, the control unit 180 executes the camera viewer, and when the coupling is engaged in the transverse direction , The map application is executed.

** Automatic control of terminal status

22 is an exemplary view showing automatic terminal status control;

The mobile terminal according to the present embodiment displays information differently when it joins the vertical direction and the horizontal direction with respect to one application (e.g., phone book function).

22, when the phone book function is executed in a state where the combination of the main apparatus 100 and the sub apparatus 300 is coupled in the longitudinal direction, the control unit 180 displays the name of the selected person, the phone number, Photos, birthdays, and so on.

On the other hand, when the phone book function is executed in a state where the combination of the two devices 100 and 300 is engaged in the horizontal direction, the controller 180 controls the phone number of the selected person such as the number of calls with the selected person, the number of messages, Display communication related information.

23 shows another example of automatic terminal state control.

The control unit 180 according to the present embodiment detects coupling and separation of the two devices 100 and 300 and controls the main device 100 to display different background images.

For example, if the first image is displayed as a background image when the two devices 100 and 300 are combined, the second image is displayed as a background image when the combination is disconnected. When the two devices 100 and 300 are combined again, the controller 180 displays the third image as a background image. In the present embodiment, a plurality of images should be designated as background images, and the control unit 180 may sequentially display the designated images randomly or sequentially as background images Can be displayed.

By displaying various background screens stored in the terminal, the present embodiment can avoid boredom of terminal use and provide a kind of fun function to the user.

** Automatic power saving control

24 is an exemplary view showing automatic power saving control of the terminal.

The control unit 180 according to the present embodiment senses the coupling and disconnection of the two devices 100 and 300 and controls the power supplied to the display of the main device 100 to be on / off .

For example, when the two devices 100 and 300 are disconnected from each other, the control unit 180 senses this and disconnects the power supplied to the display of the main device 100.

Thereafter, when the two devices 100 and 300 are coupled again, the controller 180 re-supplies the power to the main device 100 so that the main device 100 can perform the display. The automatic power control according to the present embodiment can be manually switched according to the setting of the user. When the power automatic control is manually switched, the power supplied to the display of the main device 100 is controlled by the user irrespective of the coupling and disconnection of the two devices 100 and 300.

** Automatic control of terminal locking

25 is an exemplary view showing automatic terminal lock control.

The control unit 180 according to the present embodiment detects locking and unlocking of the main apparatus 100 by sensing the coupling and disconnection of the two apparatuses 100 and 300.

The control unit 180 senses the release of the coupling between the two devices 100 and 300 and sets a lock on the main device 100. [

Then, when the two devices 100 and 300 are combined again, the main device 100 can be operated by unlocking the set lock.

In the case where the coupling between the main apparatus 100 and the sub apparatus 300 is a method of being inserted into the guide groove (or slot method) as shown in FIG. 14B, the automatic locking control according to the present embodiment is applied differently .

The controller 180 monitors the movement of the sub apparatus 300 moving in the guide groove and sets the main apparatus 100 to lock when the sub apparatus 300 passes a specific point of the guide groove The present embodiment is applied. If the main device 100 is already locked when the sub device 300 passes a specific point of the guide groove, the control unit 180 unlocks the main device 300, 100 can be operated.

Therefore, the user can control the lock / unlock of the main apparatus 100 by moving the sub-apparatus 300 slightly (to the specified point) in the guide groove.

26 is an exemplary diagram for user setting of control in combining / separating according to the present invention.

As described above, the control method for combining / separating mobile terminals according to the present invention can be classified into 'terminal operation automatic control', 'terminal state automatic control', 'terminal power saving automatic control', and 'terminal locking automatic control' The present invention allows the user to arbitrarily change the setting of these automatic controls.

The automatic control according to the engagement / disconnection of the two devices 100 and 300 may be rather inconvenient to the user. When the automatic control is inconvenient, the user can execute a user setting menu as shown in Fig. 26, change a desired automatic control item to manual control, and input a desired set value.

* Separate Concept UI (Separate Concept UI)

The following describes the control method (Separate Concept UI) in the separated state. In the state where the main device 100 and the sub device 300 of the mobile terminal are separated, various controls between the two devices 100 and 300 will be.

27 is an exemplary diagram for power supply control of the main device 100. Fig.

The user according to the present embodiment operates only the sub apparatus 300 to turn on / off the power of the main apparatus 100 in a state where the main apparatus 100 and the sub apparatus 300 are separated from each other . To this end, the sub-device 300 may have a separate software key (or hardware key) for power control, or may execute a menu for power control.

The power control command (for example, ON or OFF) input from the user is transmitted through a connection unit 230 of the sub-device 300 by a short-range wireless communication (e.g., Bluetooth, RFID Frequency Identification (IR), infrared data association (IrDA), etc.).

When the power control command of the user of the user is received by the main device 100, the controller 180 turns the power of the main device 100 on or off according to the received power control command. .

28 is an exemplary diagram for controlling the communication function of the subordinate apparatus 300. Fig.

When the main apparatus 100 and the sub apparatus 300 are separated and the call is received in the main apparatus 100, the sub apparatus 300 according to the present embodiment may provide a call function to the user . To this end, the sub-device 300 may include a function key for telephone transmission and reception, an input unit (e.g., a microphone), and an output unit (e.g., a sound output unit, an earphone connection unit, etc.) have.

The control unit 180 transmits the CALL to the sub device 300 through the connection unit 230 when the main apparatus 100 receives the CALL in a state where the two apparatuses 100 and 300 are separated. 28, the sub-device 300 displays a message informing the call reception and a telephone number of the calling party, as shown in Fig. 28, .

When the user who has recognized the CALL incoming enters the telephone transmission / reception function key, a signal of the input function key is transmitted to the main device 100, And sets a communication path for telephone communication. At this time, the transmission and communication path setting of the function key signal may be changed in accordance with the implementation method.

When a communication path for telephone communication is set between the main apparatus 100 and the sub apparatus 300, a telephone conversation using the sub apparatus 300 becomes possible. In the case of a message incoming, the control unit 180 once displays the incoming message on the display of the sub-device 300 and draws the user's attention through a predetermined alarm (e.g., sound or vibration).

The user according to the present embodiment can conveniently make a call using only the sub apparatus 300 in a state in which the mobile terminal (e.g., the main apparatus 100) is carried in a pocket or a bag.

FIG. 29 is an exemplary view of a multimedia player control. FIG.

In a state where the main apparatus 100 and the sub apparatus 300 are separated from each other, the sub apparatus 300 according to the present embodiment can provide a multimedia playback function of the main apparatus 100 to the user. To this end, the sub-device 300 may include a function key for multimedia reproduction (e.g., MP3 playback), an output unit (e.g., an audio output unit, an earphone connection unit, etc.) as shown in FIG. 9C.

When the user inputs the MP3 function key while the two devices 100 and 300 are separated from each other, a signal of the input function key is transmitted to the main device 100 through the connection unit 230. The control unit 180 receiving the signal of the function key sets a short-range wireless communication path between the two devices 100 and 300.

When the media playback and control signals of the user are input through the communication channel, the control unit 180 controls the multimedia player according to the input signals, and transmits the reproduced music sound to the sub-device 300.

A user can listen to music (e.g., MP3) by connecting an earphone to the earphone connection unit 292. If the sub-device 300 does not have a display, it may feedback the related information (e.g., playback information / status) of the music file in advance and listen to the music. If the sub-device 300 has a one-line (or two-line) display, the associated information of the music file being output will be output via the one line display.

The sub-device 300 according to the present embodiment may have separate software keys 294 for multimedia reproduction control or hardware buttons as shown in FIG. 9D.

The sub-apparatus 300 according to the present embodiment may include a gyro sensor 296. When the sub-apparatus 300 includes the gyro sensor 296, the movement and tilting of the sub-apparatus 300 sensed by the sensor 296 are transmitted to the main apparatus 100, Player controls such as the next song playback, previous song playback, or playback stop according to the signal.

The user according to the present embodiment can conveniently listen to music or moving pictures using only the sub-device 300 in a state in which the mobile terminal (e.g., the main device 100) is carried in a pocket or a bag.

30 is an exemplary diagram related to mouse function control.

In a state where the main apparatus 100 and the sub apparatus 300 are separated from each other, the sub apparatus 300 according to the present embodiment can provide a mouse function, a touch pad function, and the like to the user. To this end, the sub-device 300 may include a predetermined key for a mouse function or a touch pad function, as shown in FIG. 9C.

When the user inputs the function key while the two devices 100 and 300 are separated from each other, a signal of the input function key is transmitted to the main device 100 through the connection unit 230. The control unit 180 receiving the signal of the function key sets a short-range wireless communication path between the two devices 100 and 300 and transmits a mouse pointer 304 to one point of the display provided in the main device 100 Display.

Then, the touch input of the user detected by the sub-device 300 is transmitted to the main device 100 through the communication path, and the control unit 180 controls the movement of the mouse pointer 304 according to the touch input.

The user according to the present embodiment can control the mouse pointer 304 by using the sub-device 300 like the touch pad of the notebook or by moving a predetermined pointer 309 as shown in Fig. 30 have.

The sub-device 300 according to the present embodiment may include a software key (or hardware key) on one side of the display for scrolling the screen of the main device 100. [

The user can conveniently control an application running on the main device 100 by using the sub device 300 while keeping the main device 100 at a certain distance.

31 is another example of the mouse function control.

A user according to the present embodiment can control various applications of a personal computer (e.g., a desktop computer, a notebook computer, etc.) using the sub-device 300. [ To this end, the sub-device 300 may include various function keys (e.g., a mouse function (or a touch pad function), a multimedia playback function, etc.) as shown in FIG. 9C.

The user according to the present embodiment can control various applications of the personal computer after setting a short-range wireless communication path between the two devices 100 and 300 by inputting a desired function key, as in the embodiment of FIGS. 29 and 30 .

The user can listen to music files (e.g., mp3 files, etc.) stored in the personal computer using the sub-device 300. [ In addition, the user can select both the mouse function key and the multimedia playback function key, and select and execute the music file or the moving picture file of the personal computer through the touch input through the sub-device 300. [

The sub-device 300 according to the present embodiment may include a multi-stage slide button 312 (hardware or software key) capable of performing mode switching (Hold / Mode1 / Mode2). When the sub-device 300 includes the multi-stage slide button 312, a hold function (touch lock), a telephone transmission / reception (Mode 1) function, a mouse function (Mode 2) Lt; / RTI >

The control unit 180 switches the mode every time the multi-step slide button 312 is input, and executes the function of the corresponding mode.

32 is an exemplary diagram for controlling the game function.

In a state where the main apparatus 100 and the sub apparatus 300 are separated from each other, the sub apparatus 300 according to the present embodiment can provide a game control function to the user. To this end, the sub-device 300, such as a function key for game control, the output section shown in Figure 9c: can be provided (for example, a sound output unit, the earphone connection, etc.), a vibration element, or the like.

When the user inputs the function key in a state where the two devices 100 and 300 are separated, the signal of the input function key is transmitted to the main device 100 through the connection unit 230. The control unit 180 receiving the signal of the function key sets a short-range wireless communication path between the two devices 100 and 300.

Then, when a user's control signal (?,?,?,?, Execution key 1, execution key 2, etc.) is inputted through the communication path, the controller 180 controls objects of the game according to the input signal, And transmits the sound effect of the game to the sub-device 300. The user can connect the earphone to the earphone connection unit 292 to enjoy the game together with the sound effect of the game.

The game operation buttons 322 may be printed on the sub-device 300 in a grid (or lattice) pattern. When the game operation buttons 322 are printed, the sub-apparatus 300 may have a separate illumination element (e.g., an LED, etc.). Then, according to the blinking of the LED, the printed grid (or lattice) pattern may appear and disappear.

In addition, the game operation buttons 322 may be implemented in software. When the game operation buttons 322 are implemented in software, the user can arbitrarily set the position and the operation function of each button, and add new buttons.

The sub-device 300 according to the present embodiment can transmit the vibration in conjunction with the effect sound of the game, or transmit the vibration feedback according to the touch input of the user.

The user can operate and control the game being executed on the main device 100 by using the sub device 300 while keeping the main device 100 at a certain distance.

33A to 33B are exemplary diagrams relating to widget execution control.

In a state where the two devices 100 and 300 are separated, the sub device 300 according to the present embodiment can perform a widget function. For convenience of description, it is assumed that the sub-device 300 according to the present embodiment includes a one-line display (or two-line display) and a touch pad on which various function keys are printed, as shown in FIG. 9D.

In order to execute the function key 332 printed on the touch pad, the user touches and drags one of them (e.g., 'clock' function key) and places it on the one-line display. Sub-device 300 then displays the current time, date, etc. on the one-line display. If the 'weather' function key was touched and dragged with the one-line display, the one-line display would display today's minimum and maximum temperatures, rain probability, weather specials, and the like.

The function keys (for example, 'clock' or 'weather' function key) are printed on the touch pad as well as the one-line display. However, the sub-device 300 senses the user's touch input (touch and drag) and executes the widget of the corresponding function.

As another example of widget execution, if the user touches and drags the 'view broadcast' function key among the function keys 332 to the one-line display, the sub- Broadcast viewing " command to the main device 100. Then, the control unit 180 executes the 'broadcast viewing' application according to the execution command and provides a broadcasting service to the user.

As another example of the execution of the widget, when the user inputs a character (e.g., 'I love you') on the touch pad, the sub-device 300 displays the character input on the touch pad as the first line It can be displayed on the display.

Fig. 34 is an example of function interlock control. Fig.

When the main device 100 is running a photo or an image viewer (or a video player), the user simply touches (e.g., drags, flickers) the sub- can do.

34, when the main device 100 is running a photo viewer or an image viewer (or a moving picture player) in a state where the short-range wireless communication path is established with the sub-device 300, The control unit 180 also responds to a simple touch input (e.g., dragging, flicking, etc.) input to the sub- For example, the control unit 180 performs image switching to the previous or next image (or moving image) according to the flicking direction detected by the sub- When the flickering to the left is detected, the image of the next page (or the next sequence) is displayed, and when the flickering to the right is detected, the image of the previous page (or the previous sequence) is displayed.

The user can enjoy the images stored in the main device 100 conveniently (without inputting any control button or key operation) by using the sub-device 300 while keeping the main device 100 at a certain distance.

35 is another example of the function interlock control.

When the main device 100 is executing the character input editor, the user according to the present embodiment can input characters through the sub device 300. [

When the user inputs a letter (for example, 'I love you') on the touch pad while the character input editor is running on the main device 100, the sub-device 300 transmits the character input to the touch pad to the set communication path To the main apparatus 100 via the network. Then, the control unit 180 displays the letters of the transmitted user on the display of the main device 100 as shown in FIG.

The control unit 180 according to the present embodiment can convert the user's text into a printed body according to the setting of the terminal. When the user's text is transmitted to the main apparatus 100, the control unit 180 converts the transmitted text into a printed matter through a predetermined character recognition process. Then, the converted printed matter is displayed on the display of the main device 100 as shown in Fig.

36 is an exemplary diagram for mode switching and intensity control of the main device.

The main apparatus 100 and the sub apparatus 300 are separated from each other so that the sub apparatus 300 according to the present embodiment switches the mode of the main apparatus 100 (the manner mode or the state) Or adjust the intensity of the ringing or vibration. To this end, the sub-device 300 according to the present embodiment may include a side key 362, a navigation key 364, a lock key 366, and the like.

When the user inputs one of the function keys 362, 364, and 366 while the two devices 100 and 300 are separated from each other, the input function key signal is transmitted to the main device 100 . The controller 180 of the main apparatus 100 switches the mode of the main apparatus 100 or adjusts the intensity of the ringing tone according to the input signal.

When the user inputs the upper side key 362-1 for a longer time (e.g., 2 seconds to 3 seconds), the control unit 180 switches the state of the main device 100 to the power mode.

When the user inputs the lower side key 362-2 for a longer time (for example, 2 seconds to 3 seconds), the control unit 180 switches the state of the main device 100 to the silent mode.

When the user simply inputs the upper side key 362-1 (or the navigation key input), the controller 180 increases the ringing level of the main device 100 by one level.

When the user simply inputs the lower side key 362-2 (or the navigation key input), the controller 180 lowers the ringing level of the main device 100 by one level.

When the user inputs the lock key 366, the control unit 180 sets a lock to the main device 100. [ At this time, if the main apparatus 100 is already locked, the control unit 180 releases the lock setting of the main apparatus 300, thereby enabling the main apparatus 100 to be operated.

As another embodiment of Fig. 36, it is also possible to temporarily apply the reception volume (or ring tone) or the intensity control of the vibration.

For example, if the user is in a call using the sub-device 300 as in the embodiment of FIG. 28 and the side key 362-1 or 362-2 is input for the reception volume control, And adjusts the reception sound level of the main device 100 according to a user's input. At this time, the adjusted reception tone level is maintained only while the user is in a call. The user's call is terminated and the control unit 180, which senses the end of the call, changes the reception sound level of the main device 100 to the original setting value.

37 is an exemplary diagram relating to the photographing function remote control.

In a state where the main apparatus 100 and the sub apparatus 300 are separated from each other, the sub apparatus 300 according to the present embodiment can remotely control the camera 121.

37, when the main device 100 is switched to the camera mode with the short-range wireless communication path set to the sub-device 300, the control unit 180 executes a photographing application, The pointer 304 displays it.

The controller 180 controls the movement of the mouse pointer 304 according to the user's touch operation input to the sub-device 300. The user can control the mouse pointer 304 by using the sub-device 300 like a touch pad of a notebook or by moving a predetermined pointer 309 as shown in Fig.

Using the sub-device 300, the user can take a self-portrait photographing or a webcam photographing while being separated from the camera module of the main device 100 by a certain distance. You can also remotely control various camera settings such as resolution, scene mode, filter, balance, timer, shooting mode, ISO, image quality, storage space, clean view settings, image stabilization, blink prevention, Guide shooting, etc.) can be changed and stored. And, it can be used conveniently in a video call.

38A to 38B are exemplary diagrams for controlling the emotion mode of the sub-apparatus.

The sub-device 300 according to the present invention is also a multimedia device that cooperates with a control device or a mobile terminal for controlling the mobile terminal. However, the sub-device 300 according to the present invention has a strong character as an accessory. Therefore, ) Can be used as a tool for expressing the emotion of the user.

In the embodiment of FIG. 38A, the emotional mode of the sub-device 300 is divided into a pass mode, a sleep mode, and a conference mode according to the user's situation, and different background colors or letter colors are applied for each mode. In the present embodiment, in the case of the sleep mode, the background color and the character color of the sub device 300 may be set to gray, and the conference mode may be set to blue and the pass mode to red. The background color or the character color applied to each mode reveals emotion of the user, so it is preferable that the user can arbitrarily select a color value for each mode (sleep mode, traffic mode, and conference mode). The sub-device 300 may include a separate illumination device (e.g., LED (Light Emitting Diode)) for displaying a background color.

In the embodiment of FIG. 38B, the emotional mode of the sub-device 300 is divided into morning mode, afternoon mode, and night mode on a time basis, and different background colors or letter colors are applied for each mode. Once the user has finished setting the background color (or color) for each mode, the sub-device 300 automatically changes the background color (or color) for each mode according to the lapse of time.

39A to 39D are exemplary views for controlling functions of the clip type sub-device.

In the state where the two devices 100 and 300 are separated, navigation, GPS information display function, handsfree function, call function, camera remote control, etc. can work more effectively in the clip type sub device 300.

The clip type sub apparatus 300 can be worn on a pouch or a belt so that the clip type sub apparatus 300 can be easily carried with the main apparatus 100 separated from the main apparatus 100. The clip type sub apparatus 300 includes a coupling part 410, . The mechanical characteristics of this clip type sub-device 300 will have its effect during ourdoor, or during trips or tracking.

The sub apparatus 300 according to the present embodiment may have a display 251, an input section (e.g., a microphone or the like), and an output section (e.g., an acoustic output section, an earphone connection section, etc.) as a basic configuration. In addition, a multi-stage slide button 312 that can execute at least two functions with one button can be provided.

The clip type sub apparatus 300 according to the present embodiment can provide a navigation function as shown in FIG. 39A.

When the user executes the application in order to receive the navigation service, the controller 180 accesses the server and downloads the service information according to the movement of the user. Then, it transmits the navigation information to the destination via the short-range wireless communication path established with the sub-device 300. Information transmitted to the sub-device 300 is displayed, as shown in Fig. 39A.

The clip type sub apparatus 300 according to the present embodiment can provide a GPS information display function as shown in FIG. 39B. The clip type sub apparatus 300 receives and displays various types of GPS information from the main apparatus 100. The sub-device 300 may provide information about the user's current location, distance to destination, bearing, speed, and the like.

The clip type sub apparatus 300 according to the present embodiment can provide a message reception and call function as shown in FIG. 39C. When a CALL is received in the main apparatus 100, a short-range wireless communication path established between the main apparatus 100 and the sub apparatus 300 is set as illustrated in FIG. 28, and the sub apparatus 300 is used So that the user can make a telephone call with the other party.

The clip type sub apparatus 300 according to the present embodiment can provide a remote shooting control function, as shown in Fig. 39D. The sub apparatus 300 operates the camera of the main apparatus 100 remotely in accordance with a user's input (e.g., input of the button 312) while being separated from the main apparatus 100 by a certain distance.

The clip type sub device 300 according to the present embodiment can provide a battery residual quantity display function as shown in FIG. 39E. The control unit 180 periodically measures the remaining battery level of the main device 100 and transmits the measured value to the sub-device 300. Then, the sub-device 300 displays or stores the measured measurement value when the button 312 is input from the user.

* Combined Concept UI (Combine Concept UI)

The following describes the control method (Combine Concept UI) in the coupled state and various controls between the two devices 100 and 300 in a state where the main device 100 and the sub device 300 of the mobile terminal are combined .

40A to 40B are exemplary views of a method of controlling the main apparatus 100 and the sub apparatus 300 in the coupled state.

In this embodiment, a 'My Contents' menu is executed in the combined state of the two devices 100 and 300, and a full screen of 'My Contents' menu is displayed on the display of the main device 100 and the display of the sub- It shows how to divide the pop-up screen.

Once the 'My Content' menu is executed, the controller 180 displays the 'My Content' screen on the main device 100. And displays the indicator 334 and the software menu 336 on the sub-device 300.

Then, when the user presses the 'option' software menu, the control unit 180 displays the corresponding pop-up window (option main menu window 338) on the sub-device 300 as shown in FIG. The indicator 334 and the software menu 336 displayed on the sub-device 300 are displayed on the main device 100 together with the 'My Content' screen.

The menu screen of the terminal has a three-dimensional effect by displaying the option main menu window 338, which is additionally displayed on the 'inside content' screen, through the sub-device 300 superimposed on the main device 100.

FIG. 40B shows the sub menu window 340 on the sub-device 300 when the 'change viewing method' item is selected in the option main menu window 338 of FIG. 40A.

When the sub-menu window 340 is displayed on the sub-device 300, the controller 180 displays the pop-up window (sub-menu window 340) on the sub-device 300 as shown in FIG. The option main menu window 338 displayed on the sub-device 300 is displayed on the main device 100 together with the 'inside content' screen.

41 is another example of a method of controlling the main apparatus 100 and the sub apparatus 300 in the coupled state.

The present embodiment executes a specific function (e.g., a photo album) in a state where the main apparatus 100 and the sub apparatus 300 are combined and displays the selected objects of the menu list in the two apparatuses 100 and 300 Shows how to divide and display selected objects.

41, when the user executes the photo album, the control unit 180 displays the file list of the photo album on the main device 100 and displays the list 334, the software menu 336, the scroll bar, 424) is displayed on the sub-device (300).

When a user touches a specific object (e.g., Na Young) in the file list, a selection bar of the list is placed on the touched object 'I' and the object is selected. The control unit 180 controls the sub-device 300 to display an object (e.g., 'Na-yong') displayed on the main device 100. [

Then, when the user holds the touch for 2 seconds to 3 seconds or more, that is, when the user inputs the long touch, the controller 180 displays the image of the object 'I' in the sub-device 300. However, when the touch is removed (the user releases his / her hand), the object (e.g., 'Nanao') displayed on the sub device 300 and the selection bar 422 are moved to the main device 100 again. However, at this time, it is also possible to set the terminal to display the object (e.g., 'Nanao') and the selection bar 422 directly on the sub device 300. In addition, the object (e.g., 'Nanao') and the selection bar 422 may be moved to the main device 100 after a predetermined time elapses.

The mobile terminal according to the present invention classifies the touch operation detected in a state where the main apparatus 100 and the sub apparatus 300 are coupled by touching (or proximity touch), long touch, long touch and drag, can do. In addition, various sensors may be provided to perform various sensing functions, and a proximity sensor or a tactile sensor may be provided in the sensing unit 140 to sense proximity-touch.

When the touch detected from the outside is a long touch (at least 2 seconds to 3 seconds or more), the controller 180 displays the image list of the main device 100 corresponding to the touch point : Object ", or " object ") to the sub-device 300 and displays it. The long touch is also used to selectively move a desired object among the objects displayed on the main apparatus 100 to the sub apparatus 300. The user touches and displays a specific object of the main device 100 by moving to the sub-device 300. Meanwhile, when unnecessarily many objects are displayed on the sub-device 300, the objects of the sub-device 300 can be selectively transferred to the main device 100 using a predetermined touch input.

If a drag is detected with a long touch from the outside, the control unit 180 can display a preview screen of the image selected by the long touch on the sub-device 300.

The selection cursor (or selection bar) 342 of the main apparatus 100 is moved in accordance with the dragging, and the selected image selected by the selection cursor 342 is displayed on the preview screen. Then, when the touch from the outside disappears, the first image selected by the long touch is displayed. The control unit 180 may display the first image immediately after the touch from the outside disappears, or may display the first image after a predetermined time elapses while maintaining the display of the existing image once, even if the touch from the outside disappears .

42 is an exemplary view showing power control of the terminal.

The main apparatus 100 and the sub apparatus 300 are connected to each other by using the power key 426 (hardware or software key) provided in the sub apparatus 300 according to the present embodiment, The power can be controlled (on / off).

When the input of the key 426 is sensed, the signal generated by the key input is transmitted to the control unit 180 via a predetermined path, and when the main unit 100 is turned off off.

FIGS. 43A to 43C are views illustrating a combination of a non-touch type terminal and a sub apparatus, wherein a combination of a bar type terminal, a folder type terminal, and a slide type terminal is shown in . In this embodiment, the sub-device 300 may be combined with a non-touch type terminal to have a touch function.

Since the sub-device 300 according to the present embodiment includes the touch pad and the touch sensor, the sub-device 300 according to the present embodiment converts a change in a pressure applied to a specific portion of the touch pad or a capacitance generated at a specific portion of the touch pad into an electrical input signal .

In order to give the non-touch type terminal a touch function, the user combines the non-touch type terminal with the sub apparatus 300 and establishes a short-range wireless communication path between the two apparatuses.

When the touch input is detected after the short-range wireless communication path is established with the terminal, the sub-device 300 transmits the corresponding signal (s) and data to the terminal through the communication path.

Then, the control unit 180 of the terminal calculates which object (or area) of the display unit 151 is touched based on the transmitted data. Then, the corresponding object is moved, selected, or executed according to the pattern of the touch input (e.g., long touch, drag, flicking, etc.).

The mobile terminal control according to each embodiment of the present invention can be implemented as a computer-readable code on a medium on which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored.

Examples of the computer-readable medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . The computer may include a controller 180 of the mobile terminal.

As described above, the present invention includes a sub-device 300 that can be combined and separated, and can remotely control the operation and state of the terminal.

The operation and state of the terminal can be automatically controlled according to the coupling and disconnection operations between the main apparatus 100 and the sub apparatus 300. [

The sub apparatus 300 according to the present invention can control the constituent devices and applications of the main apparatus 100 through the short-range wireless communication path in a state of being separated from the main apparatus 100. [

The present invention can operate the display by interlocking the two devices 100 and 300 in a state where the main device 100 and the sub device 300 are coupled.

Although the present invention has been described with reference to the embodiment (s) depicted in the drawings as being limited to a particular type of terminal (e.g., Bar type terminal) or a specific combination, it is for illustrative purposes only, It will be understood by those of ordinary skill in the art that various modifications may be made thereto and that all or part of the above-described embodiment (s) may be selectively combined. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Claims (42)

A main device having a coupling portion and a display portion in a slot shape communicating with the opening region;
A sub-device detachably coupled to the main device through the aperture region; And
A sensing unit for sensing whether the main device and the sub device are engaged or disengaged;
And a control unit for detecting the separation of the sub apparatus from the main apparatus and controlling the main apparatus based on the control command received by the sub apparatus,
Wherein the sub-device comprises a pen-type terminal and is adapted to receive power via a radio signal received from the main device,
The slot shape corresponds to the shape of the pen-type terminal,
Wherein,
The main unit and the sub unit are detected by the detection unit so as to change from the locked state to the unlocked state or from the unlocked state to the locked state and to output the specific image when the unlocked state is detected And controls the display unit. The method according to claim 1,
Wherein the control unit performs different functions when the sub apparatus is detached and coupled from the main apparatus. The method according to claim 1,
The control unit detects the posture of the main device when the sub device is coupled to the main device and performs different functions when the main device is arranged in the horizontal direction and when the main device is arranged in the vertical direction And the mobile terminal. The method according to claim 1,
Wherein the control unit executes a first function when the sub-apparatus separated from the main apparatus is coupled with the main apparatus,
Wherein the control unit executes a second function when the sub apparatus in a state of being coupled with the main apparatus is separated from the main apparatus. delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete And a sub-unit detachably connected to the main unit through the opening region, the method comprising the steps of: (a)
Detecting a coupling / disconnection state of the sub device and the main device;
Changing from the locked state to the unlocked state or from the unlocked state to the locked state when the coupling / disconnection of the sub apparatus and the main apparatus is detected;
Outputting a specific image on the display unit when the unlocked state is reached;
Receiving power from the sub apparatus through a radio signal received from the main apparatus in a state where the sub apparatus and the main apparatus are separated; And
And controlling the main apparatus based on a control command received from the sub apparatus,
Wherein the subdevice comprises a pen type terminal, and the slot shape corresponds to the pen type terminal shape. delete 32. The method of claim 31,
Sensing a posture of the mobile terminal when the sub-device is coupled to the main device; And
Further comprising the step of controlling different functions when the mobile terminals are arranged in the horizontal direction or in the vertical direction. delete delete 32. The method of claim 31,
Further comprising executing a first function when the sub apparatus is coupled to the main apparatus and executing a second function when the sub apparatus is disconnected from the main apparatus. delete delete delete delete delete delete

Images